2023-10-26T06:13:32.463 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-26T06:13:32.464 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} --verbose --archive /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469 -- /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/orig.config.yaml 2023-10-26T06:13:32.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T06:13:32.632 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469 branch: wip-batrick-testing-20231024.144545 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} email: pdonnell@redhat.com first_in_suite: false job_id: '7438469' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231024.144545 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 384993681abceb8cb8affea10538d607052db4b4 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 384993681abceb8cb8affea10538d607052db4b4 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231024.144545 sha1: 384993681abceb8cb8affea10538d607052db4b4 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7595 sha1: 384993681abceb8cb8affea10538d607052db4b4 sleep_before_teardown: 0 subset: 66/256 suite: fs suite_branch: wip-batrick-testing-20231024.144545 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 384993681abceb8cb8affea10538d607052db4b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - kernel_untar_build.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-26_05:21:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.770726 2023-10-26T06:13:32.632 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa; will attempt to use it 2023-10-26T06:13:32.633 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks 2023-10-26T06:13:32.634 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-26T06:13:32.636 INFO:teuthology.task.internal:Checking packages... 2023-10-26T06:13:32.662 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '384993681abceb8cb8affea10538d607052db4b4' 2023-10-26T06:13:32.662 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-26T06:13:32.663 INFO:teuthology.packaging:ref: None 2023-10-26T06:13:32.663 INFO:teuthology.packaging:tag: None 2023-10-26T06:13:32.664 INFO:teuthology.packaging:branch: wip-batrick-testing-20231024.144545 2023-10-26T06:13:32.664 INFO:teuthology.packaging:sha1: 384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:13:32.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231024.144545 2023-10-26T06:13:32.889 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6863.g38499368 2023-10-26T06:13:32.889 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-26T06:13:32.900 INFO:teuthology.task.internal:no buildpackages task found 2023-10-26T06:13:32.900 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-26T06:13:32.944 INFO:teuthology.task.internal:Saving configuration 2023-10-26T06:13:32.972 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-26T06:13:32.983 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T06:13:33.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 06:08:23.310841', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-26T06:13:33.033 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 06:08:23.309296', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-26T06:13:33.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 06:08:23.312087', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-26T06:13:33.061 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-26T06:13:33.072 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-26T06:13:33.072 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-26T06:13:33.072 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-26T06:13:33.073 INFO:teuthology.run_tasks:Running task console_log... 2023-10-26T06:13:33.190 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe55492bca0>, signals=[15]) 2023-10-26T06:13:33.192 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-26T06:13:33.204 INFO:teuthology.task.internal:Opening connections... 2023-10-26T06:13:33.204 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:13:33.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:13:33.274 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2023-10-26T06:13:33.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:13:33.342 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-10-26T06:13:33.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:13:33.410 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-26T06:13:33.419 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-10-26T06:13:33.442 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-10-26T06:13:33.442 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-10-26T06:13:33.502 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-10-26T06:13:33.502 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2023-10-26T06:13:33.503 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-10-26T06:13:33.503 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-10-26T06:13:33.503 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2023-10-26T06:13:33.503 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-10-26T06:13:33.504 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-26T06:13:33.504 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-10-26T06:13:33.504 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-26T06:13:33.504 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-10-26T06:13:33.504 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-26T06:13:33.505 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T06:13:33.505 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:13:33.505 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T06:13:33.505 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-26T06:13:33.506 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-26T06:13:33.506 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-26T06:13:33.507 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-10-26T06:13:33.546 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-26T06:13:33.567 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-26T06:13:33.568 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-26T06:13:33.627 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-10-26T06:13:33.627 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-10-26T06:13:33.627 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-10-26T06:13:33.628 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-10-26T06:13:33.628 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-10-26T06:13:33.628 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-26T06:13:33.628 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-26T06:13:33.628 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-26T06:13:33.629 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-26T06:13:33.629 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-10-26T06:13:33.629 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-26T06:13:33.629 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T06:13:33.629 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:13:33.630 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T06:13:33.630 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-26T06:13:33.630 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-26T06:13:33.630 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-26T06:13:33.631 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-26T06:13:33.654 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-26T06:13:33.674 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-26T06:13:33.675 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-26T06:13:33.734 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2023-10-26T06:13:33.734 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2023-10-26T06:13:33.734 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2023-10-26T06:13:33.734 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2023-10-26T06:13:33.735 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2023-10-26T06:13:33.735 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-26T06:13:33.735 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-26T06:13:33.735 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-26T06:13:33.735 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-26T06:13:33.736 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2023-10-26T06:13:33.736 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-26T06:13:33.736 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-26T06:13:33.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:13:33.737 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-26T06:13:33.737 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-26T06:13:33.737 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-26T06:13:33.737 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-26T06:13:33.738 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-26T06:13:33.763 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-26T06:13:33.773 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-26T06:13:33.781 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-26T06:13:33.782 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-10-26T06:13:33.785 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2023-10-26T06:13:33.787 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-10-26T06:13:33.805 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-26T06:13:33.813 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-26T06:13:33.813 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-10-26T06:13:33.845 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2023-10-26T06:13:33.848 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-10-26T06:13:33.883 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-26T06:13:33.967 INFO:teuthology.run_tasks:Running task kernel... 2023-10-26T06:13:33.983 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-26T06:13:33.984 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-26T06:13:33.984 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-26T06:13:33.985 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-26T06:13:34.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:13:34.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-26T06:13:34.173 DEBUG:teuthology.task.kernel:sha1 for client.0 is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-10-26T06:13:34.173 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-10-26T06:13:34.173 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-26T06:13:34.194 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-26T06:13:34.194 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-10-26T06:13:34.195 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-26T06:13:34.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum upgrade -y linux-firmware 2023-10-26T06:13:35.424 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-26T06:13:35.424 INFO:teuthology.orchestra.run.smithi050.stdout:Unable to read consumer identity 2023-10-26T06:13:36.809 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-26T06:13:37.485 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-26T06:13:41.302 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 379 kB/s | 24 kB 00:00 2023-10-26T06:13:42.084 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-26T06:13:42.085 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2023-10-26T06:13:42.086 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-26T06:13:42.205 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on client.0... 2023-10-26T06:13:42.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-10-26T06:13:42.426 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/centos/8/flavors/default/x86_64/ 2023-10-26T06:13:42.427 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g5b73517e0e2f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-26T06:13:42.430 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2023-10-26T06:13:56.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26 06:13:56 URL:https://4.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g5b73517e0e2f-1.x86_64.rpm [383129572/383129572] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-26T06:13:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2023-10-26 06:13:56-- 2023-10-26T06:13:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 14s 2023-10-26T06:13:56.141 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 365M in 13s (27.2 MB/s) 2023-10-26T06:13:56.143 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on client.0... 2023-10-26T06:13:56.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-26T06:13:57.819 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying... ######################################## 2023-10-26T06:13:57.869 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing... ######################################## 2023-10-26T06:13:57.963 INFO:teuthology.orchestra.run.smithi050.stdout:Updating / installing... 2023-10-26T06:14:38.854 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-6.6.0_rc5_g5b73517e0e2f-1 ######################################## 2023-10-26T06:14:43.673 INFO:teuthology.orchestra.run.smithi050.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-26T06:15:03.709 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-26T06:15:03.709 DEBUG:teuthology.orchestra.run.smithi050:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-26T06:15:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/config-6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:03.816 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel 2023-10-26T06:15:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch 2023-10-26T06:15:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86 2023-10-26T06:15:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto 2023-10-26T06:15:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-26T06:15:03.818 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-26T06:15:03.818 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-26T06:15:03.818 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-26T06:15:03.818 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-26T06:15:03.818 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-26T06:15:03.819 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-26T06:15:03.819 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-26T06:15:03.819 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-26T06:15:03.819 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-26T06:15:03.819 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-26T06:15:03.820 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-26T06:15:03.820 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-26T06:15:03.820 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-26T06:15:03.820 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-26T06:15:03.820 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-26T06:15:03.821 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-26T06:15:03.821 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-26T06:15:03.821 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-26T06:15:03.821 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-26T06:15:03.821 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel 2023-10-26T06:15:03.822 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu 2023-10-26T06:15:03.822 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce 2023-10-26T06:15:03.822 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-26T06:15:03.822 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm 2023-10-26T06:15:03.822 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-26T06:15:03.823 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-26T06:15:03.823 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-10-26T06:15:03.823 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto 2023-10-26T06:15:03.823 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-10-26T06:15:03.823 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-10-26T06:15:03.824 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-10-26T06:15:03.824 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx 2023-10-26T06:15:03.824 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-10-26T06:15:03.824 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-10-26T06:15:03.824 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-26T06:15:03.825 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-10-26T06:15:03.825 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-10-26T06:15:03.825 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-10-26T06:15:03.825 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-10-26T06:15:03.825 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-10-26T06:15:03.826 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-10-26T06:15:03.826 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-10-26T06:15:03.826 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-10-26T06:15:03.826 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-10-26T06:15:03.826 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-10-26T06:15:03.827 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-10-26T06:15:03.827 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-10-26T06:15:03.827 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-10-26T06:15:03.827 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-10-26T06:15:03.827 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-10-26T06:15:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-10-26T06:15:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-10-26T06:15:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-10-26T06:15:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-10-26T06:15:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-10-26T06:15:03.828 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-10-26T06:15:03.829 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-10-26T06:15:03.829 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-10-26T06:15:03.829 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-10-26T06:15:03.829 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-10-26T06:15:03.829 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-10-26T06:15:03.830 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-10-26T06:15:03.830 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-10-26T06:15:03.830 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-10-26T06:15:03.830 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-10-26T06:15:03.830 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-10-26T06:15:03.831 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-10-26T06:15:03.831 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-10-26T06:15:03.831 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-10-26T06:15:03.831 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-10-26T06:15:03.831 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-10-26T06:15:03.832 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-10-26T06:15:03.832 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-10-26T06:15:03.832 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-10-26T06:15:03.832 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-10-26T06:15:03.832 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-10-26T06:15:03.833 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-10-26T06:15:03.833 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers 2023-10-26T06:15:03.833 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi 2023-10-26T06:15:03.833 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-26T06:15:03.833 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-10-26T06:15:03.834 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/custom_method.ko 2023-10-26T06:15:03.834 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-10-26T06:15:03.834 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-10-26T06:15:03.834 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-10-26T06:15:03.834 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-10-26T06:15:03.834 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-10-26T06:15:03.835 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata 2023-10-26T06:15:03.835 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-10-26T06:15:03.835 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-10-26T06:15:03.835 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ata_generic.ko 2023-10-26T06:15:03.835 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-10-26T06:15:03.836 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-10-26T06:15:03.836 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-10-26T06:15:03.836 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-10-26T06:15:03.836 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-10-26T06:15:03.836 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-10-26T06:15:03.837 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-10-26T06:15:03.837 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-10-26T06:15:03.837 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-10-26T06:15:03.837 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-10-26T06:15:03.837 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-10-26T06:15:03.838 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-10-26T06:15:03.838 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-10-26T06:15:03.838 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-26T06:15:03.838 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-26T06:15:03.838 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-10-26T06:15:03.839 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-10-26T06:15:03.839 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-10-26T06:15:03.839 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-10-26T06:15:03.839 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-10-26T06:15:03.839 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-10-26T06:15:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-10-26T06:15:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-10-26T06:15:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-10-26T06:15:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-10-26T06:15:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-10-26T06:15:03.840 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-10-26T06:15:03.841 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-10-26T06:15:03.841 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-26T06:15:03.841 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-26T06:15:03.841 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-10-26T06:15:03.841 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-10-26T06:15:03.842 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-10-26T06:15:03.842 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-10-26T06:15:03.842 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-10-26T06:15:03.842 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sis.ko 2023-10-26T06:15:03.842 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-10-26T06:15:03.843 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-10-26T06:15:03.843 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-10-26T06:15:03.843 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-10-26T06:15:03.843 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-10-26T06:15:03.843 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-10-26T06:15:03.844 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-10-26T06:15:03.844 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-10-26T06:15:03.844 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-10-26T06:15:03.844 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-10-26T06:15:03.844 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-10-26T06:15:03.845 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-10-26T06:15:03.845 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-10-26T06:15:03.845 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-10-26T06:15:03.845 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-10-26T06:15:03.845 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-10-26T06:15:03.845 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-10-26T06:15:03.846 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay 2023-10-26T06:15:03.846 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-10-26T06:15:03.846 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/base 2023-10-26T06:15:03.846 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/base/regmap 2023-10-26T06:15:03.846 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-26T06:15:03.847 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-26T06:15:03.847 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma 2023-10-26T06:15:03.847 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-10-26T06:15:03.847 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block 2023-10-26T06:15:03.847 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe 2023-10-26T06:15:03.848 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-10-26T06:15:03.848 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/brd.ko 2023-10-26T06:15:03.848 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd 2023-10-26T06:15:03.848 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-10-26T06:15:03.848 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-10-26T06:15:03.849 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/loop.ko 2023-10-26T06:15:03.849 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx 2023-10-26T06:15:03.849 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-26T06:15:03.849 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-10-26T06:15:03.849 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk 2023-10-26T06:15:03.849 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-10-26T06:15:03.850 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-10-26T06:15:03.850 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-10-26T06:15:03.850 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/virtio_blk.ko 2023-10-26T06:15:03.850 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback 2023-10-26T06:15:03.850 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-26T06:15:03.851 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkfront.ko 2023-10-26T06:15:03.851 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram 2023-10-26T06:15:03.851 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-10-26T06:15:03.851 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char 2023-10-26T06:15:03.851 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-10-26T06:15:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random 2023-10-26T06:15:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-26T06:15:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-26T06:15:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-26T06:15:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-10-26T06:15:03.853 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-26T06:15:03.853 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi 2023-10-26T06:15:03.853 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-26T06:15:03.853 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-26T06:15:03.853 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-26T06:15:03.854 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-26T06:15:03.854 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-26T06:15:03.854 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-26T06:15:03.854 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-10-26T06:15:03.854 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave 2023-10-26T06:15:03.855 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-10-26T06:15:03.855 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-10-26T06:15:03.855 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-10-26T06:15:03.855 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm 2023-10-26T06:15:03.855 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm.ko 2023-10-26T06:15:03.855 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-26T06:15:03.856 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-26T06:15:03.856 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-26T06:15:03.856 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-26T06:15:03.856 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-26T06:15:03.856 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/uv_mmtimer.ko 2023-10-26T06:15:03.857 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/virtio_console.ko 2023-10-26T06:15:03.857 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq 2023-10-26T06:15:03.857 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-26T06:15:03.857 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-26T06:15:03.857 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-26T06:15:03.858 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-26T06:15:03.858 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-26T06:15:03.858 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-26T06:15:03.858 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto 2023-10-26T06:15:03.858 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp 2023-10-26T06:15:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-26T06:15:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-10-26T06:15:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel 2023-10-26T06:15:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat 2023-10-26T06:15:03.859 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common 2023-10-26T06:15:03.860 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-26T06:15:03.860 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-26T06:15:03.860 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-26T06:15:03.860 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-10-26T06:15:03.860 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-10-26T06:15:03.861 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio 2023-10-26T06:15:03.861 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-26T06:15:03.861 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca 2023-10-26T06:15:03.861 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-10-26T06:15:03.861 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/devfreq 2023-10-26T06:15:03.862 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-26T06:15:03.862 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma 2023-10-26T06:15:03.862 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw 2023-10-26T06:15:03.862 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-26T06:15:03.862 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat 2023-10-26T06:15:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-26T06:15:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac 2023-10-26T06:15:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-10-26T06:15:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-10-26T06:15:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-10-26T06:15:03.863 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-10-26T06:15:03.864 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-10-26T06:15:03.864 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-10-26T06:15:03.864 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-10-26T06:15:03.864 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-10-26T06:15:03.864 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-10-26T06:15:03.865 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-10-26T06:15:03.865 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-10-26T06:15:03.865 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-10-26T06:15:03.865 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-10-26T06:15:03.865 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware 2023-10-26T06:15:03.865 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/edd.ko 2023-10-26T06:15:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-26T06:15:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio 2023-10-26T06:15:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-10-26T06:15:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-26T06:15:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid 2023-10-26T06:15:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-10-26T06:15:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-10-26T06:15:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-10-26T06:15:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-10-26T06:15:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-10-26T06:15:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-10-26T06:15:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-10-26T06:15:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-10-26T06:15:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-10-26T06:15:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-10-26T06:15:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-26T06:15:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-26T06:15:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-10-26T06:15:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-10-26T06:15:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-10-26T06:15:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-10-26T06:15:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-10-26T06:15:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-10-26T06:15:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-10-26T06:15:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-10-26T06:15:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-26T06:15:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-26T06:15:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-10-26T06:15:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-10-26T06:15:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-10-26T06:15:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-10-26T06:15:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-10-26T06:15:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-10-26T06:15:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-10-26T06:15:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-10-26T06:15:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-10-26T06:15:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-26T06:15:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-10-26T06:15:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-26T06:15:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-26T06:15:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-26T06:15:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-26T06:15:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-26T06:15:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-26T06:15:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-26T06:15:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-26T06:15:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-26T06:15:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-10-26T06:15:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-10-26T06:15:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-10-26T06:15:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-26T06:15:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-10-26T06:15:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-10-26T06:15:03.876 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-10-26T06:15:03.876 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-10-26T06:15:03.876 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-10-26T06:15:03.876 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-26T06:15:03.876 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-10-26T06:15:03.877 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-10-26T06:15:03.877 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-10-26T06:15:03.877 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-10-26T06:15:03.877 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-10-26T06:15:03.877 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-10-26T06:15:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-10-26T06:15:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-10-26T06:15:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-10-26T06:15:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-10-26T06:15:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-10-26T06:15:03.878 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-10-26T06:15:03.879 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv 2023-10-26T06:15:03.879 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-10-26T06:15:03.879 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-10-26T06:15:03.879 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-10-26T06:15:03.879 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon 2023-10-26T06:15:03.880 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-10-26T06:15:03.880 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-10-26T06:15:03.880 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-26T06:15:03.880 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-10-26T06:15:03.880 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-10-26T06:15:03.881 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-10-26T06:15:03.881 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-10-26T06:15:03.881 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-10-26T06:15:03.881 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-10-26T06:15:03.881 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-10-26T06:15:03.881 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-10-26T06:15:03.882 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-10-26T06:15:03.882 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-10-26T06:15:03.882 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-10-26T06:15:03.882 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-10-26T06:15:03.882 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-10-26T06:15:03.883 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-10-26T06:15:03.883 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-10-26T06:15:03.883 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-10-26T06:15:03.883 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-10-26T06:15:03.883 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-10-26T06:15:03.884 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-10-26T06:15:03.884 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-26T06:15:03.884 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-10-26T06:15:03.884 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-10-26T06:15:03.884 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-26T06:15:03.885 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-10-26T06:15:03.885 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-10-26T06:15:03.885 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-10-26T06:15:03.885 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-10-26T06:15:03.885 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-10-26T06:15:03.886 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-10-26T06:15:03.886 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-10-26T06:15:03.886 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-10-26T06:15:03.886 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-10-26T06:15:03.886 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-10-26T06:15:03.886 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-10-26T06:15:03.887 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-10-26T06:15:03.887 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-10-26T06:15:03.887 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-10-26T06:15:03.887 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-26T06:15:03.887 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-10-26T06:15:03.888 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-10-26T06:15:03.888 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-10-26T06:15:03.888 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-10-26T06:15:03.888 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-10-26T06:15:03.888 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-10-26T06:15:03.889 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-10-26T06:15:03.889 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-10-26T06:15:03.889 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-10-26T06:15:03.889 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-10-26T06:15:03.889 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-10-26T06:15:03.890 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-10-26T06:15:03.890 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-10-26T06:15:03.890 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-10-26T06:15:03.890 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-10-26T06:15:03.890 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-10-26T06:15:03.890 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-10-26T06:15:03.891 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-10-26T06:15:03.891 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-10-26T06:15:03.891 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-10-26T06:15:03.891 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-10-26T06:15:03.891 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-10-26T06:15:03.892 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-10-26T06:15:03.892 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-10-26T06:15:03.892 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-10-26T06:15:03.892 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-10-26T06:15:03.892 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-10-26T06:15:03.893 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-10-26T06:15:03.893 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-10-26T06:15:03.893 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-10-26T06:15:03.893 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-10-26T06:15:03.893 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-10-26T06:15:03.894 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-10-26T06:15:03.894 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-10-26T06:15:03.894 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-10-26T06:15:03.894 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-10-26T06:15:03.894 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-10-26T06:15:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-10-26T06:15:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-10-26T06:15:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-10-26T06:15:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-10-26T06:15:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-10-26T06:15:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-10-26T06:15:03.896 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-10-26T06:15:03.896 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-10-26T06:15:03.896 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-10-26T06:15:03.896 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-10-26T06:15:03.896 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus 2023-10-26T06:15:03.897 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-26T06:15:03.897 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-26T06:15:03.897 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-26T06:15:03.897 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-26T06:15:03.897 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-26T06:15:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-26T06:15:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-26T06:15:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-26T06:15:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-26T06:15:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-26T06:15:03.898 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-26T06:15:03.899 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-26T06:15:03.899 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-10-26T06:15:03.899 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-10-26T06:15:03.899 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-10-26T06:15:03.899 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-26T06:15:03.900 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-10-26T06:15:03.900 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-10-26T06:15:03.900 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-10-26T06:15:03.900 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-10-26T06:15:03.900 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-10-26T06:15:03.901 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-10-26T06:15:03.901 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-10-26T06:15:03.901 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-10-26T06:15:03.901 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-10-26T06:15:03.901 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-10-26T06:15:03.902 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-10-26T06:15:03.902 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-10-26T06:15:03.902 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-10-26T06:15:03.902 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-10-26T06:15:03.902 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-10-26T06:15:03.902 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-10-26T06:15:03.903 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-10-26T06:15:03.906 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-10-26T06:15:03.907 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-10-26T06:15:03.907 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-10-26T06:15:03.907 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-10-26T06:15:03.907 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-10-26T06:15:03.907 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-10-26T06:15:03.908 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-10-26T06:15:03.908 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-10-26T06:15:03.908 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c 2023-10-26T06:15:03.908 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos 2023-10-26T06:15:03.908 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-26T06:15:03.909 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-26T06:15:03.909 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses 2023-10-26T06:15:03.909 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-26T06:15:03.909 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-26T06:15:03.909 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-26T06:15:03.909 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-26T06:15:03.910 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-26T06:15:03.910 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-26T06:15:03.910 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-26T06:15:03.910 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-26T06:15:03.910 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-26T06:15:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-26T06:15:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-26T06:15:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-26T06:15:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-26T06:15:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-26T06:15:03.912 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-26T06:15:03.912 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-26T06:15:03.912 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-26T06:15:03.912 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-26T06:15:03.912 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-26T06:15:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-26T06:15:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-26T06:15:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-26T06:15:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-26T06:15:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-dev.ko 2023-10-26T06:15:03.913 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-10-26T06:15:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-26T06:15:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-10-26T06:15:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-10-26T06:15:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband 2023-10-26T06:15:03.914 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core 2023-10-26T06:15:03.915 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-26T06:15:03.915 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-10-26T06:15:03.915 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-26T06:15:03.915 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-26T06:15:03.915 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-26T06:15:03.916 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-26T06:15:03.916 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-26T06:15:03.916 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw 2023-10-26T06:15:03.916 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4 2023-10-26T06:15:03.916 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-26T06:15:03.917 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4 2023-10-26T06:15:03.917 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-26T06:15:03.917 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5 2023-10-26T06:15:03.917 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-26T06:15:03.917 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca 2023-10-26T06:15:03.918 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-26T06:15:03.918 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp 2023-10-26T06:15:03.918 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib 2023-10-26T06:15:03.918 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-26T06:15:03.918 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser 2023-10-26T06:15:03.918 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-26T06:15:03.919 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert 2023-10-26T06:15:03.919 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-26T06:15:03.919 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp 2023-10-26T06:15:03.919 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-26T06:15:03.919 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt 2023-10-26T06:15:03.920 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-26T06:15:03.920 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input 2023-10-26T06:15:03.920 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport 2023-10-26T06:15:03.920 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-26T06:15:03.920 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-26T06:15:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-10-26T06:15:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-10-26T06:15:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard 2023-10-26T06:15:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-26T06:15:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse 2023-10-26T06:15:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-10-26T06:15:03.922 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-10-26T06:15:03.922 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-10-26T06:15:03.922 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-26T06:15:03.922 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-10-26T06:15:03.922 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-26T06:15:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-26T06:15:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-26T06:15:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4 2023-10-26T06:15:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-26T06:15:03.923 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio 2023-10-26T06:15:03.924 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-10-26T06:15:03.924 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-10-26T06:15:03.924 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-26T06:15:03.924 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-10-26T06:15:03.924 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-10-26T06:15:03.924 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu 2023-10-26T06:15:03.925 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd 2023-10-26T06:15:03.925 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-26T06:15:03.925 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds 2023-10-26T06:15:03.925 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-10-26T06:15:03.925 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-10-26T06:15:03.926 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-10-26T06:15:03.926 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-10-26T06:15:03.926 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger 2023-10-26T06:15:03.926 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-26T06:15:03.926 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-26T06:15:03.927 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-26T06:15:03.927 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-26T06:15:03.927 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-26T06:15:03.927 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-26T06:15:03.927 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-26T06:15:03.927 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-26T06:15:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md 2023-10-26T06:15:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache 2023-10-26T06:15:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-10-26T06:15:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-10-26T06:15:03.928 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-10-26T06:15:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-10-26T06:15:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-10-26T06:15:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-10-26T06:15:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-10-26T06:15:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-10-26T06:15:03.929 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-10-26T06:15:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-10-26T06:15:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-10-26T06:15:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-10-26T06:15:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-10-26T06:15:03.930 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-10-26T06:15:03.931 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-10-26T06:15:03.931 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-10-26T06:15:03.931 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-10-26T06:15:03.931 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-10-26T06:15:03.931 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-10-26T06:15:03.932 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data 2023-10-26T06:15:03.932 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-26T06:15:03.932 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-10-26T06:15:03.932 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-10-26T06:15:03.932 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-10-26T06:15:03.933 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-10-26T06:15:03.933 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message 2023-10-26T06:15:03.933 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion 2023-10-26T06:15:03.933 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-10-26T06:15:03.933 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-10-26T06:15:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-10-26T06:15:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-10-26T06:15:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-10-26T06:15:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-10-26T06:15:03.934 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-10-26T06:15:03.935 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd 2023-10-26T06:15:03.935 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-10-26T06:15:03.935 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-10-26T06:15:03.935 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mfd-core.ko 2023-10-26T06:15:03.935 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-10-26T06:15:03.935 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-10-26T06:15:03.936 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-10-26T06:15:03.936 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-10-26T06:15:03.936 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc 2023-10-26T06:15:03.936 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl 2023-10-26T06:15:03.936 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-26T06:15:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-10-26T06:15:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-10-26T06:15:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-10-26T06:15:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710 2023-10-26T06:15:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-10-26T06:15:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom 2023-10-26T06:15:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-10-26T06:15:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-26T06:15:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-26T06:15:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-10-26T06:15:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-10-26T06:15:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-10-26T06:15:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-10-26T06:15:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-10-26T06:15:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d 2023-10-26T06:15:03.940 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-26T06:15:03.940 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-26T06:15:03.940 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei 2023-10-26T06:15:03.940 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-10-26T06:15:03.940 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-10-26T06:15:03.940 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-10-26T06:15:03.941 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/sgi-gru 2023-10-26T06:15:03.941 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-26T06:15:03.941 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/sgi-xp 2023-10-26T06:15:03.941 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-26T06:15:03.941 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-26T06:15:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-26T06:15:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-10-26T06:15:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-10-26T06:15:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-10-26T06:15:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-10-26T06:15:03.943 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci 2023-10-26T06:15:03.943 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-26T06:15:03.943 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net 2023-10-26T06:15:03.943 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding 2023-10-26T06:15:03.943 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-10-26T06:15:03.944 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa 2023-10-26T06:15:03.944 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53 2023-10-26T06:15:03.944 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-26T06:15:03.944 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-26T06:15:03.944 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-26T06:15:03.945 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx 2023-10-26T06:15:03.945 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-26T06:15:03.945 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-10-26T06:15:03.945 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-10-26T06:15:03.945 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet 2023-10-26T06:15:03.946 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com 2023-10-26T06:15:03.946 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-26T06:15:03.946 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-26T06:15:03.946 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-26T06:15:03.946 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-26T06:15:03.946 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390 2023-10-26T06:15:03.947 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-26T06:15:03.947 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-26T06:15:03.947 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-26T06:15:03.947 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-26T06:15:03.947 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec 2023-10-26T06:15:03.948 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-26T06:15:03.948 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere 2023-10-26T06:15:03.948 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-26T06:15:03.948 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon 2023-10-26T06:15:03.948 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-26T06:15:03.949 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera 2023-10-26T06:15:03.949 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-26T06:15:03.949 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd 2023-10-26T06:15:03.949 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-26T06:15:03.949 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-26T06:15:03.949 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-26T06:15:03.950 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros 2023-10-26T06:15:03.950 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx 2023-10-26T06:15:03.950 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-26T06:15:03.950 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-26T06:15:03.950 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-26T06:15:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-26T06:15:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-26T06:15:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx 2023-10-26T06:15:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-26T06:15:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-26T06:15:03.952 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom 2023-10-26T06:15:03.952 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-26T06:15:03.952 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-26T06:15:03.952 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-26T06:15:03.952 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-26T06:15:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-26T06:15:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet 2023-10-26T06:15:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-26T06:15:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-26T06:15:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade 2023-10-26T06:15:03.953 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna 2023-10-26T06:15:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-26T06:15:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio 2023-10-26T06:15:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-26T06:15:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-26T06:15:03.954 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-26T06:15:03.955 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-26T06:15:03.955 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-26T06:15:03.955 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-26T06:15:03.955 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-26T06:15:03.955 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-26T06:15:03.956 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-26T06:15:03.956 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-26T06:15:03.956 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco 2023-10-26T06:15:03.956 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic 2023-10-26T06:15:03.956 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-26T06:15:03.956 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec 2023-10-26T06:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip 2023-10-26T06:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-26T06:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-26T06:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-26T06:15:03.957 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-26T06:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-26T06:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-26T06:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink 2023-10-26T06:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-26T06:15:03.958 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-26T06:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-10-26T06:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex 2023-10-26T06:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet 2023-10-26T06:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-26T06:15:03.959 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-10-26T06:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-10-26T06:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel 2023-10-26T06:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-26T06:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000 2023-10-26T06:15:03.960 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-26T06:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e 2023-10-26T06:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-26T06:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k 2023-10-26T06:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-26T06:15:03.961 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e 2023-10-26T06:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-26T06:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf 2023-10-26T06:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-26T06:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb 2023-10-26T06:15:03.962 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-26T06:15:03.963 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf 2023-10-26T06:15:03.963 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-26T06:15:03.963 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-26T06:15:03.963 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-26T06:15:03.963 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-26T06:15:03.963 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-26T06:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-10-26T06:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell 2023-10-26T06:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-26T06:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-26T06:15:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-26T06:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox 2023-10-26T06:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-26T06:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-26T06:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-26T06:15:03.965 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-26T06:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-26T06:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-26T06:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel 2023-10-26T06:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-26T06:15:03.966 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom 2023-10-26T06:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-26T06:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-26T06:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi 2023-10-26T06:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-26T06:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-26T06:15:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion 2023-10-26T06:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-26T06:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia 2023-10-26T06:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-26T06:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines 2023-10-26T06:15:03.968 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-26T06:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-26T06:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic 2023-10-26T06:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-26T06:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-26T06:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-26T06:15:03.969 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-26T06:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-26T06:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc 2023-10-26T06:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-26T06:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek 2023-10-26T06:15:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-26T06:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-26T06:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-26T06:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-26T06:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rocker 2023-10-26T06:15:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-26T06:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc 2023-10-26T06:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-26T06:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan 2023-10-26T06:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-26T06:15:03.972 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis 2023-10-26T06:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-26T06:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-26T06:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc 2023-10-26T06:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-26T06:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-26T06:15:03.973 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-26T06:15:03.974 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-26T06:15:03.974 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro 2023-10-26T06:15:03.974 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-26T06:15:03.974 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-26T06:15:03.974 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-26T06:15:03.975 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun 2023-10-26T06:15:03.975 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-26T06:15:03.975 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-26T06:15:03.975 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-26T06:15:03.975 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-26T06:15:03.976 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti 2023-10-26T06:15:03.976 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-26T06:15:03.976 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti 2023-10-26T06:15:03.976 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-26T06:15:03.976 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via 2023-10-26T06:15:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-26T06:15:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-26T06:15:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet 2023-10-26T06:15:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-26T06:15:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-26T06:15:03.978 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom 2023-10-26T06:15:03.978 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-26T06:15:03.978 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-10-26T06:15:03.978 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv 2023-10-26T06:15:03.978 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-26T06:15:03.978 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154 2023-10-26T06:15:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-26T06:15:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-10-26T06:15:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan 2023-10-26T06:15:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-26T06:15:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-10-26T06:15:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-10-26T06:15:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio 2023-10-26T06:15:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-10-26T06:15:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-26T06:15:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-26T06:15:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-26T06:15:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-10-26T06:15:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/net_failover.ko 2023-10-26T06:15:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-10-26T06:15:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-10-26T06:15:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs 2023-10-26T06:15:03.982 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-26T06:15:03.982 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-26T06:15:03.982 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy 2023-10-26T06:15:03.982 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-10-26T06:15:03.982 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-26T06:15:03.983 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-26T06:15:03.983 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-26T06:15:03.983 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-10-26T06:15:03.983 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-10-26T06:15:03.983 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-10-26T06:15:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-10-26T06:15:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/dp83640.ko 2023-10-26T06:15:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-10-26T06:15:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-10-26T06:15:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-10-26T06:15:03.984 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-10-26T06:15:03.985 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-10-26T06:15:03.985 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-10-26T06:15:03.985 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-10-26T06:15:03.985 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-10-26T06:15:03.985 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-10-26T06:15:03.986 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-10-26T06:15:03.986 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-10-26T06:15:03.986 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-10-26T06:15:03.986 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp 2023-10-26T06:15:03.986 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-26T06:15:03.987 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-10-26T06:15:03.987 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-26T06:15:03.987 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-26T06:15:03.987 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-26T06:15:03.987 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-26T06:15:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-10-26T06:15:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-10-26T06:15:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-10-26T06:15:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip 2023-10-26T06:15:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slhc.ko 2023-10-26T06:15:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-10-26T06:15:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-10-26T06:15:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-10-26T06:15:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team 2023-10-26T06:15:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-10-26T06:15:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-26T06:15:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-26T06:15:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-26T06:15:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-10-26T06:15:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-26T06:15:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tun.ko 2023-10-26T06:15:03.990 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-10-26T06:15:03.991 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/virtio_net.ko 2023-10-26T06:15:03.991 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3 2023-10-26T06:15:03.991 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-26T06:15:03.991 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan 2023-10-26T06:15:03.991 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-10-26T06:15:03.992 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback 2023-10-26T06:15:03.992 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-26T06:15:03.992 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netfront.ko 2023-10-26T06:15:03.992 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb 2023-10-26T06:15:03.992 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-10-26T06:15:03.993 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme 2023-10-26T06:15:03.993 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host 2023-10-26T06:15:03.993 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-10-26T06:15:03.993 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-10-26T06:15:03.993 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport 2023-10-26T06:15:03.994 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-10-26T06:15:03.994 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-10-26T06:15:03.994 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-10-26T06:15:03.994 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-10-26T06:15:03.994 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci 2023-10-26T06:15:03.995 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug 2023-10-26T06:15:03.995 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-26T06:15:03.995 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pcie 2023-10-26T06:15:03.995 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-26T06:15:03.995 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-10-26T06:15:03.995 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia 2023-10-26T06:15:03.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-10-26T06:15:03.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-10-26T06:15:03.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-26T06:15:03.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl 2023-10-26T06:15:03.996 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel 2023-10-26T06:15:03.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-26T06:15:03.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform 2023-10-26T06:15:03.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86 2023-10-26T06:15:03.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-26T06:15:03.997 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-10-26T06:15:03.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-26T06:15:03.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-26T06:15:03.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-26T06:15:03.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-26T06:15:03.998 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-26T06:15:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-26T06:15:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-26T06:15:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-26T06:15:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-26T06:15:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-10-26T06:15:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel 2023-10-26T06:15:04.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-26T06:15:04.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-10-26T06:15:04.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-26T06:15:04.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-26T06:15:04.000 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-26T06:15:04.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-26T06:15:04.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-26T06:15:04.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-26T06:15:04.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-26T06:15:04.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-26T06:15:04.001 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-26T06:15:04.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-10-26T06:15:04.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap 2023-10-26T06:15:04.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-26T06:15:04.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-26T06:15:04.002 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps 2023-10-26T06:15:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients 2023-10-26T06:15:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-26T06:15:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-26T06:15:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-10-26T06:15:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-10-26T06:15:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp 2023-10-26T06:15:04.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-10-26T06:15:04.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-10-26T06:15:04.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc 2023-10-26T06:15:04.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-26T06:15:04.004 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-26T06:15:04.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-26T06:15:04.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-26T06:15:04.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-26T06:15:04.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-26T06:15:04.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-26T06:15:04.005 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-26T06:15:04.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-26T06:15:04.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-26T06:15:04.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-10-26T06:15:04.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-26T06:15:04.006 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-26T06:15:04.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-26T06:15:04.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-26T06:15:04.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-26T06:15:04.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-26T06:15:04.007 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-10-26T06:15:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-26T06:15:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-26T06:15:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-26T06:15:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-26T06:15:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-26T06:15:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-26T06:15:04.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-26T06:15:04.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-26T06:15:04.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-26T06:15:04.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-26T06:15:04.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-26T06:15:04.009 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-26T06:15:04.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-10-26T06:15:04.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi 2023-10-26T06:15:04.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-10-26T06:15:04.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-10-26T06:15:04.010 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-10-26T06:15:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-10-26T06:15:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-10-26T06:15:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid 2023-10-26T06:15:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-26T06:15:04.011 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-10-26T06:15:04.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx 2023-10-26T06:15:04.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-26T06:15:04.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-26T06:15:04.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-10-26T06:15:04.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr 2023-10-26T06:15:04.012 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-26T06:15:04.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-10-26T06:15:04.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi 2023-10-26T06:15:04.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-26T06:15:04.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa 2023-10-26T06:15:04.013 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-10-26T06:15:04.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc 2023-10-26T06:15:04.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-26T06:15:04.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i 2023-10-26T06:15:04.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-26T06:15:04.014 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-10-26T06:15:04.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor 2023-10-26T06:15:04.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-26T06:15:04.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi 2023-10-26T06:15:04.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-26T06:15:04.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-26T06:15:04.015 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-26T06:15:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-26T06:15:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-26T06:15:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-10-26T06:15:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/device_handler 2023-10-26T06:15:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-26T06:15:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-26T06:15:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-26T06:15:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-26T06:15:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-10-26T06:15:04.017 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r 2023-10-26T06:15:04.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-26T06:15:04.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-10-26T06:15:04.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe 2023-10-26T06:15:04.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-26T06:15:04.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-26T06:15:04.018 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic 2023-10-26T06:15:04.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-10-26T06:15:04.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-10-26T06:15:04.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-10-26T06:15:04.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-10-26T06:15:04.019 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-10-26T06:15:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-10-26T06:15:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-10-26T06:15:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci 2023-10-26T06:15:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-10-26T06:15:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-26T06:15:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-26T06:15:04.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc 2023-10-26T06:15:04.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-10-26T06:15:04.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-10-26T06:15:04.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-26T06:15:04.021 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas 2023-10-26T06:15:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-10-26T06:15:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc 2023-10-26T06:15:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-26T06:15:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid 2023-10-26T06:15:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-10-26T06:15:04.022 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-26T06:15:04.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-26T06:15:04.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-26T06:15:04.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas 2023-10-26T06:15:04.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-26T06:15:04.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas 2023-10-26T06:15:04.023 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-26T06:15:04.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-10-26T06:15:04.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001 2023-10-26T06:15:04.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-26T06:15:04.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-10-26T06:15:04.024 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-10-26T06:15:04.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx 2023-10-26T06:15:04.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-26T06:15:04.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-26T06:15:04.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx 2023-10-26T06:15:04.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-26T06:15:04.025 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-10-26T06:15:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-10-26T06:15:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-26T06:15:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-26T06:15:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-26T06:15:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-26T06:15:04.026 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-26T06:15:04.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-10-26T06:15:04.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-10-26T06:15:04.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-10-26T06:15:04.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2 2023-10-26T06:15:04.027 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-26T06:15:04.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-10-26T06:15:04.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-26T06:15:04.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-10-26T06:15:04.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb 2023-10-26T06:15:04.028 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-10-26T06:15:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target 2023-10-26T06:15:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi 2023-10-26T06:15:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-26T06:15:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback 2023-10-26T06:15:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-26T06:15:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-10-26T06:15:04.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-10-26T06:15:04.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-10-26T06:15:04.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-10-26T06:15:04.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-10-26T06:15:04.030 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc 2023-10-26T06:15:04.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-26T06:15:04.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal 2023-10-26T06:15:04.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel 2023-10-26T06:15:04.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal 2023-10-26T06:15:04.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-26T06:15:04.031 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-26T06:15:04.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-26T06:15:04.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-26T06:15:04.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-26T06:15:04.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-26T06:15:04.032 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-26T06:15:04.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-26T06:15:04.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-26T06:15:04.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-26T06:15:04.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-26T06:15:04.033 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-26T06:15:04.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-26T06:15:04.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-26T06:15:04.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-26T06:15:04.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty 2023-10-26T06:15:04.034 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless 2023-10-26T06:15:04.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-26T06:15:04.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-10-26T06:15:04.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-10-26T06:15:04.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-10-26T06:15:04.035 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial 2023-10-26T06:15:04.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250 2023-10-26T06:15:04.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-26T06:15:04.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-10-26T06:15:04.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm 2023-10-26T06:15:04.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-26T06:15:04.036 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs 2023-10-26T06:15:04.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core 2023-10-26T06:15:04.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-26T06:15:04.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host 2023-10-26T06:15:04.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-26T06:15:04.037 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio 2023-10-26T06:15:04.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-10-26T06:15:04.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-10-26T06:15:04.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-10-26T06:15:04.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-10-26T06:15:04.038 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-10-26T06:15:04.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb 2023-10-26T06:15:04.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class 2023-10-26T06:15:04.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-10-26T06:15:04.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-26T06:15:04.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-10-26T06:15:04.039 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-10-26T06:15:04.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host 2023-10-26T06:15:04.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-26T06:15:04.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image 2023-10-26T06:15:04.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-10-26T06:15:04.040 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-10-26T06:15:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc 2023-10-26T06:15:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-10-26T06:15:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-10-26T06:15:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-10-26T06:15:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-10-26T06:15:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-10-26T06:15:04.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-10-26T06:15:04.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-10-26T06:15:04.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-26T06:15:04.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-10-26T06:15:04.042 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-10-26T06:15:04.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga 2023-10-26T06:15:04.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-26T06:15:04.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-26T06:15:04.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-10-26T06:15:04.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-10-26T06:15:04.043 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-26T06:15:04.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-10-26T06:15:04.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-10-26T06:15:04.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy 2023-10-26T06:15:04.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-10-26T06:15:04.044 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial 2023-10-26T06:15:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-10-26T06:15:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-10-26T06:15:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-26T06:15:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-10-26T06:15:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-10-26T06:15:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-10-26T06:15:04.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-26T06:15:04.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-26T06:15:04.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-10-26T06:15:04.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-26T06:15:04.046 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-26T06:15:04.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-26T06:15:04.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-10-26T06:15:04.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-10-26T06:15:04.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-10-26T06:15:04.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-10-26T06:15:04.047 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-26T06:15:04.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-10-26T06:15:04.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-26T06:15:04.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-26T06:15:04.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-26T06:15:04.048 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-10-26T06:15:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-10-26T06:15:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-10-26T06:15:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-10-26T06:15:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-10-26T06:15:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-10-26T06:15:04.049 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-10-26T06:15:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-10-26T06:15:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-10-26T06:15:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-10-26T06:15:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-10-26T06:15:04.050 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-10-26T06:15:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-10-26T06:15:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-10-26T06:15:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-26T06:15:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-10-26T06:15:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-10-26T06:15:04.051 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-26T06:15:04.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-26T06:15:04.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-10-26T06:15:04.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-26T06:15:04.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-10-26T06:15:04.052 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-10-26T06:15:04.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-26T06:15:04.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage 2023-10-26T06:15:04.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-10-26T06:15:04.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-26T06:15:04.053 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-26T06:15:04.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-26T06:15:04.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-26T06:15:04.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-26T06:15:04.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-26T06:15:04.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-26T06:15:04.054 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-10-26T06:15:04.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-26T06:15:04.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-26T06:15:04.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-26T06:15:04.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-26T06:15:04.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-26T06:15:04.055 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-10-26T06:15:04.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip 2023-10-26T06:15:04.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-26T06:15:04.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-26T06:15:04.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-26T06:15:04.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio 2023-10-26T06:15:04.056 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci 2023-10-26T06:15:04.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-26T06:15:04.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-26T06:15:04.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-10-26T06:15:04.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-26T06:15:04.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost 2023-10-26T06:15:04.057 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-10-26T06:15:04.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-26T06:15:04.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-10-26T06:15:04.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-10-26T06:15:04.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video 2023-10-26T06:15:04.058 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight 2023-10-26T06:15:04.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-10-26T06:15:04.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-10-26T06:15:04.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-26T06:15:04.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio 2023-10-26T06:15:04.059 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio.ko 2023-10-26T06:15:04.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio_balloon.ko 2023-10-26T06:15:04.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio_mmio.ko 2023-10-26T06:15:04.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio_pci.ko 2023-10-26T06:15:04.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-26T06:15:04.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-26T06:15:04.060 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/virtio/virtio_ring.ko 2023-10-26T06:15:04.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1 2023-10-26T06:15:04.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters 2023-10-26T06:15:04.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-10-26T06:15:04.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-10-26T06:15:04.061 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves 2023-10-26T06:15:04.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-26T06:15:04.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-26T06:15:04.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-26T06:15:04.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-26T06:15:04.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-26T06:15:04.062 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-26T06:15:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-26T06:15:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-26T06:15:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-26T06:15:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-26T06:15:04.063 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-26T06:15:04.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-10-26T06:15:04.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog 2023-10-26T06:15:04.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-26T06:15:04.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-26T06:15:04.064 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-26T06:15:04.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-10-26T06:15:04.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-10-26T06:15:04.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-26T06:15:04.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-26T06:15:04.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-10-26T06:15:04.065 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-10-26T06:15:04.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-26T06:15:04.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-26T06:15:04.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-10-26T06:15:04.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-10-26T06:15:04.066 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-10-26T06:15:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-26T06:15:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-26T06:15:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-26T06:15:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-26T06:15:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-10-26T06:15:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-26T06:15:04.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-10-26T06:15:04.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-26T06:15:04.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-26T06:15:04.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-26T06:15:04.068 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-10-26T06:15:04.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-10-26T06:15:04.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen 2023-10-26T06:15:04.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-26T06:15:04.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-10-26T06:15:04.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-10-26T06:15:04.069 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-10-26T06:15:04.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback 2023-10-26T06:15:04.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-26T06:15:04.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-10-26T06:15:04.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs 2023-10-26T06:15:04.070 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-26T06:15:04.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs 2023-10-26T06:15:04.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p 2023-10-26T06:15:04.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-10-26T06:15:04.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs 2023-10-26T06:15:04.071 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-10-26T06:15:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs 2023-10-26T06:15:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-10-26T06:15:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-10-26T06:15:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs 2023-10-26T06:15:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-10-26T06:15:04.072 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles 2023-10-26T06:15:04.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-10-26T06:15:04.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph 2023-10-26T06:15:04.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-10-26T06:15:04.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda 2023-10-26T06:15:04.073 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-10-26T06:15:04.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs 2023-10-26T06:15:04.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-10-26T06:15:04.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm 2023-10-26T06:15:04.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-10-26T06:15:04.074 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ecryptfs 2023-10-26T06:15:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-26T06:15:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs 2023-10-26T06:15:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-10-26T06:15:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat 2023-10-26T06:15:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/fat.ko 2023-10-26T06:15:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-10-26T06:15:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/vfat.ko 2023-10-26T06:15:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache 2023-10-26T06:15:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-10-26T06:15:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse 2023-10-26T06:15:04.076 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-10-26T06:15:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/fuse.ko 2023-10-26T06:15:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2 2023-10-26T06:15:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-10-26T06:15:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs 2023-10-26T06:15:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-10-26T06:15:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus 2023-10-26T06:15:04.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-10-26T06:15:04.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs 2023-10-26T06:15:04.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-10-26T06:15:04.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs 2023-10-26T06:15:04.078 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-10-26T06:15:04.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd 2023-10-26T06:15:04.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-10-26T06:15:04.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix 2023-10-26T06:15:04.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-10-26T06:15:04.079 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs 2023-10-26T06:15:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-10-26T06:15:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs 2023-10-26T06:15:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout 2023-10-26T06:15:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-26T06:15:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout 2023-10-26T06:15:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-26T06:15:04.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout 2023-10-26T06:15:04.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-26T06:15:04.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-10-26T06:15:04.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-10-26T06:15:04.081 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-10-26T06:15:04.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common 2023-10-26T06:15:04.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-10-26T06:15:04.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-10-26T06:15:04.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd 2023-10-26T06:15:04.082 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-10-26T06:15:04.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2 2023-10-26T06:15:04.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-10-26T06:15:04.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls 2023-10-26T06:15:04.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-10-26T06:15:04.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-10-26T06:15:04.083 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-10-26T06:15:04.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-10-26T06:15:04.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-10-26T06:15:04.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-10-26T06:15:04.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-10-26T06:15:04.084 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-10-26T06:15:04.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-10-26T06:15:04.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-10-26T06:15:04.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-10-26T06:15:04.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-10-26T06:15:04.085 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-10-26T06:15:04.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-10-26T06:15:04.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-10-26T06:15:04.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-10-26T06:15:04.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-10-26T06:15:04.086 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-10-26T06:15:04.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-10-26T06:15:04.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-10-26T06:15:04.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-10-26T06:15:04.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-10-26T06:15:04.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-10-26T06:15:04.087 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-10-26T06:15:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-10-26T06:15:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-10-26T06:15:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-10-26T06:15:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-10-26T06:15:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-10-26T06:15:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-10-26T06:15:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-10-26T06:15:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-10-26T06:15:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-10-26T06:15:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-10-26T06:15:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-10-26T06:15:04.089 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-10-26T06:15:04.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-10-26T06:15:04.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-10-26T06:15:04.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-10-26T06:15:04.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-10-26T06:15:04.090 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-10-26T06:15:04.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-10-26T06:15:04.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-10-26T06:15:04.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-10-26T06:15:04.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-10-26T06:15:04.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-10-26T06:15:04.091 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-10-26T06:15:04.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-10-26T06:15:04.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-26T06:15:04.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-10-26T06:15:04.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2 2023-10-26T06:15:04.092 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster 2023-10-26T06:15:04.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-26T06:15:04.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm 2023-10-26T06:15:04.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-26T06:15:04.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs 2023-10-26T06:15:04.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-26T06:15:04.093 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-10-26T06:15:04.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-26T06:15:04.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-26T06:15:04.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-26T06:15:04.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs 2023-10-26T06:15:04.094 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-10-26T06:15:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore 2023-10-26T06:15:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-10-26T06:15:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs 2023-10-26T06:15:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-10-26T06:15:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs 2023-10-26T06:15:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-10-26T06:15:04.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb 2023-10-26T06:15:04.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client 2023-10-26T06:15:04.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-10-26T06:15:04.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common 2023-10-26T06:15:04.096 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-10-26T06:15:04.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-10-26T06:15:04.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs 2023-10-26T06:15:04.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-10-26T06:15:04.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv 2023-10-26T06:15:04.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-10-26T06:15:04.097 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf 2023-10-26T06:15:04.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-10-26T06:15:04.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs 2023-10-26T06:15:04.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-10-26T06:15:04.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs 2023-10-26T06:15:04.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-10-26T06:15:04.098 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel 2023-10-26T06:15:04.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/rcu 2023-10-26T06:15:04.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/rcu/rcutorture.ko 2023-10-26T06:15:04.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-10-26T06:15:04.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/trace 2023-10-26T06:15:04.099 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-26T06:15:04.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib 2023-10-26T06:15:04.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/asn1_encoder.ko 2023-10-26T06:15:04.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-10-26T06:15:04.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-10-26T06:15:04.100 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto 2023-10-26T06:15:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-10-26T06:15:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-10-26T06:15:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-10-26T06:15:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-10-26T06:15:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4 2023-10-26T06:15:04.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-10-26T06:15:04.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-10-26T06:15:04.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math 2023-10-26T06:15:04.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-10-26T06:15:04.102 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6 2023-10-26T06:15:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-10-26T06:15:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon 2023-10-26T06:15:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-26T06:15:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-10-26T06:15:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-10-26T06:15:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-10-26T06:15:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/zstd 2023-10-26T06:15:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/zstd/zstd_compress.ko 2023-10-26T06:15:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm 2023-10-26T06:15:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-10-26T06:15:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net 2023-10-26T06:15:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan 2023-10-26T06:15:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-10-26T06:15:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-10-26T06:15:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-10-26T06:15:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-10-26T06:15:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-26T06:15:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-10-26T06:15:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-10-26T06:15:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-10-26T06:15:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802 2023-10-26T06:15:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-10-26T06:15:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-10-26T06:15:04.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-10-26T06:15:04.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-10-26T06:15:04.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-10-26T06:15:04.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q 2023-10-26T06:15:04.107 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-10-26T06:15:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p 2023-10-26T06:15:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-10-26T06:15:04.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-10-26T06:15:04.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-10-26T06:15:04.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-10-26T06:15:04.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv 2023-10-26T06:15:04.110 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-10-26T06:15:04.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge 2023-10-26T06:15:04.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-10-26T06:15:04.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-10-26T06:15:04.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter 2023-10-26T06:15:04.111 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-26T06:15:04.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-26T06:15:04.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-26T06:15:04.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-26T06:15:04.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-26T06:15:04.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-26T06:15:04.112 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-26T06:15:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-26T06:15:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-26T06:15:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-26T06:15:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-26T06:15:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-26T06:15:04.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-26T06:15:04.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-26T06:15:04.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-26T06:15:04.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-26T06:15:04.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-26T06:15:04.114 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-26T06:15:04.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-26T06:15:04.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-26T06:15:04.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-10-26T06:15:04.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-26T06:15:04.115 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-26T06:15:04.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-26T06:15:04.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph 2023-10-26T06:15:04.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-10-26T06:15:04.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core 2023-10-26T06:15:04.116 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/failover.ko 2023-10-26T06:15:04.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-10-26T06:15:04.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp 2023-10-26T06:15:04.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-10-26T06:15:04.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-10-26T06:15:04.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-10-26T06:15:04.117 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-10-26T06:15:04.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dns_resolver 2023-10-26T06:15:04.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dns_resolver/dns_resolver.ko 2023-10-26T06:15:04.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa 2023-10-26T06:15:04.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-10-26T06:15:04.118 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-10-26T06:15:04.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-10-26T06:15:04.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-10-26T06:15:04.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-10-26T06:15:04.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154 2023-10-26T06:15:04.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan 2023-10-26T06:15:04.119 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-26T06:15:04.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-10-26T06:15:04.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-26T06:15:04.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4 2023-10-26T06:15:04.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-10-26T06:15:04.120 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-10-26T06:15:04.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-10-26T06:15:04.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-10-26T06:15:04.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-10-26T06:15:04.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-10-26T06:15:04.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-10-26T06:15:04.121 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-10-26T06:15:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-10-26T06:15:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-10-26T06:15:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter 2023-10-26T06:15:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-26T06:15:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-26T06:15:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-26T06:15:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-26T06:15:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-26T06:15:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-26T06:15:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-26T06:15:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-26T06:15:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-26T06:15:04.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-26T06:15:04.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-26T06:15:04.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-26T06:15:04.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-26T06:15:04.124 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-26T06:15:04.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-26T06:15:04.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-26T06:15:04.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-26T06:15:04.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-26T06:15:04.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-26T06:15:04.125 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-26T06:15:04.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-26T06:15:04.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-10-26T06:15:04.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-10-26T06:15:04.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-10-26T06:15:04.126 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-10-26T06:15:04.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-10-26T06:15:04.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-10-26T06:15:04.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-10-26T06:15:04.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-10-26T06:15:04.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-10-26T06:15:04.127 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-10-26T06:15:04.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-10-26T06:15:04.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-10-26T06:15:04.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-10-26T06:15:04.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-10-26T06:15:04.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-10-26T06:15:04.128 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-10-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6 2023-10-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-10-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-10-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-10-26T06:15:04.129 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-10-26T06:15:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-26T06:15:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-10-26T06:15:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-10-26T06:15:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter 2023-10-26T06:15:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-26T06:15:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-26T06:15:04.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-26T06:15:04.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-26T06:15:04.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-26T06:15:04.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-26T06:15:04.131 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-26T06:15:04.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-26T06:15:04.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-26T06:15:04.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-26T06:15:04.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-26T06:15:04.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-26T06:15:04.132 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-26T06:15:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-26T06:15:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-26T06:15:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-26T06:15:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-26T06:15:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-26T06:15:04.133 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-26T06:15:04.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-26T06:15:04.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-26T06:15:04.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-26T06:15:04.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-26T06:15:04.134 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-26T06:15:04.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-10-26T06:15:04.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-10-26T06:15:04.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-26T06:15:04.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key 2023-10-26T06:15:04.135 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-10-26T06:15:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp 2023-10-26T06:15:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-10-26T06:15:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-26T06:15:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-10-26T06:15:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-10-26T06:15:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-10-26T06:15:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-10-26T06:15:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-10-26T06:15:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc 2023-10-26T06:15:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-10-26T06:15:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154 2023-10-26T06:15:04.137 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-10-26T06:15:04.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls 2023-10-26T06:15:04.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-10-26T06:15:04.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter 2023-10-26T06:15:04.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset 2023-10-26T06:15:04.138 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-10-26T06:15:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-26T06:15:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-26T06:15:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-26T06:15:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-26T06:15:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-26T06:15:04.139 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-26T06:15:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-26T06:15:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-26T06:15:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-26T06:15:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-26T06:15:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-26T06:15:04.140 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-26T06:15:04.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-26T06:15:04.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-26T06:15:04.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-26T06:15:04.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs 2023-10-26T06:15:04.141 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-26T06:15:04.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-26T06:15:04.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-26T06:15:04.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-26T06:15:04.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-26T06:15:04.142 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-26T06:15:04.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-26T06:15:04.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-26T06:15:04.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-26T06:15:04.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-26T06:15:04.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-26T06:15:04.143 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-26T06:15:04.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-26T06:15:04.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-26T06:15:04.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-10-26T06:15:04.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-10-26T06:15:04.144 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-26T06:15:04.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-26T06:15:04.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-26T06:15:04.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-26T06:15:04.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-26T06:15:04.145 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-26T06:15:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-26T06:15:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-26T06:15:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-26T06:15:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-26T06:15:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-26T06:15:04.146 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-26T06:15:04.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-26T06:15:04.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-10-26T06:15:04.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-26T06:15:04.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-10-26T06:15:04.147 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-10-26T06:15:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-26T06:15:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-26T06:15:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-10-26T06:15:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-10-26T06:15:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-26T06:15:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-26T06:15:04.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-10-26T06:15:04.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-10-26T06:15:04.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-26T06:15:04.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-10-26T06:15:04.149 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-26T06:15:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-26T06:15:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-10-26T06:15:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-10-26T06:15:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-10-26T06:15:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-26T06:15:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-10-26T06:15:04.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-26T06:15:04.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-10-26T06:15:04.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-10-26T06:15:04.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-10-26T06:15:04.151 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-10-26T06:15:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-10-26T06:15:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-10-26T06:15:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-10-26T06:15:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_quota.ko 2023-10-26T06:15:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-10-26T06:15:04.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-10-26T06:15:04.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-10-26T06:15:04.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-10-26T06:15:04.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tunnel.ko 2023-10-26T06:15:04.153 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-10-26T06:15:04.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-26T06:15:04.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-26T06:15:04.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-26T06:15:04.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-10-26T06:15:04.154 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-10-26T06:15:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-10-26T06:15:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-10-26T06:15:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-26T06:15:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-10-26T06:15:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-10-26T06:15:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-26T06:15:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-10-26T06:15:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-10-26T06:15:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-26T06:15:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-10-26T06:15:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-26T06:15:04.156 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-10-26T06:15:04.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-26T06:15:04.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-26T06:15:04.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-10-26T06:15:04.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-10-26T06:15:04.157 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-10-26T06:15:04.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-10-26T06:15:04.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-10-26T06:15:04.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-10-26T06:15:04.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-10-26T06:15:04.158 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-10-26T06:15:04.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-10-26T06:15:04.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-10-26T06:15:04.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-10-26T06:15:04.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-10-26T06:15:04.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-10-26T06:15:04.159 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-10-26T06:15:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-10-26T06:15:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-10-26T06:15:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-10-26T06:15:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-10-26T06:15:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-10-26T06:15:04.160 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-10-26T06:15:04.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-10-26T06:15:04.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-10-26T06:15:04.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-10-26T06:15:04.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-10-26T06:15:04.161 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-10-26T06:15:04.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-10-26T06:15:04.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-10-26T06:15:04.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-10-26T06:15:04.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-10-26T06:15:04.162 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-10-26T06:15:04.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-10-26T06:15:04.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-10-26T06:15:04.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-10-26T06:15:04.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-10-26T06:15:04.163 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-10-26T06:15:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-10-26T06:15:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-10-26T06:15:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-10-26T06:15:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-10-26T06:15:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-10-26T06:15:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-10-26T06:15:04.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-10-26T06:15:04.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-10-26T06:15:04.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-10-26T06:15:04.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-10-26T06:15:04.165 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-10-26T06:15:04.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-10-26T06:15:04.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-10-26T06:15:04.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-10-26T06:15:04.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-10-26T06:15:04.166 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-10-26T06:15:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink 2023-10-26T06:15:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-10-26T06:15:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh 2023-10-26T06:15:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-10-26T06:15:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch 2023-10-26T06:15:04.167 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-10-26T06:15:04.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-10-26T06:15:04.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-10-26T06:15:04.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-10-26T06:15:04.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet 2023-10-26T06:15:04.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-10-26T06:15:04.168 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds 2023-10-26T06:15:04.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-10-26T06:15:04.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-10-26T06:15:04.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-10-26T06:15:04.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched 2023-10-26T06:15:04.169 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-10-26T06:15:04.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-10-26T06:15:04.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-10-26T06:15:04.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-10-26T06:15:04.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-10-26T06:15:04.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-10-26T06:15:04.170 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-10-26T06:15:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-10-26T06:15:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-10-26T06:15:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-10-26T06:15:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-10-26T06:15:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-10-26T06:15:04.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-10-26T06:15:04.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-10-26T06:15:04.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-10-26T06:15:04.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-10-26T06:15:04.172 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-10-26T06:15:04.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-10-26T06:15:04.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-10-26T06:15:04.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-10-26T06:15:04.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-10-26T06:15:04.173 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-10-26T06:15:04.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-10-26T06:15:04.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-10-26T06:15:04.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-10-26T06:15:04.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-10-26T06:15:04.174 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-10-26T06:15:04.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-10-26T06:15:04.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-10-26T06:15:04.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-10-26T06:15:04.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-10-26T06:15:04.175 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-10-26T06:15:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-10-26T06:15:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-10-26T06:15:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-10-26T06:15:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-10-26T06:15:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-10-26T06:15:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-10-26T06:15:04.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-10-26T06:15:04.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-10-26T06:15:04.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-10-26T06:15:04.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-10-26T06:15:04.177 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-10-26T06:15:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-10-26T06:15:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp 2023-10-26T06:15:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-10-26T06:15:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-10-26T06:15:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc 2023-10-26T06:15:04.178 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss 2023-10-26T06:15:04.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-26T06:15:04.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-26T06:15:04.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-10-26T06:15:04.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma 2023-10-26T06:15:04.179 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-26T06:15:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc 2023-10-26T06:15:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-10-26T06:15:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-10-26T06:15:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix 2023-10-26T06:15:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-10-26T06:15:04.180 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock 2023-10-26T06:15:04.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-26T06:15:04.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-26T06:15:04.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-10-26T06:15:04.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-26T06:15:04.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-26T06:15:04.181 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm 2023-10-26T06:15:04.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-26T06:15:04.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/security 2023-10-26T06:15:04.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/security/keys 2023-10-26T06:15:04.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/security/keys/encrypted-keys 2023-10-26T06:15:04.182 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-26T06:15:04.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/security/keys/trusted-keys 2023-10-26T06:15:04.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/security/keys/trusted-keys/trusted.ko 2023-10-26T06:15:04.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt 2023-10-26T06:15:04.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib 2023-10-26T06:15:04.183 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-10-26T06:15:04.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-10-26T06:15:04.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-10-26T06:15:04.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-10-26T06:15:04.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-10-26T06:15:04.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-10-26T06:15:04.184 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-10-26T06:15:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-10-26T06:15:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-10-26T06:15:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-10-26T06:15:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-10-26T06:15:04.185 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-10-26T06:15:04.186 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-10-26T06:15:04.186 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:04.187 DEBUG:teuthology.orchestra.run.smithi050:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-26T06:15:04.216 INFO:teuthology.orchestra.run.smithi050.stdout:postinstall scriptlet (using /bin/sh): 2023-10-26T06:15:04.216 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f -a -r /boot/System.map-6.6.0-rc5-g5b73517e0e2f ]; then 2023-10-26T06:15:04.216 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f /boot/.vmlinuz-6.6.0-rc5-g5b73517e0e2f-rpm 2023-10-26T06:15:04.216 INFO:teuthology.orchestra.run.smithi050.stdout:cp /boot/System.map-6.6.0-rc5-g5b73517e0e2f /boot/.System.map-6.6.0-rc5-g5b73517e0e2f-rpm 2023-10-26T06:15:04.216 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f /boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:04.217 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/installkernel 6.6.0-rc5-g5b73517e0e2f /boot/.vmlinuz-6.6.0-rc5-g5b73517e0e2f-rpm /boot/.System.map-6.6.0-rc5-g5b73517e0e2f-rpm 2023-10-26T06:15:04.217 INFO:teuthology.orchestra.run.smithi050.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g5b73517e0e2f-rpm /boot/.System.map-6.6.0-rc5-g5b73517e0e2f-rpm 2023-10-26T06:15:04.217 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-10-26T06:15:04.217 INFO:teuthology.orchestra.run.smithi050.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-26T06:15:04.217 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-26T06:15:04.218 INFO:teuthology.orchestra.run.smithi050.stdout:new-kernel-pkg --remove 6.6.0-rc5-g5b73517e0e2f --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g5b73517e0e2f.img 2023-10-26T06:15:04.218 INFO:teuthology.orchestra.run.smithi050.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-26T06:15:04.218 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-install remove 6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:04.218 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-10-26T06:15:04.218 INFO:teuthology.orchestra.run.smithi050.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-26T06:15:04.219 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-26T06:15:04.219 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:04.219 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2023-10-26T06:15:04.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-10-26T06:15:04.299 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-10-26T06:15:04.299 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-10-26T06:15:04.299 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.02 2023-10-26T06:15:04.300 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 123.el8 2023-10-26T06:15:04.300 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-10-26T06:15:04.300 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-26T06:15:04.300 INFO:teuthology.orchestra.run.smithi050.stdout:Group : System Environment/Base 2023-10-26T06:15:04.301 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 9265450 2023-10-26T06:15:04.301 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-10-26T06:15:04.301 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-26T06:15:04.301 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-26T06:15:04.302 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-26T06:15:04.302 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-26T06:15:04.302 INFO:teuthology.orchestra.run.smithi050.stdout:Relocations : (not relocatable) 2023-10-26T06:15:04.302 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : Red Hat, Inc. 2023-10-26T06:15:04.302 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : Red Hat, Inc. 2023-10-26T06:15:04.303 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-26T06:15:04.303 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-10-26T06:15:04.303 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-10-26T06:15:04.303 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:15:04.303 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-26T06:15:04.304 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-26T06:15:04.304 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-26T06:15:04.304 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-10-26T06:15:04.304 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:15:04.304 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-10-26T06:15:04.305 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-26T06:15:04.306 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:04.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-26T06:15:09.042 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-10-26T06:15:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-10-26T06:15:10.980 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-10-26T06:15:11.004 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.zKqkzl73sq 2023-10-26T06:15:11.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zKqkzl73sq 2023-10-26T06:15:11.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.zKqkzl73sq 2023-10-26T06:15:11.224 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.zKqkzl73sq is 6KB 2023-10-26T06:15:11.275 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.zKqkzl73sq 2023-10-26T06:15:11.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-10-26T06:15:11.356 INFO:teuthology.orchestra.run.smithi050.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-26T06:15:11.357 INFO:teuthology.orchestra.run.smithi050.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-26T06:15:11.357 INFO:teuthology.orchestra.run.smithi050.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.6.0-rc5-g5b73517e0e2f.conf 2023-10-26T06:15:11.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:15:11.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-10-26T06:15:41.515 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-26T06:15:41.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-26T06:15:41.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:16:41.519 DEBUG:teuthology.orchestra.remote:timed out 2023-10-26T06:16:50.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-26T06:16:50.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:16:53.921 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-26T06:16:54.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-26T06:16:54.397 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g5b73517e0e2f"... 2023-10-26T06:16:54.398 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-10-26T06:16:54.440 INFO:teuthology.orchestra.run.smithi050.stdout:6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:16:54.441 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-10-26T06:16:54.441 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-26T06:16:54.441 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-26T06:16:55.442 DEBUG:teuthology.parallel:result is None 2023-10-26T06:16:55.443 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-26T06:16:55.450 INFO:teuthology.task.internal:Creating test directory... 2023-10-26T06:16:55.451 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-26T06:16:55.456 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-26T06:16:55.458 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-26T06:16:55.495 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-26T06:16:55.502 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-26T06:16:55.509 INFO:teuthology.task.internal:Creating archive directory... 2023-10-26T06:16:55.509 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-26T06:16:55.542 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-26T06:16:55.545 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-26T06:16:55.599 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-26T06:16:55.607 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-26T06:16:55.607 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-26T06:16:55.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:16:55.627 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-26T06:16:55.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:16:55.647 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-26T06:16:55.652 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-26T06:16:55.670 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-26T06:16:55.734 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-26T06:16:55.738 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-26T06:16:55.756 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-26T06:16:55.758 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-26T06:16:55.795 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-26T06:16:55.832 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-26T06:16:55.836 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-26T06:16:55.844 INFO:teuthology.task.internal:Configuring sudo... 2023-10-26T06:16:55.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-26T06:16:55.849 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-26T06:16:55.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-26T06:16:55.917 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-26T06:16:55.927 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-26T06:16:55.927 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-26T06:16:55.932 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-26T06:16:55.934 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-26T06:16:55.971 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-26T06:16:56.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-26T06:16:56.176 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-26T06:16:56.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-26T06:16:56.320 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:16:56.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-26T06:16:56.395 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-26T06:16:56.443 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-26T06:16:56.501 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-26T06:16:56.588 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-26T06:16:56.635 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:16:56.636 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-26T06:16:56.708 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-26T06:16:56.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-26T06:16:56.817 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-26T06:16:56.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-26T06:16:56.906 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:16:56.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-26T06:16:56.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-10-26T06:16:56.980 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2023-10-26T06:16:56.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-10-26T06:16:57.039 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-26T06:16:57.077 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-26T06:16:57.093 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-26T06:16:57.458 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-26T06:16:57.466 INFO:teuthology.task.internal:Starting timer... 2023-10-26T06:16:57.466 INFO:teuthology.run_tasks:Running task pcp... 2023-10-26T06:16:57.532 INFO:teuthology.run_tasks:Running task selinux... 2023-10-26T06:16:57.541 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-26T06:16:57.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-10-26T06:16:57.648 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-10-26T06:16:57.653 DEBUG:teuthology.orchestra.run.smithi125:> sudo service auditd rotate 2023-10-26T06:16:57.722 INFO:teuthology.orchestra.run.smithi125.stdout:Rotating logs: 2023-10-26T06:16:57.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2023-10-26T06:16:57.783 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2023-10-26T06:16:57.785 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-26T06:16:57.785 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-10-26T06:16:57.839 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-10-26T06:16:57.840 DEBUG:teuthology.orchestra.run.smithi125:> /usr/sbin/getenforce 2023-10-26T06:16:57.872 INFO:teuthology.orchestra.run.smithi125.stdout:Permissive 2023-10-26T06:16:57.873 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2023-10-26T06:16:57.898 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2023-10-26T06:16:57.898 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi125.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2023-10-26T06:16:57.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-26T06:16:57.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:16:57.975 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-26T06:16:58.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:16:58.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-26T06:16:58.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:16:58.029 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-26T06:16:58.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-10-26T06:16:58.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo /usr/sbin/setenforce permissive 2023-10-26T06:16:58.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2023-10-26T06:16:58.153 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-26T06:16:58.162 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-26T06:16:58.168 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-26T06:16:58.299 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-26T06:16:58.315 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-26T06:16:58.337 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi125.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-26T06:29:20.731 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi125.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2023-10-26T06:29:20.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-26T06:29:20.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:29:20.843 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-10-26T06:29:20.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-10-26T06:29:20.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-26T06:29:20.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:29:21.028 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-26T06:29:21.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-26T06:29:21.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-26T06:29:21.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-26T06:29:21.167 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-26T06:29:21.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-26T06:29:21.241 INFO:teuthology.run_tasks:Running task clock... 2023-10-26T06:29:21.252 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-26T06:29:21.253 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-26T06:29:21.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-26T06:29:21.258 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-26T06:29:21.258 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-26T06:29:21.260 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-26T06:29:21.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-26T06:29:21.295 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-26T06:29:21.312 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-26T06:29:21.314 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-26T06:29:21.329 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-26T06:29:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-26T06:29:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-26T06:29:21.392 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: ntpd: command not found 2023-10-26T06:29:21.401 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2023-10-26T06:29:21.405 INFO:teuthology.orchestra.run.smithi125.stdout:506 Cannot talk to daemon 2023-10-26T06:29:21.412 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2023-10-26T06:29:21.421 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-26T06:29:21.427 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-26T06:29:21.436 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-26T06:29:21.441 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-26T06:29:21.460 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-10-26T06:29:21.490 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-10-26T06:29:21.514 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-10-26T06:29:21.518 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-26T06:29:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-10-26T06:29:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.519 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.525 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-10-26T06:29:21.525 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-26T06:29:21.529 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-26T06:29:21.529 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-10-26T06:29:21.529 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.529 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.529 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.530 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.561 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-26T06:29:21.651 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-10-26T06:29:21.659 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-26T06:29:21.659 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-26T06:29:21.660 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.660 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.660 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.660 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:29:21.661 INFO:teuthology.run_tasks:Running task pexec... 2023-10-26T06:29:21.672 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-26T06:29:21.673 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:29:21.674 DEBUG:teuthology.orchestra.run.smithi050:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-26T06:29:21.675 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi125.front.sepia.ceph.com 2023-10-26T06:29:21.675 DEBUG:teuthology.orchestra.run.smithi125:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-26T06:29:21.676 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi153.front.sepia.ceph.com 2023-10-26T06:29:21.676 DEBUG:teuthology.orchestra.run.smithi153:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-26T06:29:22.047 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:22.050 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:22.191 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:22.920 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:05:03 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:22.965 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:05:03 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:23.188 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:49 ago on Thu 26 Oct 2023 06:27:33 AM UTC. 2023-10-26T06:29:24.638 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-26T06:29:24.639 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-26T06:29:24.639 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2023-10-26T06:29:24.640 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-26T06:29:24.640 INFO:teuthology.orchestra.run.smithi125.stdout:Resetting modules: 2023-10-26T06:29:24.640 INFO:teuthology.orchestra.run.smithi125.stdout: container-tools 2023-10-26T06:29:24.640 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:24.640 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-26T06:29:24.641 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-26T06:29:24.641 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:24.677 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-26T06:29:24.678 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-26T06:29:24.678 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-10-26T06:29:24.678 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-26T06:29:24.678 INFO:teuthology.orchestra.run.smithi153.stdout:Resetting modules: 2023-10-26T06:29:24.679 INFO:teuthology.orchestra.run.smithi153.stdout: container-tools 2023-10-26T06:29:24.679 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:24.679 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-26T06:29:24.679 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-26T06:29:24.679 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:25.172 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-26T06:29:25.174 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-26T06:29:25.174 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-10-26T06:29:25.174 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-26T06:29:25.174 INFO:teuthology.orchestra.run.smithi050.stdout:Resetting modules: 2023-10-26T06:29:25.175 INFO:teuthology.orchestra.run.smithi050.stdout: container-tools 2023-10-26T06:29:25.175 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:25.175 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-26T06:29:25.175 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-10-26T06:29:25.175 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:25.606 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:05:06 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:25.660 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:05:06 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:26.485 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:52 ago on Thu 26 Oct 2023 06:27:33 AM UTC. 2023-10-26T06:29:28.416 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-26T06:29:28.444 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-26T06:29:28.876 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:28.915 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:29.197 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-26T06:29:29.741 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:05:10 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:29.746 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:05:10 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:29.823 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:30.855 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:57 ago on Thu 26 Oct 2023 06:27:33 AM UTC. 2023-10-26T06:29:31.435 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-26T06:29:31.472 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-26T06:29:31.527 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================================================ 2023-10-26T06:29:31.528 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-10-26T06:29:31.528 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================================================ 2023-10-26T06:29:31.529 INFO:teuthology.orchestra.run.smithi125.stdout:Installing group/module packages: 2023-10-26T06:29:31.529 INFO:teuthology.orchestra.run.smithi125.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-26T06:29:31.530 INFO:teuthology.orchestra.run.smithi125.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-26T06:29:31.530 INFO:teuthology.orchestra.run.smithi125.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-26T06:29:31.531 INFO:teuthology.orchestra.run.smithi125.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-26T06:29:31.532 INFO:teuthology.orchestra.run.smithi125.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-26T06:29:31.532 INFO:teuthology.orchestra.run.smithi125.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-26T06:29:31.533 INFO:teuthology.orchestra.run.smithi125.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-26T06:29:31.534 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-26T06:29:31.534 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-26T06:29:31.535 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-26T06:29:31.535 INFO:teuthology.orchestra.run.smithi125.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-26T06:29:31.536 INFO:teuthology.orchestra.run.smithi125.stdout:Installing module profiles: 2023-10-26T06:29:31.536 INFO:teuthology.orchestra.run.smithi125.stdout: container-tools/common 2023-10-26T06:29:31.537 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:31.538 INFO:teuthology.orchestra.run.smithi125.stdout:Enabling module streams: 2023-10-26T06:29:31.538 INFO:teuthology.orchestra.run.smithi125.stdout: container-tools rhel8 2023-10-26T06:29:31.539 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:31.539 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-26T06:29:31.539 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================================================ 2023-10-26T06:29:31.539 INFO:teuthology.orchestra.run.smithi125.stdout:Install 10 Packages 2023-10-26T06:29:31.540 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:31.541 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 18 M 2023-10-26T06:29:31.541 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 65 M 2023-10-26T06:29:31.541 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-26T06:29:31.564 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================================ 2023-10-26T06:29:31.564 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-26T06:29:31.564 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================================ 2023-10-26T06:29:31.565 INFO:teuthology.orchestra.run.smithi153.stdout:Installing group/module packages: 2023-10-26T06:29:31.565 INFO:teuthology.orchestra.run.smithi153.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-26T06:29:31.565 INFO:teuthology.orchestra.run.smithi153.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-26T06:29:31.565 INFO:teuthology.orchestra.run.smithi153.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-26T06:29:31.566 INFO:teuthology.orchestra.run.smithi153.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-26T06:29:31.566 INFO:teuthology.orchestra.run.smithi153.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-26T06:29:31.566 INFO:teuthology.orchestra.run.smithi153.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-26T06:29:31.566 INFO:teuthology.orchestra.run.smithi153.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-26T06:29:31.567 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-26T06:29:31.567 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-26T06:29:31.567 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-26T06:29:31.567 INFO:teuthology.orchestra.run.smithi153.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-26T06:29:31.568 INFO:teuthology.orchestra.run.smithi153.stdout:Installing module profiles: 2023-10-26T06:29:31.568 INFO:teuthology.orchestra.run.smithi153.stdout: container-tools/common 2023-10-26T06:29:31.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:31.568 INFO:teuthology.orchestra.run.smithi153.stdout:Enabling module streams: 2023-10-26T06:29:31.569 INFO:teuthology.orchestra.run.smithi153.stdout: container-tools rhel8 2023-10-26T06:29:31.569 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:31.569 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-26T06:29:31.569 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================================ 2023-10-26T06:29:31.570 INFO:teuthology.orchestra.run.smithi153.stdout:Install 10 Packages 2023-10-26T06:29:31.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:31.571 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 18 M 2023-10-26T06:29:31.571 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 65 M 2023-10-26T06:29:31.571 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-26T06:29:31.647 INFO:teuthology.orchestra.run.smithi125.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 345 kB/s | 41 kB 00:00 2023-10-26T06:29:31.672 INFO:teuthology.orchestra.run.smithi125.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 654 kB/s | 94 kB 00:00 2023-10-26T06:29:31.698 INFO:teuthology.orchestra.run.smithi125.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 147 kB/s | 25 kB 00:00 2023-10-26T06:29:31.710 INFO:teuthology.orchestra.run.smithi153.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 654 kB/s | 94 kB 00:00 2023-10-26T06:29:31.715 INFO:teuthology.orchestra.run.smithi125.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 735 kB/s | 49 kB 00:00 2023-10-26T06:29:31.745 INFO:teuthology.orchestra.run.smithi153.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 139 kB/s | 25 kB 00:00 2023-10-26T06:29:31.748 INFO:teuthology.orchestra.run.smithi125.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-10-26T06:29:31.770 INFO:teuthology.orchestra.run.smithi153.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 200 kB/s | 41 kB 00:00 2023-10-26T06:29:31.796 INFO:teuthology.orchestra.run.smithi153.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 579 kB/s | 49 kB 00:00 2023-10-26T06:29:31.798 INFO:teuthology.orchestra.run.smithi125.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.7 MB/s | 149 kB 00:00 2023-10-26T06:29:31.829 INFO:teuthology.orchestra.run.smithi153.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-26T06:29:31.846 INFO:teuthology.orchestra.run.smithi153.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-10-26T06:29:31.865 INFO:teuthology.orchestra.run.smithi125.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.8 MB/s | 213 kB 00:00 2023-10-26T06:29:31.922 INFO:teuthology.orchestra.run.smithi153.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.3 MB/s | 213 kB 00:00 2023-10-26T06:29:31.982 INFO:teuthology.orchestra.run.smithi125.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 28 MB/s | 8.0 MB 00:00 2023-10-26T06:29:32.005 INFO:teuthology.orchestra.run.smithi153.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 26 MB/s | 2.2 MB 00:00 2023-10-26T06:29:32.049 INFO:teuthology.orchestra.run.smithi125.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 12 MB/s | 2.2 MB 00:00 2023-10-26T06:29:32.133 INFO:teuthology.orchestra.run.smithi125.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 21 MB/s | 7.0 MB 00:00 2023-10-26T06:29:32.134 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:29:32.134 INFO:teuthology.orchestra.run.smithi125.stdout:Total 30 MB/s | 18 MB 00:00 2023-10-26T06:29:32.155 INFO:teuthology.orchestra.run.smithi153.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 21 MB/s | 8.0 MB 00:00 2023-10-26T06:29:32.240 INFO:teuthology.orchestra.run.smithi153.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 18 MB/s | 7.0 MB 00:00 2023-10-26T06:29:32.240 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:29:32.240 INFO:teuthology.orchestra.run.smithi153.stdout:Total 27 MB/s | 18 MB 00:00 2023-10-26T06:29:32.332 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-26T06:29:32.351 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-26T06:29:32.351 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-26T06:29:32.441 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-26T06:29:32.460 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-26T06:29:32.460 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-26T06:29:32.533 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-26T06:29:32.537 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-26T06:29:32.642 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-26T06:29:32.646 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-26T06:29:32.874 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-26T06:29:32.979 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================================ 2023-10-26T06:29:32.979 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-26T06:29:32.979 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================================ 2023-10-26T06:29:32.980 INFO:teuthology.orchestra.run.smithi050.stdout:Installing group/module packages: 2023-10-26T06:29:32.980 INFO:teuthology.orchestra.run.smithi050.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-26T06:29:32.980 INFO:teuthology.orchestra.run.smithi050.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-26T06:29:32.980 INFO:teuthology.orchestra.run.smithi050.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-26T06:29:32.980 INFO:teuthology.orchestra.run.smithi050.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-26T06:29:32.981 INFO:teuthology.orchestra.run.smithi050.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-26T06:29:32.981 INFO:teuthology.orchestra.run.smithi050.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-26T06:29:32.981 INFO:teuthology.orchestra.run.smithi050.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-26T06:29:32.981 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-26T06:29:32.982 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-26T06:29:32.982 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-26T06:29:32.982 INFO:teuthology.orchestra.run.smithi050.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-26T06:29:32.982 INFO:teuthology.orchestra.run.smithi050.stdout:Installing module profiles: 2023-10-26T06:29:32.982 INFO:teuthology.orchestra.run.smithi050.stdout: container-tools/common 2023-10-26T06:29:32.982 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:32.983 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling module streams: 2023-10-26T06:29:32.983 INFO:teuthology.orchestra.run.smithi050.stdout: container-tools rhel8 2023-10-26T06:29:32.983 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:32.983 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-26T06:29:32.983 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================================================ 2023-10-26T06:29:32.984 INFO:teuthology.orchestra.run.smithi050.stdout:Install 10 Packages 2023-10-26T06:29:32.984 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:32.984 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 18 M 2023-10-26T06:29:32.985 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 65 M 2023-10-26T06:29:32.985 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-26T06:29:33.063 INFO:teuthology.orchestra.run.smithi050.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 508 kB/s | 41 kB 00:00 2023-10-26T06:29:33.088 INFO:teuthology.orchestra.run.smithi050.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 235 kB/s | 25 kB 00:00 2023-10-26T06:29:33.113 INFO:teuthology.orchestra.run.smithi050.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 990 kB/s | 49 kB 00:00 2023-10-26T06:29:33.131 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-26T06:29:33.138 INFO:teuthology.orchestra.run.smithi050.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 601 kB/s | 94 kB 00:00 2023-10-26T06:29:33.180 INFO:teuthology.orchestra.run.smithi050.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.6 MB/s | 524 kB 00:00 2023-10-26T06:29:33.206 INFO:teuthology.orchestra.run.smithi050.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-10-26T06:29:33.240 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-26T06:29:33.248 INFO:teuthology.orchestra.run.smithi050.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.1 MB/s | 213 kB 00:00 2023-10-26T06:29:33.319 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-26T06:29:33.373 INFO:teuthology.orchestra.run.smithi050.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 18 MB/s | 2.2 MB 00:00 2023-10-26T06:29:33.476 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-26T06:29:33.532 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-26T06:29:33.540 INFO:teuthology.orchestra.run.smithi050.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 21 MB/s | 7.0 MB 00:00 2023-10-26T06:29:33.641 INFO:teuthology.orchestra.run.smithi050.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 15 MB/s | 8.0 MB 00:00 2023-10-26T06:29:33.641 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:29:33.642 INFO:teuthology.orchestra.run.smithi050.stdout:Total 28 MB/s | 18 MB 00:00 2023-10-26T06:29:33.680 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-26T06:29:33.727 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-26T06:29:33.925 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-26T06:29:33.954 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-26T06:29:33.988 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-26T06:29:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-26T06:29:34.013 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-26T06:29:34.169 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-26T06:29:34.286 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-26T06:29:34.504 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-26T06:29:34.509 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-26T06:29:34.553 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-26T06:29:35.066 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-26T06:29:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-26T06:29:35.289 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-26T06:29:35.318 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-26T06:29:35.466 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-26T06:29:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-26T06:29:35.942 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-26T06:29:35.943 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-26T06:29:36.176 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-26T06:29:36.293 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-26T06:29:36.339 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-26T06:29:36.345 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-26T06:29:36.541 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-26T06:29:36.593 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-26T06:29:36.815 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-26T06:29:36.815 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-26T06:29:36.815 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-26T06:29:36.815 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-26T06:29:36.816 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-26T06:29:36.816 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-26T06:29:36.816 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-26T06:29:36.816 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-26T06:29:36.816 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-26T06:29:36.816 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-26T06:29:36.821 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-26T06:29:37.048 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-26T06:29:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-26T06:29:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-26T06:29:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-26T06:29:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-26T06:29:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-26T06:29:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-26T06:29:37.345 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-26T06:29:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-26T06:29:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-26T06:29:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-26T06:29:37.346 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-26T06:29:38.068 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-26T06:29:38.068 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:05:18 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-26T06:29:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-26T06:29:38.541 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-26T06:29:38.541 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:05:19 ago on Thu 26 Oct 2023 06:24:19 AM UTC. 2023-10-26T06:29:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-26T06:29:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-26T06:29:39.265 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-26T06:29:39.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-26T06:29:39.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-26T06:29:39.266 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-26T06:29:39.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-26T06:29:39.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-26T06:29:39.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-26T06:29:39.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-26T06:29:39.267 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-26T06:29:39.268 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-26T06:29:40.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-26T06:29:40.789 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:07 ago on Thu 26 Oct 2023 06:27:33 AM UTC. 2023-10-26T06:29:40.823 INFO:teuthology.orchestra.run.smithi125.stdout:Installed products updated. 2023-10-26T06:29:41.030 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:41.030 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-26T06:29:41.031 INFO:teuthology.orchestra.run.smithi125.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.031 INFO:teuthology.orchestra.run.smithi125.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-26T06:29:41.031 INFO:teuthology.orchestra.run.smithi125.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.031 INFO:teuthology.orchestra.run.smithi125.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-26T06:29:41.031 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-26T06:29:41.032 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-26T06:29:41.032 INFO:teuthology.orchestra.run.smithi125.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.032 INFO:teuthology.orchestra.run.smithi125.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.032 INFO:teuthology.orchestra.run.smithi125.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-26T06:29:41.033 INFO:teuthology.orchestra.run.smithi125.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-26T06:29:41.033 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:29:41.033 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-26T06:29:41.200 DEBUG:teuthology.parallel:result is None 2023-10-26T06:29:41.245 INFO:teuthology.orchestra.run.smithi153.stdout:Installed products updated. 2023-10-26T06:29:41.454 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:41.455 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-26T06:29:41.455 INFO:teuthology.orchestra.run.smithi153.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.456 INFO:teuthology.orchestra.run.smithi153.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-26T06:29:41.456 INFO:teuthology.orchestra.run.smithi153.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.456 INFO:teuthology.orchestra.run.smithi153.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-26T06:29:41.456 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-26T06:29:41.457 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-26T06:29:41.457 INFO:teuthology.orchestra.run.smithi153.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.457 INFO:teuthology.orchestra.run.smithi153.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:41.457 INFO:teuthology.orchestra.run.smithi153.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-26T06:29:41.457 INFO:teuthology.orchestra.run.smithi153.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-26T06:29:41.457 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:29:41.458 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-26T06:29:41.700 DEBUG:teuthology.parallel:result is None 2023-10-26T06:29:43.611 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2023-10-26T06:29:43.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:43.833 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-26T06:29:43.834 INFO:teuthology.orchestra.run.smithi050.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:43.834 INFO:teuthology.orchestra.run.smithi050.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-26T06:29:43.834 INFO:teuthology.orchestra.run.smithi050.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:43.834 INFO:teuthology.orchestra.run.smithi050.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-26T06:29:43.834 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-26T06:29:43.835 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-26T06:29:43.835 INFO:teuthology.orchestra.run.smithi050.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:43.835 INFO:teuthology.orchestra.run.smithi050.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-26T06:29:43.835 INFO:teuthology.orchestra.run.smithi050.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-26T06:29:43.835 INFO:teuthology.orchestra.run.smithi050.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-26T06:29:43.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:29:43.836 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-26T06:29:44.053 DEBUG:teuthology.parallel:result is None 2023-10-26T06:29:44.054 INFO:teuthology.run_tasks:Running task install... 2023-10-26T06:29:44.063 DEBUG:teuthology.task.install:project ceph 2023-10-26T06:29:44.063 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}} 2023-10-26T06:29:44.064 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'} 2023-10-26T06:29:44.064 INFO:teuthology.task.install:Using flavor: default 2023-10-26T06:29:44.070 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-26T06:29:44.070 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-26T06:29:44.071 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'tag': None, 'wait_for_package': False} 2023-10-26T06:29:44.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:29:44.073 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'tag': None, 'wait_for_package': False} 2023-10-26T06:29:44.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:29:44.075 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'tag': None, 'wait_for_package': False} 2023-10-26T06:29:44.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:29:44.233 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/ 2023-10-26T06:29:44.234 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6863.g38499368 2023-10-26T06:29:44.238 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/ 2023-10-26T06:29:44.238 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6863.g38499368 2023-10-26T06:29:44.310 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/ 2023-10-26T06:29:44.310 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6863.g38499368 2023-10-26T06:29:44.360 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-26T06:29:44.361 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:29:44.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-26T06:29:44.401 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-26T06:29:44.401 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384993681abceb8cb8affea10538d607052db4b4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-26T06:29:44.417 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-26T06:29:44.418 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:29:44.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-26T06:29:44.427 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-26T06:29:44.428 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:29:44.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-26T06:29:44.461 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-26T06:29:44.462 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384993681abceb8cb8affea10538d607052db4b4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-26T06:29:44.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-26T06:29:44.499 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-26T06:29:44.499 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384993681abceb8cb8affea10538d607052db4b4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-26T06:29:44.528 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-26T06:29:44.546 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-26T06:29:44.606 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-26T06:29:44.611 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-26T06:29:44.612 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2023-10-26T06:29:44.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2023-10-26T06:29:44.670 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2023-10-26T06:29:44.672 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2023-10-26T06:29:44.709 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-26T06:29:44.779 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-10-26T06:29:44.782 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-10-26T06:29:45.003 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:45.069 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:45.268 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:45.290 INFO:teuthology.orchestra.run.smithi153.stdout:44 files removed 2023-10-26T06:29:45.345 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-26T06:29:45.350 INFO:teuthology.orchestra.run.smithi125.stdout:44 files removed 2023-10-26T06:29:45.404 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-26T06:29:45.585 INFO:teuthology.orchestra.run.smithi050.stdout:44 files removed 2023-10-26T06:29:45.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-26T06:29:45.696 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:45.796 INFO:teuthology.orchestra.run.smithi125.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:46.121 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2023-10-26T06:29:46.620 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 150 kB/s | 81 kB 00:00 2023-10-26T06:29:46.639 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 187 kB/s | 81 kB 00:00 2023-10-26T06:29:46.974 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-10-26T06:29:46.986 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 212 kB/s | 81 kB 00:00 2023-10-26T06:29:46.996 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-10-26T06:29:47.233 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 6.3 kB/s | 1.5 kB 00:00 2023-10-26T06:29:47.295 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-26T06:29:47.397 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-26T06:29:47.400 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-26T06:29:47.589 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-26T06:29:47.629 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 4.8 kB/s | 1.5 kB 00:00 2023-10-26T06:29:47.779 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-26T06:29:48.880 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-26T06:29:51.608 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 16 MB 00:04 2023-10-26T06:29:52.549 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 16 MB 00:04 2023-10-26T06:29:53.290 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-10-26T06:29:54.366 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-10-26T06:29:55.169 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 409 kB/s | 24 kB 00:00 2023-10-26T06:29:56.088 INFO:teuthology.orchestra.run.smithi125.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-26T06:29:56.218 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 467 kB/s | 24 kB 00:00 2023-10-26T06:29:57.237 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 56 MB/s | 53 MB 00:00 2023-10-26T06:30:03.560 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-10-26T06:30:03.938 INFO:teuthology.orchestra.run.smithi125.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-10-26T06:30:05.387 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-26T06:30:15.095 INFO:teuthology.orchestra.run.smithi125.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-26T06:30:15.096 INFO:teuthology.orchestra.run.smithi125.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-26T06:30:15.110 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-26T06:30:15.111 INFO:teuthology.orchestra.run.smithi125.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-26T06:30:15.112 INFO:teuthology.orchestra.run.smithi125.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-26T06:30:15.113 INFO:teuthology.orchestra.run.smithi125.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-26T06:30:15.115 INFO:teuthology.orchestra.run.smithi125.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-26T06:30:15.119 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-26T06:30:15.120 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-26T06:30:15.254 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-26T06:30:15.266 INFO:teuthology.orchestra.run.smithi125.stdout:=========================================================================================================================== 2023-10-26T06:30:15.266 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-10-26T06:30:15.266 INFO:teuthology.orchestra.run.smithi125.stdout:=========================================================================================================================== 2023-10-26T06:30:15.267 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-10-26T06:30:15.267 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-26T06:30:15.267 INFO:teuthology.orchestra.run.smithi125.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-26T06:30:15.267 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.4 k 2023-10-26T06:30:15.267 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:18.0.0-6863.g38499368.el8 ceph 5.4 M 2023-10-26T06:30:15.268 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 918 k 2023-10-26T06:30:15.268 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6863.g38499368.el8 ceph 167 k 2023-10-26T06:30:15.268 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:18.0.0-6863.g38499368.el8 ceph 1.6 M 2023-10-26T06:30:15.268 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 132 k 2023-10-26T06:30:15.269 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 1.8 M 2023-10-26T06:30:15.269 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 7.4 M 2023-10-26T06:30:15.269 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 48 k 2023-10-26T06:30:15.269 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 14 M 2023-10-26T06:30:15.269 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:18.0.0-6863.g38499368.el8 ceph 49 M 2023-10-26T06:30:15.269 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 261 k 2023-10-26T06:30:15.270 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 191 k 2023-10-26T06:30:15.270 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 261 k 2023-10-26T06:30:15.270 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 18 k 2023-10-26T06:30:15.270 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-26T06:30:15.270 INFO:teuthology.orchestra.run.smithi125.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-26T06:30:15.271 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-26T06:30:15.271 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 31 k 2023-10-26T06:30:15.271 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 840 k 2023-10-26T06:30:15.271 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 139 k 2023-10-26T06:30:15.272 INFO:teuthology.orchestra.run.smithi125.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-26T06:30:15.272 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-26T06:30:15.272 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-26T06:30:15.272 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-26T06:30:15.272 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-26T06:30:15.273 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-26T06:30:15.273 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:18.0.0-6863.g38499368.el8 ceph 197 k 2023-10-26T06:30:15.273 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:18.0.0-6863.g38499368.el8 ceph 371 k 2023-10-26T06:30:15.273 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 364 k 2023-10-26T06:30:15.273 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 107 k 2023-10-26T06:30:15.273 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 94 k 2023-10-26T06:30:15.274 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.6 M 2023-10-26T06:30:15.274 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 179 k 2023-10-26T06:30:15.274 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-26T06:30:15.274 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2023-10-26T06:30:15.275 INFO:teuthology.orchestra.run.smithi125.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-26T06:30:15.275 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-26T06:30:15.275 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-26T06:30:15.275 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-26T06:30:15.275 INFO:teuthology.orchestra.run.smithi125.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-26T06:30:15.275 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 23 M 2023-10-26T06:30:15.276 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 23 k 2023-10-26T06:30:15.276 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:18.0.0-6863.g38499368.el8 ceph 2.3 M 2023-10-26T06:30:15.276 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 242 k 2023-10-26T06:30:15.276 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:18.0.0-6863.g38499368.el8 ceph 4.6 M 2023-10-26T06:30:15.276 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:18.0.0-6863.g38499368.el8 ceph 18 M 2023-10-26T06:30:15.277 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 15 k 2023-10-26T06:30:15.277 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:18.0.0-6863.g38499368.el8 ceph 24 k 2023-10-26T06:30:15.277 INFO:teuthology.orchestra.run.smithi125.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-26T06:30:15.277 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-26T06:30:15.277 INFO:teuthology.orchestra.run.smithi125.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-26T06:30:15.278 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-26T06:30:15.278 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-26T06:30:15.278 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:18.0.0-6863.g38499368.el8 ceph 184 k 2023-10-26T06:30:15.278 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-26T06:30:15.278 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-26T06:30:15.279 INFO:teuthology.orchestra.run.smithi125.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-26T06:30:15.279 INFO:teuthology.orchestra.run.smithi125.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-26T06:30:15.279 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-26T06:30:15.279 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-26T06:30:15.279 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 518 k 2023-10-26T06:30:15.280 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-26T06:30:15.280 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.9 M 2023-10-26T06:30:15.280 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-26T06:30:15.280 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-26T06:30:15.280 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-26T06:30:15.280 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-26T06:30:15.281 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-26T06:30:15.281 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-26T06:30:15.281 INFO:teuthology.orchestra.run.smithi125.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-26T06:30:15.281 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-26T06:30:15.281 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-26T06:30:15.282 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-26T06:30:15.282 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-26T06:30:15.282 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-26T06:30:15.282 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-26T06:30:15.282 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-26T06:30:15.283 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-26T06:30:15.283 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-26T06:30:15.283 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:18.0.0-6863.g38499368.el8 ceph 45 k 2023-10-26T06:30:15.283 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 125 k 2023-10-26T06:30:15.283 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-26T06:30:15.283 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-26T06:30:15.284 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-26T06:30:15.284 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-26T06:30:15.284 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-26T06:30:15.284 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-26T06:30:15.284 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-26T06:30:15.285 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-26T06:30:15.285 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-26T06:30:15.285 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-26T06:30:15.285 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-26T06:30:15.285 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-26T06:30:15.286 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-26T06:30:15.286 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-26T06:30:15.286 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-26T06:30:15.286 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-26T06:30:15.286 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-26T06:30:15.287 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-26T06:30:15.287 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-26T06:30:15.287 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-26T06:30:15.287 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-26T06:30:15.287 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-26T06:30:15.288 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-26T06:30:15.288 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-26T06:30:15.288 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-26T06:30:15.288 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-26T06:30:15.288 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-26T06:30:15.288 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-26T06:30:15.289 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-26T06:30:15.289 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-26T06:30:15.289 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-26T06:30:15.289 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-26T06:30:15.289 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-26T06:30:15.290 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-26T06:30:15.290 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-26T06:30:15.290 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-26T06:30:15.290 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-26T06:30:15.290 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-26T06:30:15.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-26T06:30:15.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-26T06:30:15.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-26T06:30:15.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-26T06:30:15.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-26T06:30:15.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-26T06:30:15.292 INFO:teuthology.orchestra.run.smithi125.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-26T06:30:15.292 INFO:teuthology.orchestra.run.smithi125.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-26T06:30:15.292 INFO:teuthology.orchestra.run.smithi125.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-26T06:30:15.292 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-26T06:30:15.292 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-26T06:30:15.293 INFO:teuthology.orchestra.run.smithi125.stdout:Enabling module streams: 2023-10-26T06:30:15.293 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql 10 2023-10-26T06:30:15.293 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:30:15.293 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-26T06:30:15.293 INFO:teuthology.orchestra.run.smithi125.stdout:=========================================================================================================================== 2023-10-26T06:30:15.293 INFO:teuthology.orchestra.run.smithi125.stdout:Install 128 Packages 2023-10-26T06:30:15.294 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 3 Packages 2023-10-26T06:30:15.294 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:30:15.295 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 209 M 2023-10-26T06:30:15.295 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-26T06:30:15.456 INFO:teuthology.orchestra.run.smithi125.stdout:(1/131): ceph-18.0.0-6863.g38499368.el8.x86_64. 53 kB/s | 6.4 kB 00:00 2023-10-26T06:30:15.656 INFO:teuthology.orchestra.run.smithi125.stdout:(2/131): ceph-fuse-18.0.0-6863.g38499368.el8.x8 4.5 MB/s | 918 kB 00:00 2023-10-26T06:30:15.723 INFO:teuthology.orchestra.run.smithi125.stdout:(3/131): ceph-immutable-object-cache-18.0.0-686 2.5 MB/s | 167 kB 00:00 2023-10-26T06:30:15.873 INFO:teuthology.orchestra.run.smithi125.stdout:(4/131): ceph-base-18.0.0-6863.g38499368.el8.x8 10 MB/s | 5.4 MB 00:00 2023-10-26T06:30:15.945 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-26T06:30:15.946 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-26T06:30:15.962 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-26T06:30:15.963 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-26T06:30:15.965 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-26T06:30:15.966 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-26T06:30:15.969 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-26T06:30:15.972 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-26T06:30:15.973 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-26T06:30:15.990 INFO:teuthology.orchestra.run.smithi125.stdout:(5/131): ceph-mds-18.0.0-6863.g38499368.el8.x86 8.7 MB/s | 2.3 MB 00:00 2023-10-26T06:30:16.041 INFO:teuthology.orchestra.run.smithi125.stdout:(6/131): ceph-mgr-18.0.0-6863.g38499368.el8.x86 9.7 MB/s | 1.6 MB 00:00 2023-10-26T06:30:16.126 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-10-26T06:30:16.140 INFO:teuthology.orchestra.run.smithi050.stdout:=========================================================================================================================== 2023-10-26T06:30:16.140 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-10-26T06:30:16.141 INFO:teuthology.orchestra.run.smithi050.stdout:=========================================================================================================================== 2023-10-26T06:30:16.141 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-10-26T06:30:16.141 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-26T06:30:16.141 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-26T06:30:16.141 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.4 k 2023-10-26T06:30:16.142 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:18.0.0-6863.g38499368.el8 ceph 5.4 M 2023-10-26T06:30:16.142 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 918 k 2023-10-26T06:30:16.142 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6863.g38499368.el8 ceph 167 k 2023-10-26T06:30:16.142 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:18.0.0-6863.g38499368.el8 ceph 1.6 M 2023-10-26T06:30:16.143 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 132 k 2023-10-26T06:30:16.143 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 1.8 M 2023-10-26T06:30:16.143 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 7.4 M 2023-10-26T06:30:16.143 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 48 k 2023-10-26T06:30:16.143 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 14 M 2023-10-26T06:30:16.144 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:18.0.0-6863.g38499368.el8 ceph 49 M 2023-10-26T06:30:16.144 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 261 k 2023-10-26T06:30:16.144 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 191 k 2023-10-26T06:30:16.144 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 261 k 2023-10-26T06:30:16.144 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 18 k 2023-10-26T06:30:16.145 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-26T06:30:16.145 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-26T06:30:16.145 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-26T06:30:16.145 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 31 k 2023-10-26T06:30:16.145 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 840 k 2023-10-26T06:30:16.145 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 139 k 2023-10-26T06:30:16.146 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-26T06:30:16.146 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-26T06:30:16.146 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-26T06:30:16.146 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-26T06:30:16.146 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-26T06:30:16.147 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-26T06:30:16.147 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:18.0.0-6863.g38499368.el8 ceph 197 k 2023-10-26T06:30:16.147 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:18.0.0-6863.g38499368.el8 ceph 371 k 2023-10-26T06:30:16.147 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 364 k 2023-10-26T06:30:16.147 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 107 k 2023-10-26T06:30:16.148 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 94 k 2023-10-26T06:30:16.148 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.6 M 2023-10-26T06:30:16.148 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 179 k 2023-10-26T06:30:16.148 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-26T06:30:16.148 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-10-26T06:30:16.149 INFO:teuthology.orchestra.run.smithi050.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-26T06:30:16.149 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-26T06:30:16.149 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-26T06:30:16.149 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-10-26T06:30:16.150 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-26T06:30:16.150 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 23 M 2023-10-26T06:30:16.150 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 23 k 2023-10-26T06:30:16.150 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:18.0.0-6863.g38499368.el8 ceph 2.3 M 2023-10-26T06:30:16.150 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 242 k 2023-10-26T06:30:16.151 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:18.0.0-6863.g38499368.el8 ceph 4.6 M 2023-10-26T06:30:16.151 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:18.0.0-6863.g38499368.el8 ceph 18 M 2023-10-26T06:30:16.151 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 15 k 2023-10-26T06:30:16.151 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:18.0.0-6863.g38499368.el8 ceph 24 k 2023-10-26T06:30:16.151 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-26T06:30:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-26T06:30:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-26T06:30:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-26T06:30:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-26T06:30:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:18.0.0-6863.g38499368.el8 ceph 184 k 2023-10-26T06:30:16.152 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-26T06:30:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-26T06:30:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-26T06:30:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-26T06:30:16.153 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-26T06:30:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-26T06:30:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 518 k 2023-10-26T06:30:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-26T06:30:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.9 M 2023-10-26T06:30:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-26T06:30:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-26T06:30:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-26T06:30:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-26T06:30:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-26T06:30:16.155 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-26T06:30:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-26T06:30:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-26T06:30:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-26T06:30:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-26T06:30:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-26T06:30:16.156 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-26T06:30:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-26T06:30:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-26T06:30:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-26T06:30:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-26T06:30:16.157 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:18.0.0-6863.g38499368.el8 ceph 45 k 2023-10-26T06:30:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 125 k 2023-10-26T06:30:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-26T06:30:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-26T06:30:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-26T06:30:16.158 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-26T06:30:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-26T06:30:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-26T06:30:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-26T06:30:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-26T06:30:16.159 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-26T06:30:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-26T06:30:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-26T06:30:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-26T06:30:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-26T06:30:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-26T06:30:16.160 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-26T06:30:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-26T06:30:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-26T06:30:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-26T06:30:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-26T06:30:16.161 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-26T06:30:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-26T06:30:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-26T06:30:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-26T06:30:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-26T06:30:16.162 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-26T06:30:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-26T06:30:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-26T06:30:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-26T06:30:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-26T06:30:16.163 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-26T06:30:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-26T06:30:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-26T06:30:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-26T06:30:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-26T06:30:16.164 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-26T06:30:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-26T06:30:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-26T06:30:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-26T06:30:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-26T06:30:16.165 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-26T06:30:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-26T06:30:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-26T06:30:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-26T06:30:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-26T06:30:16.166 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-26T06:30:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-26T06:30:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-26T06:30:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-26T06:30:16.167 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-26T06:30:16.167 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling module streams: 2023-10-26T06:30:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql 10 2023-10-26T06:30:16.168 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:30:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-10-26T06:30:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:=========================================================================================================================== 2023-10-26T06:30:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Install 128 Packages 2023-10-26T06:30:16.168 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 3 Packages 2023-10-26T06:30:16.169 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:30:16.169 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 209 M 2023-10-26T06:30:16.170 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-10-26T06:30:16.361 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-26T06:30:16.362 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-26T06:30:16.376 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-26T06:30:16.377 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-26T06:30:16.378 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-26T06:30:16.379 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-26T06:30:16.381 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-26T06:30:16.384 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-26T06:30:16.386 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-26T06:30:16.441 INFO:teuthology.orchestra.run.smithi125.stdout:(7/131): ceph-mon-18.0.0-6863.g38499368.el8.x86 10 MB/s | 4.6 MB 00:00 2023-10-26T06:30:16.510 INFO:teuthology.orchestra.run.smithi050.stdout:(1/131): ceph-18.0.0-6863.g38499368.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-26T06:30:16.514 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-26T06:30:16.526 INFO:teuthology.orchestra.run.smithi153.stdout:=========================================================================================================================== 2023-10-26T06:30:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-26T06:30:16.527 INFO:teuthology.orchestra.run.smithi153.stdout:=========================================================================================================================== 2023-10-26T06:30:16.527 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-26T06:30:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-26T06:30:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-26T06:30:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.4 k 2023-10-26T06:30:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.0.0-6863.g38499368.el8 ceph 5.4 M 2023-10-26T06:30:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 918 k 2023-10-26T06:30:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6863.g38499368.el8 ceph 167 k 2023-10-26T06:30:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.0.0-6863.g38499368.el8 ceph 1.6 M 2023-10-26T06:30:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 132 k 2023-10-26T06:30:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 1.8 M 2023-10-26T06:30:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 7.4 M 2023-10-26T06:30:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 48 k 2023-10-26T06:30:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 14 M 2023-10-26T06:30:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.0.0-6863.g38499368.el8 ceph 49 M 2023-10-26T06:30:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 261 k 2023-10-26T06:30:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 191 k 2023-10-26T06:30:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 261 k 2023-10-26T06:30:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 18 k 2023-10-26T06:30:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-26T06:30:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-26T06:30:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-26T06:30:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 31 k 2023-10-26T06:30:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 840 k 2023-10-26T06:30:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 139 k 2023-10-26T06:30:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-26T06:30:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-26T06:30:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-26T06:30:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-26T06:30:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-26T06:30:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-26T06:30:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.0.0-6863.g38499368.el8 ceph 197 k 2023-10-26T06:30:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.0.0-6863.g38499368.el8 ceph 371 k 2023-10-26T06:30:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 364 k 2023-10-26T06:30:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 107 k 2023-10-26T06:30:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 94 k 2023-10-26T06:30:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.6 M 2023-10-26T06:30:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 179 k 2023-10-26T06:30:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-26T06:30:16.535 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2023-10-26T06:30:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-26T06:30:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-26T06:30:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-26T06:30:16.535 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-26T06:30:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-26T06:30:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 23 M 2023-10-26T06:30:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 23 k 2023-10-26T06:30:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.0.0-6863.g38499368.el8 ceph 2.3 M 2023-10-26T06:30:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 242 k 2023-10-26T06:30:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.0.0-6863.g38499368.el8 ceph 4.6 M 2023-10-26T06:30:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.0.0-6863.g38499368.el8 ceph 18 M 2023-10-26T06:30:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 15 k 2023-10-26T06:30:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.0.0-6863.g38499368.el8 ceph 24 k 2023-10-26T06:30:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-26T06:30:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-26T06:30:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-26T06:30:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-26T06:30:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-26T06:30:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.0.0-6863.g38499368.el8 ceph 184 k 2023-10-26T06:30:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-26T06:30:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-26T06:30:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-26T06:30:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-26T06:30:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-26T06:30:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-26T06:30:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 518 k 2023-10-26T06:30:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-26T06:30:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.9 M 2023-10-26T06:30:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-26T06:30:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-26T06:30:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-26T06:30:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-26T06:30:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-26T06:30:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-26T06:30:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-26T06:30:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-26T06:30:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-26T06:30:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-26T06:30:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-26T06:30:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-26T06:30:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-26T06:30:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-26T06:30:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-26T06:30:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-26T06:30:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:18.0.0-6863.g38499368.el8 ceph 45 k 2023-10-26T06:30:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 125 k 2023-10-26T06:30:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-26T06:30:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-26T06:30:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-26T06:30:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-26T06:30:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-26T06:30:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-26T06:30:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-26T06:30:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-26T06:30:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-26T06:30:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-26T06:30:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-26T06:30:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-26T06:30:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-26T06:30:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-26T06:30:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-26T06:30:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-26T06:30:16.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-26T06:30:16.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-26T06:30:16.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-26T06:30:16.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-26T06:30:16.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-26T06:30:16.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-26T06:30:16.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-26T06:30:16.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-26T06:30:16.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-26T06:30:16.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-26T06:30:16.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-26T06:30:16.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-26T06:30:16.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-26T06:30:16.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-26T06:30:16.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-26T06:30:16.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-26T06:30:16.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-26T06:30:16.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-26T06:30:16.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-26T06:30:16.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-26T06:30:16.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-26T06:30:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-26T06:30:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-26T06:30:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-26T06:30:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-26T06:30:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-26T06:30:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-26T06:30:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-26T06:30:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-26T06:30:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-26T06:30:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-26T06:30:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-26T06:30:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-26T06:30:16.553 INFO:teuthology.orchestra.run.smithi153.stdout:Enabling module streams: 2023-10-26T06:30:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql 10 2023-10-26T06:30:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:30:16.554 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-26T06:30:16.554 INFO:teuthology.orchestra.run.smithi153.stdout:=========================================================================================================================== 2023-10-26T06:30:16.554 INFO:teuthology.orchestra.run.smithi153.stdout:Install 128 Packages 2023-10-26T06:30:16.554 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 3 Packages 2023-10-26T06:30:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:30:16.555 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 209 M 2023-10-26T06:30:16.555 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-26T06:30:17.015 INFO:teuthology.orchestra.run.smithi153.stdout:(1/131): ceph-18.0.0-6863.g38499368.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-26T06:30:17.516 INFO:teuthology.orchestra.run.smithi125.stdout:(8/131): ceph-osd-18.0.0-6863.g38499368.el8.x86 12 MB/s | 18 MB 00:01 2023-10-26T06:30:17.591 INFO:teuthology.orchestra.run.smithi125.stdout:(9/131): ceph-selinux-18.0.0-6863.g38499368.el8 325 kB/s | 24 kB 00:00 2023-10-26T06:30:17.871 INFO:teuthology.orchestra.run.smithi153.stdout:(2/131): ceph-fuse-18.0.0-6863.g38499368.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-26T06:30:17.975 INFO:teuthology.orchestra.run.smithi125.stdout:(10/131): ceph-radosgw-18.0.0-6863.g38499368.el 9.1 MB/s | 14 MB 00:01 2023-10-26T06:30:18.004 INFO:teuthology.orchestra.run.smithi153.stdout:(3/131): ceph-immutable-object-cache-18.0.0-686 1.2 MB/s | 167 kB 00:00 2023-10-26T06:30:18.042 INFO:teuthology.orchestra.run.smithi125.stdout:(11/131): cephfs-mirror-18.0.0-6863.g38499368.e 3.8 MB/s | 261 kB 00:00 2023-10-26T06:30:18.108 INFO:teuthology.orchestra.run.smithi125.stdout:(12/131): libcephfs-devel-18.0.0-6863.g38499368 466 kB/s | 31 kB 00:00 2023-10-26T06:30:18.205 INFO:teuthology.orchestra.run.smithi153.stdout:(4/131): ceph-base-18.0.0-6863.g38499368.el8.x8 3.6 MB/s | 5.4 MB 00:01 2023-10-26T06:30:18.242 INFO:teuthology.orchestra.run.smithi125.stdout:(13/131): libcephfs2-18.0.0-6863.g38499368.el8. 6.2 MB/s | 840 kB 00:00 2023-10-26T06:30:18.326 INFO:teuthology.orchestra.run.smithi125.stdout:(14/131): libcephsqlite-18.0.0-6863.g38499368.e 2.2 MB/s | 184 kB 00:00 2023-10-26T06:30:18.396 INFO:teuthology.orchestra.run.smithi050.stdout:(2/131): ceph-base-18.0.0-6863.g38499368.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-10-26T06:30:18.401 INFO:teuthology.orchestra.run.smithi125.stdout:(15/131): librados-devel-18.0.0-6863.g38499368. 1.8 MB/s | 139 kB 00:00 2023-10-26T06:30:18.439 INFO:teuthology.orchestra.run.smithi153.stdout:(5/131): ceph-mgr-18.0.0-6863.g38499368.el8.x86 7.0 MB/s | 1.6 MB 00:00 2023-10-26T06:30:18.452 INFO:teuthology.orchestra.run.smithi050.stdout:(3/131): ceph-immutable-object-cache-18.0.0-686 2.9 MB/s | 167 kB 00:00 2023-10-26T06:30:18.485 INFO:teuthology.orchestra.run.smithi125.stdout:(16/131): libradosstriper1-18.0.0-6863.g3849936 6.1 MB/s | 518 kB 00:00 2023-10-26T06:30:19.127 INFO:teuthology.orchestra.run.smithi050.stdout:(4/131): ceph-mds-18.0.0-6863.g38499368.el8.x86 3.4 MB/s | 2.3 MB 00:00 2023-10-26T06:30:19.181 INFO:teuthology.orchestra.run.smithi153.stdout:(6/131): ceph-mds-18.0.0-6863.g38499368.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-10-26T06:30:19.236 INFO:teuthology.orchestra.run.smithi050.stdout:(5/131): ceph-fuse-18.0.0-6863.g38499368.el8.x8 337 kB/s | 918 kB 00:02 2023-10-26T06:30:19.281 INFO:teuthology.orchestra.run.smithi153.stdout:(7/131): ceph-mon-18.0.0-6863.g38499368.el8.x86 5.5 MB/s | 4.6 MB 00:00 2023-10-26T06:30:19.469 INFO:teuthology.orchestra.run.smithi125.stdout:(17/131): librgw2-18.0.0-6863.g38499368.el8.x86 7.0 MB/s | 6.9 MB 00:00 2023-10-26T06:30:19.536 INFO:teuthology.orchestra.run.smithi050.stdout:(6/131): ceph-mgr-18.0.0-6863.g38499368.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-10-26T06:30:19.544 INFO:teuthology.orchestra.run.smithi125.stdout:(18/131): python3-ceph-argparse-18.0.0-6863.g38 594 kB/s | 45 kB 00:00 2023-10-26T06:30:19.619 INFO:teuthology.orchestra.run.smithi125.stdout:(19/131): python3-ceph-common-18.0.0-6863.g3849 1.6 MB/s | 125 kB 00:00 2023-10-26T06:30:19.703 INFO:teuthology.orchestra.run.smithi125.stdout:(20/131): python3-cephfs-18.0.0-6863.g38499368. 2.3 MB/s | 197 kB 00:00 2023-10-26T06:30:19.803 INFO:teuthology.orchestra.run.smithi125.stdout:(21/131): python3-rados-18.0.0-6863.g38499368.e 3.6 MB/s | 371 kB 00:00 2023-10-26T06:30:19.904 INFO:teuthology.orchestra.run.smithi125.stdout:(22/131): python3-rbd-18.0.0-6863.g38499368.el8 3.6 MB/s | 364 kB 00:00 2023-10-26T06:30:20.004 INFO:teuthology.orchestra.run.smithi125.stdout:(23/131): python3-rgw-18.0.0-6863.g38499368.el8 1.0 MB/s | 107 kB 00:00 2023-10-26T06:30:20.096 INFO:teuthology.orchestra.run.smithi125.stdout:(24/131): rbd-fuse-18.0.0-6863.g38499368.el8.x8 1.0 MB/s | 94 kB 00:00 2023-10-26T06:30:20.771 INFO:teuthology.orchestra.run.smithi125.stdout:(25/131): rbd-mirror-18.0.0-6863.g38499368.el8. 5.3 MB/s | 3.6 MB 00:00 2023-10-26T06:30:20.863 INFO:teuthology.orchestra.run.smithi125.stdout:(26/131): rbd-nbd-18.0.0-6863.g38499368.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-26T06:30:20.971 INFO:teuthology.orchestra.run.smithi125.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6863.g 213 kB/s | 23 kB 00:00 2023-10-26T06:30:21.047 INFO:teuthology.orchestra.run.smithi125.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6863.g3849936 1.7 MB/s | 132 kB 00:00 2023-10-26T06:30:21.315 INFO:teuthology.orchestra.run.smithi153.stdout:(8/131): ceph-radosgw-18.0.0-6863.g38499368.el8 6.8 MB/s | 14 MB 00:02 2023-10-26T06:30:21.364 INFO:teuthology.orchestra.run.smithi125.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6863.g38499 5.6 MB/s | 1.8 MB 00:00 2023-10-26T06:30:21.381 INFO:teuthology.orchestra.run.smithi153.stdout:(9/131): ceph-selinux-18.0.0-6863.g38499368.el8 367 kB/s | 24 kB 00:00 2023-10-26T06:30:22.739 INFO:teuthology.orchestra.run.smithi125.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 5.4 MB/s | 7.4 MB 00:01 2023-10-26T06:30:22.847 INFO:teuthology.orchestra.run.smithi125.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6863.g38 2.2 MB/s | 242 kB 00:00 2023-10-26T06:30:22.964 INFO:teuthology.orchestra.run.smithi125.stdout:(32/131): ceph-mgr-rook-18.0.0-6863.g38499368.e 408 kB/s | 48 kB 00:00 2023-10-26T06:30:23.057 INFO:teuthology.orchestra.run.smithi125.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6863.g3 163 kB/s | 15 kB 00:00 2023-10-26T06:30:23.157 INFO:teuthology.orchestra.run.smithi125.stdout:(34/131): ceph-volume-18.0.0-6863.g38499368.el8 2.6 MB/s | 261 kB 00:00 2023-10-26T06:30:23.257 INFO:teuthology.orchestra.run.smithi125.stdout:(35/131): cephadm-18.0.0-6863.g38499368.el8.noa 1.9 MB/s | 191 kB 00:00 2023-10-26T06:30:23.341 INFO:teuthology.orchestra.run.smithi125.stdout:(36/131): cephfs-top-18.0.0-6863.g38499368.el8. 217 kB/s | 18 kB 00:00 2023-10-26T06:30:23.766 INFO:teuthology.orchestra.run.smithi125.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 721 kB/s | 306 kB 00:00 2023-10-26T06:30:23.816 INFO:teuthology.orchestra.run.smithi125.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2023-10-26T06:30:23.867 INFO:teuthology.orchestra.run.smithi125.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-10-26T06:30:23.958 INFO:teuthology.orchestra.run.smithi125.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2023-10-26T06:30:24.201 INFO:teuthology.orchestra.run.smithi125.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 180 kB/s | 44 kB 00:00 2023-10-26T06:30:24.286 INFO:teuthology.orchestra.run.smithi050.stdout:(7/131): ceph-osd-18.0.0-6863.g38499368.el8.x86 3.8 MB/s | 18 MB 00:04 2023-10-26T06:30:24.434 INFO:teuthology.orchestra.run.smithi125.stdout:(42/131): ceph-common-18.0.0-6863.g38499368.el8 2.5 MB/s | 23 MB 00:09 2023-10-26T06:30:24.576 INFO:teuthology.orchestra.run.smithi125.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 494 kB/s | 185 kB 00:00 2023-10-26T06:30:24.610 INFO:teuthology.orchestra.run.smithi125.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 490 kB/s | 16 kB 00:00 2023-10-26T06:30:24.660 INFO:teuthology.orchestra.run.smithi125.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-10-26T06:30:24.736 INFO:teuthology.orchestra.run.smithi125.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-10-26T06:30:24.786 INFO:teuthology.orchestra.run.smithi125.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-10-26T06:30:24.819 INFO:teuthology.orchestra.run.smithi125.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 332 kB/s | 11 kB 00:00 2023-10-26T06:30:24.908 INFO:teuthology.orchestra.run.smithi125.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 302 kB/s | 18 kB 00:00 2023-10-26T06:30:24.995 INFO:teuthology.orchestra.run.smithi050.stdout:(8/131): ceph-mon-18.0.0-6863.g38499368.el8.x86 823 kB/s | 4.6 MB 00:05 2023-10-26T06:30:25.095 INFO:teuthology.orchestra.run.smithi050.stdout:(9/131): ceph-selinux-18.0.0-6863.g38499368.el8 244 kB/s | 24 kB 00:00 2023-10-26T06:30:25.253 INFO:teuthology.orchestra.run.smithi125.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 3.1 MB/s | 1.2 MB 00:00 2023-10-26T06:30:25.504 INFO:teuthology.orchestra.run.smithi125.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 195 kB/s | 49 kB 00:00 2023-10-26T06:30:25.554 INFO:teuthology.orchestra.run.smithi125.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-26T06:30:25.596 INFO:teuthology.orchestra.run.smithi125.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-26T06:30:25.672 INFO:teuthology.orchestra.run.smithi153.stdout:(10/131): ceph-common-18.0.0-6863.g38499368.el8 2.5 MB/s | 23 MB 00:08 2023-10-26T06:30:25.698 INFO:teuthology.orchestra.run.smithi125.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-10-26T06:30:25.846 INFO:teuthology.orchestra.run.smithi125.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 104 kB/s | 16 kB 00:00 2023-10-26T06:30:25.865 INFO:teuthology.orchestra.run.smithi153.stdout:(11/131): cephfs-mirror-18.0.0-6863.g38499368.e 1.3 MB/s | 261 kB 00:00 2023-10-26T06:30:25.943 INFO:teuthology.orchestra.run.smithi125.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 348 kB/s | 34 kB 00:00 2023-10-26T06:30:25.973 INFO:teuthology.orchestra.run.smithi153.stdout:(12/131): libcephfs-devel-18.0.0-6863.g38499368 287 kB/s | 31 kB 00:00 2023-10-26T06:30:26.030 INFO:teuthology.orchestra.run.smithi125.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 2.2 MB/s | 196 kB 00:00 2023-10-26T06:30:26.080 INFO:teuthology.orchestra.run.smithi125.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-10-26T06:30:26.122 INFO:teuthology.orchestra.run.smithi125.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 449 kB/s | 19 kB 00:00 2023-10-26T06:30:26.156 INFO:teuthology.orchestra.run.smithi125.stdout:(60/131): python3-cachetools-3.1.1-4.el8.noarch 19 kB/s | 33 kB 00:01 2023-10-26T06:30:26.198 INFO:teuthology.orchestra.run.smithi125.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-10-26T06:30:26.231 INFO:teuthology.orchestra.run.smithi125.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-10-26T06:30:26.257 INFO:teuthology.orchestra.run.smithi125.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 471 kB/s | 27 kB 00:00 2023-10-26T06:30:26.308 INFO:teuthology.orchestra.run.smithi125.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-10-26T06:30:26.350 INFO:teuthology.orchestra.run.smithi125.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-26T06:30:26.375 INFO:teuthology.orchestra.run.smithi125.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 915 kB/s | 61 kB 00:00 2023-10-26T06:30:26.408 INFO:teuthology.orchestra.run.smithi125.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-10-26T06:30:26.463 INFO:teuthology.orchestra.run.smithi125.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-10-26T06:30:26.492 INFO:teuthology.orchestra.run.smithi125.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-10-26T06:30:26.565 INFO:teuthology.orchestra.run.smithi153.stdout:(13/131): libcephfs2-18.0.0-6863.g38499368.el8. 1.4 MB/s | 840 kB 00:00 2023-10-26T06:30:26.577 INFO:teuthology.orchestra.run.smithi125.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-26T06:30:26.643 INFO:teuthology.orchestra.run.smithi125.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-26T06:30:26.693 INFO:teuthology.orchestra.run.smithi125.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-26T06:30:26.732 INFO:teuthology.orchestra.run.smithi153.stdout:(14/131): libcephsqlite-18.0.0-6863.g38499368.e 1.1 MB/s | 184 kB 00:00 2023-10-26T06:30:26.736 INFO:teuthology.orchestra.run.smithi125.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-26T06:30:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-26T06:30:26.833 INFO:teuthology.orchestra.run.smithi153.stdout:(15/131): librados-devel-18.0.0-6863.g38499368. 1.4 MB/s | 139 kB 00:00 2023-10-26T06:30:26.970 INFO:teuthology.orchestra.run.smithi125.stdout:(75/131): python3-scipy-1.0.0-21.module+el8.5.0 29 MB/s | 14 MB 00:00 2023-10-26T06:30:26.986 INFO:teuthology.orchestra.run.smithi125.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 202 kB/s | 39 kB 00:00 2023-10-26T06:30:27.027 INFO:teuthology.orchestra.run.smithi125.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-26T06:30:27.062 INFO:teuthology.orchestra.run.smithi125.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-10-26T06:30:27.087 INFO:teuthology.orchestra.run.smithi125.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-26T06:30:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-26T06:30:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-26T06:30:27.149 INFO:teuthology.orchestra.run.smithi153.stdout:(16/131): libradosstriper1-18.0.0-6863.g3849936 1.6 MB/s | 518 kB 00:00 2023-10-26T06:30:27.196 INFO:teuthology.orchestra.run.smithi125.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 532 kB/s | 27 kB 00:00 2023-10-26T06:30:27.279 INFO:teuthology.orchestra.run.smithi125.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-10-26T06:30:27.304 INFO:teuthology.orchestra.run.smithi125.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2023-10-26T06:30:27.330 INFO:teuthology.orchestra.run.smithi125.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 876 kB/s | 44 kB 00:00 2023-10-26T06:30:27.380 INFO:teuthology.orchestra.run.smithi125.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-10-26T06:30:27.472 INFO:teuthology.orchestra.run.smithi125.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-10-26T06:30:27.850 INFO:teuthology.orchestra.run.smithi153.stdout:(17/131): ceph-test-18.0.0-6863.g38499368.el8.x 7.6 MB/s | 49 MB 00:06 2023-10-26T06:30:27.881 INFO:teuthology.orchestra.run.smithi125.stdout:(88/131): ceph-test-18.0.0-6863.g38499368.el8.x 4.8 MB/s | 49 MB 00:10 2023-10-26T06:30:27.906 INFO:teuthology.orchestra.run.smithi125.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 148 kB/s | 64 kB 00:00 2023-10-26T06:30:27.925 INFO:teuthology.orchestra.run.smithi153.stdout:(18/131): python3-ceph-argparse-18.0.0-6863.g38 597 kB/s | 45 kB 00:00 2023-10-26T06:30:27.964 INFO:teuthology.orchestra.run.smithi125.stdout:(90/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 385 kB/s | 225 kB 00:00 2023-10-26T06:30:27.990 INFO:teuthology.orchestra.run.smithi125.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 257 kB/s | 20 kB 00:00 2023-10-26T06:30:28.001 INFO:teuthology.orchestra.run.smithi153.stdout:(19/131): python3-ceph-common-18.0.0-6863.g3849 1.6 MB/s | 125 kB 00:00 2023-10-26T06:30:28.015 INFO:teuthology.orchestra.run.smithi125.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 945 kB/s | 126 kB 00:00 2023-10-26T06:30:28.032 INFO:teuthology.orchestra.run.smithi125.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2023-10-26T06:30:28.074 INFO:teuthology.orchestra.run.smithi125.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-10-26T06:30:28.084 INFO:teuthology.orchestra.run.smithi153.stdout:(20/131): python3-cephfs-18.0.0-6863.g38499368. 2.3 MB/s | 197 kB 00:00 2023-10-26T06:30:28.100 INFO:teuthology.orchestra.run.smithi125.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-10-26T06:30:28.149 INFO:teuthology.orchestra.run.smithi125.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-26T06:30:28.168 INFO:teuthology.orchestra.run.smithi153.stdout:(21/131): python3-rados-18.0.0-6863.g38499368.e 4.4 MB/s | 371 kB 00:00 2023-10-26T06:30:28.199 INFO:teuthology.orchestra.run.smithi125.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-26T06:30:28.275 INFO:teuthology.orchestra.run.smithi125.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 20 MB/s | 4.9 MB 00:00 2023-10-26T06:30:28.334 INFO:teuthology.orchestra.run.smithi125.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-26T06:30:28.367 INFO:teuthology.orchestra.run.smithi125.stdout:(100/131): postgresql-contrib-10.21-2.module+el 8.6 MB/s | 808 kB 00:00 2023-10-26T06:30:28.367 INFO:teuthology.orchestra.run.smithi153.stdout:(22/131): ceph-osd-18.0.0-6863.g38499368.el8.x8 2.0 MB/s | 18 MB 00:09 2023-10-26T06:30:28.393 INFO:teuthology.orchestra.run.smithi153.stdout:(23/131): python3-rbd-18.0.0-6863.g38499368.el8 1.6 MB/s | 364 kB 00:00 2023-10-26T06:30:28.401 INFO:teuthology.orchestra.run.smithi125.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-26T06:30:28.451 INFO:teuthology.orchestra.run.smithi153.stdout:(24/131): rbd-fuse-18.0.0-6863.g38499368.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-26T06:30:28.470 INFO:teuthology.orchestra.run.smithi125.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-26T06:30:28.476 INFO:teuthology.orchestra.run.smithi153.stdout:(25/131): python3-rgw-18.0.0-6863.g38499368.el8 986 kB/s | 107 kB 00:00 2023-10-26T06:30:28.493 INFO:teuthology.orchestra.run.smithi125.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.1 MB/s | 200 kB 00:00 2023-10-26T06:30:28.511 INFO:teuthology.orchestra.run.smithi050.stdout:(10/131): ceph-radosgw-18.0.0-6863.g38499368.el 3.3 MB/s | 14 MB 00:04 2023-10-26T06:30:28.518 INFO:teuthology.orchestra.run.smithi125.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-10-26T06:30:28.544 INFO:teuthology.orchestra.run.smithi125.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-26T06:30:28.569 INFO:teuthology.orchestra.run.smithi125.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 955 kB/s | 48 kB 00:00 2023-10-26T06:30:28.586 INFO:teuthology.orchestra.run.smithi125.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-26T06:30:28.611 INFO:teuthology.orchestra.run.smithi125.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-10-26T06:30:28.637 INFO:teuthology.orchestra.run.smithi125.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-26T06:30:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:(26/131): rbd-nbd-18.0.0-6863.g38499368.el8.x86 1.1 MB/s | 179 kB 00:00 2023-10-26T06:30:28.662 INFO:teuthology.orchestra.run.smithi125.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-26T06:30:28.687 INFO:teuthology.orchestra.run.smithi050.stdout:(11/131): cephfs-mirror-18.0.0-6863.g38499368.e 1.5 MB/s | 261 kB 00:00 2023-10-26T06:30:28.695 INFO:teuthology.orchestra.run.smithi125.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-26T06:30:28.712 INFO:teuthology.orchestra.run.smithi125.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-10-26T06:30:28.728 INFO:teuthology.orchestra.run.smithi153.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6863.g 277 kB/s | 23 kB 00:00 2023-10-26T06:30:28.737 INFO:teuthology.orchestra.run.smithi125.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-26T06:30:28.780 INFO:teuthology.orchestra.run.smithi125.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 8.2 MB/s | 559 kB 00:00 2023-10-26T06:30:28.788 INFO:teuthology.orchestra.run.smithi050.stdout:(12/131): libcephfs-devel-18.0.0-6863.g38499368 310 kB/s | 31 kB 00:00 2023-10-26T06:30:28.797 INFO:teuthology.orchestra.run.smithi125.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-10-26T06:30:28.863 INFO:teuthology.orchestra.run.smithi125.stdout:(116/131): postgresql-server-10.21-2.module+el8 7.6 MB/s | 5.1 MB 00:00 2023-10-26T06:30:28.897 INFO:teuthology.orchestra.run.smithi125.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-26T06:30:28.956 INFO:teuthology.orchestra.run.smithi125.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2023-10-26T06:30:28.981 INFO:teuthology.orchestra.run.smithi125.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 867 kB/s | 72 kB 00:00 2023-10-26T06:30:29.006 INFO:teuthology.orchestra.run.smithi125.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-26T06:30:29.011 INFO:teuthology.orchestra.run.smithi153.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6863.g3849936 466 kB/s | 132 kB 00:00 2023-10-26T06:30:29.029 INFO:teuthology.orchestra.run.smithi050.stdout:(13/131): ceph-common-18.0.0-6863.g38499368.el8 1.8 MB/s | 23 MB 00:12 2023-10-26T06:30:29.032 INFO:teuthology.orchestra.run.smithi125.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-26T06:30:29.057 INFO:teuthology.orchestra.run.smithi125.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-26T06:30:29.084 INFO:teuthology.orchestra.run.smithi125.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-26T06:30:29.107 INFO:teuthology.orchestra.run.smithi125.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 771 kB/s | 39 kB 00:00 2023-10-26T06:30:29.141 INFO:teuthology.orchestra.run.smithi125.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-26T06:30:29.145 INFO:teuthology.orchestra.run.smithi153.stdout:(29/131): rbd-mirror-18.0.0-6863.g38499368.el8. 5.2 MB/s | 3.6 MB 00:00 2023-10-26T06:30:29.166 INFO:teuthology.orchestra.run.smithi125.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-26T06:30:29.192 INFO:teuthology.orchestra.run.smithi125.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-26T06:30:29.192 INFO:teuthology.orchestra.run.smithi050.stdout:(14/131): libcephsqlite-18.0.0-6863.g38499368.e 1.1 MB/s | 184 kB 00:00 2023-10-26T06:30:29.230 INFO:teuthology.orchestra.run.smithi050.stdout:(15/131): libcephfs2-18.0.0-6863.g38499368.el8. 1.9 MB/s | 840 kB 00:00 2023-10-26T06:30:29.289 INFO:teuthology.orchestra.run.smithi050.stdout:(16/131): librados-devel-18.0.0-6863.g38499368. 1.4 MB/s | 139 kB 00:00 2023-10-26T06:30:29.400 INFO:teuthology.orchestra.run.smithi125.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 4.3 MB/s | 2.3 MB 00:00 2023-10-26T06:30:29.459 INFO:teuthology.orchestra.run.smithi125.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-26T06:30:29.497 INFO:teuthology.orchestra.run.smithi050.stdout:(17/131): libradosstriper1-18.0.0-6863.g3849936 1.9 MB/s | 518 kB 00:00 2023-10-26T06:30:29.597 INFO:teuthology.orchestra.run.smithi050.stdout:(18/131): python3-ceph-argparse-18.0.0-6863.g38 448 kB/s | 45 kB 00:00 2023-10-26T06:30:29.922 INFO:teuthology.orchestra.run.smithi050.stdout:(19/131): python3-ceph-common-18.0.0-6863.g3849 387 kB/s | 125 kB 00:00 2023-10-26T06:30:30.099 INFO:teuthology.orchestra.run.smithi050.stdout:(20/131): python3-cephfs-18.0.0-6863.g38499368. 1.1 MB/s | 197 kB 00:00 2023-10-26T06:30:30.331 INFO:teuthology.orchestra.run.smithi050.stdout:(21/131): python3-rados-18.0.0-6863.g38499368.e 1.6 MB/s | 371 kB 00:00 2023-10-26T06:30:30.353 INFO:teuthology.orchestra.run.smithi153.stdout:(30/131): librgw2-18.0.0-6863.g38499368.el8.x86 2.2 MB/s | 6.9 MB 00:03 2023-10-26T06:30:30.375 INFO:teuthology.orchestra.run.smithi125.stdout:(130/131): librados2-18.0.0-6863.g38499368.el8. 3.1 MB/s | 3.7 MB 00:01 2023-10-26T06:30:30.453 INFO:teuthology.orchestra.run.smithi125.stdout:(131/131): librbd1-18.0.0-6863.g38499368.el8.x8 2.9 MB/s | 3.7 MB 00:01 2023-10-26T06:30:30.456 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:30:30.456 INFO:teuthology.orchestra.run.smithi125.stdout:Total 14 MB/s | 209 MB 00:15 2023-10-26T06:30:30.490 INFO:teuthology.orchestra.run.smithi050.stdout:(22/131): python3-rbd-18.0.0-6863.g38499368.el8 2.2 MB/s | 364 kB 00:00 2023-10-26T06:30:30.528 INFO:teuthology.orchestra.run.smithi153.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6863.g38 1.4 MB/s | 242 kB 00:00 2023-10-26T06:30:30.574 INFO:teuthology.orchestra.run.smithi050.stdout:(23/131): python3-rgw-18.0.0-6863.g38499368.el8 1.3 MB/s | 107 kB 00:00 2023-10-26T06:30:30.632 INFO:teuthology.orchestra.run.smithi050.stdout:(24/131): rbd-fuse-18.0.0-6863.g38499368.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-26T06:30:30.662 INFO:teuthology.orchestra.run.smithi153.stdout:(32/131): ceph-mgr-diskprediction-local-18.0.0- 4.9 MB/s | 7.4 MB 00:01 2023-10-26T06:30:30.696 INFO:teuthology.orchestra.run.smithi153.stdout:(33/131): ceph-mgr-dashboard-18.0.0-6863.g38499 1.0 MB/s | 1.8 MB 00:01 2023-10-26T06:30:30.713 INFO:teuthology.orchestra.run.smithi153.stdout:(34/131): ceph-mgr-rook-18.0.0-6863.g38499368.e 259 kB/s | 48 kB 00:00 2023-10-26T06:30:30.729 INFO:teuthology.orchestra.run.smithi153.stdout:(35/131): ceph-prometheus-alerts-18.0.0-6863.g3 225 kB/s | 15 kB 00:00 2023-10-26T06:30:30.805 INFO:teuthology.orchestra.run.smithi153.stdout:(36/131): cephadm-18.0.0-6863.g38499368.el8.noa 2.5 MB/s | 191 kB 00:00 2023-10-26T06:30:30.822 INFO:teuthology.orchestra.run.smithi153.stdout:(37/131): cephfs-top-18.0.0-6863.g38499368.el8. 197 kB/s | 18 kB 00:00 2023-10-26T06:30:30.880 INFO:teuthology.orchestra.run.smithi153.stdout:(38/131): ceph-volume-18.0.0-6863.g38499368.el8 1.4 MB/s | 261 kB 00:00 2023-10-26T06:30:31.097 INFO:teuthology.orchestra.run.smithi153.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2023-10-26T06:30:31.163 INFO:teuthology.orchestra.run.smithi153.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 275 kB/s | 75 kB 00:00 2023-10-26T06:30:31.198 INFO:teuthology.orchestra.run.smithi153.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 780 kB/s | 306 kB 00:00 2023-10-26T06:30:31.240 INFO:teuthology.orchestra.run.smithi153.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 571 kB/s | 44 kB 00:00 2023-10-26T06:30:31.261 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-26T06:30:31.299 INFO:teuthology.orchestra.run.smithi153.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-10-26T06:30:31.315 INFO:teuthology.orchestra.run.smithi153.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2023-10-26T06:30:31.332 INFO:teuthology.orchestra.run.smithi050.stdout:(25/131): librgw2-18.0.0-6863.g38499368.el8.x86 3.4 MB/s | 6.9 MB 00:02 2023-10-26T06:30:31.379 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-26T06:30:31.379 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-26T06:30:31.382 INFO:teuthology.orchestra.run.smithi153.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 232 kB/s | 33 kB 00:00 2023-10-26T06:30:31.383 INFO:teuthology.orchestra.run.smithi050.stdout:(26/131): rbd-nbd-18.0.0-6863.g38499368.el8.x86 3.5 MB/s | 179 kB 00:00 2023-10-26T06:30:31.408 INFO:teuthology.orchestra.run.smithi153.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-26T06:30:31.425 INFO:teuthology.orchestra.run.smithi153.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-10-26T06:30:31.461 INFO:teuthology.orchestra.run.smithi050.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6863.g 295 kB/s | 23 kB 00:00 2023-10-26T06:30:31.475 INFO:teuthology.orchestra.run.smithi153.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-26T06:30:31.500 INFO:teuthology.orchestra.run.smithi153.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-10-26T06:30:31.517 INFO:teuthology.orchestra.run.smithi050.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6863.g3849936 2.4 MB/s | 132 kB 00:00 2023-10-26T06:30:31.575 INFO:teuthology.orchestra.run.smithi153.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-10-26T06:30:31.576 INFO:teuthology.orchestra.run.smithi050.stdout:(29/131): rbd-mirror-18.0.0-6863.g38499368.el8. 3.8 MB/s | 3.6 MB 00:00 2023-10-26T06:30:31.601 INFO:teuthology.orchestra.run.smithi153.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-10-26T06:30:31.643 INFO:teuthology.orchestra.run.smithi153.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 8.2 MB/s | 1.2 MB 00:00 2023-10-26T06:30:31.668 INFO:teuthology.orchestra.run.smithi153.stdout:(53/131): python3-logutils-0.3.5-11.el8.noarch. 529 kB/s | 49 kB 00:00 2023-10-26T06:30:31.693 INFO:teuthology.orchestra.run.smithi153.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 637 kB/s | 59 kB 00:00 2023-10-26T06:30:31.746 INFO:teuthology.orchestra.run.smithi153.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 586 kB/s | 60 kB 00:00 2023-10-26T06:30:31.777 INFO:teuthology.orchestra.run.smithi153.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-10-26T06:30:31.802 INFO:teuthology.orchestra.run.smithi153.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-10-26T06:30:31.827 INFO:teuthology.orchestra.run.smithi153.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 415 kB/s | 34 kB 00:00 2023-10-26T06:30:31.861 INFO:teuthology.orchestra.run.smithi153.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-26T06:30:31.886 INFO:teuthology.orchestra.run.smithi153.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 766 kB/s | 64 kB 00:00 2023-10-26T06:30:31.945 INFO:teuthology.orchestra.run.smithi153.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-10-26T06:30:31.979 INFO:teuthology.orchestra.run.smithi153.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2023-10-26T06:30:32.004 INFO:teuthology.orchestra.run.smithi153.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 249 kB/s | 29 kB 00:00 2023-10-26T06:30:32.029 INFO:teuthology.orchestra.run.smithi153.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 328 kB/s | 27 kB 00:00 2023-10-26T06:30:32.088 INFO:teuthology.orchestra.run.smithi153.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-10-26T06:30:32.155 INFO:teuthology.orchestra.run.smithi153.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 488 kB/s | 61 kB 00:00 2023-10-26T06:30:32.180 INFO:teuthology.orchestra.run.smithi153.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2023-10-26T06:30:32.198 INFO:teuthology.orchestra.run.smithi050.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6863.g38499 2.6 MB/s | 1.8 MB 00:00 2023-10-26T06:30:32.205 INFO:teuthology.orchestra.run.smithi153.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2023-10-26T06:30:32.222 INFO:teuthology.orchestra.run.smithi153.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 342 kB/s | 23 kB 00:00 2023-10-26T06:30:32.247 INFO:teuthology.orchestra.run.smithi153.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-10-26T06:30:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6863.g38 3.1 MB/s | 242 kB 00:00 2023-10-26T06:30:32.314 INFO:teuthology.orchestra.run.smithi153.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 515 kB/s | 47 kB 00:00 2023-10-26T06:30:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:(32/131): ceph-mgr-rook-18.0.0-6863.g38499368.e 959 kB/s | 48 kB 00:00 2023-10-26T06:30:32.348 INFO:teuthology.orchestra.run.smithi153.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-10-26T06:30:32.365 INFO:teuthology.orchestra.run.smithi153.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 839 kB/s | 43 kB 00:00 2023-10-26T06:30:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6863.g3 301 kB/s | 15 kB 00:00 2023-10-26T06:30:32.398 INFO:teuthology.orchestra.run.smithi153.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 7.9 MB/s | 1.7 MB 00:00 2023-10-26T06:30:32.424 INFO:teuthology.orchestra.run.smithi153.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-10-26T06:30:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 574 kB/s | 48 kB 00:00 2023-10-26T06:30:32.453 INFO:teuthology.orchestra.run.smithi050.stdout:(34/131): ceph-volume-18.0.0-6863.g38499368.el8 3.4 MB/s | 261 kB 00:00 2023-10-26T06:30:32.466 INFO:teuthology.orchestra.run.smithi153.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 1.1 MB/s | 43 kB 00:00 2023-10-26T06:30:32.519 INFO:teuthology.orchestra.run.smithi050.stdout:(35/131): cephadm-18.0.0-6863.g38499368.el8.noa 2.8 MB/s | 191 kB 00:00 2023-10-26T06:30:32.528 INFO:teuthology.orchestra.run.smithi153.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 676 kB/s | 87 kB 00:00 2023-10-26T06:30:32.531 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-26T06:30:32.536 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-26T06:30:32.566 INFO:teuthology.orchestra.run.smithi153.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 933 kB/s | 109 kB 00:00 2023-10-26T06:30:32.569 INFO:teuthology.orchestra.run.smithi050.stdout:(36/131): cephfs-top-18.0.0-6863.g38499368.el8. 363 kB/s | 18 kB 00:00 2023-10-26T06:30:32.592 INFO:teuthology.orchestra.run.smithi153.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-10-26T06:30:32.617 INFO:teuthology.orchestra.run.smithi153.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-10-26T06:30:32.642 INFO:teuthology.orchestra.run.smithi153.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-26T06:30:32.676 INFO:teuthology.orchestra.run.smithi153.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.7 MB/s | 560 kB 00:00 2023-10-26T06:30:32.678 INFO:teuthology.orchestra.run.smithi050.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.8 MB/s | 306 kB 00:00 2023-10-26T06:30:32.704 INFO:teuthology.orchestra.run.smithi050.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 2.3 MB/s | 59 kB 00:00 2023-10-26T06:30:32.743 INFO:teuthology.orchestra.run.smithi153.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 178 kB/s | 18 kB 00:00 2023-10-26T06:30:32.754 INFO:teuthology.orchestra.run.smithi050.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-10-26T06:30:32.776 INFO:teuthology.orchestra.run.smithi153.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 3.4 MB/s | 559 kB 00:00 2023-10-26T06:30:32.802 INFO:teuthology.orchestra.run.smithi153.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-26T06:30:32.804 INFO:teuthology.orchestra.run.smithi050.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 9.3 MB/s | 476 kB 00:00 2023-10-26T06:30:32.827 INFO:teuthology.orchestra.run.smithi153.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-10-26T06:30:32.830 INFO:teuthology.orchestra.run.smithi050.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.7 MB/s | 44 kB 00:00 2023-10-26T06:30:32.852 INFO:teuthology.orchestra.run.smithi153.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-26T06:30:32.872 INFO:teuthology.orchestra.run.smithi050.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2023-10-26T06:30:32.897 INFO:teuthology.orchestra.run.smithi050.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 1.3 MB/s | 33 kB 00:00 2023-10-26T06:30:32.905 INFO:teuthology.orchestra.run.smithi153.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2023-10-26T06:30:32.922 INFO:teuthology.orchestra.run.smithi050.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 655 kB/s | 16 kB 00:00 2023-10-26T06:30:32.936 INFO:teuthology.orchestra.run.smithi153.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 717 kB/s | 60 kB 00:00 2023-10-26T06:30:32.956 INFO:teuthology.orchestra.run.smithi050.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 5.1 MB/s | 173 kB 00:00 2023-10-26T06:30:32.961 INFO:teuthology.orchestra.run.smithi153.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.7 MB/s | 98 kB 00:00 2023-10-26T06:30:32.987 INFO:teuthology.orchestra.run.smithi153.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-26T06:30:32.998 INFO:teuthology.orchestra.run.smithi050.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 9.0 MB/s | 384 kB 00:00 2023-10-26T06:30:33.012 INFO:teuthology.orchestra.run.smithi153.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-10-26T06:30:33.032 INFO:teuthology.orchestra.run.smithi050.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-10-26T06:30:33.054 INFO:teuthology.orchestra.run.smithi153.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-10-26T06:30:33.096 INFO:teuthology.orchestra.run.smithi050.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 173 kB/s | 11 kB 00:00 2023-10-26T06:30:33.129 INFO:teuthology.orchestra.run.smithi153.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-10-26T06:30:33.155 INFO:teuthology.orchestra.run.smithi153.stdout:(96/131): NetworkManager-initscripts-updown-1.3 1.3 MB/s | 138 kB 00:00 2023-10-26T06:30:33.188 INFO:teuthology.orchestra.run.smithi153.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-10-26T06:30:33.191 INFO:teuthology.orchestra.run.smithi050.stdout:(49/131): ceph-mgr-diskprediction-local-18.0.0- 4.6 MB/s | 7.4 MB 00:01 2023-10-26T06:30:33.216 INFO:teuthology.orchestra.run.smithi050.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 147 kB/s | 18 kB 00:00 2023-10-26T06:30:33.230 INFO:teuthology.orchestra.run.smithi153.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.1 MB/s | 2.3 MB 00:00 2023-10-26T06:30:33.249 INFO:teuthology.orchestra.run.smithi050.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-10-26T06:30:33.255 INFO:teuthology.orchestra.run.smithi153.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 810 kB/s | 54 kB 00:00 2023-10-26T06:30:33.283 INFO:teuthology.orchestra.run.smithi050.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2023-10-26T06:30:33.317 INFO:teuthology.orchestra.run.smithi050.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2023-10-26T06:30:33.322 INFO:teuthology.orchestra.run.smithi153.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-10-26T06:30:33.356 INFO:teuthology.orchestra.run.smithi153.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-10-26T06:30:33.359 INFO:teuthology.orchestra.run.smithi050.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-10-26T06:30:33.381 INFO:teuthology.orchestra.run.smithi153.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-10-26T06:30:33.393 INFO:teuthology.orchestra.run.smithi050.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-26T06:30:33.418 INFO:teuthology.orchestra.run.smithi050.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-10-26T06:30:33.423 INFO:teuthology.orchestra.run.smithi153.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-26T06:30:33.443 INFO:teuthology.orchestra.run.smithi050.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2023-10-26T06:30:33.469 INFO:teuthology.orchestra.run.smithi050.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-10-26T06:30:33.491 INFO:teuthology.orchestra.run.smithi153.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 4.8 MB/s | 538 kB 00:00 2023-10-26T06:30:33.502 INFO:teuthology.orchestra.run.smithi050.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-26T06:30:33.524 INFO:teuthology.orchestra.run.smithi153.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-10-26T06:30:33.549 INFO:teuthology.orchestra.run.smithi153.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.2 MB/s | 187 kB 00:00 2023-10-26T06:30:33.550 INFO:teuthology.orchestra.run.smithi050.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 231 kB/s | 19 kB 00:00 2023-10-26T06:30:33.578 INFO:teuthology.orchestra.run.smithi050.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-10-26T06:30:33.582 INFO:teuthology.orchestra.run.smithi153.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-26T06:30:33.603 INFO:teuthology.orchestra.run.smithi050.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 552 kB/s | 29 kB 00:00 2023-10-26T06:30:33.616 INFO:teuthology.orchestra.run.smithi153.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 801 kB/s | 27 kB 00:00 2023-10-26T06:30:33.628 INFO:teuthology.orchestra.run.smithi050.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 551 kB/s | 27 kB 00:00 2023-10-26T06:30:33.654 INFO:teuthology.orchestra.run.smithi050.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-10-26T06:30:33.680 INFO:teuthology.orchestra.run.smithi050.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-10-26T06:30:33.689 INFO:teuthology.orchestra.run.smithi153.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 4.3 MB/s | 320 kB 00:00 2023-10-26T06:30:33.705 INFO:teuthology.orchestra.run.smithi050.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-26T06:30:33.725 INFO:teuthology.orchestra.run.smithi153.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.2 MB/s | 44 kB 00:00 2023-10-26T06:30:33.730 INFO:teuthology.orchestra.run.smithi050.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-26T06:30:33.755 INFO:teuthology.orchestra.run.smithi050.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-10-26T06:30:33.780 INFO:teuthology.orchestra.run.smithi050.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-10-26T06:30:33.817 INFO:teuthology.orchestra.run.smithi153.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-26T06:30:33.839 INFO:teuthology.orchestra.run.smithi050.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2023-10-26T06:30:33.896 INFO:teuthology.orchestra.run.smithi153.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 5.7 MB/s | 457 kB 00:00 2023-10-26T06:30:33.898 INFO:teuthology.orchestra.run.smithi050.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-10-26T06:30:33.940 INFO:teuthology.orchestra.run.smithi050.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-26T06:30:33.951 INFO:teuthology.orchestra.run.smithi153.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 4.0 MB/s | 225 kB 00:00 2023-10-26T06:30:34.010 INFO:teuthology.orchestra.run.smithi153.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2023-10-26T06:30:34.011 INFO:teuthology.orchestra.run.smithi050.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.6 MB/s | 259 kB 00:00 2023-10-26T06:30:34.035 INFO:teuthology.orchestra.run.smithi153.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 765 kB/s | 64 kB 00:00 2023-10-26T06:30:34.073 INFO:teuthology.orchestra.run.smithi050.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.1 MB/s | 323 kB 00:00 2023-10-26T06:30:34.086 INFO:teuthology.orchestra.run.smithi153.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2023-10-26T06:30:34.121 INFO:teuthology.orchestra.run.smithi153.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 239 kB/s | 20 kB 00:00 2023-10-26T06:30:34.144 INFO:teuthology.orchestra.run.smithi153.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.7 MB/s | 103 kB 00:00 2023-10-26T06:30:34.178 INFO:teuthology.orchestra.run.smithi153.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-26T06:30:34.182 INFO:teuthology.orchestra.run.smithi050.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 359 kB/s | 39 kB 00:00 2023-10-26T06:30:34.219 INFO:teuthology.orchestra.run.smithi153.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-26T06:30:34.249 INFO:teuthology.orchestra.run.smithi050.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-26T06:30:34.299 INFO:teuthology.orchestra.run.smithi050.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-10-26T06:30:34.342 INFO:teuthology.orchestra.run.smithi050.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-26T06:30:34.385 INFO:teuthology.orchestra.run.smithi050.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.2 MB/s | 187 kB 00:00 2023-10-26T06:30:34.386 INFO:teuthology.orchestra.run.smithi153.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-10-26T06:30:34.429 INFO:teuthology.orchestra.run.smithi153.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-26T06:30:34.478 INFO:teuthology.orchestra.run.smithi050.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2023-10-26T06:30:34.571 INFO:teuthology.orchestra.run.smithi153.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.5 MB/s | 354 kB 00:00 2023-10-26T06:30:34.698 INFO:teuthology.orchestra.run.smithi050.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 15 MB/s | 14 MB 00:00 2023-10-26T06:30:34.728 INFO:teuthology.orchestra.run.smithi050.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 807 kB/s | 27 kB 00:00 2023-10-26T06:30:34.770 INFO:teuthology.orchestra.run.smithi050.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-26T06:30:34.829 INFO:teuthology.orchestra.run.smithi153.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 7.1 MB/s | 4.9 MB 00:00 2023-10-26T06:30:34.845 INFO:teuthology.orchestra.run.smithi050.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-10-26T06:30:34.871 INFO:teuthology.orchestra.run.smithi050.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2023-10-26T06:30:34.929 INFO:teuthology.orchestra.run.smithi050.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-10-26T06:30:34.963 INFO:teuthology.orchestra.run.smithi153.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 6.4 MB/s | 4.7 MB 00:00 2023-10-26T06:30:34.971 INFO:teuthology.orchestra.run.smithi050.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-26T06:30:34.997 INFO:teuthology.orchestra.run.smithi153.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.7 MB/s | 808 kB 00:00 2023-10-26T06:30:35.014 INFO:teuthology.orchestra.run.smithi050.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-10-26T06:30:35.047 INFO:teuthology.orchestra.run.smithi153.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-10-26T06:30:35.089 INFO:teuthology.orchestra.run.smithi050.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-26T06:30:35.106 INFO:teuthology.orchestra.run.smithi050.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2023-10-26T06:30:35.132 INFO:teuthology.orchestra.run.smithi050.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 480 kB/s | 20 kB 00:00 2023-10-26T06:30:35.156 INFO:teuthology.orchestra.run.smithi050.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-26T06:30:35.172 INFO:teuthology.orchestra.run.smithi153.stdout:(128/131): postgresql-server-10.21-2.module+el8 8.4 MB/s | 5.1 MB 00:00 2023-10-26T06:30:35.206 INFO:teuthology.orchestra.run.smithi050.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-10-26T06:30:35.223 INFO:teuthology.orchestra.run.smithi153.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-26T06:30:35.248 INFO:teuthology.orchestra.run.smithi050.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-26T06:30:35.399 INFO:teuthology.orchestra.run.smithi050.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 20 MB/s | 4.9 MB 00:00 2023-10-26T06:30:35.441 INFO:teuthology.orchestra.run.smithi050.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-26T06:30:35.516 INFO:teuthology.orchestra.run.smithi050.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-26T06:30:35.550 INFO:teuthology.orchestra.run.smithi050.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-10-26T06:30:35.556 INFO:teuthology.orchestra.run.smithi153.stdout:(130/131): librbd1-18.0.0-6863.g38499368.el8.x8 7.3 MB/s | 3.7 MB 00:00 2023-10-26T06:30:35.609 INFO:teuthology.orchestra.run.smithi050.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 14 MB/s | 808 kB 00:00 2023-10-26T06:30:35.692 INFO:teuthology.orchestra.run.smithi050.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-10-26T06:30:35.726 INFO:teuthology.orchestra.run.smithi050.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-26T06:30:35.843 INFO:teuthology.orchestra.run.smithi050.stdout:(102/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-10-26T06:30:35.868 INFO:teuthology.orchestra.run.smithi050.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.4 MB/s | 200 kB 00:00 2023-10-26T06:30:35.893 INFO:teuthology.orchestra.run.smithi050.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 851 kB/s | 43 kB 00:00 2023-10-26T06:30:35.922 INFO:teuthology.orchestra.run.smithi050.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-26T06:30:35.944 INFO:teuthology.orchestra.run.smithi050.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 950 kB/s | 48 kB 00:00 2023-10-26T06:30:35.969 INFO:teuthology.orchestra.run.smithi050.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-26T06:30:35.994 INFO:teuthology.orchestra.run.smithi050.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-10-26T06:30:36.020 INFO:teuthology.orchestra.run.smithi050.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-26T06:30:36.045 INFO:teuthology.orchestra.run.smithi050.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-26T06:30:36.079 INFO:teuthology.orchestra.run.smithi050.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-26T06:30:36.104 INFO:teuthology.orchestra.run.smithi050.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 318 kB/s | 19 kB 00:00 2023-10-26T06:30:36.121 INFO:teuthology.orchestra.run.smithi050.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-26T06:30:36.155 INFO:teuthology.orchestra.run.smithi050.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 11 MB/s | 559 kB 00:00 2023-10-26T06:30:36.180 INFO:teuthology.orchestra.run.smithi050.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-10-26T06:30:36.214 INFO:teuthology.orchestra.run.smithi050.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-10-26T06:30:36.214 INFO:teuthology.orchestra.run.smithi153.stdout:(131/131): librados2-18.0.0-6863.g38499368.el8. 3.1 MB/s | 3.7 MB 00:01 2023-10-26T06:30:36.217 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:30:36.217 INFO:teuthology.orchestra.run.smithi153.stdout:Total 11 MB/s | 209 MB 00:19 2023-10-26T06:30:36.264 INFO:teuthology.orchestra.run.smithi050.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-10-26T06:30:36.298 INFO:teuthology.orchestra.run.smithi050.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-10-26T06:30:36.340 INFO:teuthology.orchestra.run.smithi050.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-26T06:30:36.398 INFO:teuthology.orchestra.run.smithi050.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-10-26T06:30:36.423 INFO:teuthology.orchestra.run.smithi050.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 719 kB/s | 60 kB 00:00 2023-10-26T06:30:36.449 INFO:teuthology.orchestra.run.smithi050.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-26T06:30:36.474 INFO:teuthology.orchestra.run.smithi050.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-26T06:30:36.499 INFO:teuthology.orchestra.run.smithi050.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-10-26T06:30:36.535 INFO:teuthology.orchestra.run.smithi050.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-26T06:30:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.8 MB/s | 171 kB 00:00 2023-10-26T06:30:36.584 INFO:teuthology.orchestra.run.smithi050.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-26T06:30:37.031 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-26T06:30:37.084 INFO:teuthology.orchestra.run.smithi050.stdout:(128/131): librados2-18.0.0-6863.g38499368.el8. 7.1 MB/s | 3.7 MB 00:00 2023-10-26T06:30:37.153 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-26T06:30:37.153 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-26T06:30:37.176 INFO:teuthology.orchestra.run.smithi050.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 8.5 MB/s | 798 kB 00:00 2023-10-26T06:30:37.235 INFO:teuthology.orchestra.run.smithi050.stdout:(130/131): librbd1-18.0.0-6863.g38499368.el8.x8 5.7 MB/s | 3.7 MB 00:00 2023-10-26T06:30:37.661 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-26T06:30:37.823 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-26T06:30:37.983 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-26T06:30:38.208 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-26T06:30:38.292 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-26T06:30:38.296 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-26T06:30:38.367 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-26T06:30:38.455 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-26T06:30:38.742 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-26T06:30:39.155 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-26T06:30:39.358 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:30:39.766 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:30:39.983 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:30:40.106 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:30:40.291 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:30:40.388 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:30:41.077 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-26T06:30:41.334 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-26T06:30:41.555 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-26T06:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout:(131/131): ceph-test-18.0.0-6863.g38499368.el8. 2.9 MB/s | 49 MB 00:16 2023-10-26T06:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.2 MB/s | 209 MB 00:25 2023-10-26T06:30:41.987 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-26T06:30:42.257 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-26T06:30:42.391 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-26T06:30:42.498 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-26T06:30:42.649 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-26T06:30:42.748 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-26T06:30:42.875 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-26T06:30:43.000 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-26T06:30:43.149 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-26T06:30:43.461 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-10-26T06:30:43.608 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-10-26T06:30:43.608 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-10-26T06:30:43.783 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-26T06:30:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-26T06:30:43.975 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-26T06:30:44.171 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-26T06:30:44.396 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-26T06:30:44.560 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-26T06:30:44.648 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-26T06:30:44.745 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-26T06:30:44.782 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-26T06:30:45.065 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-26T06:30:45.229 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-10-26T06:30:45.234 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-10-26T06:30:45.455 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-26T06:30:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-26T06:30:45.732 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-26T06:30:45.806 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.0.0-6863.g38499368.el8.x86_64 5/134 2023-10-26T06:30:45.968 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-26T06:30:46.212 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-26T06:30:46.253 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.0.0-6863.g38499368.el8.x86_64 5/134 2023-10-26T06:30:46.405 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-26T06:30:46.472 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:30:46.601 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:30:46.615 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-26T06:30:46.847 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:30:46.869 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-26T06:30:46.943 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:30:47.047 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 26/134 2023-10-26T06:30:47.143 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:30:47.180 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 27/134 2023-10-26T06:30:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-26T06:30:47.634 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-26T06:30:47.891 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-26T06:30:48.095 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 28/134 2023-10-26T06:30:48.318 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-26T06:30:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-26T06:30:48.630 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-26T06:30:48.692 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-26T06:30:48.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-26T06:30:48.913 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-26T06:30:48.942 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-26T06:30:49.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-26T06:30:49.132 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-26T06:30:49.235 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-26T06:30:49.501 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-26T06:30:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-26T06:30:49.963 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-26T06:30:50.139 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-26T06:30:50.298 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-26T06:30:50.330 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-10-26T06:30:50.514 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-26T06:30:50.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-26T06:30:50.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-26T06:30:50.911 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-26T06:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-26T06:30:51.161 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-26T06:30:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-26T06:30:51.232 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-26T06:30:51.326 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-26T06:30:51.388 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-26T06:30:51.435 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-26T06:30:51.545 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-26T06:30:51.625 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-26T06:30:51.853 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 36/134 2023-10-26T06:30:51.982 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-26T06:30:52.035 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 37/134 2023-10-26T06:30:52.045 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-26T06:30:52.205 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-26T06:30:52.214 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-26T06:30:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:30:52.401 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-26T06:30:52.575 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-26T06:30:52.743 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-26T06:30:52.841 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:30:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-26T06:30:52.963 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-26T06:30:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:30:53.161 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-26T06:30:53.202 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:30:53.203 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-26T06:30:53.378 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:30:53.426 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-26T06:30:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:30:53.560 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-26T06:30:53.690 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-26T06:30:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-26T06:30:53.851 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-26T06:30:53.936 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 26/134 2023-10-26T06:30:53.972 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-26T06:30:54.040 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-26T06:30:54.098 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 27/134 2023-10-26T06:30:54.175 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-26T06:30:54.262 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-26T06:30:54.368 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 28/134 2023-10-26T06:30:54.544 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-26T06:30:54.596 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-26T06:30:54.610 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-26T06:30:54.887 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-26T06:30:54.888 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-26T06:30:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-26T06:30:55.080 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-26T06:30:55.166 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-26T06:30:55.314 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-26T06:30:55.361 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-26T06:30:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-26T06:30:55.543 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-26T06:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-26T06:30:55.734 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-26T06:30:55.777 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-26T06:30:55.902 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-26T06:30:55.935 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-26T06:30:56.197 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-26T06:30:56.349 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-26T06:30:56.467 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-26T06:30:56.649 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-26T06:30:56.710 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-26T06:30:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-26T06:30:56.953 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-26T06:30:57.146 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-26T06:30:57.324 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-26T06:30:57.417 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-26T06:30:57.497 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-26T06:30:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-26T06:30:57.566 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-26T06:30:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-26T06:30:57.760 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-26T06:30:57.828 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-26T06:30:58.025 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-26T06:30:58.072 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-26T06:30:58.217 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-26T06:30:58.302 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-26T06:30:58.309 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-26T06:30:58.534 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-26T06:30:58.540 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-26T06:30:58.616 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-26T06:30:58.748 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-26T06:30:58.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-26T06:30:58.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-26T06:30:58.921 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-26T06:30:59.017 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 36/134 2023-10-26T06:30:59.092 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-26T06:30:59.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-26T06:30:59.218 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 37/134 2023-10-26T06:30:59.351 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-26T06:30:59.375 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-26T06:30:59.419 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-26T06:30:59.579 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-26T06:30:59.587 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-26T06:30:59.622 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-26T06:30:59.751 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-26T06:30:59.836 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-26T06:30:59.843 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-26T06:30:59.882 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-26T06:30:59.950 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-26T06:31:00.056 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-26T06:31:00.127 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-26T06:31:00.214 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-26T06:31:00.292 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-26T06:31:00.319 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 26/134 2023-10-26T06:31:00.474 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-26T06:31:00.475 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 27/134 2023-10-26T06:31:00.524 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-26T06:31:00.633 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-26T06:31:00.711 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-26T06:31:00.795 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-26T06:31:00.803 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-26T06:31:01.033 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-26T06:31:01.042 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-26T06:31:01.215 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-26T06:31:01.283 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-26T06:31:01.419 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-26T06:31:01.444 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-26T06:31:01.551 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 28/134 2023-10-26T06:31:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-26T06:31:01.724 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-26T06:31:01.881 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-26T06:31:01.931 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-26T06:31:01.962 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-26T06:31:02.032 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-26T06:31:02.137 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-26T06:31:02.237 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-26T06:31:02.303 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-26T06:31:02.378 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-26T06:31:02.514 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-26T06:31:02.559 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-26T06:31:02.977 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-26T06:31:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-26T06:31:03.382 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-26T06:31:03.449 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-26T06:31:03.681 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-26T06:31:03.708 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-26T06:31:03.968 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-26T06:31:03.978 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-26T06:31:04.279 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-26T06:31:04.284 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-26T06:31:04.552 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-26T06:31:04.609 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-26T06:31:04.786 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-26T06:31:04.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-26T06:31:05.087 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-26T06:31:05.159 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-26T06:31:05.369 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-26T06:31:05.528 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-26T06:31:05.574 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-26T06:31:05.575 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-26T06:31:05.757 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-26T06:31:05.770 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-26T06:31:05.777 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-26T06:31:05.838 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-26T06:31:05.983 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-26T06:31:06.004 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 93/134 2023-10-26T06:31:06.149 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-26T06:31:06.184 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 36/134 2023-10-26T06:31:06.423 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 37/134 2023-10-26T06:31:06.485 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-26T06:31:06.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-26T06:31:06.749 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-26T06:31:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-26T06:31:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-26T06:31:07.136 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-26T06:31:07.227 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-26T06:31:07.309 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-26T06:31:07.447 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-26T06:31:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-26T06:31:07.713 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-26T06:31:07.796 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-26T06:31:08.009 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-26T06:31:08.181 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-26T06:31:08.220 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-26T06:31:08.380 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-26T06:31:08.492 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-26T06:31:08.604 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-26T06:31:08.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-26T06:31:08.849 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-26T06:31:08.967 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-26T06:31:09.066 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-26T06:31:09.237 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-26T06:31:09.255 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-26T06:31:09.425 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-26T06:31:09.618 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-26T06:31:09.707 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-26T06:31:09.733 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:09.903 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-26T06:31:09.978 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:10.031 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-26T06:31:10.079 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-26T06:31:10.274 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-26T06:31:10.305 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-26T06:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-26T06:31:10.558 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-26T06:31:10.595 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-26T06:31:10.809 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-26T06:31:10.860 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-26T06:31:10.931 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-26T06:31:11.042 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-26T06:31:11.070 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-26T06:31:11.081 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-26T06:31:11.276 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-26T06:31:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-26T06:31:11.680 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-26T06:31:11.934 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-26T06:31:12.143 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-26T06:31:12.337 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-26T06:31:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-26T06:31:12.517 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-26T06:31:12.632 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-26T06:31:12.822 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-26T06:31:12.938 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-26T06:31:13.152 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-26T06:31:13.182 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-26T06:31:13.325 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-26T06:31:13.420 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-26T06:31:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-26T06:31:13.669 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-26T06:31:13.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-26T06:31:13.837 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-26T06:31:14.037 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-26T06:31:14.045 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-26T06:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-26T06:31:14.555 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-26T06:31:14.776 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-26T06:31:14.914 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-26T06:31:14.956 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-26T06:31:15.107 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-26T06:31:15.134 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-26T06:31:15.208 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-26T06:31:15.337 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-26T06:31:15.477 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 93/134 2023-10-26T06:31:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-26T06:31:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-26T06:31:15.917 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-26T06:31:16.076 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-26T06:31:16.348 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-26T06:31:16.591 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-26T06:31:16.808 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-26T06:31:17.089 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-26T06:31:17.327 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-26T06:31:17.514 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-26T06:31:17.781 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-26T06:31:19.199 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-26T06:31:19.514 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-26T06:31:19.766 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-26T06:31:19.918 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-26T06:31:20.184 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:20.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-26T06:31:20.672 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-26T06:31:20.783 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:21.139 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-26T06:31:21.210 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-26T06:31:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-26T06:31:21.593 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-26T06:31:21.774 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-26T06:31:21.877 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-26T06:31:22.083 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 93/134 2023-10-26T06:31:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:27.943 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:29.106 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-26T06:31:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-26T06:31:29.546 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-26T06:31:29.690 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-26T06:31:29.786 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-26T06:31:29.787 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /sys 2023-10-26T06:31:29.787 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /proc 2023-10-26T06:31:29.787 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-10-26T06:31:29.787 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /run 2023-10-26T06:31:29.788 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /mnt 2023-10-26T06:31:29.788 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /var/tmp 2023-10-26T06:31:29.788 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /home 2023-10-26T06:31:29.788 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /tmp 2023-10-26T06:31:29.788 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-10-26T06:31:29.788 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:31:30.141 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-26T06:31:31.734 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-26T06:31:31.948 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-26T06:31:32.168 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-26T06:31:32.374 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-26T06:31:32.837 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-26T06:31:33.024 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-26T06:31:33.041 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-26T06:31:34.744 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-26T06:31:34.967 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-26T06:31:35.080 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 102/134 2023-10-26T06:31:35.300 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 103/134 2023-10-26T06:31:35.507 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-26T06:31:35.727 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-26T06:31:36.005 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-26T06:31:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-26T06:31:37.148 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-26T06:31:37.238 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-26T06:31:37.597 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 107/134 2023-10-26T06:31:37.807 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-26T06:31:37.841 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-26T06:31:38.015 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-26T06:31:38.026 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-26T06:31:39.349 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-2:18.0.0-6863.g38499368.el8.x86_64 110/134 2023-10-26T06:31:39.563 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-26T06:31:39.597 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-26T06:31:39.740 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-26T06:31:39.781 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-26T06:31:39.964 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-26T06:31:40.322 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-26T06:31:40.433 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-26T06:31:40.434 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2023-10-26T06:31:40.434 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2023-10-26T06:31:40.434 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-10-26T06:31:40.434 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2023-10-26T06:31:40.434 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2023-10-26T06:31:40.435 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2023-10-26T06:31:40.435 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2023-10-26T06:31:40.435 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2023-10-26T06:31:40.435 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-10-26T06:31:40.435 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:31:40.515 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-26T06:31:40.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-26T06:31:42.398 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-26T06:31:42.627 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-26T06:31:42.846 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-26T06:31:43.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-26T06:31:43.560 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-26T06:31:43.754 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-26T06:31:43.771 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-26T06:31:45.167 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-26T06:31:45.438 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 115/134 2023-10-26T06:31:45.555 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-26T06:31:45.639 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-26T06:31:45.829 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-26T06:31:45.830 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-26T06:31:45.984 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 102/134 2023-10-26T06:31:46.228 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 103/134 2023-10-26T06:31:46.420 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-26T06:31:46.642 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-26T06:31:46.751 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-26T06:31:46.834 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-26T06:31:47.112 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-26T06:31:47.292 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 119/134 2023-10-26T06:31:47.509 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-26T06:31:47.709 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 121/134 2023-10-26T06:31:47.794 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-26T06:31:47.890 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-26T06:31:48.020 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-26T06:31:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-26T06:31:48.502 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 107/134 2023-10-26T06:31:48.793 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-26T06:31:48.828 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-26T06:31:49.021 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-26T06:31:49.031 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-26T06:31:50.122 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:31:50.372 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:31:50.372 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.0.0-6863.g38499368.el8.x86_64 110/134 2023-10-26T06:31:50.394 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:31:50.584 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 124/134 2023-10-26T06:31:50.656 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-26T06:31:50.690 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-26T06:31:50.870 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-26T06:31:50.879 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 125/134 2023-10-26T06:31:50.913 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-26T06:31:51.058 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-26T06:31:51.059 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-10-26T06:31:51.059 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-10-26T06:31:51.059 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-10-26T06:31:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2023-10-26T06:31:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-10-26T06:31:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-10-26T06:31:51.061 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-10-26T06:31:51.061 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-10-26T06:31:51.061 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2023-10-26T06:31:51.061 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:31:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-26T06:31:51.219 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 126/134 2023-10-26T06:31:51.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-26T06:31:51.471 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-26T06:31:51.490 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-26T06:31:51.662 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-26T06:31:51.663 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-26T06:31:51.671 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-26T06:31:51.846 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-26T06:31:52.054 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-26T06:31:52.135 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-26T06:31:52.354 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-26T06:31:52.367 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-26T06:31:52.367 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:31:52.607 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:31:52.608 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-26T06:31:52.852 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-26T06:31:53.087 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:31:53.329 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-26T06:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-26T06:31:53.597 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:31:53.598 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:18.0.0-6863.g38499368.el8.x86_64 1/134 2023-10-26T06:31:53.598 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2/134 2023-10-26T06:31:53.598 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 3/134 2023-10-26T06:31:53.598 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 4/134 2023-10-26T06:31:53.598 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6863.g38499 5/134 2023-10-26T06:31:53.599 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:31:53.599 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:31:53.599 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:31:53.599 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-26T06:31:53.600 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 10/134 2023-10-26T06:31:53.600 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 11/134 2023-10-26T06:31:53.600 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 12/134 2023-10-26T06:31:53.600 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 13/134 2023-10-26T06:31:53.600 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 14/134 2023-10-26T06:31:53.601 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 15/134 2023-10-26T06:31:53.601 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 16/134 2023-10-26T06:31:53.601 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 17/134 2023-10-26T06:31:53.601 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 18/134 2023-10-26T06:31:53.601 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 19/134 2023-10-26T06:31:53.602 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 20/134 2023-10-26T06:31:53.602 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 21/134 2023-10-26T06:31:53.602 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 22/134 2023-10-26T06:31:53.602 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 23/134 2023-10-26T06:31:53.602 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 24/134 2023-10-26T06:31:53.603 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 25/134 2023-10-26T06:31:53.603 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 26/134 2023-10-26T06:31:53.603 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 27/134 2023-10-26T06:31:53.603 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 28/134 2023-10-26T06:31:53.603 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 29/134 2023-10-26T06:31:53.613 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 30/134 2023-10-26T06:31:53.613 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 31/134 2023-10-26T06:31:53.613 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 32/134 2023-10-26T06:31:53.613 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 33/134 2023-10-26T06:31:53.613 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 34/134 2023-10-26T06:31:53.614 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 35/134 2023-10-26T06:31:53.614 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 36/134 2023-10-26T06:31:53.614 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephadm-2:18.0.0-6863.g38499368.el8.noarch 37/134 2023-10-26T06:31:53.614 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 38/134 2023-10-26T06:31:53.614 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-26T06:31:53.615 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-26T06:31:53.615 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-26T06:31:53.615 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-26T06:31:53.615 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-26T06:31:53.615 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-26T06:31:53.616 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-26T06:31:53.616 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-26T06:31:53.616 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-26T06:31:53.616 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-26T06:31:53.616 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-26T06:31:53.617 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-26T06:31:53.617 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-26T06:31:53.617 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-26T06:31:53.617 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-26T06:31:53.617 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-26T06:31:53.618 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-26T06:31:53.618 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-26T06:31:53.618 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-26T06:31:53.618 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-26T06:31:53.618 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-26T06:31:53.619 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-26T06:31:53.619 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-26T06:31:53.619 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-26T06:31:53.619 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-26T06:31:53.619 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-26T06:31:53.620 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-26T06:31:53.620 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-26T06:31:53.620 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-26T06:31:53.620 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-26T06:31:53.620 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-26T06:31:53.620 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-26T06:31:53.621 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-26T06:31:53.621 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-26T06:31:53.621 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-26T06:31:53.621 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-26T06:31:53.621 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-26T06:31:53.622 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-26T06:31:53.622 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-26T06:31:53.622 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-26T06:31:53.622 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-26T06:31:53.622 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-26T06:31:53.623 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-26T06:31:53.623 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-26T06:31:53.623 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-26T06:31:53.623 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-26T06:31:53.623 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-26T06:31:53.624 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-26T06:31:53.624 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-26T06:31:53.624 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-26T06:31:53.624 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-26T06:31:53.624 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-26T06:31:53.625 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-26T06:31:53.625 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-26T06:31:53.625 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-26T06:31:53.625 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-26T06:31:53.625 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-26T06:31:53.626 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-26T06:31:53.626 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-26T06:31:53.626 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-26T06:31:53.626 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-26T06:31:53.626 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-26T06:31:53.627 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-26T06:31:53.627 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-26T06:31:53.627 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-26T06:31:53.627 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-26T06:31:53.627 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-26T06:31:53.628 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-26T06:31:53.628 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-26T06:31:53.628 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-26T06:31:53.628 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-26T06:31:53.628 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-26T06:31:53.628 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-26T06:31:53.629 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-26T06:31:53.629 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-26T06:31:53.629 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-26T06:31:53.629 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-26T06:31:53.629 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-26T06:31:53.630 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-26T06:31:53.630 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-26T06:31:53.630 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-26T06:31:53.630 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-26T06:31:53.630 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-26T06:31:53.631 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-26T06:31:53.631 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-26T06:31:53.631 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-26T06:31:53.631 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-26T06:31:53.631 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-26T06:31:53.632 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-26T06:31:53.632 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-26T06:31:53.632 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:18.0.0-6863.g38499368.el8.x86_64 129/134 2023-10-26T06:31:53.632 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-26T06:31:53.632 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 131/134 2023-10-26T06:31:53.632 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:31:53.633 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-26T06:31:53.819 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-26T06:31:54.012 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-26T06:31:54.574 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-26T06:31:54.812 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-26T06:31:54.856 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-26T06:31:56.082 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:31:56.082 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:53 ago on Thu 26 Oct 2023 06:30:03 AM UTC. 2023-10-26T06:31:56.340 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-26T06:31:57.270 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 115/134 2023-10-26T06:31:57.614 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-26T06:31:57.828 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-26T06:31:57.839 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 117/134 2023-10-26T06:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-26T06:31:58.132 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-26T06:31:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 102/134 2023-10-26T06:31:58.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 103/134 2023-10-26T06:31:58.386 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-26T06:31:58.569 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-26T06:31:58.572 INFO:teuthology.orchestra.run.smithi125.stdout:Installed products updated. 2023-10-26T06:31:58.578 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-26T06:31:58.786 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:31:58.786 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2023-10-26T06:31:58.787 INFO:teuthology.orchestra.run.smithi125.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-26T06:31:58.787 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.787 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.787 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-26T06:31:58.787 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-26T06:31:58.788 INFO:teuthology.orchestra.run.smithi125.stdout: automake-1.16.1-7.el8.noarch 2023-10-26T06:31:58.788 INFO:teuthology.orchestra.run.smithi125.stdout: bison-3.0.4-10.el8.x86_64 2023-10-26T06:31:58.788 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.788 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.788 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.789 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.789 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.789 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.789 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.789 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.790 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.790 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.790 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.790 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.790 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.791 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.791 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.791 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.791 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.791 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.792 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.792 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.792 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.792 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.792 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:31:58.793 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-26T06:31:58.793 INFO:teuthology.orchestra.run.smithi125.stdout: flex-2.6.1-9.el8.x86_64 2023-10-26T06:31:58.793 INFO:teuthology.orchestra.run.smithi125.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-26T06:31:58.793 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-26T06:31:58.793 INFO:teuthology.orchestra.run.smithi125.stdout: jq-1.6-3.el8.x86_64 2023-10-26T06:31:58.794 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-26T06:31:58.794 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-26T06:31:58.794 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-26T06:31:58.794 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.794 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.795 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.795 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-26T06:31:58.795 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-26T06:31:58.795 INFO:teuthology.orchestra.run.smithi125.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-26T06:31:58.795 INFO:teuthology.orchestra.run.smithi125.stdout: libpq-13.5-1.el8.x86_64 2023-10-26T06:31:58.796 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-26T06:31:58.796 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-26T06:31:58.796 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.796 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.796 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-26T06:31:58.797 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.797 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-26T06:31:58.797 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-26T06:31:58.797 INFO:teuthology.orchestra.run.smithi125.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-26T06:31:58.797 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-26T06:31:58.798 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-26T06:31:58.798 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-26T06:31:58.798 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-26T06:31:58.798 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-26T06:31:58.798 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-26T06:31:58.799 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-26T06:31:58.799 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-26T06:31:58.799 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-26T06:31:58.799 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-26T06:31:58.799 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-26T06:31:58.800 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:31:58.800 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:31:58.800 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:31:58.800 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-26T06:31:58.800 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-26T06:31:58.801 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-26T06:31:58.801 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-26T06:31:58.801 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-26T06:31:58.801 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.801 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.802 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.802 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-26T06:31:58.802 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-26T06:31:58.803 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-26T06:31:58.803 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-26T06:31:58.803 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-26T06:31:58.803 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-26T06:31:58.803 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-26T06:31:58.804 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-26T06:31:58.804 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-26T06:31:58.804 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-26T06:31:58.804 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-26T06:31:58.805 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-26T06:31:58.805 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-26T06:31:58.805 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-26T06:31:58.805 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-26T06:31:58.805 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-26T06:31:58.806 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-26T06:31:58.806 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-26T06:31:58.806 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-26T06:31:58.806 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-26T06:31:58.807 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-26T06:31:58.807 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-26T06:31:58.807 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend-2.6-1.el8.noarch 2023-10-26T06:31:58.807 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-26T06:31:58.808 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-26T06:31:58.808 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-26T06:31:58.808 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-26T06:31:58.808 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-26T06:31:58.809 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-26T06:31:58.809 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.809 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.810 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-26T06:31:58.810 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-26T06:31:58.810 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.810 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-26T06:31:58.811 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-26T06:31:58.811 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-26T06:31:58.811 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-26T06:31:58.811 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-26T06:31:58.812 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-26T06:31:58.812 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-26T06:31:58.812 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-26T06:31:58.813 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-26T06:31:58.813 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-26T06:31:58.813 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-26T06:31:58.813 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-26T06:31:58.813 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-26T06:31:58.814 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.814 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.814 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:31:58.815 INFO:teuthology.orchestra.run.smithi125.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-26T06:31:58.815 INFO:teuthology.orchestra.run.smithi125.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-26T06:31:58.815 INFO:teuthology.orchestra.run.smithi125.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-26T06:31:58.815 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-26T06:31:58.816 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-26T06:31:58.816 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-26T06:31:58.816 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-26T06:31:58.817 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-26T06:31:58.848 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-26T06:31:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-26T06:31:58.966 DEBUG:teuthology.parallel:result is None 2023-10-26T06:31:59.034 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-26T06:31:59.073 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 121/134 2023-10-26T06:31:59.253 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-26T06:32:00.194 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-26T06:32:00.410 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-26T06:32:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-26T06:32:00.916 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 107/134 2023-10-26T06:32:01.185 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-26T06:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-26T06:32:01.477 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-26T06:32:01.507 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-26T06:32:01.606 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:32:01.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:32:01.969 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:32:02.240 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 124/134 2023-10-26T06:32:02.484 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 125/134 2023-10-26T06:32:02.884 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 126/134 2023-10-26T06:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:18.0.0-6863.g38499368.el8.x86_64 110/134 2023-10-26T06:32:03.256 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-26T06:32:03.320 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-26T06:32:03.352 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-26T06:32:03.469 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-26T06:32:03.542 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-26T06:32:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-26T06:32:03.627 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-26T06:32:03.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-26T06:32:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-26T06:32:03.955 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-26T06:32:04.151 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-26T06:32:04.155 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-26T06:32:04.159 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-26T06:32:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-26T06:32:04.295 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:32:04.319 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-26T06:32:04.613 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:32:04.613 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-26T06:32:04.933 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-26T06:32:05.167 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:32:05.694 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:32:05.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.0.0-6863.g38499368.el8.x86_64 1/134 2023-10-26T06:32:05.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2/134 2023-10-26T06:32:05.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 3/134 2023-10-26T06:32:05.695 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 4/134 2023-10-26T06:32:05.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6863.g38499 5/134 2023-10-26T06:32:05.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:32:05.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:32:05.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:32:05.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-26T06:32:05.696 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 10/134 2023-10-26T06:32:05.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 11/134 2023-10-26T06:32:05.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 12/134 2023-10-26T06:32:05.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 13/134 2023-10-26T06:32:05.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 14/134 2023-10-26T06:32:05.697 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 15/134 2023-10-26T06:32:05.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 16/134 2023-10-26T06:32:05.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 17/134 2023-10-26T06:32:05.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 18/134 2023-10-26T06:32:05.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 19/134 2023-10-26T06:32:05.698 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 20/134 2023-10-26T06:32:05.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 21/134 2023-10-26T06:32:05.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 22/134 2023-10-26T06:32:05.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 23/134 2023-10-26T06:32:05.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 24/134 2023-10-26T06:32:05.699 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 25/134 2023-10-26T06:32:05.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 26/134 2023-10-26T06:32:05.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 27/134 2023-10-26T06:32:05.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 28/134 2023-10-26T06:32:05.700 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 29/134 2023-10-26T06:32:05.709 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 30/134 2023-10-26T06:32:05.710 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 31/134 2023-10-26T06:32:05.710 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 32/134 2023-10-26T06:32:05.710 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 33/134 2023-10-26T06:32:05.710 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 34/134 2023-10-26T06:32:05.711 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 35/134 2023-10-26T06:32:05.711 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 36/134 2023-10-26T06:32:05.711 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.0.0-6863.g38499368.el8.noarch 37/134 2023-10-26T06:32:05.711 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 38/134 2023-10-26T06:32:05.711 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-26T06:32:05.712 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-26T06:32:05.712 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-26T06:32:05.712 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-26T06:32:05.712 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-26T06:32:05.712 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-26T06:32:05.713 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-26T06:32:05.713 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-26T06:32:05.713 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-26T06:32:05.713 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-26T06:32:05.713 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-26T06:32:05.714 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-26T06:32:05.714 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-26T06:32:05.714 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-26T06:32:05.714 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-26T06:32:05.714 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-26T06:32:05.715 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-26T06:32:05.715 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-26T06:32:05.715 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-26T06:32:05.715 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-26T06:32:05.715 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-26T06:32:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-26T06:32:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-26T06:32:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-26T06:32:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-26T06:32:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-26T06:32:05.716 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-26T06:32:05.717 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-26T06:32:05.717 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-26T06:32:05.717 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-26T06:32:05.717 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-26T06:32:05.717 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-26T06:32:05.718 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-26T06:32:05.718 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-26T06:32:05.718 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-26T06:32:05.718 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-26T06:32:05.718 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-26T06:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-26T06:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-26T06:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-26T06:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-26T06:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-26T06:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-26T06:32:05.720 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-26T06:32:05.720 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-26T06:32:05.720 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-26T06:32:05.720 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-26T06:32:05.720 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-26T06:32:05.721 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-26T06:32:05.721 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-26T06:32:05.721 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-26T06:32:05.721 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-26T06:32:05.721 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-26T06:32:05.722 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-26T06:32:05.722 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-26T06:32:05.723 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-26T06:32:05.723 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-26T06:32:05.723 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-26T06:32:05.723 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-26T06:32:05.724 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-26T06:32:05.724 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-26T06:32:05.724 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-26T06:32:05.724 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-26T06:32:05.724 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-26T06:32:05.725 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-26T06:32:05.725 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-26T06:32:05.725 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-26T06:32:05.725 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-26T06:32:05.725 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-26T06:32:05.725 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-26T06:32:05.726 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-26T06:32:05.726 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-26T06:32:05.726 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-26T06:32:05.726 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-26T06:32:05.726 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-26T06:32:05.727 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-26T06:32:05.727 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-26T06:32:05.727 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-26T06:32:05.727 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-26T06:32:05.727 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-26T06:32:05.728 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-26T06:32:05.728 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-26T06:32:05.728 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-26T06:32:05.728 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-26T06:32:05.728 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-26T06:32:05.729 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-26T06:32:05.729 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-26T06:32:05.729 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-26T06:32:05.730 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-26T06:32:05.730 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-26T06:32:05.730 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.0.0-6863.g38499368.el8.x86_64 129/134 2023-10-26T06:32:05.731 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-26T06:32:05.731 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 131/134 2023-10-26T06:32:05.731 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:32:05.731 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-26T06:32:08.451 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:32:08.452 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:02:04 ago on Thu 26 Oct 2023 06:30:04 AM UTC. 2023-10-26T06:32:09.712 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-26T06:32:10.207 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 115/134 2023-10-26T06:32:10.351 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-26T06:32:10.637 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-26T06:32:10.982 INFO:teuthology.orchestra.run.smithi153.stdout:Installed products updated. 2023-10-26T06:32:11.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:32:11.194 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2023-10-26T06:32:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-26T06:32:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.195 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-26T06:32:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-26T06:32:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.1-7.el8.noarch 2023-10-26T06:32:11.195 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.0.4-10.el8.x86_64 2023-10-26T06:32:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.199 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.200 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-26T06:32:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.1-9.el8.x86_64 2023-10-26T06:32:11.201 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-26T06:32:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-26T06:32:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-3.el8.x86_64 2023-10-26T06:32:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-26T06:32:11.202 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-26T06:32:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-26T06:32:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.203 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-26T06:32:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-26T06:32:11.204 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-26T06:32:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: libpq-13.5-1.el8.x86_64 2023-10-26T06:32:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-26T06:32:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-26T06:32:11.205 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-26T06:32:11.206 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-26T06:32:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-26T06:32:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-26T06:32:11.207 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-26T06:32:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-26T06:32:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-26T06:32:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-26T06:32:11.208 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-26T06:32:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-26T06:32:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-26T06:32:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-26T06:32:11.209 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-26T06:32:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-26T06:32:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-26T06:32:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:32:11.210 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:32:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:32:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-26T06:32:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-26T06:32:11.211 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-26T06:32:11.212 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-26T06:32:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-26T06:32:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-26T06:32:11.214 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-26T06:32:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-26T06:32:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-26T06:32:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-26T06:32:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-26T06:32:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-26T06:32:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-26T06:32:11.216 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-26T06:32:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-26T06:32:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-26T06:32:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-26T06:32:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-26T06:32:11.217 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-26T06:32:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-26T06:32:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-26T06:32:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-26T06:32:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-26T06:32:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-26T06:32:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-26T06:32:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-26T06:32:11.219 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-26T06:32:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2023-10-26T06:32:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-26T06:32:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-26T06:32:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-26T06:32:11.220 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-26T06:32:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-26T06:32:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-26T06:32:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.221 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-26T06:32:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-26T06:32:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-26T06:32:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-26T06:32:11.222 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-26T06:32:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-26T06:32:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-26T06:32:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-26T06:32:11.223 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-26T06:32:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-26T06:32:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-26T06:32:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-26T06:32:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-26T06:32:11.224 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-26T06:32:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-26T06:32:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.225 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-26T06:32:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-26T06:32:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-26T06:32:11.226 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-26T06:32:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-26T06:32:11.227 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-26T06:32:11.228 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:32:11.228 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-26T06:32:11.390 DEBUG:teuthology.parallel:result is None 2023-10-26T06:32:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-26T06:32:12.433 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-26T06:32:12.633 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 119/134 2023-10-26T06:32:12.856 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-26T06:32:13.040 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 121/134 2023-10-26T06:32:13.235 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-26T06:32:16.781 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:32:17.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:32:17.090 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-26T06:32:17.377 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 124/134 2023-10-26T06:32:17.602 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 125/134 2023-10-26T06:32:17.970 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 126/134 2023-10-26T06:32:18.285 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-26T06:32:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-26T06:32:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-26T06:32:18.744 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-26T06:32:18.924 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-26T06:32:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-26T06:32:19.250 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-26T06:32:19.280 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-26T06:32:19.280 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:32:19.507 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:32:19.507 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-26T06:32:19.791 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-26T06:32:20.026 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:32:20.278 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:32:20.278 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-26T06:32:20.279 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:32:20.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:18.0.0-6863.g38499368.el8.x86_64 1/134 2023-10-26T06:32:20.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2/134 2023-10-26T06:32:20.917 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 3/134 2023-10-26T06:32:20.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 4/134 2023-10-26T06:32:20.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6863.g38499 5/134 2023-10-26T06:32:20.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-26T06:32:20.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-26T06:32:20.918 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-26T06:32:20.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-26T06:32:20.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 10/134 2023-10-26T06:32:20.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 11/134 2023-10-26T06:32:20.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 12/134 2023-10-26T06:32:20.919 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 13/134 2023-10-26T06:32:20.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 14/134 2023-10-26T06:32:20.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 15/134 2023-10-26T06:32:20.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 16/134 2023-10-26T06:32:20.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 17/134 2023-10-26T06:32:20.920 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 18/134 2023-10-26T06:32:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 19/134 2023-10-26T06:32:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 20/134 2023-10-26T06:32:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 21/134 2023-10-26T06:32:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 22/134 2023-10-26T06:32:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 23/134 2023-10-26T06:32:20.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 24/134 2023-10-26T06:32:20.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 25/134 2023-10-26T06:32:20.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 26/134 2023-10-26T06:32:20.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 27/134 2023-10-26T06:32:20.931 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 28/134 2023-10-26T06:32:20.931 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 29/134 2023-10-26T06:32:20.931 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 30/134 2023-10-26T06:32:20.932 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 31/134 2023-10-26T06:32:20.932 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 32/134 2023-10-26T06:32:20.932 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 33/134 2023-10-26T06:32:20.932 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 34/134 2023-10-26T06:32:20.932 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 35/134 2023-10-26T06:32:20.933 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 36/134 2023-10-26T06:32:20.933 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:18.0.0-6863.g38499368.el8.noarch 37/134 2023-10-26T06:32:20.933 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 38/134 2023-10-26T06:32:20.933 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-26T06:32:20.933 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-26T06:32:20.933 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-26T06:32:20.934 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-26T06:32:20.934 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-26T06:32:20.934 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-26T06:32:20.934 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-26T06:32:20.934 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-26T06:32:20.935 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-26T06:32:20.935 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-26T06:32:20.935 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-26T06:32:20.935 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-26T06:32:20.935 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-26T06:32:20.936 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-26T06:32:20.936 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-26T06:32:20.936 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-26T06:32:20.936 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-26T06:32:20.936 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-26T06:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-26T06:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-26T06:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-26T06:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-26T06:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-26T06:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-26T06:32:20.938 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-26T06:32:20.938 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-26T06:32:20.938 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-26T06:32:20.938 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-26T06:32:20.938 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-26T06:32:20.939 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-26T06:32:20.939 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-26T06:32:20.939 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-26T06:32:20.939 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-26T06:32:20.939 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-26T06:32:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-26T06:32:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-26T06:32:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-26T06:32:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-26T06:32:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-26T06:32:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-26T06:32:20.941 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-26T06:32:20.941 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-26T06:32:20.941 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-26T06:32:20.941 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-26T06:32:20.941 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-26T06:32:20.942 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-26T06:32:20.942 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-26T06:32:20.942 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-26T06:32:20.942 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-26T06:32:20.942 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-26T06:32:20.942 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-26T06:32:20.943 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-26T06:32:20.943 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-26T06:32:20.943 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-26T06:32:20.943 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-26T06:32:20.943 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-26T06:32:20.944 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-26T06:32:20.944 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-26T06:32:20.944 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-26T06:32:20.944 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-26T06:32:20.944 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-26T06:32:20.945 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-26T06:32:20.945 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-26T06:32:20.945 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-26T06:32:20.945 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-26T06:32:20.945 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-26T06:32:20.946 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-26T06:32:20.946 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-26T06:32:20.946 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-26T06:32:20.946 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-26T06:32:20.946 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-26T06:32:20.947 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-26T06:32:20.947 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-26T06:32:20.947 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-26T06:32:20.947 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-26T06:32:20.947 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-26T06:32:20.947 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-26T06:32:20.948 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-26T06:32:20.948 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-26T06:32:20.948 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-26T06:32:20.948 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-26T06:32:20.948 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-26T06:32:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-26T06:32:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-26T06:32:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-26T06:32:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-26T06:32:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-26T06:32:20.949 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-26T06:32:20.950 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-26T06:32:20.950 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-26T06:32:20.950 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:18.0.0-6863.g38499368.el8.x86_64 129/134 2023-10-26T06:32:20.950 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-26T06:32:20.951 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 131/134 2023-10-26T06:32:20.951 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-26T06:32:20.951 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-26T06:32:23.639 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-26T06:32:23.639 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:20 ago on Thu 26 Oct 2023 06:30:03 AM UTC. 2023-10-26T06:32:26.298 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2023-10-26T06:32:26.539 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:32:26.539 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-10-26T06:32:26.539 INFO:teuthology.orchestra.run.smithi050.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-26T06:32:26.539 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.540 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.540 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-10-26T06:32:26.540 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-26T06:32:26.540 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.1-7.el8.noarch 2023-10-26T06:32:26.540 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.0.4-10.el8.x86_64 2023-10-26T06:32:26.541 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.541 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.541 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.541 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.541 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.543 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.543 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.543 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.543 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.543 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.544 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.545 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.545 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.545 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 2023-10-26T06:32:26.545 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-26T06:32:26.545 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.1-9.el8.x86_64 2023-10-26T06:32:26.545 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-26T06:32:26.546 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-26T06:32:26.546 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-3.el8.x86_64 2023-10-26T06:32:26.546 INFO:teuthology.orchestra.run.smithi050.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-26T06:32:26.546 INFO:teuthology.orchestra.run.smithi050.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-26T06:32:26.546 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-26T06:32:26.547 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.547 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.547 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.547 INFO:teuthology.orchestra.run.smithi050.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-26T06:32:26.547 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-26T06:32:26.548 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-26T06:32:26.548 INFO:teuthology.orchestra.run.smithi050.stdout: libpq-13.5-1.el8.x86_64 2023-10-26T06:32:26.548 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-26T06:32:26.548 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-26T06:32:26.548 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.549 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.549 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-26T06:32:26.549 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.549 INFO:teuthology.orchestra.run.smithi050.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-26T06:32:26.549 INFO:teuthology.orchestra.run.smithi050.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-26T06:32:26.549 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-26T06:32:26.550 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-26T06:32:26.550 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-26T06:32:26.550 INFO:teuthology.orchestra.run.smithi050.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-26T06:32:26.550 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-26T06:32:26.550 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-26T06:32:26.551 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-26T06:32:26.551 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-26T06:32:26.551 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-26T06:32:26.551 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-26T06:32:26.551 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-26T06:32:26.552 INFO:teuthology.orchestra.run.smithi050.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-26T06:32:26.552 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:32:26.552 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:32:26.552 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-26T06:32:26.552 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-26T06:32:26.552 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-26T06:32:26.553 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-26T06:32:26.553 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-26T06:32:26.553 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-26T06:32:26.553 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.553 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.554 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.554 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-26T06:32:26.554 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-26T06:32:26.554 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-26T06:32:26.554 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-26T06:32:26.554 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-26T06:32:26.555 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-26T06:32:26.555 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-26T06:32:26.555 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-26T06:32:26.555 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-26T06:32:26.555 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-26T06:32:26.556 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-26T06:32:26.556 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-26T06:32:26.556 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-26T06:32:26.556 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-26T06:32:26.556 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-26T06:32:26.556 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-26T06:32:26.557 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-26T06:32:26.557 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-26T06:32:26.557 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-26T06:32:26.557 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-26T06:32:26.557 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-26T06:32:26.558 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-26T06:32:26.558 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2023-10-26T06:32:26.558 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-26T06:32:26.558 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-26T06:32:26.558 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-26T06:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-26T06:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-26T06:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-26T06:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-26T06:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-26T06:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-26T06:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-26T06:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-26T06:32:26.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-26T06:32:26.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-26T06:32:26.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-26T06:32:26.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-26T06:32:26.561 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-26T06:32:26.562 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-26T06:32:26.562 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-26T06:32:26.562 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-26T06:32:26.562 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-26T06:32:26.562 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-26T06:32:26.563 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.563 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.563 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-26T06:32:26.563 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-26T06:32:26.563 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-26T06:32:26.563 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-26T06:32:26.564 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-26T06:32:26.564 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-26T06:32:26.564 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-26T06:32:26.565 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:32:26.565 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-10-26T06:32:26.849 DEBUG:teuthology.parallel:result is None 2023-10-26T06:32:26.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:32:27.004 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-26T06:32:27.060 INFO:teuthology.orchestra.run.smithi050.stdout:18.0.0-6863.g38499368.el8 2023-10-26T06:32:27.061 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863.g38499368.el8 2023-10-26T06:32:27.061 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863.g38499368 is installed. 2023-10-26T06:32:27.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:32:27.214 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-26T06:32:27.242 INFO:teuthology.orchestra.run.smithi125.stdout:18.0.0-6863.g38499368.el8 2023-10-26T06:32:27.243 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863.g38499368.el8 2023-10-26T06:32:27.243 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863.g38499368 is installed. 2023-10-26T06:32:27.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:32:27.466 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-26T06:32:27.494 INFO:teuthology.orchestra.run.smithi153.stdout:18.0.0-6863.g38499368.el8 2023-10-26T06:32:27.495 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863.g38499368.el8 2023-10-26T06:32:27.495 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863.g38499368 is installed. 2023-10-26T06:32:27.495 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-26T06:32:27.496 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:32:27.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-26T06:32:27.596 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:32:27.596 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-26T06:32:27.644 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:32:27.645 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-26T06:32:27.693 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-26T06:32:27.694 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:32:27.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-10-26T06:32:27.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-26T06:32:27.883 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:32:27.884 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2023-10-26T06:32:27.916 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-26T06:32:27.986 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:32:27.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-10-26T06:32:28.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-26T06:32:28.089 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-26T06:32:28.090 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:32:28.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-26T06:32:28.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-26T06:32:28.278 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:32:28.279 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-26T06:32:28.311 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-26T06:32:28.384 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:32:28.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-26T06:32:28.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-26T06:32:28.484 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-26T06:32:28.485 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:32:28.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-10-26T06:32:28.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-26T06:32:28.668 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:32:28.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2023-10-26T06:32:28.700 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-26T06:32:28.769 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:32:28.770 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-10-26T06:32:28.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-26T06:32:28.873 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-26T06:32:28.959 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-26T06:32:28.960 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:32:28.961 INFO:tasks.cephadm:Cluster fsid is 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:32:28.961 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-26T06:32:28.962 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.50', 'mon.b': '172.21.15.125', 'mon.c': '172.21.15.153'} 2023-10-26T06:32:28.962 INFO:tasks.cephadm:First mon is mon.a on smithi050 2023-10-26T06:32:28.962 INFO:tasks.cephadm:First mgr is x 2023-10-26T06:32:28.963 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-26T06:32:28.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2023-10-26T06:32:29.037 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname $(hostname -s) 2023-10-26T06:32:29.071 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2023-10-26T06:32:29.104 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-26T06:32:29.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:32:29.253 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73553/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6863-g38499368', 'node_name': '172.21.4.64+confusa02', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6863.g38499368'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-24 19:42:09.877327', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231024.144545', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/', 'archs': ['arm64', 'source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73554/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6863-g38499368', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6863.g38499368'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-24 17:51:36.100178', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231024.144545', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-10-26T06:32:29.476 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-batrick-testing-20231024.144545, sha1 384993681abceb8cb8affea10538d607052db4b4 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:32:29.477 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/x86_64/flavors/default/cephadm 2023-10-26T06:32:29.477 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:29.971 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 26 06:32 /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:29.971 DEBUG:teuthology.orchestra.run.smithi125:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:30.862 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 26 06:32 /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:30.862 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:31.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 26 06:32 /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:31.629 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:31.681 DEBUG:teuthology.orchestra.run.smithi125:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:31.703 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-26T06:32:31.754 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 on all hosts... 2023-10-26T06:32:31.755 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 pull 2023-10-26T06:32:31.759 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 pull 2023-10-26T06:32:31.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 pull 2023-10-26T06:32:33.138 INFO:teuthology.orchestra.run.smithi125.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4... 2023-10-26T06:32:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4... 2023-10-26T06:32:36.248 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4... 2023-10-26T06:33:04.527 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:33:04.528 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-26T06:33:04.528 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "3c558842a6a58df17819a90ea0aee78a222bf7a961aede7c9e924f0377629632", 2023-10-26T06:33:04.529 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2023-10-26T06:33:04.529 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:157f71b6318e4fe6f68f85c327ecc42c0e9055d75a7cde3c8e6625892ed6b040" 2023-10-26T06:33:04.529 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:33:04.530 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:33:05.330 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-26T06:33:05.331 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-26T06:33:05.331 INFO:teuthology.orchestra.run.smithi125.stdout: "image_id": "3c558842a6a58df17819a90ea0aee78a222bf7a961aede7c9e924f0377629632", 2023-10-26T06:33:05.331 INFO:teuthology.orchestra.run.smithi125.stdout: "repo_digests": [ 2023-10-26T06:33:05.331 INFO:teuthology.orchestra.run.smithi125.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:157f71b6318e4fe6f68f85c327ecc42c0e9055d75a7cde3c8e6625892ed6b040" 2023-10-26T06:33:05.332 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-26T06:33:05.332 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-26T06:33:06.038 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-26T06:33:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-26T06:33:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "3c558842a6a58df17819a90ea0aee78a222bf7a961aede7c9e924f0377629632", 2023-10-26T06:33:06.038 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2023-10-26T06:33:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:157f71b6318e4fe6f68f85c327ecc42c0e9055d75a7cde3c8e6625892ed6b040" 2023-10-26T06:33:06.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-10-26T06:33:06.039 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-26T06:33:06.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2023-10-26T06:33:06.138 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph 2023-10-26T06:33:06.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2023-10-26T06:33:06.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2023-10-26T06:33:06.278 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /etc/ceph 2023-10-26T06:33:06.311 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2023-10-26T06:33:06.338 INFO:tasks.cephadm:Writing seed config... 2023-10-26T06:33:06.339 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-26T06:33:06.340 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-26T06:33:06.340 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-26T06:33:06.340 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-26T06:33:06.340 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-26T06:33:06.341 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-26T06:33:06.341 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-26T06:33:06.341 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-26T06:33:06.342 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-10-26T06:33:06.342 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-10-26T06:33:06.342 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-10-26T06:33:06.342 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-26T06:33:06.343 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-26T06:33:06.343 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-10-26T06:33:06.343 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-10-26T06:33:06.343 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-26T06:33:06.344 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-26T06:33:06.344 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-10-26T06:33:06.344 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-26T06:33:06.344 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-26T06:33:06.345 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-26T06:33:06.345 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-26T06:33:06.345 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-26T06:33:06.345 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-26T06:33:06.346 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-26T06:33:06.346 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:33:06.347 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-26T06:33:06.391 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6f658e7e-73c9-11ee-8db9-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2023-10-26T06:33:06.392 DEBUG:teuthology.orchestra.run.smithi050:mon.a> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a.service 2023-10-26T06:33:06.436 DEBUG:teuthology.orchestra.run.smithi050:mgr.x> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x.service 2023-10-26T06:33:06.481 INFO:tasks.cephadm:Bootstrapping... 2023-10-26T06:33:06.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 -v bootstrap --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.50 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:33:06.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:33:06.551 INFO:journalctl@ceph.mgr.x.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:33:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-10-26T06:33:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', '-v', 'bootstrap', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.50', '--skip-admin-label'] 2023-10-26T06:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 4.1.1 2023-10-26T06:33:06.896 INFO:teuthology.orchestra.run.smithi050.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-26T06:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying podman|docker is present... 2023-10-26T06:33:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 4.1.1 2023-10-26T06:33:07.069 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying lvm2 is present... 2023-10-26T06:33:07.070 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying time synchronization is in place... 2023-10-26T06:33:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-26T06:33:07.084 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-26T06:33:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-26T06:33:07.097 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2023-10-26T06:33:07.111 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2023-10-26T06:33:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2023-10-26T06:33:07.124 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2023-10-26T06:33:07.125 INFO:teuthology.orchestra.run.smithi050.stdout:Repeating the final host check... 2023-10-26T06:33:07.297 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 4.1.1 2023-10-26T06:33:07.297 INFO:teuthology.orchestra.run.smithi050.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-26T06:33:07.297 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl is present 2023-10-26T06:33:07.297 INFO:teuthology.orchestra.run.smithi050.stdout:lvcreate is present 2023-10-26T06:33:07.310 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-26T06:33:07.311 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-26T06:33:07.323 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-26T06:33:07.324 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2023-10-26T06:33:07.337 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2023-10-26T06:33:07.351 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2023-10-26T06:33:07.353 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2023-10-26T06:33:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:Host looks OK 2023-10-26T06:33:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:Cluster fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:07.354 INFO:teuthology.orchestra.run.smithi050.stdout:Acquiring lock 140709813922280 on /run/cephadm/6f658e7e-73c9-11ee-8db9-212e2dc638e7.lock 2023-10-26T06:33:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:Lock 140709813922280 acquired on /run/cephadm/6f658e7e-73c9-11ee-8db9-212e2dc638e7.lock 2023-10-26T06:33:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 3300 ... 2023-10-26T06:33:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 6789 ... 2023-10-26T06:33:07.355 INFO:teuthology.orchestra.run.smithi050.stdout:Base mon IP(s) is [172.21.15.50:3300, 172.21.15.50:6789], mon addrv is [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2023-10-26T06:33:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-26T06:33:07.360 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.50 metric 100 2023-10-26T06:33:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-26T06:33:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-26T06:33:07.367 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1748sec hoplimit 64 pref medium 2023-10-26T06:33:07.373 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-26T06:33:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-26T06:33:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-26T06:33:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-26T06:33:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-26T06:33:07.374 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-26T06:33:07.375 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2023-10-26T06:33:07.375 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2023-10-26T06:33:07.375 INFO:teuthology.orchestra.run.smithi050.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-26T06:33:07.376 INFO:teuthology.orchestra.run.smithi050.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-26T06:33:07.376 INFO:teuthology.orchestra.run.smithi050.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4... 2023-10-26T06:33:07.853 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 3c558842a6a58df17819a90ea0aee78a222bf7a961aede7c9e924f0377629632 2023-10-26T06:33:07.853 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4... 2023-10-26T06:33:07.854 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Getting image source signatures 2023-10-26T06:33:07.854 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:e0288be9f59cf54e9f695ad8ed1728839ca25cdcdf0f94b536445ee2ca502075 2023-10-26T06:33:07.854 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:bbe8e0105070d322009febb1dbcee79a3945eab3305036f79cc6f757ea8642c0 2023-10-26T06:33:07.854 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying config sha256:3c558842a6a58df17819a90ea0aee78a222bf7a961aede7c9e924f0377629632 2023-10-26T06:33:07.855 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-26T06:33:07.855 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Storing signatures 2023-10-26T06:33:08.829 INFO:teuthology.orchestra.run.smithi050.stdout:ceph: stdout ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev) 2023-10-26T06:33:08.830 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph version: ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev) 2023-10-26T06:33:08.830 INFO:teuthology.orchestra.run.smithi050.stdout:Extracting ceph user uid/gid from container image... 2023-10-26T06:33:09.610 INFO:teuthology.orchestra.run.smithi050.stdout:stat: stdout 167 167 2023-10-26T06:33:09.611 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial keys... 2023-10-26T06:33:10.487 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQAlCDpluESFOhAAUpg8vG8TkCKgPObClzssZQ== 2023-10-26T06:33:11.270 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQAmCDplfU6LNRAAzO1puRUCamLgQNG1EiDi8A== 2023-10-26T06:33:12.147 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQAnCDpl9sedJhAAQg8UKKQ96SaNB+OuIUm2YA== 2023-10-26T06:33:12.149 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial monmap... 2023-10-26T06:33:12.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-26T06:33:12.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-26T06:33:12.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:12.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-26T06:33:12.925 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool for a [v2:172.21.15.50:3300,v1:172.21.15.50:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-26T06:33:12.926 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2023-10-26T06:33:12.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: set fsid to 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:12.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-26T06:33:12.926 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:33:12.926 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mon... 2023-10-26T06:33:14.111 INFO:teuthology.orchestra.run.smithi050.stdout:create mon.a on 2023-10-26T06:33:14.370 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-26T06:33:14.577 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-26T06:33:14.833 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7.target → /etc/systemd/system/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7.target. 2023-10-26T06:33:14.834 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7.target → /etc/systemd/system/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7.target. 2023-10-26T06:33:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a 2023-10-26T06:33:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a.service: Unit ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a.service not loaded. 2023-10-26T06:33:15.402 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7.target.wants/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@.service. 2023-10-26T06:33:15.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:15 smithi050 systemd[1]: Starting Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:33:16.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:15 smithi050 podman[94445]: 2023-10-26T06:33:16.232 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-26T06:33:16.232 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2023-10-26T06:33:16.248 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-26T06:33:16.248 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2023-10-26T06:33:16.248 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2023-10-26T06:33:16.249 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2023-10-26T06:33:16.249 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon to start... 2023-10-26T06:33:16.249 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon... 2023-10-26T06:33:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:16 smithi050 bash[94445]: 2c6f336419a0276783acc40f63eb7d144d5d9618259d2ba94e900986a2e49e23 2023-10-26T06:33:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:16 smithi050 ceph-mon[94485]: mkfs 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:16 smithi050 ceph-mon[94485]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-26T06:33:16.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:16 smithi050 systemd[1]: Started Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:33:17.333 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout cluster: 2023-10-26T06:33:17.335 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout id: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:17.335 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-26T06:33:17.335 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout services: 2023-10-26T06:33:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.689609s) 2023-10-26T06:33:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-26T06:33:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-26T06:33:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout data: 2023-10-26T06:33:17.337 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-26T06:33:17.337 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-26T06:33:17.337 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-26T06:33:17.337 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pgs: 2023-10-26T06:33:17.337 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:17.338 INFO:teuthology.orchestra.run.smithi050.stdout:mon is available 2023-10-26T06:33:17.338 INFO:teuthology.orchestra.run.smithi050.stdout:Assimilating anything we can from ceph.conf... 2023-10-26T06:33:17.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:17 smithi050 ceph-mon[94485]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-26T06:33:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:17 smithi050 ceph-mon[94485]: monmap e1: 1 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:33:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:17 smithi050 ceph-mon[94485]: fsmap 2023-10-26T06:33:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:17 smithi050 ceph-mon[94485]: osdmap e1: 0 total, 0 up, 0 in 2023-10-26T06:33:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:17 smithi050 ceph-mon[94485]: mgrmap e1: no daemons active 2023-10-26T06:33:17.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:17 smithi050 ceph-mon[94485]: from='client.? 172.21.15.50:0/3592495639' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-26T06:33:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:18 smithi050 ceph-mon[94485]: from='client.? 172.21.15.50:0/1464750358' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-26T06:33:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:18 smithi050 ceph-mon[94485]: from='client.? 172.21.15.50:0/1464750358' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-26T06:33:18.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:18.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2023-10-26T06:33:18.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:18.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2023-10-26T06:33:18.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-26T06:33:18.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-26T06:33:18.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-26T06:33:18.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-26T06:33:18.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:18.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-26T06:33:18.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-26T06:33:18.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2023-10-26T06:33:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-26T06:33:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-26T06:33:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-26T06:33:18.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-26T06:33:18.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-26T06:33:18.423 INFO:teuthology.orchestra.run.smithi050.stdout:Generating new minimal ceph.conf... 2023-10-26T06:33:20.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:20 smithi050 ceph-mon[94485]: from='client.? 172.21.15.50:0/62639702' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:33:20.802 INFO:teuthology.orchestra.run.smithi050.stdout:Restarting the monitor... 2023-10-26T06:33:21.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:20 smithi050 systemd[1]: Stopping Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:33:21.543 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94461]: 2023-10-26T06:33:21.279+0000 7fa7df899700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:33:21.544 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94461]: 2023-10-26T06:33:21.279+0000 7fa7df899700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-26T06:33:21.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:21 smithi050 bash[94823]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a 2023-10-26T06:33:22.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 systemd[1]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a.service: Succeeded. 2023-10-26T06:33:22.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 systemd[1]: Stopped Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:33:22.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 systemd[1]: Starting Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:33:22.712 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 podman[94954]: 2023-10-26T06:33:22.712 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 bash[94954]: 92de4461b3b4b4e8d835fdf498df0a349bbbed2d4d400b614c58a124d2d0f74c 2023-10-26T06:33:22.712 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: set uid:gid to 167:167 (ceph:ceph) 2023-10-26T06:33:22.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev), process ceph-mon, pid 7 2023-10-26T06:33:22.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: pidfile_write: ignore empty --pid-file 2023-10-26T06:33:22.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: load: jerasure load: lrc 2023-10-26T06:33:22.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: RocksDB version: 7.9.2 2023-10-26T06:33:22.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Git sha 0 2023-10-26T06:33:22.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Compile date 2023-10-24 16:36:40 2023-10-26T06:33:22.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: DB SUMMARY 2023-10-26T06:33:22.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: DB Session ID: JTGLBO65FE758TXOBQV3 2023-10-26T06:33:22.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: CURRENT file: CURRENT 2023-10-26T06:33:22.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: IDENTITY file: IDENTITY 2023-10-26T06:33:22.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-26T06:33:22.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-26T06:33:22.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 90621 ; 2023-10-26T06:33:22.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.error_if_exists: 0 2023-10-26T06:33:22.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.create_if_missing: 0 2023-10-26T06:33:22.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.paranoid_checks: 1 2023-10-26T06:33:22.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-26T06:33:22.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-26T06:33:22.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-26T06:33:22.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.env: 0x55fcc7c48da0 2023-10-26T06:33:22.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.fs: PosixFileSystem 2023-10-26T06:33:22.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.info_log: 0x55fcc8a276a0 2023-10-26T06:33:22.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_file_opening_threads: 16 2023-10-26T06:33:22.773 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.statistics: (nil) 2023-10-26T06:33:22.773 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.use_fsync: 0 2023-10-26T06:33:22.773 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_log_file_size: 0 2023-10-26T06:33:22.773 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-26T06:33:22.773 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-26T06:33:22.773 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.keep_log_file_num: 1000 2023-10-26T06:33:22.774 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.recycle_log_file_num: 0 2023-10-26T06:33:22.774 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.allow_fallocate: 1 2023-10-26T06:33:22.774 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.allow_mmap_reads: 0 2023-10-26T06:33:22.774 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.allow_mmap_writes: 0 2023-10-26T06:33:22.775 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.use_direct_reads: 0 2023-10-26T06:33:22.775 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-26T06:33:22.775 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.create_missing_column_families: 0 2023-10-26T06:33:22.775 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.db_log_dir: 2023-10-26T06:33:22.775 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.wal_dir: 2023-10-26T06:33:22.776 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-26T06:33:22.776 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-26T06:33:22.776 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-26T06:33:22.776 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-26T06:33:22.776 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-26T06:33:22.777 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-26T06:33:22.777 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.advise_random_on_open: 1 2023-10-26T06:33:22.777 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.db_write_buffer_size: 0 2023-10-26T06:33:22.777 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.write_buffer_manager: 0x55fcc89df360 2023-10-26T06:33:22.777 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-26T06:33:22.777 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-26T06:33:22.778 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-26T06:33:22.778 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.rate_limiter: (nil) 2023-10-26T06:33:22.778 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-26T06:33:22.778 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.wal_recovery_mode: 2 2023-10-26T06:33:22.778 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.enable_thread_tracking: 0 2023-10-26T06:33:22.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.enable_pipelined_write: 0 2023-10-26T06:33:22.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.unordered_write: 0 2023-10-26T06:33:22.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-26T06:33:22.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-26T06:33:22.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-26T06:33:22.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-26T06:33:22.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.row_cache: None 2023-10-26T06:33:22.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.wal_filter: None 2023-10-26T06:33:22.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-26T06:33:22.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.allow_ingest_behind: 0 2023-10-26T06:33:22.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.two_write_queues: 0 2023-10-26T06:33:22.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.manual_wal_flush: 0 2023-10-26T06:33:22.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.wal_compression: 0 2023-10-26T06:33:22.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.atomic_flush: 0 2023-10-26T06:33:22.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-26T06:33:22.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-26T06:33:22.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-26T06:33:22.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.log_readahead_size: 0 2023-10-26T06:33:22.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-26T06:33:22.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.best_efforts_recovery: 0 2023-10-26T06:33:22.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-26T06:33:22.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-26T06:33:22.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.allow_data_in_errors: 0 2023-10-26T06:33:22.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.db_host_id: __hostname__ 2023-10-26T06:33:22.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-26T06:33:22.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_background_jobs: 2 2023-10-26T06:33:22.784 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_background_compactions: -1 2023-10-26T06:33:22.784 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_subcompactions: 1 2023-10-26T06:33:22.784 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-26T06:33:22.784 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-26T06:33:22.784 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-26T06:33:22.785 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_total_wal_size: 0 2023-10-26T06:33:22.785 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-26T06:33:22.785 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-26T06:33:22.785 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-26T06:33:22.785 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-26T06:33:22.786 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_open_files: -1 2023-10-26T06:33:22.786 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bytes_per_sync: 0 2023-10-26T06:33:22.786 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-26T06:33:22.786 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-26T06:33:22.786 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_readahead_size: 0 2023-10-26T06:33:22.787 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_background_flushes: -1 2023-10-26T06:33:22.787 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Compression algorithms supported: 2023-10-26T06:33:22.787 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-26T06:33:22.787 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kZSTD supported: 0 2023-10-26T06:33:22.787 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kXpressCompression supported: 0 2023-10-26T06:33:22.788 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kLZ4HCCompression supported: 1 2023-10-26T06:33:22.788 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kZlibCompression supported: 1 2023-10-26T06:33:22.788 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kSnappyCompression supported: 1 2023-10-26T06:33:22.788 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kLZ4Compression supported: 1 2023-10-26T06:33:22.788 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: kBZip2Compression supported: 0 2023-10-26T06:33:22.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-26T06:33:22.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-26T06:33:22.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-26T06:33:22.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-26T06:33:22.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-26T06:33:22.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.merge_operator: 2023-10-26T06:33:22.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_filter: None 2023-10-26T06:33:22.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_filter_factory: None 2023-10-26T06:33:22.791 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.sst_partitioner_factory: None 2023-10-26T06:33:22.791 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-26T06:33:22.791 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-26T06:33:22.791 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fcc8a277a0) 2023-10-26T06:33:22.791 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks: 1 2023-10-26T06:33:22.791 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-26T06:33:22.792 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-26T06:33:22.792 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_top_level_index_and_filter: 1 2023-10-26T06:33:22.792 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_type: 0 2023-10-26T06:33:22.792 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_index_type: 0 2023-10-26T06:33:22.792 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_shortening: 1 2023-10-26T06:33:22.793 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-26T06:33:22.793 INFO:journalctl@ceph.mon.a.smithi050.stdout: checksum: 4 2023-10-26T06:33:22.793 INFO:journalctl@ceph.mon.a.smithi050.stdout: no_block_cache: 0 2023-10-26T06:33:22.793 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache: 0x55fcc8a7d1f0 2023-10-26T06:33:22.793 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_name: BinnedLRUCache 2023-10-26T06:33:22.794 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_options: 2023-10-26T06:33:22.794 INFO:journalctl@ceph.mon.a.smithi050.stdout: capacity : 536870912 2023-10-26T06:33:22.794 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_shard_bits : 4 2023-10-26T06:33:22.794 INFO:journalctl@ceph.mon.a.smithi050.stdout: strict_capacity_limit : 0 2023-10-26T06:33:22.794 INFO:journalctl@ceph.mon.a.smithi050.stdout: high_pri_pool_ratio: 0.000 2023-10-26T06:33:22.795 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_compressed: (nil) 2023-10-26T06:33:22.795 INFO:journalctl@ceph.mon.a.smithi050.stdout: persistent_cache: (nil) 2023-10-26T06:33:22.795 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size: 4096 2023-10-26T06:33:22.795 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size_deviation: 10 2023-10-26T06:33:22.795 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_restart_interval: 16 2023-10-26T06:33:22.796 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_block_restart_interval: 1 2023-10-26T06:33:22.796 INFO:journalctl@ceph.mon.a.smithi050.stdout: metadata_block_size: 4096 2023-10-26T06:33:22.796 INFO:journalctl@ceph.mon.a.smithi050.stdout: partition_filters: 0 2023-10-26T06:33:22.796 INFO:journalctl@ceph.mon.a.smithi050.stdout: use_delta_encoding: 1 2023-10-26T06:33:22.796 INFO:journalctl@ceph.mon.a.smithi050.stdout: filter_policy: bloomfilter 2023-10-26T06:33:22.796 INFO:journalctl@ceph.mon.a.smithi050.stdout: whole_key_filtering: 1 2023-10-26T06:33:22.797 INFO:journalctl@ceph.mon.a.smithi050.stdout: verify_compression: 0 2023-10-26T06:33:22.797 INFO:journalctl@ceph.mon.a.smithi050.stdout: read_amp_bytes_per_bit: 0 2023-10-26T06:33:22.797 INFO:journalctl@ceph.mon.a.smithi050.stdout: format_version: 5 2023-10-26T06:33:22.797 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_index_compression: 1 2023-10-26T06:33:22.797 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_align: 0 2023-10-26T06:33:22.798 INFO:journalctl@ceph.mon.a.smithi050.stdout: max_auto_readahead_size: 262144 2023-10-26T06:33:22.798 INFO:journalctl@ceph.mon.a.smithi050.stdout: prepopulate_block_cache: 0 2023-10-26T06:33:22.798 INFO:journalctl@ceph.mon.a.smithi050.stdout: initial_auto_readahead_size: 8192 2023-10-26T06:33:22.798 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_file_reads_for_auto_readahead: 2 2023-10-26T06:33:22.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.write_buffer_size: 33554432 2023-10-26T06:33:22.799 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_write_buffer_number: 2 2023-10-26T06:33:22.799 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression: NoCompression 2023-10-26T06:33:22.799 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression: Disabled 2023-10-26T06:33:22.799 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.prefix_extractor: nullptr 2023-10-26T06:33:22.799 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-26T06:33:22.800 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.num_levels: 7 2023-10-26T06:33:22.800 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-26T06:33:22.800 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-26T06:33:22.800 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-26T06:33:22.800 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-26T06:33:22.801 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-26T06:33:22.801 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-26T06:33:22.801 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-26T06:33:22.801 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-26T06:33:22.801 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-26T06:33:22.802 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-26T06:33:22.803 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-26T06:33:22.803 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-26T06:33:22.803 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-26T06:33:22.803 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.level: 32767 2023-10-26T06:33:22.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.strategy: 0 2023-10-26T06:33:22.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-26T06:33:22.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-26T06:33:22.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-26T06:33:22.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-26T06:33:22.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.enabled: false 2023-10-26T06:33:22.805 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-26T06:33:22.805 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-26T06:33:22.805 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-26T06:33:22.805 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-26T06:33:22.805 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.target_file_size_base: 67108864 2023-10-26T06:33:22.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-26T06:33:22.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-26T06:33:22.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-26T06:33:22.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-26T06:33:22.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-26T06:33:22.807 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-26T06:33:22.807 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-26T06:33:22.807 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-26T06:33:22.807 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-26T06:33:22.807 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-26T06:33:22.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-26T06:33:22.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-26T06:33:22.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-26T06:33:22.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-26T06:33:22.809 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.arena_block_size: 1048576 2023-10-26T06:33:22.809 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-26T06:33:22.809 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-26T06:33:22.809 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.disable_auto_compactions: 0 2023-10-26T06:33:22.809 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-26T06:33:22.810 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-26T06:33:22.810 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-26T06:33:22.810 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-26T06:33:22.810 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-26T06:33:22.810 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-26T06:33:22.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-26T06:33:22.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-26T06:33:22.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-26T06:33:22.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-26T06:33:22.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.table_properties_collectors: 2023-10-26T06:33:22.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.inplace_update_support: 0 2023-10-26T06:33:22.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-26T06:33:22.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-26T06:33:22.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-26T06:33:22.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-26T06:33:22.812 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.bloom_locality: 0 2023-10-26T06:33:22.813 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.max_successive_merges: 0 2023-10-26T06:33:22.813 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-26T06:33:22.813 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.paranoid_file_checks: 0 2023-10-26T06:33:22.813 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.force_consistency_checks: 1 2023-10-26T06:33:22.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.report_bg_io_stats: 0 2023-10-26T06:33:22.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.ttl: 2592000 2023-10-26T06:33:22.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-26T06:33:22.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-26T06:33:22.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-26T06:33:22.815 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.enable_blob_files: false 2023-10-26T06:33:22.815 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.min_blob_size: 0 2023-10-26T06:33:22.815 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.blob_file_size: 268435456 2023-10-26T06:33:22.815 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-26T06:33:22.815 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-26T06:33:22.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-26T06:33:22.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-26T06:33:22.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-26T06:33:22.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.blob_file_starting_level: 0 2023-10-26T06:33:22.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-26T06:33:22.816 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-26T06:33:22.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-26T06:33:22.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 29a476da-cd02-4582-a1a2-02fda791b4fd 2023-10-26T06:33:22.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302002720867, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-26T06:33:22.817 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-26T06:33:22.818 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302002722352, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 86570, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 84650, "index_size": 266, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11465, "raw_average_key_size": 48, "raw_value_size": 78183, "raw_average_value_size": 331, "num_data_blocks": 11, "num_entries": 236, "num_filter_entries": 236, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1698302002, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "29a476da-cd02-4582-a1a2-02fda791b4fd", "db_session_id": "JTGLBO65FE758TXOBQV3", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-26T06:33:22.818 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302002722507, "job": 1, "event": "recovery_finished"} 2023-10-26T06:33:22.818 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-26T06:33:22.818 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-26T06:33:22.818 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fcc8b1a000 2023-10-26T06:33:22.819 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: DB pointer 0x55fcc8b06000 2023-10-26T06:33:22.819 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-26T06:33:22.819 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-26T06:33:22.819 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** DB Stats ** 2023-10-26T06:33:22.819 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-26T06:33:22.820 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-26T06:33:22.820 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-26T06:33:22.820 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-26T06:33:22.820 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-26T06:33:22.820 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-26T06:33:22.821 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-26T06:33:22.821 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2023-10-26T06:33:22.821 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2023-10-26T06:33:22.821 INFO:journalctl@ceph.mon.a.smithi050.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-26T06:33:22.821 INFO:journalctl@ceph.mon.a.smithi050.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-26T06:33:22.822 INFO:journalctl@ceph.mon.a.smithi050.stdout: L0 2/0 86.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-26T06:33:22.822 INFO:journalctl@ceph.mon.a.smithi050.stdout: Sum 2/0 86.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-26T06:33:22.822 INFO:journalctl@ceph.mon.a.smithi050.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 90.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-26T06:33:22.822 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2023-10-26T06:33:22.822 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2023-10-26T06:33:22.823 INFO:journalctl@ceph.mon.a.smithi050.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-26T06:33:22.823 INFO:journalctl@ceph.mon.a.smithi050.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-26T06:33:22.823 INFO:journalctl@ceph.mon.a.smithi050.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 90.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-26T06:33:22.823 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2023-10-26T06:33:22.823 INFO:journalctl@ceph.mon.a.smithi050.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-26T06:33:22.823 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2023-10-26T06:33:22.824 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-26T06:33:22.824 INFO:journalctl@ceph.mon.a.smithi050.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-26T06:33:22.824 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-26T06:33:22.824 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-26T06:33:22.824 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-26T06:33:22.825 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-26T06:33:22.825 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative compaction: 0.00 GB write, 13.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-26T06:33:22.825 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval compaction: 0.00 GB write, 13.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-26T06:33:22.825 INFO:journalctl@ceph.mon.a.smithi050.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-26T06:33:22.825 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache BinnedLRUCache@0x55fcc8a7d1f0#7 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-26T06:33:22.826 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-26T06:33:22.826 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2023-10-26T06:33:22.826 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-26T06:33:22.826 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: starting mon.a rank 0 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:22.826 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???) e1 preinit fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:22.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).mds e1 new map 2023-10-26T06:33:22.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).mds e1 print_map 2023-10-26T06:33:22.827 INFO:journalctl@ceph.mon.a.smithi050.stdout: e1 2023-10-26T06:33:22.827 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-26T06:33:22.828 INFO:journalctl@ceph.mon.a.smithi050.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-26T06:33:22.828 INFO:journalctl@ceph.mon.a.smithi050.stdout: legacy client fscid: -1 2023-10-26T06:33:22.828 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2023-10-26T06:33:22.828 INFO:journalctl@ceph.mon.a.smithi050.stdout: No filesystems configured 2023-10-26T06:33:22.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-26T06:33:22.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:33:22.829 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:33:22.829 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:33:22.829 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-26T06:33:22.829 INFO:teuthology.orchestra.run.smithi050.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-26T06:33:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 systemd[1]: Started Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:33:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-26T06:33:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: monmap e1: 1 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:33:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: fsmap 2023-10-26T06:33:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: osdmap e1: 0 total, 0 up, 0 in 2023-10-26T06:33:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:22 smithi050 ceph-mon[94997]: mgrmap e1: no daemons active 2023-10-26T06:33:23.872 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-26T06:33:23.891 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:33:23.892 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mgr... 2023-10-26T06:33:23.892 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-26T06:33:23.892 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-26T06:33:24.275 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x 2023-10-26T06:33:24.275 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x.service: Unit ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x.service not loaded. 2023-10-26T06:33:24.481 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7.target.wants/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@.service. 2023-10-26T06:33:24.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:24 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/154780799' entity='client.admin' 2023-10-26T06:33:24.768 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:24 smithi050 systemd[1]: Starting Ceph mgr.x for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:33:27.703 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:27 smithi050 podman[95228]: 2023-10-26T06:33:27.703 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:27 smithi050 bash[95228]: ec1677c82baf3720e2b741412fc83c5a8de01457c83f0a96c03d8632074a8a36 2023-10-26T06:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-26T06:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2023-10-26T06:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-26T06:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2023-10-26T06:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2023-10-26T06:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2023-10-26T06:33:27.763 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-26T06:33:27.763 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2023-10-26T06:33:27.780 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-26T06:33:27.780 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2023-10-26T06:33:27.780 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2023-10-26T06:33:27.780 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-26T06:33:27.781 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr to start... 2023-10-26T06:33:27.781 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr... 2023-10-26T06:33:28.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:27 smithi050 systemd[1]: Started Ceph mgr.x for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:33:28.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:27.795+0000 7f57e891c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-26T06:33:28.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:27.910+0000 7f57e891c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-26T06:33:28.433 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:28.040+0000 7f57e891c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-26T06:33:28.433 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:28.187+0000 7f57e891c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-26T06:33:28.433 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:28.431+0000 7f57e891c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-26T06:33:28.965 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:28.968 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:33:28.968 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:33:28.968 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2023-10-26T06:33:28.969 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-26T06:33:28.969 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-26T06:33:28.969 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-26T06:33:28.969 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.969 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-26T06:33:28.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-26T06:33:28.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2023-10-26T06:33:28.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:28.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-26T06:33:28.970 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2023-10-26T06:33:28.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:28.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-26T06:33:28.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-26T06:33:28.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:28.971 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-26T06:33:28.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-26T06:33:28.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-26T06:33:28.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:28.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-26T06:33:28.972 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-26T06:33:28.973 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-26T06:33:28.976 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-26T06:33:28.976 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-26T06:33:28.976 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-26T06:33:28.977 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.977 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-26T06:33:28.977 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-26T06:33:28.977 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-26T06:33:28.977 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-26T06:33:28.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-26T06:33:28.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-26T06:33:28.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-26T06:33:28.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-26T06:33:28.978 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-26T06:33:28.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-26T06:33:28.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:28.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-26T06:33:28.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-26T06:33:28.979 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-26T06:33:28.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-26T06:33:28.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-26T06:33:28.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-26T06:33:28.980 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-26T06:33:28.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-26T06:33:28.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2023-10-26T06:33:28.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:28.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-26T06:33:28.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.981 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-26T06:33:28.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:28.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2023-10-26T06:33:16.189115+0000", 2023-10-26T06:33:28.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-26T06:33:28.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:28.982 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-26T06:33:28.983 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:33:28.983 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (1/15)... 2023-10-26T06:33:28.996 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:28 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/622752952' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-26T06:33:28.997 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:28.940+0000 7f57e891c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-26T06:33:29.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:29.114+0000 7f57e891c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-26T06:33:29.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:29.236+0000 7f57e891c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-26T06:33:29.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:29.366+0000 7f57e891c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-26T06:33:30.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:29.935+0000 7f57e891c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-26T06:33:31.235 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:30.861+0000 7f57e891c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-26T06:33:31.235 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:30.971+0000 7f57e891c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-26T06:33:32.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:31 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/134743924' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-26T06:33:32.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:32.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:33:32.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:33:32.059 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2023-10-26T06:33:32.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-26T06:33:32.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-26T06:33:32.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-26T06:33:32.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.060 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-26T06:33:32.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-26T06:33:32.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2023-10-26T06:33:32.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:32.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-26T06:33:32.061 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2023-10-26T06:33:32.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:32.062 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-10-26T06:33:32.063 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-26T06:33:32.063 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:32.064 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-26T06:33:32.064 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-26T06:33:32.064 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.064 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-26T06:33:32.064 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:32.065 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-26T06:33:32.065 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-26T06:33:32.065 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-26T06:33:32.068 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-26T06:33:32.068 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-26T06:33:32.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-26T06:33:32.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-26T06:33:32.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-26T06:33:32.069 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-26T06:33:32.070 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-26T06:33:32.070 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-26T06:33:32.070 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-26T06:33:32.070 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-26T06:33:32.070 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-26T06:33:32.071 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-26T06:33:32.071 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.071 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-26T06:33:32.071 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:32.071 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-26T06:33:32.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-26T06:33:32.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-26T06:33:32.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-26T06:33:32.072 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-26T06:33:32.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-26T06:33:32.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-26T06:33:32.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-26T06:33:32.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2023-10-26T06:33:32.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:32.073 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-26T06:33:32.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-26T06:33:32.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:32.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2023-10-26T06:33:16.189115+0000", 2023-10-26T06:33:32.074 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-26T06:33:32.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:32.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-26T06:33:32.075 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:33:32.075 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (2/15)... 2023-10-26T06:33:32.400 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:32.018+0000 7f57e891c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:33:32.401 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:32.157+0000 7f57e891c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-26T06:33:32.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:32.399+0000 7f57e891c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:33:33.099 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:32.799+0000 7f57e891c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-26T06:33:33.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:33.097+0000 7f57e891c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-26T06:33:33.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:33.308+0000 7f57e891c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-26T06:33:34.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:33.685+0000 7f57e891c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-26T06:33:34.961 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:34.683+0000 7f57e891c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-26T06:33:34.961 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:34.865+0000 7f57e891c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-26T06:33:35.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:35.131+0000 7f57e891c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-26T06:33:35.575 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:35.284+0000 7f57e891c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-26T06:33:36.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:35.573+0000 7f57e891c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-26T06:33:37.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:36.704+0000 7f57e891c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-26T06:33:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: Activating manager daemon x 2023-10-26T06:33:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: mgrmap e2: x(active, starting, since 0.00410195s) 2023-10-26T06:33:37.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-26T06:33:37.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-26T06:33:37.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-26T06:33:37.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:33:37.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-26T06:33:37.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: Manager daemon x is now available 2023-10-26T06:33:37.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-26T06:33:37.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-26T06:33:37.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' 2023-10-26T06:33:37.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' 2023-10-26T06:33:37.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:36 smithi050 ceph-mon[94997]: from='mgr.14100 172.21.15.50:0/3006599530' entity='mgr.x' 2023-10-26T06:33:38.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:38.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:33:38.659 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:33:38.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2023-10-26T06:33:38.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-26T06:33:38.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-26T06:33:38.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-26T06:33:38.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.660 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-26T06:33:38.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-26T06:33:38.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2023-10-26T06:33:38.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:38.661 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-26T06:33:38.662 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2023-10-26T06:33:38.662 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:38.662 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-10-26T06:33:38.662 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-26T06:33:38.663 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:38.663 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-26T06:33:38.663 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-26T06:33:38.663 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.663 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-26T06:33:38.663 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:38.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-26T06:33:38.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-26T06:33:38.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-26T06:33:38.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-26T06:33:38.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-26T06:33:38.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-26T06:33:38.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-26T06:33:38.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-26T06:33:38.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-26T06:33:38.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-26T06:33:38.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-26T06:33:38.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-26T06:33:38.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-26T06:33:38.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-26T06:33:38.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-26T06:33:38.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-26T06:33:38.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:38.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-26T06:33:38.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-26T06:33:38.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-26T06:33:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-26T06:33:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-26T06:33:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-26T06:33:38.670 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-26T06:33:38.670 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-26T06:33:38.670 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2023-10-26T06:33:38.670 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2023-10-26T06:33:38.671 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-26T06:33:38.671 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.671 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-26T06:33:38.671 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-26T06:33:38.672 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2023-10-26T06:33:16.189115+0000", 2023-10-26T06:33:38.672 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-26T06:33:38.672 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2023-10-26T06:33:38.672 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-26T06:33:38.673 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:33:38.673 INFO:teuthology.orchestra.run.smithi050.stdout:mgr is available 2023-10-26T06:33:38.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:38 smithi050 ceph-mon[94997]: mgrmap e3: x(active, since 1.00796s) 2023-10-26T06:33:38.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:38 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2276023988' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-26T06:33:39.835 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2023-10-26T06:33:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-26T06:33:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-26T06:33:39.836 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-26T06:33:39.837 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-26T06:33:39.837 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:39.837 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-26T06:33:39.837 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-26T06:33:39.837 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2023-10-26T06:33:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2023-10-26T06:33:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-26T06:33:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-26T06:33:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-26T06:33:39.838 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-26T06:33:39.839 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-26T06:33:39.839 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling cephadm module... 2023-10-26T06:33:40.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:39 smithi050 ceph-mon[94997]: mgrmap e4: x(active, since 2s) 2023-10-26T06:33:40.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:39 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3049287681' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-26T06:33:41.005 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:40 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1897299078' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-26T06:33:41.006 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: ignoring --setuser ceph since I am not root 2023-10-26T06:33:41.006 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: ignoring --setgroup ceph since I am not root 2023-10-26T06:33:41.006 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:41.004+0000 7f19b918a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-26T06:33:41.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:41.116+0000 7f19b918a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-26T06:33:41.659 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:41.270+0000 7f19b918a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-26T06:33:41.659 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:41.401+0000 7f19b918a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-26T06:33:42.014 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1897299078' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-26T06:33:42.014 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-mon[94997]: mgrmap e5: x(active, since 4s) 2023-10-26T06:33:42.014 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:41.657+0000 7f19b918a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-26T06:33:42.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:42.155+0000 7f19b918a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-26T06:33:42.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:33:42.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-26T06:33:42.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-26T06:33:42.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-26T06:33:42.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-26T06:33:42.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:33:42.423 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2023-10-26T06:33:42.423 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 5... 2023-10-26T06:33:42.589 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:42.326+0000 7f19b918a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-26T06:33:42.589 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:42.454+0000 7f19b918a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-26T06:33:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:42 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1872470747' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-26T06:33:43.018 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:42.587+0000 7f19b918a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-26T06:33:43.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:43.166+0000 7f19b918a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-26T06:33:44.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:44.048+0000 7f19b918a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-26T06:33:44.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:44.157+0000 7f19b918a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-26T06:33:45.515 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:45.155+0000 7f19b918a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:33:45.515 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:45.280+0000 7f19b918a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-26T06:33:45.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:45.513+0000 7f19b918a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:33:46.179 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:45.892+0000 7f19b918a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-26T06:33:46.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:46.177+0000 7f19b918a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-26T06:33:46.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:46.378+0000 7f19b918a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-26T06:33:47.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:46.735+0000 7f19b918a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-26T06:33:48.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:47.705+0000 7f19b918a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-26T06:33:48.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:47.887+0000 7f19b918a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-26T06:33:48.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:48.147+0000 7f19b918a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-26T06:33:48.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:48.299+0000 7f19b918a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-26T06:33:49.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:48.586+0000 7f19b918a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-26T06:33:50.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:33:49.697+0000 7f19b918a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-26T06:33:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: Active manager daemon x restarted 2023-10-26T06:33:50.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: Activating manager daemon x 2023-10-26T06:33:50.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: osdmap e2: 0 total, 0 up, 0 in 2023-10-26T06:33:50.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: mgrmap e6: x(active, starting, since 0.00370075s) 2023-10-26T06:33:50.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:33:50.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-26T06:33:50.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-26T06:33:50.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-26T06:33:50.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-26T06:33:50.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: Manager daemon x is now available 2023-10-26T06:33:50.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:50.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:50.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:33:50.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:33:50.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:49 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:33:51.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:50 smithi050 ceph-mon[94997]: Found migration_current of "None". Setting to last migration. 2023-10-26T06:33:51.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:50 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-26T06:33:51.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:50 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-26T06:33:51.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:50 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:51.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:50 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:51.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:50 smithi050 ceph-mon[94997]: mgrmap e7: x(active, since 1.00698s) 2023-10-26T06:33:51.216 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:33:51.217 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-26T06:33:51.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-26T06:33:51.218 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:33:51.218 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 5 is available 2023-10-26T06:33:51.219 INFO:teuthology.orchestra.run.smithi050.stdout:Setting orchestrator backend to cephadm... 2023-10-26T06:33:52.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:51 smithi050 ceph-mon[94997]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-26T06:33:52.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:51 smithi050 ceph-mon[94997]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-26T06:33:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:52 smithi050 ceph-mon[94997]: mgrmap e8: x(active, since 2s) 2023-10-26T06:33:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:52 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:53.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:52 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:33:53.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:52 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:33:53.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-26T06:33:53.579 INFO:teuthology.orchestra.run.smithi050.stdout:Generating ssh key... 2023-10-26T06:33:53.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:53 smithi050 ceph-mon[94997]: [26/Oct/2023:06:33:51] ENGINE Bus STARTING 2023-10-26T06:33:53.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:53 smithi050 ceph-mon[94997]: [26/Oct/2023:06:33:51] ENGINE Serving on http://172.21.15.50:8765 2023-10-26T06:33:53.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:53 smithi050 ceph-mon[94997]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:33:53.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:53 smithi050 ceph-mon[94997]: [26/Oct/2023:06:33:52] ENGINE Serving on https://172.21.15.50:7150 2023-10-26T06:33:53.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:53 smithi050 ceph-mon[94997]: [26/Oct/2023:06:33:52] ENGINE Bus STARTED 2023-10-26T06:33:54.834 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-mon[94997]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:33:54.835 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:54.835 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:33:54.835 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: Generating public/private rsa key pair. 2023-10-26T06:33:54.836 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: Your identification has been saved in /tmp/tmpbs3pohl0/key. 2023-10-26T06:33:54.836 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: Your public key has been saved in /tmp/tmpbs3pohl0/key.pub. 2023-10-26T06:33:54.836 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: The key fingerprint is: 2023-10-26T06:33:54.836 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: SHA256:TRGQplI3l2lhlyzQszjxLAREkcS4qxG1iMTacSXrIpk ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:54.836 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: The key's randomart image is: 2023-10-26T06:33:54.837 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: +---[RSA 3072]----+ 2023-10-26T06:33:54.837 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: |. .BB+o==*.. | 2023-10-26T06:33:54.837 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: | o. +o+ B.Ooo | 2023-10-26T06:33:54.837 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: |oo =.+ = O.+ | 2023-10-26T06:33:54.837 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: |oo+.+ . +o+ | 2023-10-26T06:33:54.838 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: |E ...o So. | 2023-10-26T06:33:54.838 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: | .... | 2023-10-26T06:33:54.838 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: | o | 2023-10-26T06:33:54.839 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: | . | 2023-10-26T06:33:54.839 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: | | 2023-10-26T06:33:54.839 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:33:54 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: +----[SHA256]-----+ 2023-10-26T06:33:56.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:55 smithi050 ceph-mon[94997]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:33:56.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:55 smithi050 ceph-mon[94997]: Generating ssh key... 2023-10-26T06:33:56.241 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:33:56.242 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-26T06:33:56.242 INFO:teuthology.orchestra.run.smithi050.stdout:Adding key to root@localhost authorized_keys... 2023-10-26T06:33:56.245 INFO:teuthology.orchestra.run.smithi050.stdout:Adding host smithi050... 2023-10-26T06:33:57.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:56 smithi050 ceph-mon[94997]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:33:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:58 smithi050 ceph-mon[94997]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:33:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:33:58 smithi050 ceph-mon[94997]: Deploying cephadm binary to smithi050 2023-10-26T06:34:00.829 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Added host 'smithi050' with addr '172.21.15.50' 2023-10-26T06:34:00.830 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mon service... 2023-10-26T06:34:01.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:01 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:01.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:01 smithi050 ceph-mon[94997]: Added host smithi050 2023-10-26T06:34:01.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:01 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:02.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-26T06:34:02.208 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mgr service... 2023-10-26T06:34:02.797 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:02 smithi050 ceph-mon[94997]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:02.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:02 smithi050 ceph-mon[94997]: Saving service mon spec with placement count:5 2023-10-26T06:34:02.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:02 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:03.792 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-26T06:34:04.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:04 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:04.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:04 smithi050 ceph-mon[94997]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:04.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:04 smithi050 ceph-mon[94997]: Saving service mgr spec with placement count:2 2023-10-26T06:34:04.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:04 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:04.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:04 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:05.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:05 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1558160152' entity='client.admin' 2023-10-26T06:34:06.258 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling the dashboard module... 2023-10-26T06:34:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:06 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:06 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2934811316' entity='client.admin' 2023-10-26T06:34:08.141 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:07 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4068318011' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-26T06:34:08.141 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:07 smithi050 ceph-mon[94997]: from='mgr.14118 172.21.15.50:0/3784764387' entity='mgr.x' 2023-10-26T06:34:08.142 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:07 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: ignoring --setuser ceph since I am not root 2023-10-26T06:34:08.142 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:07 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: ignoring --setgroup ceph since I am not root 2023-10-26T06:34:08.142 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:08.139+0000 7f7e6679a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-26T06:34:08.402 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:08.254+0000 7f7e6679a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-26T06:34:08.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:08.400+0000 7f7e6679a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-26T06:34:08.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:08.540+0000 7f7e6679a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-26T06:34:09.062 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4068318011' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-26T06:34:09.062 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-mon[94997]: mgrmap e9: x(active, since 18s) 2023-10-26T06:34:09.063 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:08.784+0000 7f7e6679a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-26T06:34:09.319 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:09 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:09.298+0000 7f7e6679a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-26T06:34:09.590 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:09 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:09.468+0000 7f7e6679a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-26T06:34:09.727 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:34:09.727 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-26T06:34:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-26T06:34:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-26T06:34:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-26T06:34:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:34:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2023-10-26T06:34:09.728 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 9... 2023-10-26T06:34:10.004 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:09 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2971131375' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-26T06:34:10.004 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:09 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:09.590+0000 7f7e6679a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-26T06:34:10.005 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:09 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:09.722+0000 7f7e6679a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-26T06:34:10.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:10 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:10.302+0000 7f7e6679a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-26T06:34:11.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:11 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:11.182+0000 7f7e6679a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-26T06:34:11.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:11 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:11.291+0000 7f7e6679a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-26T06:34:12.651 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:12 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:12.287+0000 7f7e6679a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:34:12.651 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:12 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:12.414+0000 7f7e6679a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-26T06:34:13.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:12 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:12.649+0000 7f7e6679a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:34:13.318 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:13.028+0000 7f7e6679a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-26T06:34:13.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:13.316+0000 7f7e6679a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-26T06:34:13.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:13.519+0000 7f7e6679a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-26T06:34:14.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:13.880+0000 7f7e6679a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-26T06:34:15.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:14 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:14.852+0000 7f7e6679a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-26T06:34:15.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:15.035+0000 7f7e6679a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-26T06:34:15.742 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:15.298+0000 7f7e6679a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-26T06:34:15.742 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:15.451+0000 7f7e6679a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-26T06:34:16.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:15.740+0000 7f7e6679a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-26T06:34:17.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:34:16.856+0000 7f7e6679a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-26T06:34:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: Active manager daemon x restarted 2023-10-26T06:34:17.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: Activating manager daemon x 2023-10-26T06:34:17.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: osdmap e3: 0 total, 0 up, 0 in 2023-10-26T06:34:17.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: mgrmap e10: x(active, starting, since 0.00408756s) 2023-10-26T06:34:17.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:34:17.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-26T06:34:17.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-26T06:34:17.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-26T06:34:17.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-26T06:34:17.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: Manager daemon x is now available 2023-10-26T06:34:17.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:17.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-26T06:34:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-26T06:34:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:17 smithi050 ceph-mon[94997]: mgrmap e11: x(active, since 1.00725s) 2023-10-26T06:34:18.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2023-10-26T06:34:18.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-26T06:34:18.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-26T06:34:18.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2023-10-26T06:34:18.425 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 9 is available 2023-10-26T06:34:18.426 INFO:teuthology.orchestra.run.smithi050.stdout:Generating a dashboard self-signed certificate... 2023-10-26T06:34:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:18 smithi050 ceph-mon[94997]: [26/Oct/2023:06:34:17] ENGINE Bus STARTING 2023-10-26T06:34:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:18 smithi050 ceph-mon[94997]: [26/Oct/2023:06:34:17] ENGINE Serving on http://172.21.15.50:8765 2023-10-26T06:34:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:18 smithi050 ceph-mon[94997]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-26T06:34:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:18 smithi050 ceph-mon[94997]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-26T06:34:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:18 smithi050 ceph-mon[94997]: [26/Oct/2023:06:34:17] ENGINE Serving on https://172.21.15.50:7150 2023-10-26T06:34:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:18 smithi050 ceph-mon[94997]: [26/Oct/2023:06:34:17] ENGINE Bus STARTED 2023-10-26T06:34:19.808 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-26T06:34:19.809 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial admin user... 2023-10-26T06:34:20.098 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:19 smithi050 ceph-mon[94997]: mgrmap e12: x(active, since 2s) 2023-10-26T06:34:20.098 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:20.099 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:20.099 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:21.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:20 smithi050 ceph-mon[94997]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:21.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:20 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:21.387 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$gJZZi.W1j5QajhrNud35NeIri8iu9aS6V3b3GvNdw8xYn7zlulAii", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1698302060, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-26T06:34:21.387 INFO:teuthology.orchestra.run.smithi050.stdout:Fetching dashboard port number... 2023-10-26T06:34:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:21 smithi050 ceph-mon[94997]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:21 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:22.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 8443 2023-10-26T06:34:22.901 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-26T06:34:22.901 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2023-10-26T06:34:22.919 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-26T06:34:22.919 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2023-10-26T06:34:22.919 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2023-10-26T06:34:22.920 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-26T06:34:22.922 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph Dashboard is now available at: 2023-10-26T06:34:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: URL: https://smithi050.front.sepia.ceph.com:8443/ 2023-10-26T06:34:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: User: admin 2023-10-26T06:34:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: Password: ftg0faiyim 2023-10-26T06:34:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:22.924 INFO:teuthology.orchestra.run.smithi050.stdout:Saving cluster configuration to /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config directory 2023-10-26T06:34:22.924 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling autotune for osd_memory_target 2023-10-26T06:34:23.177 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/365312934' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-26T06:34:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:24 smithi050 ceph-mon[94997]: mgrmap e13: x(active, since 6s) 2023-10-26T06:34:25.382 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-26T06:34:25.383 INFO:teuthology.orchestra.run.smithi050.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-26T06:34:25.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.383 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:34:25.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.383 INFO:teuthology.orchestra.run.smithi050.stdout:Or, if you are only running a single cluster on this host: 2023-10-26T06:34:25.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.384 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-26T06:34:25.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.384 INFO:teuthology.orchestra.run.smithi050.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-26T06:34:25.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.385 INFO:teuthology.orchestra.run.smithi050.stdout: ceph telemetry on 2023-10-26T06:34:25.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.385 INFO:teuthology.orchestra.run.smithi050.stdout:For more information see: 2023-10-26T06:34:25.385 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.385 INFO:teuthology.orchestra.run.smithi050.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-26T06:34:25.386 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:25.386 INFO:teuthology.orchestra.run.smithi050.stdout:Bootstrap complete. 2023-10-26T06:34:25.445 INFO:tasks.cephadm:Fetching config... 2023-10-26T06:34:25.446 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:34:25.446 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-26T06:34:25.495 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-26T06:34:25.495 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:34:25.495 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-26T06:34:25.593 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-26T06:34:25.593 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:34:25.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-26T06:34:25.712 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-26T06:34:25.712 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:34:25.713 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-26T06:34:25.805 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-26T06:34:25.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-26T06:34:25.964 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:34:25.998 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-26T06:34:26.055 INFO:teuthology.orchestra.run.smithi125.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:34:26.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-26T06:34:26.116 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUh9xnuOCARnMDm73zYzjBYqi+uwMV9FYVYk1/kvPb4vrAkOqg4ItMfz5q0AImBCCs9Hi5Udu6ly3sku1mvkDxbQ5jpdt/EemLaX4avF1ATfWfEBorcYmU8wM1+t8omUqfkLFRie3lrDdK5pHytpCxd7xGLYMpfDHUmF0ZWjLSn/D0hUp7XZWYhAZPHHIaNGinr+fcdTOSTKnDRr1u4qWKARXP4P3/KxQPBHbx2Nj03Fq1P+Iy+Ur6QvyU9p+L/v4fb27uI+ET2OsvPMACrXjomu8ecHxp10Sj4RudnJMMCkQNw/7M16WtfHRYF+hhvnBUJyxrSEbFHPOn6nbmt6cwuEJysnUaNX5hO+v4/+A7DJaLvM89xVz45wqpr472iYMIbeE4Ov0P/s0tH6+fTDW7m0/gKjDC1Noq7wWgqvbRvNsHVfdS1LEUda1dDgDHaTqB00pj4ioT8BblrVVWfPiXBMTNXUV+59hDCXfPhs0PvlFUnI+mxUzz7IbBTTvejqE= ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:34:26.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-26T06:34:26.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:26 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3472964985' entity='client.admin' 2023-10-26T06:34:26.879 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:29.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:28 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:29.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:28 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:29.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:28 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:34:29.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:28 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:29.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:28 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:29.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:28 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:29.527 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-26T06:34:29.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-26T06:34:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:30 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/196282597' entity='client.admin' 2023-10-26T06:34:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:30 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:30 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:30.373 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:32.560 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi125 2023-10-26T06:34:32.561 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:34:32.561 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/etc/ceph/ceph.conf 2023-10-26T06:34:32.582 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:34:32.582 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:34:32.642 INFO:tasks.cephadm:Adding host smithi125 to orchestrator... 2023-10-26T06:34:32.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch host add smithi125 2023-10-26T06:34:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:34:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:34:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:34:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:32 smithi050 ceph-mon[94997]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:34:33.407 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:33 smithi050 ceph-mon[94997]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:34:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:33 smithi050 ceph-mon[94997]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:34:35.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:35 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:35.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:35 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:35.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:35 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:36.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:36 smithi050 ceph-mon[94997]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi125", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:36.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:36 smithi050 ceph-mon[94997]: Deploying cephadm binary to smithi125 2023-10-26T06:34:37.715 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi125' with addr '172.21.15.125' 2023-10-26T06:34:38.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:37 smithi050 ceph-mon[94997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:38.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:37 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:38.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:37 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:38.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-26T06:34:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:38 smithi050 ceph-mon[94997]: Added host smithi125 2023-10-26T06:34:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:38 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:38 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:40.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:39 smithi050 ceph-mon[94997]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:40.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:39 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:40.625 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:40.625 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.125", "hostname": "smithi125", "labels": [], "status": ""}] 2023-10-26T06:34:41.221 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2023-10-26T06:34:41.221 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:34:41.221 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2023-10-26T06:34:41.242 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:34:41.242 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:34:41.300 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2023-10-26T06:34:41.301 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch host add smithi153 2023-10-26T06:34:42.042 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:41 smithi050 ceph-mon[94997]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:34:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:41 smithi050 ceph-mon[94997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:44.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:44.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:44.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:44.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:44.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:34:44.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:34:44.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:34:44.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:34:44.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:44.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:34:44.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:44.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:44.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:43 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:44 smithi050 ceph-mon[94997]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:34:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:44 smithi050 ceph-mon[94997]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:34:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:44 smithi050 ceph-mon[94997]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:46.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:45 smithi050 ceph-mon[94997]: Deploying cephadm binary to smithi153 2023-10-26T06:34:46.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:45 smithi050 ceph-mon[94997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:46.215 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi153' with addr '172.21.15.153' 2023-10-26T06:34:46.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-26T06:34:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:47.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:47 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:47.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:47 smithi050 ceph-mon[94997]: Added host smithi153 2023-10-26T06:34:47.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:47 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:47.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:47 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:47.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:47 smithi050 ceph-mon[94997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:48.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:48 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:49.101 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:34:49.101 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.125", "hostname": "smithi125", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2023-10-26T06:34:49.562 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-26T06:34:49.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd crush tunables default 2023-10-26T06:34:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:49 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:49 smithi050 ceph-mon[94997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:34:50.866 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:50 smithi050 ceph-mon[94997]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:34:52.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:51 smithi050 ceph-mon[94997]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:52.803 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-10-26T06:34:53.171 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:34:53.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:34:53.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:34:53.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:34:53.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2566083979' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-26T06:34:53.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.174 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:52 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:53.287 INFO:tasks.cephadm:Adding mon.a on smithi050 2023-10-26T06:34:53.288 INFO:tasks.cephadm:Adding mon.b on smithi125 2023-10-26T06:34:53.288 INFO:tasks.cephadm:Adding mon.c on smithi153 2023-10-26T06:34:53.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch apply mon '3;smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c' 2023-10-26T06:34:53.875 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:34:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:53 smithi050 ceph-mon[94997]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:34:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:53 smithi050 ceph-mon[94997]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:34:54.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:53 smithi050 ceph-mon[94997]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:34:54.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:53 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2566083979' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-26T06:34:54.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:53 smithi050 ceph-mon[94997]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:34:54.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:53 smithi050 ceph-mon[94997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:55.594 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2023-10-26T06:34:56.174 DEBUG:teuthology.orchestra.run.smithi125:mon.b> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.b.service 2023-10-26T06:34:56.177 DEBUG:teuthology.orchestra.run.smithi153:mon.c> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.c.service 2023-10-26T06:34:56.179 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-26T06:34:56.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph mon dump -f json 2023-10-26T06:34:56.209 INFO:journalctl@ceph.mon.c.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:34:56.213 INFO:journalctl@ceph.mon.b.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:34:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:34:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:34:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:34:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:34:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:34:56.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:55 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:34:57.089 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:34:57.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:56 smithi050 ceph-mon[94997]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:34:57.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:56 smithi050 ceph-mon[94997]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c;count:3 2023-10-26T06:34:57.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:56 smithi050 ceph-mon[94997]: Deploying daemon mon.c on smithi153 2023-10-26T06:34:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:57 smithi050 ceph-mon[94997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:34:59.233 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:34:59 smithi153 systemd[1]: Starting Ceph mon.c for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:34:59.407 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:34:59.407 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","modified":"2023-10-26T06:33:12.527988Z","created":"2023-10-26T06:33:12.527988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-26T06:34:59.409 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2023-10-26T06:34:59.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:34:59 smithi153 podman[131595]: 2023-10-26T06:35:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:59 smithi050 ceph-mon[94997]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:34:59 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/2932479502' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: set uid:gid to 167:167 (ceph:ceph) 2023-10-26T06:35:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev), process ceph-mon, pid 7 2023-10-26T06:35:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pidfile_write: ignore empty --pid-file 2023-10-26T06:35:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: load: jerasure load: lrc 2023-10-26T06:35:00.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: RocksDB version: 7.9.2 2023-10-26T06:35:00.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Git sha 0 2023-10-26T06:35:00.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Compile date 2023-10-24 16:36:40 2023-10-26T06:35:00.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: DB SUMMARY 2023-10-26T06:35:00.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: DB Session ID: 0HR6FHJPT17GRRU6P4HG 2023-10-26T06:35:00.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: CURRENT file: CURRENT 2023-10-26T06:35:00.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: IDENTITY file: IDENTITY 2023-10-26T06:35:00.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-26T06:35:00.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-26T06:35:00.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-26T06:35:00.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.error_if_exists: 0 2023-10-26T06:35:00.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.create_if_missing: 0 2023-10-26T06:35:00.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.paranoid_checks: 1 2023-10-26T06:35:00.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-26T06:35:00.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-26T06:35:00.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-26T06:35:00.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.env: 0x560489832da0 2023-10-26T06:35:00.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.fs: PosixFileSystem 2023-10-26T06:35:00.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.info_log: 0x56048b621660 2023-10-26T06:35:00.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_file_opening_threads: 16 2023-10-26T06:35:00.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.statistics: (nil) 2023-10-26T06:35:00.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.use_fsync: 0 2023-10-26T06:35:00.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_log_file_size: 0 2023-10-26T06:35:00.491 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-26T06:35:00.491 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-26T06:35:00.491 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.keep_log_file_num: 1000 2023-10-26T06:35:00.491 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.recycle_log_file_num: 0 2023-10-26T06:35:00.491 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.allow_fallocate: 1 2023-10-26T06:35:00.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.allow_mmap_reads: 0 2023-10-26T06:35:00.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.allow_mmap_writes: 0 2023-10-26T06:35:00.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.use_direct_reads: 0 2023-10-26T06:35:00.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-26T06:35:00.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.create_missing_column_families: 0 2023-10-26T06:35:00.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.db_log_dir: 2023-10-26T06:35:00.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.wal_dir: 2023-10-26T06:35:00.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-26T06:35:00.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-26T06:35:00.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-26T06:35:00.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-26T06:35:00.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-26T06:35:00.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-26T06:35:00.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.advise_random_on_open: 1 2023-10-26T06:35:00.495 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.db_write_buffer_size: 0 2023-10-26T06:35:00.495 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.write_buffer_manager: 0x56048b5d9360 2023-10-26T06:35:00.495 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-26T06:35:00.495 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-26T06:35:00.495 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-26T06:35:00.496 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.rate_limiter: (nil) 2023-10-26T06:35:00.496 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-26T06:35:00.496 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.wal_recovery_mode: 2 2023-10-26T06:35:00.496 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.enable_thread_tracking: 0 2023-10-26T06:35:00.496 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.enable_pipelined_write: 0 2023-10-26T06:35:00.497 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.unordered_write: 0 2023-10-26T06:35:00.497 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-26T06:35:00.497 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-26T06:35:00.497 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-26T06:35:00.497 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-26T06:35:00.498 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.row_cache: None 2023-10-26T06:35:00.498 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.wal_filter: None 2023-10-26T06:35:00.498 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-26T06:35:00.498 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.allow_ingest_behind: 0 2023-10-26T06:35:00.499 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.two_write_queues: 0 2023-10-26T06:35:00.499 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.manual_wal_flush: 0 2023-10-26T06:35:00.499 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.wal_compression: 0 2023-10-26T06:35:00.499 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.atomic_flush: 0 2023-10-26T06:35:00.499 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-26T06:35:00.500 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-26T06:35:00.500 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-26T06:35:00.500 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.log_readahead_size: 0 2023-10-26T06:35:00.500 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-26T06:35:00.500 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.best_efforts_recovery: 0 2023-10-26T06:35:00.501 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-26T06:35:00.501 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-26T06:35:00.501 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.allow_data_in_errors: 0 2023-10-26T06:35:00.501 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.db_host_id: __hostname__ 2023-10-26T06:35:00.503 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-26T06:35:00.503 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_background_jobs: 2 2023-10-26T06:35:00.503 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_background_compactions: -1 2023-10-26T06:35:00.503 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_subcompactions: 1 2023-10-26T06:35:00.504 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-26T06:35:00.504 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-26T06:35:00.504 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-26T06:35:00.504 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_total_wal_size: 0 2023-10-26T06:35:00.504 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-26T06:35:00.505 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-26T06:35:00.505 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-26T06:35:00.505 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-26T06:35:00.505 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_open_files: -1 2023-10-26T06:35:00.505 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bytes_per_sync: 0 2023-10-26T06:35:00.506 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-26T06:35:00.506 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-26T06:35:00.506 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_readahead_size: 0 2023-10-26T06:35:00.506 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_background_flushes: -1 2023-10-26T06:35:00.506 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Compression algorithms supported: 2023-10-26T06:35:00.507 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-26T06:35:00.507 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kZSTD supported: 0 2023-10-26T06:35:00.507 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kXpressCompression supported: 0 2023-10-26T06:35:00.507 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kLZ4HCCompression supported: 1 2023-10-26T06:35:00.508 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kZlibCompression supported: 1 2023-10-26T06:35:00.508 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kSnappyCompression supported: 1 2023-10-26T06:35:00.508 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kLZ4Compression supported: 1 2023-10-26T06:35:00.508 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: kBZip2Compression supported: 0 2023-10-26T06:35:00.508 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-26T06:35:00.509 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-26T06:35:00.509 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-26T06:35:00.509 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-26T06:35:00.509 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-26T06:35:00.509 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.merge_operator: 2023-10-26T06:35:00.510 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_filter: None 2023-10-26T06:35:00.510 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_filter_factory: None 2023-10-26T06:35:00.510 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.sst_partitioner_factory: None 2023-10-26T06:35:00.510 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-26T06:35:00.510 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-26T06:35:00.511 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56048b621760) 2023-10-26T06:35:00.511 INFO:journalctl@ceph.mon.c.smithi153.stdout: cache_index_and_filter_blocks: 1 2023-10-26T06:35:00.511 INFO:journalctl@ceph.mon.c.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-26T06:35:00.511 INFO:journalctl@ceph.mon.c.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-26T06:35:00.512 INFO:journalctl@ceph.mon.c.smithi153.stdout: pin_top_level_index_and_filter: 1 2023-10-26T06:35:00.512 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_type: 0 2023-10-26T06:35:00.512 INFO:journalctl@ceph.mon.c.smithi153.stdout: data_block_index_type: 0 2023-10-26T06:35:00.512 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_shortening: 1 2023-10-26T06:35:00.512 INFO:journalctl@ceph.mon.c.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-26T06:35:00.513 INFO:journalctl@ceph.mon.c.smithi153.stdout: checksum: 4 2023-10-26T06:35:00.513 INFO:journalctl@ceph.mon.c.smithi153.stdout: no_block_cache: 0 2023-10-26T06:35:00.513 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache: 0x56048b6771f0 2023-10-26T06:35:00.513 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_name: BinnedLRUCache 2023-10-26T06:35:00.513 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_options: 2023-10-26T06:35:00.514 INFO:journalctl@ceph.mon.c.smithi153.stdout: capacity : 536870912 2023-10-26T06:35:00.514 INFO:journalctl@ceph.mon.c.smithi153.stdout: num_shard_bits : 4 2023-10-26T06:35:00.514 INFO:journalctl@ceph.mon.c.smithi153.stdout: strict_capacity_limit : 0 2023-10-26T06:35:00.514 INFO:journalctl@ceph.mon.c.smithi153.stdout: high_pri_pool_ratio: 0.000 2023-10-26T06:35:00.514 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_compressed: (nil) 2023-10-26T06:35:00.515 INFO:journalctl@ceph.mon.c.smithi153.stdout: persistent_cache: (nil) 2023-10-26T06:35:00.515 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_size: 4096 2023-10-26T06:35:00.515 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_size_deviation: 10 2023-10-26T06:35:00.515 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_restart_interval: 16 2023-10-26T06:35:00.516 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_block_restart_interval: 1 2023-10-26T06:35:00.516 INFO:journalctl@ceph.mon.c.smithi153.stdout: metadata_block_size: 4096 2023-10-26T06:35:00.516 INFO:journalctl@ceph.mon.c.smithi153.stdout: partition_filters: 0 2023-10-26T06:35:00.516 INFO:journalctl@ceph.mon.c.smithi153.stdout: use_delta_encoding: 1 2023-10-26T06:35:00.516 INFO:journalctl@ceph.mon.c.smithi153.stdout: filter_policy: bloomfilter 2023-10-26T06:35:00.517 INFO:journalctl@ceph.mon.c.smithi153.stdout: whole_key_filtering: 1 2023-10-26T06:35:00.517 INFO:journalctl@ceph.mon.c.smithi153.stdout: verify_compression: 0 2023-10-26T06:35:00.517 INFO:journalctl@ceph.mon.c.smithi153.stdout: read_amp_bytes_per_bit: 0 2023-10-26T06:35:00.517 INFO:journalctl@ceph.mon.c.smithi153.stdout: format_version: 5 2023-10-26T06:35:00.517 INFO:journalctl@ceph.mon.c.smithi153.stdout: enable_index_compression: 1 2023-10-26T06:35:00.518 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_align: 0 2023-10-26T06:35:00.518 INFO:journalctl@ceph.mon.c.smithi153.stdout: max_auto_readahead_size: 262144 2023-10-26T06:35:00.518 INFO:journalctl@ceph.mon.c.smithi153.stdout: prepopulate_block_cache: 0 2023-10-26T06:35:00.518 INFO:journalctl@ceph.mon.c.smithi153.stdout: initial_auto_readahead_size: 8192 2023-10-26T06:35:00.518 INFO:journalctl@ceph.mon.c.smithi153.stdout: num_file_reads_for_auto_readahead: 2 2023-10-26T06:35:00.519 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.write_buffer_size: 33554432 2023-10-26T06:35:00.519 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_write_buffer_number: 2 2023-10-26T06:35:00.519 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression: NoCompression 2023-10-26T06:35:00.519 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression: Disabled 2023-10-26T06:35:00.520 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.prefix_extractor: nullptr 2023-10-26T06:35:00.520 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-26T06:35:00.520 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.num_levels: 7 2023-10-26T06:35:00.520 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-26T06:35:00.520 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-26T06:35:00.521 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-26T06:35:00.521 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-26T06:35:00.521 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-26T06:35:00.521 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-26T06:35:00.521 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-26T06:35:00.522 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-26T06:35:00.522 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-26T06:35:00.522 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-26T06:35:00.522 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-26T06:35:00.523 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-26T06:35:00.523 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-26T06:35:00.523 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.level: 32767 2023-10-26T06:35:00.523 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.strategy: 0 2023-10-26T06:35:00.523 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-26T06:35:00.524 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-26T06:35:00.524 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-26T06:35:00.524 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-26T06:35:00.524 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.enabled: false 2023-10-26T06:35:00.524 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-26T06:35:00.525 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-26T06:35:00.525 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-26T06:35:00.525 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-26T06:35:00.525 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.target_file_size_base: 67108864 2023-10-26T06:35:00.525 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-26T06:35:00.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-26T06:35:00.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-26T06:35:00.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-26T06:35:00.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-26T06:35:00.526 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-26T06:35:00.527 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-26T06:35:00.527 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-26T06:35:00.527 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-26T06:35:00.527 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-26T06:35:00.528 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-26T06:35:00.528 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-26T06:35:00.528 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-26T06:35:00.528 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-26T06:35:00.528 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.arena_block_size: 1048576 2023-10-26T06:35:00.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-26T06:35:00.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-26T06:35:00.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.disable_auto_compactions: 0 2023-10-26T06:35:00.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-26T06:35:00.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-26T06:35:00.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-26T06:35:00.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-26T06:35:00.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-26T06:35:00.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-26T06:35:00.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-26T06:35:00.531 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-26T06:35:00.531 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-26T06:35:00.531 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-26T06:35:00.531 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.table_properties_collectors: 2023-10-26T06:35:00.532 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.inplace_update_support: 0 2023-10-26T06:35:00.532 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-26T06:35:00.532 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-26T06:35:00.532 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-26T06:35:00.532 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-26T06:35:00.533 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.bloom_locality: 0 2023-10-26T06:35:00.533 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.max_successive_merges: 0 2023-10-26T06:35:00.533 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-26T06:35:00.533 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.paranoid_file_checks: 0 2023-10-26T06:35:00.533 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.force_consistency_checks: 1 2023-10-26T06:35:00.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.report_bg_io_stats: 0 2023-10-26T06:35:00.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.ttl: 2592000 2023-10-26T06:35:00.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-26T06:35:00.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-26T06:35:00.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-26T06:35:00.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.enable_blob_files: false 2023-10-26T06:35:00.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.min_blob_size: 0 2023-10-26T06:35:00.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.blob_file_size: 268435456 2023-10-26T06:35:00.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-26T06:35:00.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-26T06:35:00.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-26T06:35:00.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-26T06:35:00.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-26T06:35:00.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.blob_file_starting_level: 0 2023-10-26T06:35:00.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-26T06:35:00.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-26T06:35:00.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-26T06:35:00.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8830dc12-65fb-48d4-ad56-982db60af6a2 2023-10-26T06:35:00.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302100082148, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-26T06:35:00.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-26T06:35:00.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302100082584, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1698302100, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8830dc12-65fb-48d4-ad56-982db60af6a2", "db_session_id": "0HR6FHJPT17GRRU6P4HG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-26T06:35:00.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302100082650, "job": 1, "event": "recovery_finished"} 2023-10-26T06:35:00.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-26T06:35:00.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-26T06:35:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56048b714000 2023-10-26T06:35:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: DB pointer 0x56048b700000 2023-10-26T06:35:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-26T06:35:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-26T06:35:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** DB Stats ** 2023-10-26T06:35:00.540 INFO:journalctl@ceph.mon.c.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-26T06:35:00.540 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-26T06:35:00.540 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-26T06:35:00.540 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-26T06:35:00.540 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-26T06:35:00.541 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-26T06:35:00.541 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-26T06:35:00.541 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2023-10-26T06:35:00.541 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** Compaction Stats [default] ** 2023-10-26T06:35:00.542 INFO:journalctl@ceph.mon.c.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-26T06:35:00.542 INFO:journalctl@ceph.mon.c.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-26T06:35:00.542 INFO:journalctl@ceph.mon.c.smithi153.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:00.542 INFO:journalctl@ceph.mon.c.smithi153.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:00.542 INFO:journalctl@ceph.mon.c.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:00.543 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2023-10-26T06:35:00.543 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** Compaction Stats [default] ** 2023-10-26T06:35:00.543 INFO:journalctl@ceph.mon.c.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-26T06:35:00.543 INFO:journalctl@ceph.mon.c.smithi153.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-26T06:35:00.543 INFO:journalctl@ceph.mon.c.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:00.544 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2023-10-26T06:35:00.544 INFO:journalctl@ceph.mon.c.smithi153.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-26T06:35:00.544 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2023-10-26T06:35:00.544 INFO:journalctl@ceph.mon.c.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-26T06:35:00.544 INFO:journalctl@ceph.mon.c.smithi153.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-26T06:35:00.545 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-26T06:35:00.545 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-26T06:35:00.545 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-26T06:35:00.545 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-26T06:35:00.545 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-26T06:35:00.546 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-26T06:35:00.546 INFO:journalctl@ceph.mon.c.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-26T06:35:00.546 INFO:journalctl@ceph.mon.c.smithi153.stdout: Block cache BinnedLRUCache@0x56048b6771f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-10-26T06:35:00.546 INFO:journalctl@ceph.mon.c.smithi153.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-26T06:35:00.547 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2023-10-26T06:35:00.547 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-26T06:35:00.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-26T06:35:00.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: using public_addr v2:172.21.15.153:0/0 -> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-10-26T06:35:00.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: starting mon.c rank -1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:35:00.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(???) e0 preinit fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:35:00.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 bash[131595]: 68a17b2895674bc9d86fd4f67d39ca6779e82ea71313a4ed2afa6186196d990d 2023-10-26T06:35:00.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).mds e1 new map 2023-10-26T06:35:00.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-26T06:35:00.548 INFO:journalctl@ceph.mon.c.smithi153.stdout: e1 2023-10-26T06:35:00.549 INFO:journalctl@ceph.mon.c.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-26T06:35:00.549 INFO:journalctl@ceph.mon.c.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-26T06:35:00.549 INFO:journalctl@ceph.mon.c.smithi153.stdout: legacy client fscid: -1 2023-10-26T06:35:00.549 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2023-10-26T06:35:00.549 INFO:journalctl@ceph.mon.c.smithi153.stdout: No filesystems configured 2023-10-26T06:35:00.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-26T06:35:00.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-26T06:35:00.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-26T06:35:00.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-26T06:35:00.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-26T06:35:00.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-26T06:35:00.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-26T06:35:00.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:35:00.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:35:00.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:35:00.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:00.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:00.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:00.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:00.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:00.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:00.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:00.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:00.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Deploying cephadm binary to smithi153 2023-10-26T06:35:00.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Added host smithi153 2023-10-26T06:35:00.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:00.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:35:00.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:00.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:00.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:00.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:00.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2566083979' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-26T06:35:00.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:00.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:00.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:00.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2566083979' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-26T06:35:00.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:00.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:00.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:00.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:00.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:00.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:00.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:00.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:00.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c;count:3 2023-10-26T06:35:00.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: Deploying daemon mon.c on smithi153 2023-10-26T06:35:00.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:00.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/2932479502' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:00.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 ceph-mon[131657]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-26T06:35:00.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:00 smithi153 systemd[1]: Started Ceph mon.c for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:35:01.210 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-26T06:35:01.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph mon dump -f json 2023-10-26T06:35:01.785 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:35:05.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:05.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: mon.a calling monitor election 2023-10-26T06:35:05.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:05.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: mon.c calling monitor election 2023-10-26T06:35:05.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:05.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:05.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-26T06:35:05.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: monmap e2: 2 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:05.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: fsmap 2023-10-26T06:35:05.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:05.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: mgrmap e13: x(active, since 48s) 2023-10-26T06:35:05.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: overall HEALTH_OK 2023-10-26T06:35:05.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:05.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:05 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:05.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:05.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: mon.a calling monitor election 2023-10-26T06:35:05.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:05.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: mon.c calling monitor election 2023-10-26T06:35:05.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:05.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:05.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:05.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-26T06:35:05.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: monmap e2: 2 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:05.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: fsmap 2023-10-26T06:35:05.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:05.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: mgrmap e13: x(active, since 48s) 2023-10-26T06:35:05.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: overall HEALTH_OK 2023-10-26T06:35:05.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:05.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:05 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:06 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:06 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:06.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:06 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:06.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:06 smithi153 ceph-mon[131657]: Deploying daemon mon.b on smithi125 2023-10-26T06:35:06.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:06 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:06 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:06 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:06 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:06.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:06 smithi050 ceph-mon[94997]: Deploying daemon mon.b on smithi125 2023-10-26T06:35:06.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:06 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:06.601 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:35:06.601 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","modified":"2023-10-26T06:35:00.110972Z","created":"2023-10-26T06:33:12.527988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-26T06:35:06.604 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2023-10-26T06:35:07.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:07 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/226912884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:07.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:07 smithi153 ceph-mon[131657]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:07.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:07 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/226912884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:07.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:07 smithi050 ceph-mon[94997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:07.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:07 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:07.111+0000 7f7e1fe22700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-26T06:35:08.069 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:07 smithi125 systemd[1]: Starting Ceph mon.b for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:35:08.151 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-26T06:35:08.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph mon dump -f json 2023-10-26T06:35:08.323 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 podman[130603]: 2023-10-26T06:35:08.323 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: set uid:gid to 167:167 (ceph:ceph) 2023-10-26T06:35:08.324 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev), process ceph-mon, pid 7 2023-10-26T06:35:08.324 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pidfile_write: ignore empty --pid-file 2023-10-26T06:35:08.324 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: load: jerasure load: lrc 2023-10-26T06:35:08.324 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: RocksDB version: 7.9.2 2023-10-26T06:35:08.324 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Git sha 0 2023-10-26T06:35:08.325 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Compile date 2023-10-24 16:36:40 2023-10-26T06:35:08.325 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: DB SUMMARY 2023-10-26T06:35:08.325 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: DB Session ID: TWFA5IMFJK2170PX93D5 2023-10-26T06:35:08.325 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: CURRENT file: CURRENT 2023-10-26T06:35:08.325 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: IDENTITY file: IDENTITY 2023-10-26T06:35:08.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-26T06:35:08.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-26T06:35:08.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-26T06:35:08.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.error_if_exists: 0 2023-10-26T06:35:08.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.create_if_missing: 0 2023-10-26T06:35:08.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.paranoid_checks: 1 2023-10-26T06:35:08.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-26T06:35:08.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-26T06:35:08.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-26T06:35:08.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.env: 0x55f6f0733da0 2023-10-26T06:35:08.328 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.fs: PosixFileSystem 2023-10-26T06:35:08.328 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.info_log: 0x55f6f168b660 2023-10-26T06:35:08.328 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_file_opening_threads: 16 2023-10-26T06:35:08.328 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.statistics: (nil) 2023-10-26T06:35:08.328 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.use_fsync: 0 2023-10-26T06:35:08.329 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_log_file_size: 0 2023-10-26T06:35:08.329 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-26T06:35:08.329 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-26T06:35:08.329 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.keep_log_file_num: 1000 2023-10-26T06:35:08.329 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.recycle_log_file_num: 0 2023-10-26T06:35:08.330 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.allow_fallocate: 1 2023-10-26T06:35:08.330 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.allow_mmap_reads: 0 2023-10-26T06:35:08.330 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.allow_mmap_writes: 0 2023-10-26T06:35:08.330 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.use_direct_reads: 0 2023-10-26T06:35:08.330 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-26T06:35:08.330 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.create_missing_column_families: 0 2023-10-26T06:35:08.331 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.db_log_dir: 2023-10-26T06:35:08.331 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.wal_dir: 2023-10-26T06:35:08.331 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-26T06:35:08.331 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-26T06:35:08.331 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-26T06:35:08.332 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-26T06:35:08.332 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-26T06:35:08.332 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-26T06:35:08.332 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.advise_random_on_open: 1 2023-10-26T06:35:08.332 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.db_write_buffer_size: 0 2023-10-26T06:35:08.333 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.write_buffer_manager: 0x55f6f1643360 2023-10-26T06:35:08.333 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-26T06:35:08.333 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-26T06:35:08.333 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-26T06:35:08.333 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.rate_limiter: (nil) 2023-10-26T06:35:08.333 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-26T06:35:08.334 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.wal_recovery_mode: 2 2023-10-26T06:35:08.334 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.enable_thread_tracking: 0 2023-10-26T06:35:08.334 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.enable_pipelined_write: 0 2023-10-26T06:35:08.334 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.unordered_write: 0 2023-10-26T06:35:08.334 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-26T06:35:08.335 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-26T06:35:08.335 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-26T06:35:08.335 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-26T06:35:08.335 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.row_cache: None 2023-10-26T06:35:08.335 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.wal_filter: None 2023-10-26T06:35:08.335 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-26T06:35:08.336 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.allow_ingest_behind: 0 2023-10-26T06:35:08.336 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.two_write_queues: 0 2023-10-26T06:35:08.336 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.manual_wal_flush: 0 2023-10-26T06:35:08.336 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.wal_compression: 0 2023-10-26T06:35:08.336 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.atomic_flush: 0 2023-10-26T06:35:08.337 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-26T06:35:08.337 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-26T06:35:08.337 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-26T06:35:08.337 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.log_readahead_size: 0 2023-10-26T06:35:08.337 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-26T06:35:08.337 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.best_efforts_recovery: 0 2023-10-26T06:35:08.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-26T06:35:08.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-26T06:35:08.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.allow_data_in_errors: 0 2023-10-26T06:35:08.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.db_host_id: __hostname__ 2023-10-26T06:35:08.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-26T06:35:08.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_background_jobs: 2 2023-10-26T06:35:08.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_background_compactions: -1 2023-10-26T06:35:08.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_subcompactions: 1 2023-10-26T06:35:08.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-26T06:35:08.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-26T06:35:08.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-26T06:35:08.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_total_wal_size: 0 2023-10-26T06:35:08.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-26T06:35:08.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-26T06:35:08.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-26T06:35:08.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-26T06:35:08.341 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_open_files: -1 2023-10-26T06:35:08.341 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bytes_per_sync: 0 2023-10-26T06:35:08.341 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-26T06:35:08.341 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-26T06:35:08.341 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_readahead_size: 0 2023-10-26T06:35:08.342 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_background_flushes: -1 2023-10-26T06:35:08.342 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Compression algorithms supported: 2023-10-26T06:35:08.342 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-26T06:35:08.342 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kZSTD supported: 0 2023-10-26T06:35:08.342 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kXpressCompression supported: 0 2023-10-26T06:35:08.343 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kLZ4HCCompression supported: 1 2023-10-26T06:35:08.343 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kZlibCompression supported: 1 2023-10-26T06:35:08.343 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kSnappyCompression supported: 1 2023-10-26T06:35:08.343 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kLZ4Compression supported: 1 2023-10-26T06:35:08.343 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: kBZip2Compression supported: 0 2023-10-26T06:35:08.344 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-26T06:35:08.344 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-26T06:35:08.344 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-26T06:35:08.344 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-26T06:35:08.344 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-26T06:35:08.345 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.merge_operator: 2023-10-26T06:35:08.345 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_filter: None 2023-10-26T06:35:08.345 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_filter_factory: None 2023-10-26T06:35:08.345 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.sst_partitioner_factory: None 2023-10-26T06:35:08.345 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-26T06:35:08.345 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-26T06:35:08.346 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f6f168b760) 2023-10-26T06:35:08.346 INFO:journalctl@ceph.mon.b.smithi125.stdout: cache_index_and_filter_blocks: 1 2023-10-26T06:35:08.346 INFO:journalctl@ceph.mon.b.smithi125.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-26T06:35:08.346 INFO:journalctl@ceph.mon.b.smithi125.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-26T06:35:08.346 INFO:journalctl@ceph.mon.b.smithi125.stdout: pin_top_level_index_and_filter: 1 2023-10-26T06:35:08.347 INFO:journalctl@ceph.mon.b.smithi125.stdout: index_type: 0 2023-10-26T06:35:08.347 INFO:journalctl@ceph.mon.b.smithi125.stdout: data_block_index_type: 0 2023-10-26T06:35:08.347 INFO:journalctl@ceph.mon.b.smithi125.stdout: index_shortening: 1 2023-10-26T06:35:08.347 INFO:journalctl@ceph.mon.b.smithi125.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-26T06:35:08.347 INFO:journalctl@ceph.mon.b.smithi125.stdout: checksum: 4 2023-10-26T06:35:08.348 INFO:journalctl@ceph.mon.b.smithi125.stdout: no_block_cache: 0 2023-10-26T06:35:08.348 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_cache: 0x55f6f16e11f0 2023-10-26T06:35:08.348 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_cache_name: BinnedLRUCache 2023-10-26T06:35:08.348 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_cache_options: 2023-10-26T06:35:08.348 INFO:journalctl@ceph.mon.b.smithi125.stdout: capacity : 536870912 2023-10-26T06:35:08.348 INFO:journalctl@ceph.mon.b.smithi125.stdout: num_shard_bits : 4 2023-10-26T06:35:08.349 INFO:journalctl@ceph.mon.b.smithi125.stdout: strict_capacity_limit : 0 2023-10-26T06:35:08.349 INFO:journalctl@ceph.mon.b.smithi125.stdout: high_pri_pool_ratio: 0.000 2023-10-26T06:35:08.349 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_cache_compressed: (nil) 2023-10-26T06:35:08.349 INFO:journalctl@ceph.mon.b.smithi125.stdout: persistent_cache: (nil) 2023-10-26T06:35:08.349 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_size: 4096 2023-10-26T06:35:08.350 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_size_deviation: 10 2023-10-26T06:35:08.350 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_restart_interval: 16 2023-10-26T06:35:08.350 INFO:journalctl@ceph.mon.b.smithi125.stdout: index_block_restart_interval: 1 2023-10-26T06:35:08.350 INFO:journalctl@ceph.mon.b.smithi125.stdout: metadata_block_size: 4096 2023-10-26T06:35:08.350 INFO:journalctl@ceph.mon.b.smithi125.stdout: partition_filters: 0 2023-10-26T06:35:08.351 INFO:journalctl@ceph.mon.b.smithi125.stdout: use_delta_encoding: 1 2023-10-26T06:35:08.351 INFO:journalctl@ceph.mon.b.smithi125.stdout: filter_policy: bloomfilter 2023-10-26T06:35:08.351 INFO:journalctl@ceph.mon.b.smithi125.stdout: whole_key_filtering: 1 2023-10-26T06:35:08.351 INFO:journalctl@ceph.mon.b.smithi125.stdout: verify_compression: 0 2023-10-26T06:35:08.351 INFO:journalctl@ceph.mon.b.smithi125.stdout: read_amp_bytes_per_bit: 0 2023-10-26T06:35:08.351 INFO:journalctl@ceph.mon.b.smithi125.stdout: format_version: 5 2023-10-26T06:35:08.352 INFO:journalctl@ceph.mon.b.smithi125.stdout: enable_index_compression: 1 2023-10-26T06:35:08.352 INFO:journalctl@ceph.mon.b.smithi125.stdout: block_align: 0 2023-10-26T06:35:08.352 INFO:journalctl@ceph.mon.b.smithi125.stdout: max_auto_readahead_size: 262144 2023-10-26T06:35:08.352 INFO:journalctl@ceph.mon.b.smithi125.stdout: prepopulate_block_cache: 0 2023-10-26T06:35:08.352 INFO:journalctl@ceph.mon.b.smithi125.stdout: initial_auto_readahead_size: 8192 2023-10-26T06:35:08.353 INFO:journalctl@ceph.mon.b.smithi125.stdout: num_file_reads_for_auto_readahead: 2 2023-10-26T06:35:08.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.write_buffer_size: 33554432 2023-10-26T06:35:08.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_write_buffer_number: 2 2023-10-26T06:35:08.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression: NoCompression 2023-10-26T06:35:08.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression: Disabled 2023-10-26T06:35:08.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.prefix_extractor: nullptr 2023-10-26T06:35:08.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-26T06:35:08.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 bash[130603]: 2d5ebda7d9ce45e8c490e175b5663ec81a7667863c89b2a9db77e11fe2910326 2023-10-26T06:35:08.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.num_levels: 7 2023-10-26T06:35:08.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-26T06:35:08.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-26T06:35:08.355 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-26T06:35:08.355 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-26T06:35:08.355 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-26T06:35:08.355 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-26T06:35:08.355 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-26T06:35:08.356 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-26T06:35:08.356 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-26T06:35:08.356 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-26T06:35:08.356 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-26T06:35:08.356 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-26T06:35:08.356 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-26T06:35:08.357 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.level: 32767 2023-10-26T06:35:08.357 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.strategy: 0 2023-10-26T06:35:08.357 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-26T06:35:08.357 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-26T06:35:08.357 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-26T06:35:08.357 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-26T06:35:08.358 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.enabled: false 2023-10-26T06:35:08.358 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-26T06:35:08.358 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-26T06:35:08.358 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-26T06:35:08.358 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-26T06:35:08.359 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.target_file_size_base: 67108864 2023-10-26T06:35:08.359 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-26T06:35:08.359 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-26T06:35:08.359 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-26T06:35:08.359 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-26T06:35:08.359 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-26T06:35:08.360 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-26T06:35:08.360 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-26T06:35:08.360 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-26T06:35:08.360 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-26T06:35:08.360 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-26T06:35:08.361 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-26T06:35:08.361 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-26T06:35:08.361 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-26T06:35:08.361 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-26T06:35:08.361 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.arena_block_size: 1048576 2023-10-26T06:35:08.362 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-26T06:35:08.362 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-26T06:35:08.362 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.disable_auto_compactions: 0 2023-10-26T06:35:08.363 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-26T06:35:08.363 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-26T06:35:08.363 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-26T06:35:08.363 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-26T06:35:08.364 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-26T06:35:08.364 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-26T06:35:08.364 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-26T06:35:08.364 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-26T06:35:08.364 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-26T06:35:08.365 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-26T06:35:08.365 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.table_properties_collectors: 2023-10-26T06:35:08.365 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.inplace_update_support: 0 2023-10-26T06:35:08.365 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-26T06:35:08.365 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-26T06:35:08.366 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-26T06:35:08.366 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-26T06:35:08.366 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.bloom_locality: 0 2023-10-26T06:35:08.366 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.max_successive_merges: 0 2023-10-26T06:35:08.366 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-26T06:35:08.366 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.paranoid_file_checks: 0 2023-10-26T06:35:08.367 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.force_consistency_checks: 1 2023-10-26T06:35:08.367 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.report_bg_io_stats: 0 2023-10-26T06:35:08.367 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.ttl: 2592000 2023-10-26T06:35:08.367 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-26T06:35:08.367 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-26T06:35:08.368 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-26T06:35:08.368 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.enable_blob_files: false 2023-10-26T06:35:08.368 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.min_blob_size: 0 2023-10-26T06:35:08.368 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.blob_file_size: 268435456 2023-10-26T06:35:08.368 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-26T06:35:08.369 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-26T06:35:08.369 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-26T06:35:08.369 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-26T06:35:08.369 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-26T06:35:08.369 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.blob_file_starting_level: 0 2023-10-26T06:35:08.369 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-26T06:35:08.370 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-26T06:35:08.370 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-26T06:35:08.370 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe7f9578-456a-422f-b878-48d08fe5a24b 2023-10-26T06:35:08.370 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302108301964, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-26T06:35:08.370 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-26T06:35:08.371 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302108302364, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1698302108, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe7f9578-456a-422f-b878-48d08fe5a24b", "db_session_id": "TWFA5IMFJK2170PX93D5", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-26T06:35:08.371 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: EVENT_LOG_v1 {"time_micros": 1698302108302448, "job": 1, "event": "recovery_finished"} 2023-10-26T06:35:08.371 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-26T06:35:08.371 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-26T06:35:08.371 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f6f177e000 2023-10-26T06:35:08.372 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: DB pointer 0x55f6f176a000 2023-10-26T06:35:08.372 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-26T06:35:08.372 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-26T06:35:08.372 INFO:journalctl@ceph.mon.b.smithi125.stdout: ** DB Stats ** 2023-10-26T06:35:08.372 INFO:journalctl@ceph.mon.b.smithi125.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-26T06:35:08.373 INFO:journalctl@ceph.mon.b.smithi125.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-26T06:35:08.373 INFO:journalctl@ceph.mon.b.smithi125.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-26T06:35:08.373 INFO:journalctl@ceph.mon.b.smithi125.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-26T06:35:08.373 INFO:journalctl@ceph.mon.b.smithi125.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-26T06:35:08.373 INFO:journalctl@ceph.mon.b.smithi125.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-26T06:35:08.373 INFO:journalctl@ceph.mon.b.smithi125.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-26T06:35:08.374 INFO:journalctl@ceph.mon.b.smithi125.stdout: 2023-10-26T06:35:08.374 INFO:journalctl@ceph.mon.b.smithi125.stdout: ** Compaction Stats [default] ** 2023-10-26T06:35:08.374 INFO:journalctl@ceph.mon.b.smithi125.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-26T06:35:08.374 INFO:journalctl@ceph.mon.b.smithi125.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-26T06:35:08.374 INFO:journalctl@ceph.mon.b.smithi125.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:08.375 INFO:journalctl@ceph.mon.b.smithi125.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:08.375 INFO:journalctl@ceph.mon.b.smithi125.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:08.375 INFO:journalctl@ceph.mon.b.smithi125.stdout: 2023-10-26T06:35:08.375 INFO:journalctl@ceph.mon.b.smithi125.stdout: ** Compaction Stats [default] ** 2023-10-26T06:35:08.375 INFO:journalctl@ceph.mon.b.smithi125.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-26T06:35:08.376 INFO:journalctl@ceph.mon.b.smithi125.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-26T06:35:08.376 INFO:journalctl@ceph.mon.b.smithi125.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-26T06:35:08.376 INFO:journalctl@ceph.mon.b.smithi125.stdout: 2023-10-26T06:35:08.376 INFO:journalctl@ceph.mon.b.smithi125.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-26T06:35:08.376 INFO:journalctl@ceph.mon.b.smithi125.stdout: 2023-10-26T06:35:08.376 INFO:journalctl@ceph.mon.b.smithi125.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-26T06:35:08.377 INFO:journalctl@ceph.mon.b.smithi125.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-26T06:35:08.377 INFO:journalctl@ceph.mon.b.smithi125.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-26T06:35:08.377 INFO:journalctl@ceph.mon.b.smithi125.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-26T06:35:08.377 INFO:journalctl@ceph.mon.b.smithi125.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-26T06:35:08.377 INFO:journalctl@ceph.mon.b.smithi125.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-26T06:35:08.378 INFO:journalctl@ceph.mon.b.smithi125.stdout: Cumulative compaction: 0.00 GB write, 0.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-26T06:35:08.378 INFO:journalctl@ceph.mon.b.smithi125.stdout: Interval compaction: 0.00 GB write, 0.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-26T06:35:08.378 INFO:journalctl@ceph.mon.b.smithi125.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-26T06:35:08.378 INFO:journalctl@ceph.mon.b.smithi125.stdout: Block cache BinnedLRUCache@0x55f6f16e11f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-26T06:35:08.378 INFO:journalctl@ceph.mon.b.smithi125.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-26T06:35:08.379 INFO:journalctl@ceph.mon.b.smithi125.stdout: 2023-10-26T06:35:08.379 INFO:journalctl@ceph.mon.b.smithi125.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-26T06:35:08.379 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-26T06:35:08.379 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: using public_addr v2:172.21.15.125:0/0 -> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] 2023-10-26T06:35:08.379 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: starting mon.b rank -1 at public addrs [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] at bind addrs [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:35:08.379 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(???) e0 preinit fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:35:08.380 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).mds e1 new map 2023-10-26T06:35:08.380 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-26T06:35:08.380 INFO:journalctl@ceph.mon.b.smithi125.stdout: e1 2023-10-26T06:35:08.380 INFO:journalctl@ceph.mon.b.smithi125.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-26T06:35:08.380 INFO:journalctl@ceph.mon.b.smithi125.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-26T06:35:08.381 INFO:journalctl@ceph.mon.b.smithi125.stdout: legacy client fscid: -1 2023-10-26T06:35:08.381 INFO:journalctl@ceph.mon.b.smithi125.stdout: 2023-10-26T06:35:08.381 INFO:journalctl@ceph.mon.b.smithi125.stdout: No filesystems configured 2023-10-26T06:35:08.381 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-26T06:35:08.381 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-26T06:35:08.382 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-26T06:35:08.382 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-26T06:35:08.382 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-26T06:35:08.382 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-26T06:35:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-26T06:35:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:35:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:35:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-26T06:35:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:08.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:08.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:08.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:08.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:08.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:08.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:08.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:08.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Deploying cephadm binary to smithi153 2023-10-26T06:35:08.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Added host smithi153 2023-10-26T06:35:08.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:08.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:35:08.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.680 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.680 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:08.680 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:08.680 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:08.680 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:08.681 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2566083979' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-26T06:35:08.681 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.681 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.681 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.681 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:08.682 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:08.682 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:08.682 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2566083979' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-26T06:35:08.682 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:08.683 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.683 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.683 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.683 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:08.683 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:08.683 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:08.684 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.684 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:08.684 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:08.684 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:08.684 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c;count:3 2023-10-26T06:35:08.685 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Deploying daemon mon.c on smithi153 2023-10-26T06:35:08.685 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.685 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.685 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/2932479502' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:08.685 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:08.685 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.686 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.a calling monitor election 2023-10-26T06:35:08.686 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.686 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.686 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.686 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.c calling monitor election 2023-10-26T06:35:08.687 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.687 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.687 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.687 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.687 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.688 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-26T06:35:08.688 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: monmap e2: 2 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:08.688 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: fsmap 2023-10-26T06:35:08.688 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:08.688 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mgrmap e13: x(active, since 48s) 2023-10-26T06:35:08.689 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: overall HEALTH_OK 2023-10-26T06:35:08.689 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.689 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.689 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:08.689 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:08.690 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:08.690 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: Deploying daemon mon.b on smithi125 2023-10-26T06:35:08.690 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:08.690 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/226912884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:08.690 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:08.691 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 ceph-mon[130643]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-26T06:35:08.691 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:08 smithi125 systemd[1]: Started Ceph mon.b for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:35:08.725 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:35:13.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:13.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: mon.a calling monitor election 2023-10-26T06:35:13.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: mon.c calling monitor election 2023-10-26T06:35:13.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:13.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:13.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:13.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:13.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-26T06:35:13.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: monmap e3: 3 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],b=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:13.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: fsmap 2023-10-26T06:35:13.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:13.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: mgrmap e13: x(active, since 56s) 2023-10-26T06:35:13.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-26T06:35:13.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-26T06:35:13.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-26T06:35:13.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: mon.b (rank 2) addr [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] is down (out of quorum) 2023-10-26T06:35:13.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:13.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:13 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:13.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:13.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: mon.a calling monitor election 2023-10-26T06:35:13.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: mon.c calling monitor election 2023-10-26T06:35:13.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:13.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:13.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:13.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:13.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:13.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-26T06:35:13.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: monmap e3: 3 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],b=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:13.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: fsmap 2023-10-26T06:35:13.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:13.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: mgrmap e13: x(active, since 56s) 2023-10-26T06:35:13.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-26T06:35:13.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-26T06:35:13.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-26T06:35:13.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: mon.b (rank 2) addr [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] is down (out of quorum) 2023-10-26T06:35:13.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:13.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:13 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:14.007 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-26T06:35:14.007 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","modified":"2023-10-26T06:35:08.329172Z","created":"2023-10-26T06:33:12.527988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:3300","nonce":0},{"type":"v1","addr":"172.21.15.125:6789","nonce":0}]},"addr":"172.21.15.125:6789/0","public_addr":"172.21.15.125:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-26T06:35:14.010 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 3 2023-10-26T06:35:14.483 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-26T06:35:14.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-26T06:35:14.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:14 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:14.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:14 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:14.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:14 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:14.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:14 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/3437539413' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:14.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:14 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:14 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:14 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:14 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:14 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/3437539413' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:14 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.240 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:15.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:15.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: mon.a calling monitor election 2023-10-26T06:35:15.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: mon.c calling monitor election 2023-10-26T06:35:15.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:15.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:15.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:15.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:15.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:15.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-26T06:35:15.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: monmap e3: 3 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],b=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:15.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: fsmap 2023-10-26T06:35:15.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:15.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: mgrmap e13: x(active, since 56s) 2023-10-26T06:35:15.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-26T06:35:15.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-26T06:35:15.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-26T06:35:15.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: mon.b (rank 2) addr [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] is down (out of quorum) 2023-10-26T06:35:15.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:15.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:15.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:15.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:15.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:15.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/3437539413' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-26T06:35:15.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:15 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: mon.b calling monitor election 2023-10-26T06:35:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: mon.b calling monitor election 2023-10-26T06:35:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: mon.c calling monitor election 2023-10-26T06:35:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: mon.a calling monitor election 2023-10-26T06:35:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-26T06:35:16.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: monmap e3: 3 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],b=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:16.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: fsmap 2023-10-26T06:35:16.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:16.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: mgrmap e13: x(active, since 58s) 2023-10-26T06:35:16.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-26T06:35:16.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Cluster is now healthy 2023-10-26T06:35:16.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: overall HEALTH_OK 2023-10-26T06:35:16.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:16.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:16.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:35:16.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:16.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:16.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:16.427 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:16.427 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.427 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.427 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.427 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:16 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: mon.b calling monitor election 2023-10-26T06:35:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: mon.b calling monitor election 2023-10-26T06:35:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: mon.c calling monitor election 2023-10-26T06:35:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: mon.a calling monitor election 2023-10-26T06:35:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-26T06:35:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: monmap e3: 3 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],b=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: fsmap 2023-10-26T06:35:16.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:16.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: mgrmap e13: x(active, since 58s) 2023-10-26T06:35:16.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-26T06:35:16.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Cluster is now healthy 2023-10-26T06:35:16.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: overall HEALTH_OK 2023-10-26T06:35:16.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:16.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:16.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:35:16.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:16.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:16.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:16.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:16.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:16 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: mon.b calling monitor election 2023-10-26T06:35:16.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: mon.b calling monitor election 2023-10-26T06:35:16.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: mon.c calling monitor election 2023-10-26T06:35:16.506 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: mon.a calling monitor election 2023-10-26T06:35:16.506 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-26T06:35:16.506 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: monmap e3: 3 mons at {a=[v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0],b=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-26T06:35:16.506 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: fsmap 2023-10-26T06:35:16.506 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: osdmap e4: 0 total, 0 up, 0 in 2023-10-26T06:35:16.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: mgrmap e13: x(active, since 58s) 2023-10-26T06:35:16.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-26T06:35:16.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Cluster is now healthy 2023-10-26T06:35:16.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: overall HEALTH_OK 2023-10-26T06:35:16.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:16.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:16.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:35:16.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:16.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:16.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:16.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:16.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:16 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:16.997 INFO:teuthology.orchestra.run.smithi050.stdout:# minimal ceph.conf for 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:35:16.998 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-10-26T06:35:16.998 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:35:16.998 INFO:teuthology.orchestra.run.smithi050.stdout: mon_host = [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2023-10-26T06:35:17.378 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:17.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:17.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:17.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: Reconfiguring mon.a (unknown last config time)... 2023-10-26T06:35:17.381 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:17.381 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:17.381 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:17.381 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: Reconfiguring daemon mon.a on smithi050 2023-10-26T06:35:17.381 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:17 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3812679962' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:17.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: Reconfiguring mon.a (unknown last config time)... 2023-10-26T06:35:17.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:17.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:17.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:17.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: Reconfiguring daemon mon.a on smithi050 2023-10-26T06:35:17.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:17 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3812679962' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:17.430 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-26T06:35:17.430 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:35:17.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2023-10-26T06:35:17.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:17.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:17.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: Reconfiguring mon.a (unknown last config time)... 2023-10-26T06:35:17.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:17.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:17.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:17.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: Reconfiguring daemon mon.a on smithi050 2023-10-26T06:35:17.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:17 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3812679962' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:17.506 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:35:17.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:17.617 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:35:17.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.conf 2023-10-26T06:35:17.656 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:35:17.656 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:17.729 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:35:17.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2023-10-26T06:35:17.766 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:35:17.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:17.835 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-26T06:35:17.836 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-26T06:35:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:19.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: Reconfiguring mon.b (monmap changed)... 2023-10-26T06:35:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:19.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:19.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: Reconfiguring daemon mon.b on smithi125 2023-10-26T06:35:19.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:19 smithi050 ceph-mon[94997]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:19.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:19.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:19.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: Reconfiguring mon.b (monmap changed)... 2023-10-26T06:35:19.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:19.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:19.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:19.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: Reconfiguring daemon mon.b on smithi125 2023-10-26T06:35:19.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:19 smithi125 ceph-mon[130643]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:19.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:19.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:19.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: Reconfiguring mon.b (monmap changed)... 2023-10-26T06:35:19.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:19.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:19.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:19.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: Reconfiguring daemon mon.b on smithi125 2023-10-26T06:35:19.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:19 smithi153 ceph-mon[131657]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:20.836 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:20.837 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:20.837 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: Reconfiguring mon.c (monmap changed)... 2023-10-26T06:35:20.837 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:20.837 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:20.837 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:20.838 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: Reconfiguring daemon mon.c on smithi153 2023-10-26T06:35:20.838 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:20 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2321250961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-26T06:35:20.869 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: ignoring --setuser ceph since I am not root 2023-10-26T06:35:20.870 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: ignoring --setgroup ceph since I am not root 2023-10-26T06:35:20.870 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:20.867+0000 7fac57441200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-26T06:35:20.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:20.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:20.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: Reconfiguring mon.c (monmap changed)... 2023-10-26T06:35:20.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:20.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:20.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:20.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: Reconfiguring daemon mon.c on smithi153 2023-10-26T06:35:20.872 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2321250961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-26T06:35:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' 2023-10-26T06:35:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: Reconfiguring mon.c (monmap changed)... 2023-10-26T06:35:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: from='mgr.14150 172.21.15.50:0/3744850312' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:20.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: Reconfiguring daemon mon.c on smithi153 2023-10-26T06:35:20.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:20 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2321250961' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-26T06:35:21.225 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:20.976+0000 7fac57441200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-26T06:35:21.225 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:21.097+0000 7fac57441200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-26T06:35:21.270 INFO:tasks.cephadm:Adding mgr.x on smithi050 2023-10-26T06:35:21.270 INFO:tasks.cephadm:Adding mgr.y on smithi125 2023-10-26T06:35:21.270 INFO:tasks.cephadm:Adding mgr.z on smithi153 2023-10-26T06:35:21.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch apply mgr '3;smithi050=x;smithi125=y;smithi153=z' 2023-10-26T06:35:21.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:21.223+0000 7fac57441200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-26T06:35:21.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:21.462+0000 7fac57441200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-26T06:35:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:35:21.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2321250961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-26T06:35:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:21 smithi125 ceph-mon[130643]: mgrmap e14: x(active, since 63s) 2023-10-26T06:35:21.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2321250961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-26T06:35:21.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:21 smithi050 ceph-mon[94997]: mgrmap e14: x(active, since 63s) 2023-10-26T06:35:21.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2321250961' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-26T06:35:21.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:21 smithi153 ceph-mon[131657]: mgrmap e14: x(active, since 63s) 2023-10-26T06:35:22.227 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:21.932+0000 7fac57441200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-26T06:35:22.227 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:22.104+0000 7fac57441200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-26T06:35:22.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:22.225+0000 7fac57441200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-26T06:35:22.517 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:22.355+0000 7fac57441200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-26T06:35:23.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:22.915+0000 7fac57441200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-26T06:35:24.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:23.800+0000 7fac57441200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-26T06:35:24.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:23.912+0000 7fac57441200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-26T06:35:25.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:24.923+0000 7fac57441200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:35:25.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:25.050+0000 7fac57441200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-26T06:35:25.678 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:25.289+0000 7fac57441200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:35:25.969 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:25.676+0000 7fac57441200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-26T06:35:26.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:25.967+0000 7fac57441200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-26T06:35:26.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:26.172+0000 7fac57441200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-26T06:35:27.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:26.539+0000 7fac57441200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-26T06:35:27.970 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:27.518+0000 7fac57441200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-26T06:35:27.971 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:27.702+0000 7fac57441200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-26T06:35:28.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:27.969+0000 7fac57441200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-26T06:35:28.267 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:28.125+0000 7fac57441200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-26T06:35:28.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:28.421+0000 7fac57441200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-26T06:35:29.916 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: Active manager daemon x restarted 2023-10-26T06:35:29.916 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: Activating manager daemon x 2023-10-26T06:35:29.917 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: osdmap e5: 0 total, 0 up, 0 in 2023-10-26T06:35:29.917 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: mgrmap e15: x(active, starting, since 0.0047462s) 2023-10-26T06:35:29.917 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:29.918 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:29.918 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:29.918 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-26T06:35:29.919 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-26T06:35:29.919 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-26T06:35:29.919 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-26T06:35:29.920 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: Manager daemon x is now available 2023-10-26T06:35:29.920 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:29.921 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:29.927 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: Active manager daemon x restarted 2023-10-26T06:35:29.928 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: Activating manager daemon x 2023-10-26T06:35:29.928 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: osdmap e5: 0 total, 0 up, 0 in 2023-10-26T06:35:29.928 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: mgrmap e15: x(active, starting, since 0.0047462s) 2023-10-26T06:35:29.929 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:29.929 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:29.930 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:29.930 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-26T06:35:29.930 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-26T06:35:29.931 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-26T06:35:29.931 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-26T06:35:29.931 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: Manager daemon x is now available 2023-10-26T06:35:29.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:29.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:29.933 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:35:29.543+0000 7fac57441200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-26T06:35:29.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: Active manager daemon x restarted 2023-10-26T06:35:29.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: Activating manager daemon x 2023-10-26T06:35:29.935 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: osdmap e5: 0 total, 0 up, 0 in 2023-10-26T06:35:29.935 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: mgrmap e15: x(active, starting, since 0.0047462s) 2023-10-26T06:35:29.935 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:35:29.936 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:35:29.936 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:35:29.936 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-26T06:35:29.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-26T06:35:29.937 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-26T06:35:29.938 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-26T06:35:29.938 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: Manager daemon x is now available 2023-10-26T06:35:29.938 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:29.939 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:30.566 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mgr update... 2023-10-26T06:35:30.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-26T06:35:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-26T06:35:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:30 smithi125 ceph-mon[130643]: mgrmap e16: x(active, since 1.00902s) 2023-10-26T06:35:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-26T06:35:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-26T06:35:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:30 smithi153 ceph-mon[131657]: mgrmap e16: x(active, since 1.00902s) 2023-10-26T06:35:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:30.993 DEBUG:teuthology.orchestra.run.smithi125:mgr.y> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.y.service 2023-10-26T06:35:30.996 DEBUG:teuthology.orchestra.run.smithi153:mgr.z> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.z.service 2023-10-26T06:35:30.998 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-26T06:35:30.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-26T06:35:31.003 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-26T06:35:31.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-26T06:35:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-26T06:35:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-26T06:35:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:30 smithi050 ceph-mon[94997]: mgrmap e16: x(active, since 1.00902s) 2023-10-26T06:35:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.020 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-26T06:35:31.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-26T06:35:31.024 INFO:journalctl@ceph.mgr.y.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:35:31.026 INFO:journalctl@ceph.mgr.z.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:35:31.065 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-26T06:35:31.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-26T06:35:31.112 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-26T06:35:31.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-26T06:35:31.162 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-26T06:35:31.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-26T06:35:31.210 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-26T06:35:31.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-26T06:35:31.260 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-26T06:35:31.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-26T06:35:31.316 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-26T06:35:31.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-26T06:35:31.375 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-26T06:35:31.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-26T06:35:31.427 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-26T06:35:31.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-26T06:35:31.480 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-26T06:35:31.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-26T06:35:31.537 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-26T06:35:31.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-26T06:35:31.614 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-26T06:35:31.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-26T06:35:31.666 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-26T06:35:31.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-26T06:35:31.750 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-26T06:35:31.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-26T06:35:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: [26/Oct/2023:06:35:29] ENGINE Bus STARTING 2023-10-26T06:35:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: [26/Oct/2023:06:35:30] ENGINE Serving on http://172.21.15.50:8765 2023-10-26T06:35:31.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: [26/Oct/2023:06:35:30] ENGINE Serving on https://172.21.15.50:7150 2023-10-26T06:35:31.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: [26/Oct/2023:06:35:30] ENGINE Bus STARTED 2023-10-26T06:35:31.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi125=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:31.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: Saving service mgr spec with placement smithi050=x;smithi125=y;smithi153=z;count:3 2023-10-26T06:35:31.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.752 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:31 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.813 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-26T06:35:31.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-26T06:35:31.877 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-26T06:35:31.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-26T06:35:31.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: [26/Oct/2023:06:35:29] ENGINE Bus STARTING 2023-10-26T06:35:31.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: [26/Oct/2023:06:35:30] ENGINE Serving on http://172.21.15.50:8765 2023-10-26T06:35:31.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: [26/Oct/2023:06:35:30] ENGINE Serving on https://172.21.15.50:7150 2023-10-26T06:35:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: [26/Oct/2023:06:35:30] ENGINE Bus STARTED 2023-10-26T06:35:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi125=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: Saving service mgr spec with placement smithi050=x;smithi125=y;smithi153=z;count:3 2023-10-26T06:35:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:31 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.935 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-26T06:35:31.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-26T06:35:31.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: [26/Oct/2023:06:35:29] ENGINE Bus STARTING 2023-10-26T06:35:31.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: [26/Oct/2023:06:35:30] ENGINE Serving on http://172.21.15.50:8765 2023-10-26T06:35:31.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: [26/Oct/2023:06:35:30] ENGINE Serving on https://172.21.15.50:7150 2023-10-26T06:35:31.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: [26/Oct/2023:06:35:30] ENGINE Bus STARTED 2023-10-26T06:35:31.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi125=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:35:31.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: Saving service mgr spec with placement smithi050=x;smithi125=y;smithi153=z;count:3 2023-10-26T06:35:31.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:31 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:31.996 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-26T06:35:31.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-26T06:35:32.056 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-26T06:35:32.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-26T06:35:32.113 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-26T06:35:32.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-26T06:35:32.178 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-26T06:35:32.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-26T06:35:32.235 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-26T06:35:32.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-26T06:35:32.312 DEBUG:tasks.cephadm:set 24 configs 2023-10-26T06:35:32.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi050') 2023-10-26T06:35:32.512 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:32.625 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:32.892 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:32.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:32.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: mgrmap e17: x(active, since 2s) 2023-10-26T06:35:32.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:32.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: mgrmap e17: x(active, since 2s) 2023-10-26T06:35:32.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:32.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:33.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: mgrmap e17: x(active, since 2s) 2023-10-26T06:35:33.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:33.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:33.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:33.118 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:33.139 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:33.980 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:34.457 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:34 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:34.457 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:34 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:34 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:34 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:34.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:34 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:34.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:34 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:35.241 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:36.343 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:36.343 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:36.344 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:36.344 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:36.344 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:36.344 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:35:36.344 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:36.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:36.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:36.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:36 smithi050 ceph-mon[94997]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:36.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:36.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:36.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:36.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:36.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:36.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:35:36.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:36.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:36.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:36.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:36 smithi125 ceph-mon[130643]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:36.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:36.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:36.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:35:36.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:36.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:36.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: Updating smithi050:/etc/ceph/ceph.conf 2023-10-26T06:35:36.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: Updating smithi125:/etc/ceph/ceph.conf 2023-10-26T06:35:36.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: Updating smithi153:/etc/ceph/ceph.conf 2023-10-26T06:35:36.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:36.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:36 smithi153 ceph-mon[131657]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:37.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 -- 172.21.15.50:0/979434718 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc408038b90 msgr2=0x7fc40803b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:37.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 --2- 172.21.15.50:0/979434718 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc408038b90 0x7fc40803b050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc420199220 tx=0x7fc410005fb0 comp rx=0 tx=0).stop 2023-10-26T06:35:37.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 -- 172.21.15.50:0/979434718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4201023e0 msgr2=0x7fc42019f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:37.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 --2- 172.21.15.50:0/979434718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4201023e0 0x7fc42019f2c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc41800ef30 tx=0x7fc41800c3a0 comp rx=0 tx=0).stop 2023-10-26T06:35:37.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 -- 172.21.15.50:0/979434718 shutdown_connections 2023-10-26T06:35:37.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 --2- 172.21.15.50:0/979434718 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc408038b90 0x7fc40803b050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:37.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 --2- 172.21.15.50:0/979434718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4201023e0 0x7fc42019f2c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:37.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 --2- 172.21.15.50:0/979434718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc420100840 0x7fc420197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:37.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 --2- 172.21.15.50:0/979434718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc420101a40 0x7fc4201982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:37.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 -- 172.21.15.50:0/979434718 >> 172.21.15.50:0/979434718 conn(0x7fc4200fbe00 msgr2=0x7fc420072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:37.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 -- 172.21.15.50:0/979434718 shutdown_connections 2023-10-26T06:35:37.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:37.131+0000 7fc4260dc700 1 -- 172.21.15.50:0/979434718 wait complete. 2023-10-26T06:35:37.435 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:37.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:37.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:37.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:37 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/979434718' entity='client.admin' 2023-10-26T06:35:37.618 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:37.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:37.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:37.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:37.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:37 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/979434718' entity='client.admin' 2023-10-26T06:35:37.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.conf 2023-10-26T06:35:37.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: Updating smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:37.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: Updating smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:37.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:37.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2023-10-26T06:35:37.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:37 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/979434718' entity='client.admin' 2023-10-26T06:35:37.810 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:38.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:38.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:38.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-26T06:35:38.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:38.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:38.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:38.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:38.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-26T06:35:38.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:38.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:38.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: Updating smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-26T06:35:38.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:38.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:38.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-26T06:35:38.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:38.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:38.795 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:38.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 -- 172.21.15.50:0/3206910678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac1067a0 msgr2=0x7ff7ac106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:38.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/3206910678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac106b80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009990 tx=0x7ff7a8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 -- 172.21.15.50:0/3206910678 shutdown_connections 2023-10-26T06:35:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/3206910678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068b30 0x7ff7ac10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/3206910678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac106b80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/3206910678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac068190 0x7ff7ac0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 -- 172.21.15.50:0/3206910678 >> 172.21.15.50:0/3206910678 conn(0x7ff7ac075790 msgr2=0x7ff7ac075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 -- 172.21.15.50:0/3206910678 shutdown_connections 2023-10-26T06:35:38.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.845+0000 7ff7b3baa700 1 -- 172.21.15.50:0/3206910678 wait complete. 2023-10-26T06:35:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.846+0000 7ff7b3baa700 1 Processor -- start 2023-10-26T06:35:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.846+0000 7ff7b3baa700 1 -- start start 2023-10-26T06:35:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b3baa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068190 0x7ff7ac196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b3baa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac068b30 0x7ff7ac196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b3baa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b3baa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac19afc0 con 0x7ff7ac068190 2023-10-26T06:35:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b3baa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac19b130 con 0x7ff7ac068b30 2023-10-26T06:35:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b3baa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac19b2f0 con 0x7ff7ac1067a0 2023-10-26T06:35:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b2147700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b2147700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:39586/0 (socket says 172.21.15.50:39586) 2023-10-26T06:35:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b2147700 1 -- 172.21.15.50:0/2952743315 learned_addr learned my addr 172.21.15.50:0/2952743315 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.847+0000 7ff7b1145700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac068b30 0x7ff7ac196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1145700 1 -- 172.21.15.50:0/2952743315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac1067a0 msgr2=0x7ff7ac19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1145700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1145700 1 -- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068190 msgr2=0x7ff7ac196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1946700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068190 0x7ff7ac196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1145700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068190 0x7ff7ac196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1145700 1 -- 172.21.15.50:0/2952743315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80095f0 con 0x7ff7ac068b30 2023-10-26T06:35:38.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.848+0000 7ff7b1946700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068190 0x7ff7ac196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:35:38.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.849+0000 7ff7b1145700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac068b30 0x7ff7ac196650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00d950 tx=0x7ff79c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:38.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.849+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c009930 con 0x7ff7ac068b30 2023-10-26T06:35:38.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.849+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac19b5d0 con 0x7ff7ac068b30 2023-10-26T06:35:38.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.849+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac1a2e30 con 0x7ff7ac068b30 2023-10-26T06:35:38.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.849+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(22 keys) v1 ==== 987+0+0 (secure 0 0 0) 0x7ff79c010460 con 0x7ff7ac068b30 2023-10-26T06:35:38.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.849+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00b5d0 con 0x7ff7ac068b30 2023-10-26T06:35:38.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.851+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7900050e0 con 0x7ff7ac068b30 2023-10-26T06:35:38.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.852+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7ff79c0105d0 con 0x7ff7ac068b30 2023-10-26T06:35:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.853+0000 7ff7a2ffd700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff798038b40 0x7ff79803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.853+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff79c04abb0 con 0x7ff7ac068b30 2023-10-26T06:35:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.853+0000 7ff7b1946700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff798038b40 0x7ff79803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.854+0000 7ff7b1946700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff798038b40 0x7ff79803b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8000c00 tx=0x7ff7a8005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:38.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.858+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff79c01b590 con 0x7ff7ac068b30 2023-10-26T06:35:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.701+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1645435139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8072a20 msgr2=0x7f51f8072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:38.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.701+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1645435139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8072a20 0x7f51f8072e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009990 tx=0x7f51e8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1645435139 shutdown_connections 2023-10-26T06:35:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1645435139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f810d250 0x7f51f810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1645435139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f8072a20 0x7f51f8072e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1645435139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51f8073340 0x7f51f810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1645435139 >> 172.21.15.50:0/1645435139 conn(0x7f51f80779e0 msgr2=0x7f51f8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1645435139 shutdown_connections 2023-10-26T06:35:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.702+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1645435139 wait complete. 2023-10-26T06:35:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.703+0000 7f51fc8ed700 1 Processor -- start 2023-10-26T06:35:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.703+0000 7f51fc8ed700 1 -- start start 2023-10-26T06:35:38.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.703+0000 7f51fc8ed700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f8072a20 0x7f51f8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.703+0000 7f51fc8ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51f8073340 0x7f51f8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51fc8ed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 0x7f51f819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51fc8ed700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819d230 con 0x7f51f810d250 2023-10-26T06:35:38.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51fc8ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819d3a0 con 0x7f51f8073340 2023-10-26T06:35:38.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51fc8ed700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819d560 con 0x7f51f8072a20 2023-10-26T06:35:38.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 0x7f51f819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 0x7f51f819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48544/0 (socket says 172.21.15.50:48544) 2023-10-26T06:35:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 -- 172.21.15.50:0/1812290746 learned_addr learned my addr 172.21.15.50:0/1812290746 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f659c700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f8072a20 0x7f51f8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f5d9b700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51f8073340 0x7f51f8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 -- 172.21.15.50:0/1812290746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f8072a20 msgr2=0x7f51f8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f8072a20 0x7f51f8198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 -- 172.21.15.50:0/1812290746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51f8073340 msgr2=0x7f51f8198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51f8073340 0x7f51f8198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f6d9d700 1 -- 172.21.15.50:0/1812290746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e80095f0 con 0x7f51f810d250 2023-10-26T06:35:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.704+0000 7f51f659c700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f8072a20 0x7f51f8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:38.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.705+0000 7f51f6d9d700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 0x7f51f819cc20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51f0007f10 tx=0x7f51f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:38.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.705+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0009ea0 con 0x7f51f810d250 2023-10-26T06:35:38.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.705+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(22 keys) v1 ==== 987+0+0 (secure 0 0 0) 0x7f51f000f040 con 0x7f51f810d250 2023-10-26T06:35:38.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.705+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0012350 con 0x7f51f810d250 2023-10-26T06:35:38.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.705+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f819d840 con 0x7f51f810d250 2023-10-26T06:35:38.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.705+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81a50a0 con 0x7f51f810d250 2023-10-26T06:35:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.706+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f51f001d460 con 0x7f51f810d250 2023-10-26T06:35:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.706+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f8108460 con 0x7f51f810d250 2023-10-26T06:35:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.707+0000 7f51e77fe700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e0038b40 0x7f51e003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.707+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f51f004b1a0 con 0x7f51f810d250 2023-10-26T06:35:38.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.707+0000 7f51f659c700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e0038b40 0x7f51e003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.708+0000 7f51f659c700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e0038b40 0x7f51e003b000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51e8006010 tx=0x7f51e800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:38.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.712+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f51f0011d10 con 0x7f51f810d250 2023-10-26T06:35:38.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:38.995+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7f51f804e530 con 0x7f51f810d250 2023-10-26T06:35:39.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.000+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f51f804e530 con 0x7f51f810d250 2023-10-26T06:35:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.000+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 7 ==== config(23 keys) v1 ==== 1018+0+0 (secure 0 0 0) 0x7ff79c04a350 con 0x7ff7ac068b30 2023-10-26T06:35:39.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.001+0000 7f51e77fe700 1 -- 172.21.15.50:0/1812290746 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(23 keys) v1 ==== 1018+0+0 (secure 0 0 0) 0x7f51f001beb0 con 0x7f51f810d250 2023-10-26T06:35:39.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e0038b40 msgr2=0x7f51e003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e0038b40 0x7f51e003b000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f51e8006010 tx=0x7f51e800b260 comp rx=0 tx=0).stop 2023-10-26T06:35:39.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 msgr2=0x7f51f819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 0x7f51f819cc20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51f0007f10 tx=0x7f51f000d3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 shutdown_connections 2023-10-26T06:35:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e0038b40 0x7f51e003b000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51f810d250 0x7f51f819cc20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51f8072a20 0x7f51f8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 --2- 172.21.15.50:0/1812290746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51f8073340 0x7f51f8198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 >> 172.21.15.50:0/1812290746 conn(0x7f51f80779e0 msgr2=0x7f51f80ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.003+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 shutdown_connections 2023-10-26T06:35:39.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.004+0000 7f51fc8ed700 1 -- 172.21.15.50:0/1812290746 wait complete. 2023-10-26T06:35:39.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.115+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7ff790005910 con 0x7ff7ac068b30 2023-10-26T06:35:39.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.120+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 8 ==== config(24 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ff79c01b770 con 0x7ff7ac068b30 2023-10-26T06:35:39.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.120+0000 7ff7a2ffd700 1 -- 172.21.15.50:0/2952743315 <== mon.2 v2:172.21.15.125:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff79c01b3b0 con 0x7ff7ac068b30 2023-10-26T06:35:39.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff798038b40 msgr2=0x7ff79803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff798038b40 0x7ff79803b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8000c00 tx=0x7ff7a8005fb0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac068b30 msgr2=0x7ff7ac196650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac068b30 0x7ff7ac196650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00d950 tx=0x7ff79c00dc60 comp rx=0 tx=0).stop 2023-10-26T06:35:39.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 shutdown_connections 2023-10-26T06:35:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff798038b40 0x7ff79803b000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac1067a0 0x7ff7ac19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7ac068190 0x7ff7ac196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 --2- 172.21.15.50:0/2952743315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7ac068b30 0x7ff7ac196650 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 >> 172.21.15.50:0/2952743315 conn(0x7ff7ac075790 msgr2=0x7ff7ac0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:39.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 shutdown_connections 2023-10-26T06:35:39.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.123+0000 7ff7b3baa700 1 -- 172.21.15.50:0/2952743315 wait complete. 2023-10-26T06:35:39.403 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:39 smithi050 ceph-mon[94997]: Deploying daemon mgr.z on smithi153 2023-10-26T06:35:39.403 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:39 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1812290746' entity='client.admin' 2023-10-26T06:35:39.404 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:39 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:39.602 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:39.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:39 smithi125 ceph-mon[130643]: Deploying daemon mgr.z on smithi153 2023-10-26T06:35:39.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:39 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1812290746' entity='client.admin' 2023-10-26T06:35:39.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:39 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:39.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:39 smithi153 ceph-mon[131657]: Deploying daemon mgr.z on smithi153 2023-10-26T06:35:39.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:39 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1812290746' entity='client.admin' 2023-10-26T06:35:39.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:39 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:39.736 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:39 smithi153 systemd[1]: Starting Ceph mgr.z for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:35:39.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.745+0000 7f6457fff700 1 -- 172.21.15.50:0/2164613188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64581005f0 msgr2=0x7f6458100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.745+0000 7f6457fff700 1 --2- 172.21.15.50:0/2164613188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64581005f0 0x7f6458100a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f644c009990 tx=0x7f644c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 -- 172.21.15.50:0/2164613188 shutdown_connections 2023-10-26T06:35:39.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 --2- 172.21.15.50:0/2164613188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 0x7f645810d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 --2- 172.21.15.50:0/2164613188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6458106680 0x7f6458106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 --2- 172.21.15.50:0/2164613188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64581005f0 0x7f6458100a70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 -- 172.21.15.50:0/2164613188 >> 172.21.15.50:0/2164613188 conn(0x7f64580fc120 msgr2=0x7f64580fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:39.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 -- 172.21.15.50:0/2164613188 shutdown_connections 2023-10-26T06:35:39.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.746+0000 7f6457fff700 1 -- 172.21.15.50:0/2164613188 wait complete. 2023-10-26T06:35:39.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 Processor -- start 2023-10-26T06:35:39.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 -- start start 2023-10-26T06:35:39.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64581005f0 0x7f645819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 0x7f645819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458106680 0x7f64581988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6458198f30 con 0x7f6458106680 2023-10-26T06:35:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64581990a0 con 0x7f64581005f0 2023-10-26T06:35:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.747+0000 7f6457fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6458199260 con 0x7f6458100fb0 2023-10-26T06:35:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f6456ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64581005f0 0x7f645819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f6456ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64581005f0 0x7f645819e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:54486/0 (socket says 172.21.15.50:54486) 2023-10-26T06:35:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 0x7f645819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f6456ffd700 1 -- 172.21.15.50:0/86124979 learned_addr learned my addr 172.21.15.50:0/86124979 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64577fe700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458106680 0x7f64581988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 -- 172.21.15.50:0/86124979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64581005f0 msgr2=0x7f645819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64581005f0 0x7f645819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 -- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458106680 msgr2=0x7f64581988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:39.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458106680 0x7f64581988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:39.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 -- 172.21.15.50:0/86124979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0095f0 con 0x7f6458100fb0 2023-10-26T06:35:39.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.748+0000 7f64567fc700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 0x7f645819ecd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f644c000c00 tx=0x7f644c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.749+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c01d070 con 0x7f6458100fb0 2023-10-26T06:35:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.749+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(24 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7f644c004500 con 0x7f6458100fb0 2023-10-26T06:35:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.749+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64581994e0 con 0x7f6458100fb0 2023-10-26T06:35:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.749+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c021d30 con 0x7f6458100fb0 2023-10-26T06:35:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.749+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64581a5780 con 0x7f6458100fb0 2023-10-26T06:35:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.750+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f644c02b440 con 0x7f6458100fb0 2023-10-26T06:35:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.750+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6458101d30 con 0x7f6458100fb0 2023-10-26T06:35:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.750+0000 7f645c90d700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6440038b40 0x7f644003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.750+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f644c04c9e0 con 0x7f6458100fb0 2023-10-26T06:35:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.750+0000 7f6456ffd700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6440038b40 0x7f644003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.751+0000 7f6456ffd700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6440038b40 0x7f644003b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6448005950 tx=0x7f6448009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.755+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f644c029950 con 0x7f6458100fb0 2023-10-26T06:35:39.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.991+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f645804e4c0 con 0x7f6458100fb0 2023-10-26T06:35:39.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.996+0000 7f645c90d700 1 -- 172.21.15.50:0/86124979 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v13)=0 v13) v1 ==== 108+0+0 (secure 0 0 0) 0x7f644c026030 con 0x7f6458100fb0 2023-10-26T06:35:40.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6440038b40 msgr2=0x7f644003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6440038b40 0x7f644003b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6448005950 tx=0x7f6448009260 comp rx=0 tx=0).stop 2023-10-26T06:35:40.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 msgr2=0x7f645819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 0x7f645819ecd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f644c000c00 tx=0x7f644c009580 comp rx=0 tx=0).stop 2023-10-26T06:35:40.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 shutdown_connections 2023-10-26T06:35:40.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6440038b40 0x7f644003b000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6458106680 0x7f64581988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64581005f0 0x7f645819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 --2- 172.21.15.50:0/86124979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6458100fb0 0x7f645819ecd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 >> 172.21.15.50:0/86124979 conn(0x7f64580fc120 msgr2=0x7f645810c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:40.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 shutdown_connections 2023-10-26T06:35:40.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:39.999+0000 7f6457fff700 1 -- 172.21.15.50:0/86124979 wait complete. 2023-10-26T06:35:40.089 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:39 smithi153 podman[134637]: 2023-10-26T06:35:40.386 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 bash[134637]: 3b2d65b084a015e1127b3dbe8f72dad222bafed8b459ff8bb329542669b0774e 2023-10-26T06:35:40.386 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mgr[134677]: -- 172.21.15.153:0/2888491624 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558e7d6931e0 con 0x558e7d669000 2023-10-26T06:35:40.386 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 systemd[1]: Started Ceph mgr.z for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:35:40.387 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:40.207+0000 7f90a602f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-26T06:35:40.387 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:40.294+0000 7f90a602f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-26T06:35:40.387 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:40.384+0000 7f90a602f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-26T06:35:40.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.185+0000 7fbfd01af700 1 -- 172.21.15.50:0/2610966705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc810d250 msgr2=0x7fbfc810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.185+0000 7fbfd01af700 1 --2- 172.21.15.50:0/2610966705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc810d250 0x7fbfc810f640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000b0a0 tx=0x7fbfc000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 -- 172.21.15.50:0/2610966705 shutdown_connections 2023-10-26T06:35:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 --2- 172.21.15.50:0/2610966705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc810d250 0x7fbfc810f640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 --2- 172.21.15.50:0/2610966705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc8072a20 0x7fbfc8072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 --2- 172.21.15.50:0/2610966705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8073340 0x7fbfc810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 -- 172.21.15.50:0/2610966705 >> 172.21.15.50:0/2610966705 conn(0x7fbfc80779e0 msgr2=0x7fbfc8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:40.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 -- 172.21.15.50:0/2610966705 shutdown_connections 2023-10-26T06:35:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.186+0000 7fbfd01af700 1 -- 172.21.15.50:0/2610966705 wait complete. 2023-10-26T06:35:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.187+0000 7fbfd01af700 1 Processor -- start 2023-10-26T06:35:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.187+0000 7fbfd01af700 1 -- start start 2023-10-26T06:35:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.187+0000 7fbfd01af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 0x7fbfc8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.187+0000 7fbfd01af700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 0x7fbfc81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfd01af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc810d250 0x7fbfc819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfd01af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc819dd30 con 0x7fbfc8072a20 2023-10-26T06:35:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfd01af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc819dea0 con 0x7fbfc810d250 2023-10-26T06:35:40.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfd01af700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc819e060 con 0x7fbfc8073340 2023-10-26T06:35:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcdf4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 0x7fbfc8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 0x7fbfc81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 0x7fbfc81993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:39624/0 (socket says 172.21.15.50:39624) 2023-10-26T06:35:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcdf4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 0x7fbfc8198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48592/0 (socket says 172.21.15.50:48592) 2023-10-26T06:35:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 -- 172.21.15.50:0/177794512 learned_addr learned my addr 172.21.15.50:0/177794512 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:40.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfce74c700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc810d250 0x7fbfc819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 -- 172.21.15.50:0/177794512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc810d250 msgr2=0x7fbfc819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc810d250 0x7fbfc819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 -- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 msgr2=0x7fbfc8198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 0x7fbfc8198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcd74a700 1 -- 172.21.15.50:0/177794512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0009d00 con 0x7fbfc8073340 2023-10-26T06:35:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfce74c700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc810d250 0x7fbfc819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:35:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.188+0000 7fbfcdf4b700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 0x7fbfc8198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.189+0000 7fbfcd74a700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 0x7fbfc81993c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800e9a0 tx=0x7fbfb800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.189+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8009790 con 0x7fbfc8073340 2023-10-26T06:35:40.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.189+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc819e340 con 0x7fbfc8073340 2023-10-26T06:35:40.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.189+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(24 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7fbfb800cbd0 con 0x7fbfc8073340 2023-10-26T06:35:40.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.189+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8018680 con 0x7fbfc8073340 2023-10-26T06:35:40.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.189+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc81a5ba0 con 0x7fbfc8073340 2023-10-26T06:35:40.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.190+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc8108460 con 0x7fbfc8073340 2023-10-26T06:35:40.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.191+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fbfb8010430 con 0x7fbfc8073340 2023-10-26T06:35:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.192+0000 7fbfbeffd700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbfb4038b40 0x7fbfb403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.192+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbfb8014070 con 0x7fbfc8073340 2023-10-26T06:35:40.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.192+0000 7fbfcdf4b700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbfb4038b40 0x7fbfb403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.192+0000 7fbfcdf4b700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbfb4038b40 0x7fbfb403b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4011490 tx=0x7fbfc4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.198+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbfb801f310 con 0x7fbfc8073340 2023-10-26T06:35:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.449+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fbfc80740b0 con 0x7fbfc8073340 2023-10-26T06:35:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.457+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 7 ==== config(25 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7fbfb801f310 con 0x7fbfc8073340 2023-10-26T06:35:40.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.457+0000 7fbfbeffd700 1 -- 172.21.15.50:0/177794512 <== mon.1 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbfb80260c0 con 0x7fbfc8073340 2023-10-26T06:35:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbfb4038b40 msgr2=0x7fbfb403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbfb4038b40 0x7fbfb403b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4011490 tx=0x7fbfc4009260 comp rx=0 tx=0).stop 2023-10-26T06:35:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 msgr2=0x7fbfc81993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 0x7fbfc81993c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800e9a0 tx=0x7fbfb800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 shutdown_connections 2023-10-26T06:35:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbfb4038b40 0x7fbfb403b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbfc810d250 0x7fbfc819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfc8072a20 0x7fbfc8198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 --2- 172.21.15.50:0/177794512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfc8073340 0x7fbfc81993c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.461+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 >> 172.21.15.50:0/177794512 conn(0x7fbfc80779e0 msgr2=0x7fbfc80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:40.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.462+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 shutdown_connections 2023-10-26T06:35:40.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.462+0000 7fbfd01af700 1 -- 172.21.15.50:0/177794512 wait complete. 2023-10-26T06:35:40.614 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi050') 2023-10-26T06:35:40.650 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:40.478+0000 7f90a602f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-26T06:35:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.260+0000 7ffa16161700 1 -- 172.21.15.50:0/2492933055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa101067a0 msgr2=0x7ffa10106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.260+0000 7ffa16161700 1 --2- 172.21.15.50:0/2492933055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa101067a0 0x7ffa10106b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009990 tx=0x7ffa00009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 -- 172.21.15.50:0/2492933055 shutdown_connections 2023-10-26T06:35:40.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 --2- 172.21.15.50:0/2492933055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068b30 0x7ffa1010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 --2- 172.21.15.50:0/2492933055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa101067a0 0x7ffa10106b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 --2- 172.21.15.50:0/2492933055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa10068190 0x7ffa100685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 -- 172.21.15.50:0/2492933055 >> 172.21.15.50:0/2492933055 conn(0x7ffa10075790 msgr2=0x7ffa10075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 -- 172.21.15.50:0/2492933055 shutdown_connections 2023-10-26T06:35:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.261+0000 7ffa16161700 1 -- 172.21.15.50:0/2492933055 wait complete. 2023-10-26T06:35:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 Processor -- start 2023-10-26T06:35:40.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 -- start start 2023-10-26T06:35:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068190 0x7ffa1019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa10068b30 0x7ffa1019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa101067a0 0x7ffa101969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10197000 con 0x7ffa10068190 2023-10-26T06:35:40.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10197170 con 0x7ffa101067a0 2023-10-26T06:35:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.262+0000 7ffa16161700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10197330 con 0x7ffa10068b30 2023-10-26T06:35:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068190 0x7ffa1019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa10068b30 0x7ffa1019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068190 0x7ffa1019c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2023-10-26T06:35:40.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0f7fe700 1 -- 172.21.15.50:0/3699497676 learned_addr learned my addr 172.21.15.50:0/3699497676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0ffff700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa101067a0 0x7ffa101969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 -- 172.21.15.50:0/3699497676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa101067a0 msgr2=0x7ffa101969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa101067a0 0x7ffa101969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 -- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068190 msgr2=0x7ffa1019c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068190 0x7ffa1019c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 -- 172.21.15.50:0/3699497676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa000095f0 con 0x7ffa10068b30 2023-10-26T06:35:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0effd700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa10068b30 0x7ffa1019cd50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400e9f0 tx=0x7ffa0400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.263+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400c9c0 con 0x7ffa10068b30 2023-10-26T06:35:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.264+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(24 keys) v1 ==== 1049+0+0 (secure 0 0 0) 0x7ffa04010430 con 0x7ffa10068b30 2023-10-26T06:35:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.264+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04018680 con 0x7ffa10068b30 2023-10-26T06:35:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.264+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa10197610 con 0x7ffa10068b30 2023-10-26T06:35:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.264+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa101a3800 con 0x7ffa10068b30 2023-10-26T06:35:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.265+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10108d50 con 0x7ffa10068b30 2023-10-26T06:35:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.265+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7ffa04010810 con 0x7ffa10068b30 2023-10-26T06:35:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.265+0000 7ffa0cff9700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9f8038b40 0x7ff9f803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.265+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ffa04014070 con 0x7ffa10068b30 2023-10-26T06:35:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.265+0000 7ffa0f7fe700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9f8038b40 0x7ff9f803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.266+0000 7ffa0f7fe700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9f8038b40 0x7ff9f803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa00006010 tx=0x7ffa0000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.270+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffa04016720 con 0x7ffa10068b30 2023-10-26T06:35:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.457+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 7 ==== config(25 keys) v1 ==== 1080+0+0 (secure 0 0 0) 0x7ffa0401feb0 con 0x7ffa10068b30 2023-10-26T06:35:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.524+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) v1 -- 0x7ffa10101ee0 con 0x7ffa10068b30 2023-10-26T06:35:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.529+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 8 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa04014230 con 0x7ffa10068b30 2023-10-26T06:35:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.529+0000 7ffa0cff9700 1 -- 172.21.15.50:0/3699497676 <== mon.1 v2:172.21.15.153:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v15)=0 v15) v1 ==== 114+0+0 (secure 0 0 0) 0x7ffa04016330 con 0x7ffa10068b30 2023-10-26T06:35:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9f8038b40 msgr2=0x7ff9f803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9f8038b40 0x7ff9f803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa00006010 tx=0x7ffa0000b260 comp rx=0 tx=0).stop 2023-10-26T06:35:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa10068b30 msgr2=0x7ffa1019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa10068b30 0x7ffa1019cd50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400e9f0 tx=0x7ffa0400ed00 comp rx=0 tx=0).stop 2023-10-26T06:35:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 shutdown_connections 2023-10-26T06:35:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9f8038b40 0x7ff9f803b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa101067a0 0x7ffa101969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa10068190 0x7ffa1019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 --2- 172.21.15.50:0/3699497676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa10068b30 0x7ffa1019cd50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 >> 172.21.15.50:0/3699497676 conn(0x7ffa10075790 msgr2=0x7ffa100fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.531+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 shutdown_connections 2023-10-26T06:35:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:40.532+0000 7ffa16161700 1 -- 172.21.15.50:0/3699497676 wait complete. 2023-10-26T06:35:40.984 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:40.648+0000 7f90a602f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-26T06:35:41.126 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.126 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:41.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-26T06:35:41.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:41.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:41.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: Deploying daemon mgr.y on smithi125 2023-10-26T06:35:41.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:40 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.284 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.284 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.284 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.284 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.284 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:41.285 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-26T06:35:41.285 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:41.285 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:41.285 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: Deploying daemon mgr.y on smithi125 2023-10-26T06:35:41.285 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.286 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:40 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.331 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:41.016+0000 7f90a602f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-26T06:35:41.332 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:41.147+0000 7f90a602f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-26T06:35:41.332 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:41.235+0000 7f90a602f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-26T06:35:41.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.333 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.333 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.333 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:41.333 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:41.333 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-26T06:35:41.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:41.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:41.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: Deploying daemon mgr.y on smithi125 2023-10-26T06:35:41.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.335 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:40 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:41.734 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:41.329+0000 7f90a602f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-26T06:35:41.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.775+0000 7f564d724700 1 -- 172.21.15.50:0/2267252516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5648101260 msgr2=0x7f564810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:41.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.775+0000 7f564d724700 1 --2- 172.21.15.50:0/2267252516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5648101260 0x7f564810d650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f564000b0a0 tx=0x7f564000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:41.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 -- 172.21.15.50:0/2267252516 shutdown_connections 2023-10-26T06:35:41.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 --2- 172.21.15.50:0/2267252516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5648101260 0x7f564810d650 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:41.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 --2- 172.21.15.50:0/2267252516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56481057c0 0x7f5648105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:41.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 --2- 172.21.15.50:0/2267252516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56481008a0 0x7f5648100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:41.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 -- 172.21.15.50:0/2267252516 >> 172.21.15.50:0/2267252516 conn(0x7f56480779e0 msgr2=0x7f5648077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:41.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 -- 172.21.15.50:0/2267252516 shutdown_connections 2023-10-26T06:35:41.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.776+0000 7f564d724700 1 -- 172.21.15.50:0/2267252516 wait complete. 2023-10-26T06:35:41.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.777+0000 7f564d724700 1 Processor -- start 2023-10-26T06:35:41.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.777+0000 7f564d724700 1 -- start start 2023-10-26T06:35:41.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.777+0000 7f564d724700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 0x7f5648072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:41.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.777+0000 7f564d724700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5648101260 0x7f5648073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:41.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.777+0000 7f564d724700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56481057c0 0x7f5648073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:41.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f564d724700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481a5050 con 0x7f56481008a0 2023-10-26T06:35:41.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f564d724700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481a51c0 con 0x7f5648101260 2023-10-26T06:35:41.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f564d724700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481a5380 con 0x7f56481057c0 2023-10-26T06:35:41.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 0x7f5648072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:41.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 0x7f5648072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48626/0 (socket says 172.21.15.50:48626) 2023-10-26T06:35:41.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 -- 172.21.15.50:0/1155391703 learned_addr learned my addr 172.21.15.50:0/1155391703 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:41.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f56467fc700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5648101260 0x7f5648073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f56477fe700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56481057c0 0x7f5648073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 -- 172.21.15.50:0/1155391703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56481057c0 msgr2=0x7f5648073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56481057c0 0x7f5648073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:41.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 -- 172.21.15.50:0/1155391703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5648101260 msgr2=0x7f5648073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:41.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5648101260 0x7f5648073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:41.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 -- 172.21.15.50:0/1155391703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009d00 con 0x7f56481008a0 2023-10-26T06:35:41.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.778+0000 7f5646ffd700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 0x7f5648072af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f563800e970 tx=0x7f563800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:41.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.779+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638009790 con 0x7f56481008a0 2023-10-26T06:35:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.779+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f563800c7e0 con 0x7f56481008a0 2023-10-26T06:35:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.779+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56481a5660 con 0x7f56481008a0 2023-10-26T06:35:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.779+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638003c70 con 0x7f56481008a0 2023-10-26T06:35:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.779+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481a5bb0 con 0x7f56481008a0 2023-10-26T06:35:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.780+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648101f30 con 0x7f56481008a0 2023-10-26T06:35:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.780+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f5638018430 con 0x7f56481008a0 2023-10-26T06:35:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.780+0000 7f562ffff700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5630038b40 0x7f563003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.780+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f5638014070 con 0x7f56481008a0 2023-10-26T06:35:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.781+0000 7f56467fc700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5630038b40 0x7f563003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:41.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.781+0000 7f56467fc700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5630038b40 0x7f563003b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5648074220 tx=0x7f563c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:41.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:41.785+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5638003dd0 con 0x7f56481008a0 2023-10-26T06:35:41.922 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:41 smithi125 systemd[1]: Starting Ceph mgr.y for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:35:42.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.009+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f5648110780 con 0x7f56481008a0 2023-10-26T06:35:42.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.012+0000 7f562ffff700 1 -- 172.21.15.50:0/1155391703 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v16)=0 v16) v1 ==== 127+0+0 (secure 0 0 0) 0x7f5638017c10 con 0x7f56481008a0 2023-10-26T06:35:42.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.014+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5630038b40 msgr2=0x7f563003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:42.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.014+0000 7f564d724700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5630038b40 0x7f563003b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5648074220 tx=0x7f563c009260 comp rx=0 tx=0).stop 2023-10-26T06:35:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.014+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 msgr2=0x7f5648072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.014+0000 7f564d724700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 0x7f5648072af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f563800e970 tx=0x7f563800ec80 comp rx=0 tx=0).stop 2023-10-26T06:35:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 shutdown_connections 2023-10-26T06:35:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5630038b40 0x7f563003b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:42.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56481057c0 0x7f5648073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56481008a0 0x7f5648072af0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 --2- 172.21.15.50:0/1155391703 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5648101260 0x7f5648073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 >> 172.21.15.50:0/1155391703 conn(0x7f56480779e0 msgr2=0x7f56480fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 shutdown_connections 2023-10-26T06:35:42.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:42.015+0000 7f564d724700 1 -- 172.21.15.50:0/1155391703 wait complete. 2023-10-26T06:35:42.084 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:42.234 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:41.752+0000 7f90a602f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-26T06:35:42.399 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 podman[132983]: 2023-10-26T06:35:42.672 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 bash[132983]: 749339ab95738ceffb9a411d96d30ef6b5de57ae1495aaa6f022ab9f1d62b149 2023-10-26T06:35:42.672 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 ceph-mgr[133023]: -- 172.21.15.125:0/855814200 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bebf0851e0 con 0x55bebf05ac00 2023-10-26T06:35:42.673 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 systemd[1]: Started Ceph mgr.y for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:35:42.673 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:42.520+0000 7f3ed8c58200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-26T06:35:42.673 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:42.601+0000 7f3ed8c58200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-26T06:35:42.734 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:42.425+0000 7f90a602f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-26T06:35:42.735 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:42.506+0000 7f90a602f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-26T06:35:42.974 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:42.692+0000 7f3ed8c58200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-26T06:35:42.975 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:42.792+0000 7f3ed8c58200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-26T06:35:42.975 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:42.973+0000 7f3ed8c58200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-26T06:35:43.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:43 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1155391703' entity='client.admin' 2023-10-26T06:35:43.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:43.277 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:43.333 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1155391703' entity='client.admin' 2023-10-26T06:35:43.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.334 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.335 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:43.342 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:43.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1155391703' entity='client.admin' 2023-10-26T06:35:43.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:43.358 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.523+0000 7f6fa161b700 1 -- 172.21.15.50:0/405006754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1008a0 msgr2=0x7f6f9c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.523+0000 7f6fa161b700 1 --2- 172.21.15.50:0/405006754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c100d20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009990 tx=0x7f6f90009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 -- 172.21.15.50:0/405006754 shutdown_connections 2023-10-26T06:35:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 --2- 172.21.15.50:0/405006754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c101260 0x7f6f9c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 --2- 172.21.15.50:0/405006754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1057c0 0x7f6f9c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 --2- 172.21.15.50:0/405006754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c100d20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 -- 172.21.15.50:0/405006754 >> 172.21.15.50:0/405006754 conn(0x7f6f9c0779e0 msgr2=0x7f6f9c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:43.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 -- 172.21.15.50:0/405006754 shutdown_connections 2023-10-26T06:35:43.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.524+0000 7f6fa161b700 1 -- 172.21.15.50:0/405006754 wait complete. 2023-10-26T06:35:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 Processor -- start 2023-10-26T06:35:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 -- start start 2023-10-26T06:35:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c101260 0x7f6f9c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1057c0 0x7f6f9c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1a4ff0 con 0x7f6f9c101260 2023-10-26T06:35:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1a5160 con 0x7f6f9c1057c0 2023-10-26T06:35:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.525+0000 7f6fa161b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1a5320 con 0x7f6f9c1008a0 2023-10-26T06:35:43.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:39678/0 (socket says 172.21.15.50:39678) 2023-10-26T06:35:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c101260 0x7f6f9c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 -- 172.21.15.50:0/625521929 learned_addr learned my addr 172.21.15.50:0/625521929 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 -- 172.21.15.50:0/625521929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1057c0 msgr2=0x7f6f9c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1057c0 0x7f6f9c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 -- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c101260 msgr2=0x7f6f9c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c101260 0x7f6f9c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 -- 172.21.15.50:0/625521929 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900095f0 con 0x7f6f9c1008a0 2023-10-26T06:35:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.526+0000 7f6f9affd700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c072af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00e970 tx=0x7f6f8c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:43.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.527+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c009790 con 0x7f6f9c1008a0 2023-10-26T06:35:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.527+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f8c00eec0 con 0x7f6f9c1008a0 2023-10-26T06:35:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.527+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003cf0 con 0x7f6f9c1008a0 2023-10-26T06:35:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.527+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c1a5600 con 0x7f6f9c1008a0 2023-10-26T06:35:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.527+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c1a5b00 con 0x7f6f9c1008a0 2023-10-26T06:35:43.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.528+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c108da0 con 0x7f6f9c1008a0 2023-10-26T06:35:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.528+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f6f8c018430 con 0x7f6f9c1008a0 2023-10-26T06:35:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.528+0000 7f6f83fff700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6f84038b40 0x7f6f8403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.528+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6f8c014070 con 0x7f6f9c1008a0 2023-10-26T06:35:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.529+0000 7f6f9a7fc700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6f84038b40 0x7f6f8403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.529+0000 7f6f9a7fc700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6f84038b40 0x7f6f8403b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0741d0 tx=0x7f6f9000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.533+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f8c01f340 con 0x7f6f9c1008a0 2023-10-26T06:35:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 -- 172.21.15.50:0/100838122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7201008a0 msgr2=0x7fb720100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 --2- 172.21.15.50:0/100838122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7201008a0 0x7fb720100d20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb714009990 tx=0x7fb714009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 -- 172.21.15.50:0/100838122 shutdown_connections 2023-10-26T06:35:43.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 --2- 172.21.15.50:0/100838122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb720101260 0x7fb72010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 --2- 172.21.15.50:0/100838122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7201057c0 0x7fb720105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 --2- 172.21.15.50:0/100838122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7201008a0 0x7fb720100d20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 -- 172.21.15.50:0/100838122 >> 172.21.15.50:0/100838122 conn(0x7fb7200779e0 msgr2=0x7fb720077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 -- 172.21.15.50:0/100838122 shutdown_connections 2023-10-26T06:35:43.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.545+0000 7fb726113700 1 -- 172.21.15.50:0/100838122 wait complete. 2023-10-26T06:35:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.546+0000 7fb726113700 1 Processor -- start 2023-10-26T06:35:43.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 -- start start 2023-10-26T06:35:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 0x7fb720072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720101260 0x7fb720073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7201057c0 0x7fb720073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201a4fd0 con 0x7fb7201008a0 2023-10-26T06:35:43.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201a5140 con 0x7fb720101260 2023-10-26T06:35:43.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb726113700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201a5300 con 0x7fb7201057c0 2023-10-26T06:35:43.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb71f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 0x7fb720072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb71effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720101260 0x7fb720073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb71f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 0x7fb720072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48658/0 (socket says 172.21.15.50:48658) 2023-10-26T06:35:43.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.547+0000 7fb71f7fe700 1 -- 172.21.15.50:0/230422527 learned_addr learned my addr 172.21.15.50:0/230422527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71ffff700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7201057c0 0x7fb720073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71f7fe700 1 -- 172.21.15.50:0/230422527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7201057c0 msgr2=0x7fb720073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71f7fe700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7201057c0 0x7fb720073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71f7fe700 1 -- 172.21.15.50:0/230422527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720101260 msgr2=0x7fb720073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71f7fe700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720101260 0x7fb720073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71f7fe700 1 -- 172.21.15.50:0/230422527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140095f0 con 0x7fb7201008a0 2023-10-26T06:35:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71effd700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720101260 0x7fb720073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71f7fe700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 0x7fb720072af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb71000e970 tx=0x7fb71000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710009790 con 0x7fb7201008a0 2023-10-26T06:35:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.548+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb71000eec0 con 0x7fb7201008a0 2023-10-26T06:35:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.549+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710003cf0 con 0x7fb7201008a0 2023-10-26T06:35:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.549+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7201a55e0 con 0x7fb7201008a0 2023-10-26T06:35:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.549+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7201a5a90 con 0x7fb7201008a0 2023-10-26T06:35:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.550+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720108da0 con 0x7fb7201008a0 2023-10-26T06:35:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.550+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fb71000ccd0 con 0x7fb7201008a0 2023-10-26T06:35:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.551+0000 7fb71cff9700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb708038b40 0x7fb70803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.551+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb710014070 con 0x7fb7201008a0 2023-10-26T06:35:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.551+0000 7fb71effd700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb708038b40 0x7fb70803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.552+0000 7fb71effd700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb708038b40 0x7fb70803b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb7200741d0 tx=0x7fb71400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.556+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb71000fa10 con 0x7fb7201008a0 2023-10-26T06:35:43.619 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:43.331+0000 7f90a602f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:35:43.620 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:43.436+0000 7f90a602f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-26T06:35:43.620 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:43.617+0000 7f90a602f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:35:43.672 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:43.352+0000 7f3ed8c58200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-26T06:35:43.672 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:43.484+0000 7f3ed8c58200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-26T06:35:43.673 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:43.579+0000 7f3ed8c58200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-26T06:35:43.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.755+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7f6f9c074020 con 0x7f6f9c1008a0 2023-10-26T06:35:43.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.774+0000 7f6f83fff700 1 -- 172.21.15.50:0/625521929 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) v1 ==== 117+0+0 (secure 0 0 0) 0x7f6f8c00fbb0 con 0x7f6f9c1008a0 2023-10-26T06:35:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6f84038b40 msgr2=0x7f6f8403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6f84038b40 0x7f6f8403b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0741d0 tx=0x7f6f9000b260 comp rx=0 tx=0).stop 2023-10-26T06:35:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 msgr2=0x7f6f9c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c072af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00e970 tx=0x7f6f8c00ec80 comp rx=0 tx=0).stop 2023-10-26T06:35:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 shutdown_connections 2023-10-26T06:35:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6f84038b40 0x7f6f8403b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f9c1057c0 0x7f6f9c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f9c1008a0 0x7f6f9c072af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 --2- 172.21.15.50:0/625521929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c101260 0x7f6f9c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 >> 172.21.15.50:0/625521929 conn(0x7f6f9c0779e0 msgr2=0x7f6f9c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 shutdown_connections 2023-10-26T06:35:43.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.777+0000 7f6fa161b700 1 -- 172.21.15.50:0/625521929 wait complete. 2023-10-26T06:35:43.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.788+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7fb720073f80 con 0x7fb7201008a0 2023-10-26T06:35:43.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.791+0000 7fb71cff9700 1 -- 172.21.15.50:0/230422527 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v18)=0 v18) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb71000f3c0 con 0x7fb7201008a0 2023-10-26T06:35:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb708038b40 msgr2=0x7fb70803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb708038b40 0x7fb70803b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb7200741d0 tx=0x7fb71400b260 comp rx=0 tx=0).stop 2023-10-26T06:35:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 msgr2=0x7fb720072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 0x7fb720072af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb71000e970 tx=0x7fb71000ec80 comp rx=0 tx=0).stop 2023-10-26T06:35:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 shutdown_connections 2023-10-26T06:35:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb708038b40 0x7fb70803b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7201057c0 0x7fb720073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7201008a0 0x7fb720072af0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 --2- 172.21.15.50:0/230422527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb720101260 0x7fb720073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 >> 172.21.15.50:0/230422527 conn(0x7fb7200779e0 msgr2=0x7fb7200fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 shutdown_connections 2023-10-26T06:35:43.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:43.794+0000 7fb726113700 1 -- 172.21.15.50:0/230422527 wait complete. 2023-10-26T06:35:44.127 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:43.679+0000 7f3ed8c58200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-26T06:35:44.234 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:43.933+0000 7f90a602f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-26T06:35:44.234 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:44.173+0000 7f90a602f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-26T06:35:44.422 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:44.126+0000 7f3ed8c58200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-26T06:35:44.596 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:44.327+0000 7f90a602f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-26T06:35:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:44.984 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:44.593+0000 7f90a602f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-26T06:35:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/230422527' entity='client.admin' 2023-10-26T06:35:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:44.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:44.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:44.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:44.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:44.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: Reconfiguring mgr.x (unknown last config time)... 2023-10-26T06:35:44.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:44.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:44.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:44.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: Reconfiguring daemon mgr.x on smithi050 2023-10-26T06:35:44.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/230422527' entity='client.admin' 2023-10-26T06:35:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:45.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:45.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: Reconfiguring mgr.x (unknown last config time)... 2023-10-26T06:35:45.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:45.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:45.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:45.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: Reconfiguring daemon mgr.x on smithi050 2023-10-26T06:35:45.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:45.173 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:44.797+0000 7f3ed8c58200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-26T06:35:45.173 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:44.878+0000 7f3ed8c58200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-26T06:35:45.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:45.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/230422527' entity='client.admin' 2023-10-26T06:35:45.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:45.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:45.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: Reconfiguring mgr.x (unknown last config time)... 2023-10-26T06:35:45.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-26T06:35:45.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-26T06:35:45.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:45.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: Reconfiguring daemon mgr.x on smithi050 2023-10-26T06:35:45.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:45.220 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi050') 2023-10-26T06:35:45.221 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi050') 2023-10-26T06:35:45.221 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi050') 2023-10-26T06:35:45.221 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi050') 2023-10-26T06:35:45.222 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi050') 2023-10-26T06:35:45.627 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:45.301+0000 7f90a602f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-26T06:35:45.628 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:45.432+0000 7f90a602f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-26T06:35:45.903 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:45.642+0000 7f3ed8c58200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:35:45.903 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:45.731+0000 7f3ed8c58200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-26T06:35:45.956 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:45.625+0000 7f90a602f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-26T06:35:45.956 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:45.737+0000 7f90a602f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-26T06:35:45.956 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:45.954+0000 7f90a602f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-26T06:35:46.172 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:45.902+0000 7f3ed8c58200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-26T06:35:46.549 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:46.178+0000 7f3ed8c58200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-26T06:35:46.550 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:46.402+0000 7f3ed8c58200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-26T06:35:46.679 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi050') 2023-10-26T06:35:46.812 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:46.548+0000 7f3ed8c58200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-26T06:35:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:46 smithi050 ceph-mon[94997]: Standby manager daemon z started 2023-10-26T06:35:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:46 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-26T06:35:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:46 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-26T06:35:47.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:46 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-26T06:35:47.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:46 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-26T06:35:47.172 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:46.810+0000 7f3ed8c58200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-26T06:35:47.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-mon[130643]: Standby manager daemon z started 2023-10-26T06:35:47.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-26T06:35:47.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-26T06:35:47.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-26T06:35:47.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:46 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-26T06:35:47.234 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:35:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z[134653]: 2023-10-26T06:35:46.816+0000 7f90a602f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-26T06:35:47.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:46 smithi153 ceph-mon[131657]: Standby manager daemon z started 2023-10-26T06:35:47.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:46 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-26T06:35:47.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:46 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-26T06:35:47.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:46 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-26T06:35:47.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:46 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.153:0/1356565985' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-26T06:35:47.833 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:47.505+0000 7f3ed8c58200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-26T06:35:47.834 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:47.637+0000 7f3ed8c58200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-26T06:35:47.834 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:47.831+0000 7f3ed8c58200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-26T06:35:48.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 -- 172.21.15.50:0/3741046224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 msgr2=0x7f48f40733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 --2- 172.21.15.50:0/3741046224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 0x7f48f40733e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009990 tx=0x7f48e4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 -- 172.21.15.50:0/3741046224 shutdown_connections 2023-10-26T06:35:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 --2- 172.21.15.50:0/3741046224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 0x7f48f41139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 --2- 172.21.15.50:0/3741046224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f4072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 --2- 172.21.15.50:0/3741046224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 0x7f48f40733e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 -- 172.21.15.50:0/3741046224 >> 172.21.15.50:0/3741046224 conn(0x7f48f40779e0 msgr2=0x7f48f4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 -- 172.21.15.50:0/3741046224 shutdown_connections 2023-10-26T06:35:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.879+0000 7f48fb750700 1 -- 172.21.15.50:0/3741046224 wait complete. 2023-10-26T06:35:48.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.880+0000 7f48fb750700 1 Processor -- start 2023-10-26T06:35:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 -- start start 2023-10-26T06:35:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 0x7f48f419d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f419d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 0x7f48f41a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41a21c0 con 0x7f48f4072f60 2023-10-26T06:35:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41a2330 con 0x7f48f4074770 2023-10-26T06:35:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48fb750700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41a24f0 con 0x7f48f4111570 2023-10-26T06:35:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48f8ceb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f419d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48f94ec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 0x7f48f419d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48f8ceb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f419d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:50606/0 (socket says 172.21.15.50:50606) 2023-10-26T06:35:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48f8ceb700 1 -- 172.21.15.50:0/783334569 learned_addr learned my addr 172.21.15.50:0/783334569 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.881+0000 7f48f9ced700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 0x7f48f41a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f8ceb700 1 -- 172.21.15.50:0/783334569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 msgr2=0x7f48f41a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f8ceb700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 0x7f48f41a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f8ceb700 1 -- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 msgr2=0x7f48f419d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f8ceb700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 0x7f48f419d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f8ceb700 1 -- 172.21.15.50:0/783334569 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009520 con 0x7f48f4074770 2023-10-26T06:35:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f9ced700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 0x7f48f41a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:35:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48f8ceb700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f419d800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48e4005910 tx=0x7f48e4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e401d070 con 0x7f48f4074770 2023-10-26T06:35:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e40095f0 con 0x7f48f4074770 2023-10-26T06:35:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48e4022470 con 0x7f48f4074770 2023-10-26T06:35:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4017650 con 0x7f48f4074770 2023-10-26T06:35:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.882+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f41a29f0 con 0x7f48f4074770 2023-10-26T06:35:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.884+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f40740b0 con 0x7f48f4074770 2023-10-26T06:35:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.884+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 18) v1 ==== 90808+0+0 (secure 0 0 0) 0x7f48e400fac0 con 0x7f48f4074770 2023-10-26T06:35:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.885+0000 7f48ea7fc700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f48e006cfc0 0x7f48e006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.885+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f48e408c740 con 0x7f48f4074770 2023-10-26T06:35:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.885+0000 7f48f94ec700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f48e006cfc0 0x7f48e006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.886+0000 7f48f94ec700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f48e006cfc0 0x7f48e006f480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009df0 tx=0x7f48f0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.890+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f48e4057a20 con 0x7f48f4074770 2023-10-26T06:35:48.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.128+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7f48f419e5d0 con 0x7f48f4074770 2023-10-26T06:35:48.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.133+0000 7f48ea7fc700 1 -- 172.21.15.50:0/783334569 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v20)=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f48e405b040 con 0x7f48f4074770 2023-10-26T06:35:48.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f48e006cfc0 msgr2=0x7f48e006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f48e006cfc0 0x7f48e006f480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009df0 tx=0x7f48f0009260 comp rx=0 tx=0).stop 2023-10-26T06:35:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 msgr2=0x7f48f419d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f419d800 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48e4005910 tx=0x7f48e4004730 comp rx=0 tx=0).stop 2023-10-26T06:35:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 shutdown_connections 2023-10-26T06:35:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f48e006cfc0 0x7f48e006f480 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48f4111570 0x7f48f41a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48f4072f60 0x7f48f419d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 --2- 172.21.15.50:0/783334569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48f4074770 0x7f48f419d800 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 >> 172.21.15.50:0/783334569 conn(0x7f48f40779e0 msgr2=0x7f48f4110140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 shutdown_connections 2023-10-26T06:35:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:48.136+0000 7f48fb750700 1 -- 172.21.15.50:0/783334569 wait complete. 2023-10-26T06:35:48.160 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:47 smithi050 ceph-mon[94997]: mgrmap e18: x(active, since 17s), standbys: z 2023-10-26T06:35:48.161 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:47 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-26T06:35:48.161 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:47 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4244391121' entity='client.admin' 2023-10-26T06:35:48.162 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-mon[130643]: mgrmap e18: x(active, since 17s), standbys: z 2023-10-26T06:35:48.162 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-26T06:35:48.163 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4244391121' entity='client.admin' 2023-10-26T06:35:48.163 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:47.945+0000 7f3ed8c58200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-26T06:35:48.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:47 smithi153 ceph-mon[131657]: mgrmap e18: x(active, since 17s), standbys: z 2023-10-26T06:35:48.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:47 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-26T06:35:48.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:47 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4244391121' entity='client.admin' 2023-10-26T06:35:48.422 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:48.160+0000 7f3ed8c58200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-26T06:35:48.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 -- 172.21.15.50:0/1214344924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801057c0 msgr2=0x7fe680105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 --2- 172.21.15.50:0/1214344924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801057c0 0x7fe680105ba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe674009990 tx=0x7fe674009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 -- 172.21.15.50:0/1214344924 shutdown_connections 2023-10-26T06:35:48.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 --2- 172.21.15.50:0/1214344924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe680101260 0x7fe68010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 --2- 172.21.15.50:0/1214344924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801057c0 0x7fe680105ba0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 --2- 172.21.15.50:0/1214344924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801008a0 0x7fe680100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.334+0000 7fe686d54700 1 -- 172.21.15.50:0/1214344924 >> 172.21.15.50:0/1214344924 conn(0x7fe6800779e0 msgr2=0x7fe680077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:48.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.335+0000 7fe686d54700 1 -- 172.21.15.50:0/1214344924 shutdown_connections 2023-10-26T06:35:48.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.335+0000 7fe686d54700 1 -- 172.21.15.50:0/1214344924 wait complete. 2023-10-26T06:35:48.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.336+0000 7fe686d54700 1 Processor -- start 2023-10-26T06:35:48.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.336+0000 7fe686d54700 1 -- start start 2023-10-26T06:35:48.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe686d54700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 0x7fe680198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe686d54700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe680101260 0x7fe6801993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe686d54700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801057c0 0x7fe68019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe686d54700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019dda0 con 0x7fe6801008a0 2023-10-26T06:35:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe686d54700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019df10 con 0x7fe6801057c0 2023-10-26T06:35:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe686d54700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019e0d0 con 0x7fe680101260 2023-10-26T06:35:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe684af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 0x7fe680198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe684af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 0x7fe680198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47176/0 (socket says 172.21.15.50:47176) 2023-10-26T06:35:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe684af0700 1 -- 172.21.15.50:0/4244391121 learned_addr learned my addr 172.21.15.50:0/4244391121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:48.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe6852f1700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801057c0 0x7fe68019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.337+0000 7fe67ffff700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe680101260 0x7fe6801993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe684af0700 1 -- 172.21.15.50:0/4244391121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe680101260 msgr2=0x7fe6801993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe684af0700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe680101260 0x7fe6801993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe684af0700 1 -- 172.21.15.50:0/4244391121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801057c0 msgr2=0x7fe68019d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe684af0700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801057c0 0x7fe68019d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe684af0700 1 -- 172.21.15.50:0/4244391121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c009520 con 0x7fe6801008a0 2023-10-26T06:35:48.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe6852f1700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801057c0 0x7fe68019d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:48.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe684af0700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 0x7fe680198ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe674000c00 tx=0x7fe674005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:48.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67401d070 con 0x7fe6801008a0 2023-10-26T06:35:48.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe674022470 con 0x7fe6801008a0 2023-10-26T06:35:48.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674017650 con 0x7fe6801008a0 2023-10-26T06:35:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740095f0 con 0x7fe6801008a0 2023-10-26T06:35:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.338+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68019e580 con 0x7fe6801008a0 2023-10-26T06:35:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.339+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe680101f30 con 0x7fe6801008a0 2023-10-26T06:35:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.340+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) v1 ==== 90808+0+0 (secure 0 0 0) 0x7fe67400fad0 con 0x7fe6801008a0 2023-10-26T06:35:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.341+0000 7fe67dffb700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe67006cfc0 0x7fe67006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:48.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.342+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe67408c650 con 0x7fe6801008a0 2023-10-26T06:35:48.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.342+0000 7fe67ffff700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe67006cfc0 0x7fe67006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:48.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.342+0000 7fe67ffff700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe67006cfc0 0x7fe67006f480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe68019a400 tx=0x7fe66c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:48.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.346+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe6740579d0 con 0x7fe6801008a0 2023-10-26T06:35:48.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.623+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7fe68019a1b0 con 0x7fe6801008a0 2023-10-26T06:35:48.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.631+0000 7fe67dffb700 1 -- 172.21.15.50:0/4244391121 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) v1 ==== 116+0+0 (secure 0 0 0) 0x7fe67405aff0 con 0x7fe6801008a0 2023-10-26T06:35:48.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe67006cfc0 msgr2=0x7fe67006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe67006cfc0 0x7fe67006f480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe68019a400 tx=0x7fe66c009260 comp rx=0 tx=0).stop 2023-10-26T06:35:48.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 msgr2=0x7fe680198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:48.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 0x7fe680198ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe674000c00 tx=0x7fe674005740 comp rx=0 tx=0).stop 2023-10-26T06:35:48.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 shutdown_connections 2023-10-26T06:35:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe67006cfc0 0x7fe67006f480 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6801057c0 0x7fe68019d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6801008a0 0x7fe680198ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 --2- 172.21.15.50:0/4244391121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe680101260 0x7fe6801993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:48.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 >> 172.21.15.50:0/4244391121 conn(0x7fe6800779e0 msgr2=0x7fe68010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:48.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 shutdown_connections 2023-10-26T06:35:48.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:47.634+0000 7fe686d54700 1 -- 172.21.15.50:0/4244391121 wait complete. 2023-10-26T06:35:49.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:49 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:49.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:49 smithi050 ceph-mon[94997]: Standby manager daemon y started 2023-10-26T06:35:49.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:49 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-26T06:35:49.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:49 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-26T06:35:49.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:49 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-26T06:35:49.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:49 smithi050 ceph-mon[94997]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-26T06:35:49.422 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y[132999]: 2023-10-26T06:35:49.037+0000 7f3ed8c58200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-26T06:35:49.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:49.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-mon[130643]: Standby manager daemon y started 2023-10-26T06:35:49.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-26T06:35:49.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-26T06:35:49.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-26T06:35:49.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:49 smithi125 ceph-mon[130643]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-26T06:35:49.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:49 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:49.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:49 smithi153 ceph-mon[131657]: Standby manager daemon y started 2023-10-26T06:35:49.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:49 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-26T06:35:49.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:49 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-26T06:35:49.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:49 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-26T06:35:49.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:49 smithi153 ceph-mon[131657]: from='mgr.? 172.21.15.125:0/1710369104' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-26T06:35:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.810+0000 7ffa095b2700 1 -- 172.21.15.50:0/688956861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041008a0 msgr2=0x7ffa04100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:49.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.810+0000 7ffa095b2700 1 --2- 172.21.15.50:0/688956861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041008a0 0x7ffa04100d20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009990 tx=0x7ff9f8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 -- 172.21.15.50:0/688956861 shutdown_connections 2023-10-26T06:35:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 --2- 172.21.15.50:0/688956861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa04101260 0x7ffa0410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 --2- 172.21.15.50:0/688956861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041057c0 0x7ffa04105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 --2- 172.21.15.50:0/688956861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041008a0 0x7ffa04100d20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:49.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 -- 172.21.15.50:0/688956861 >> 172.21.15.50:0/688956861 conn(0x7ffa040779e0 msgr2=0x7ffa04077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 -- 172.21.15.50:0/688956861 shutdown_connections 2023-10-26T06:35:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.811+0000 7ffa095b2700 1 -- 172.21.15.50:0/688956861 wait complete. 2023-10-26T06:35:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.812+0000 7ffa095b2700 1 Processor -- start 2023-10-26T06:35:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 -- start start 2023-10-26T06:35:49.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 0x7ffa0419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa04101260 0x7ffa0419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041057c0 0x7ffa04196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa04197060 con 0x7ffa041057c0 2023-10-26T06:35:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa041971a0 con 0x7ffa04101260 2023-10-26T06:35:49.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.813+0000 7ffa095b2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa04197360 con 0x7ffa041008a0 2023-10-26T06:35:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.814+0000 7ffa02ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 0x7ffa0419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.814+0000 7ffa02ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 0x7ffa0419c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:48640/0 (socket says 172.21.15.50:48640) 2023-10-26T06:35:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.814+0000 7ffa02ffd700 1 -- 172.21.15.50:0/908757270 learned_addr learned my addr 172.21.15.50:0/908757270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.814+0000 7ffa027fc700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa04101260 0x7ffa0419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:49.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.815+0000 7ffa02ffd700 1 -- 172.21.15.50:0/908757270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa04101260 msgr2=0x7ffa0419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.815+0000 7ffa02ffd700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa04101260 0x7ffa0419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.815+0000 7ffa02ffd700 1 -- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041057c0 msgr2=0x7ffa04196b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-26T06:35:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.815+0000 7ffa02ffd700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041057c0 0x7ffa04196b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.815+0000 7ffa02ffd700 1 -- 172.21.15.50:0/908757270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80095f0 con 0x7ffa041008a0 2023-10-26T06:35:49.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.815+0000 7ffa02ffd700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 0x7ffa0419c980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400e970 tx=0x7ff9f400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.816+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4009790 con 0x7ffa041008a0 2023-10-26T06:35:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.816+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9f400eec0 con 0x7ffa041008a0 2023-10-26T06:35:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.816+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa04197560 con 0x7ffa041008a0 2023-10-26T06:35:49.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.816+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4003cf0 con 0x7ffa041008a0 2023-10-26T06:35:49.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.816+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa041a1840 con 0x7ffa041008a0 2023-10-26T06:35:49.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.817+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04108da0 con 0x7ffa041008a0 2023-10-26T06:35:49.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.820+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7ff9f400ccd0 con 0x7ffa041008a0 2023-10-26T06:35:49.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.822+0000 7ff9ebfff700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9ec0a14c0 0x7ff9ec0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:49.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.822+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff9f4014070 con 0x7ffa041008a0 2023-10-26T06:35:49.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.822+0000 7ffa027fc700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9ec0a14c0 0x7ff9ec0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.823+0000 7ffa027fc700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9ec0a14c0 0x7ff9ec0a3980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa04198210 tx=0x7ff9f8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:49.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:49.826+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff9f40964d0 con 0x7ffa041008a0 2023-10-26T06:35:50.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.058+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7ffa04101f30 con 0x7ffa041008a0 2023-10-26T06:35:50.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.064+0000 7ff9ebfff700 1 -- 172.21.15.50:0/908757270 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v21)=0 v21) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff9f4099af0 con 0x7ffa041008a0 2023-10-26T06:35:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9ec0a14c0 msgr2=0x7ff9ec0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9ec0a14c0 0x7ff9ec0a3980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa04198210 tx=0x7ff9f8005fd0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 msgr2=0x7ffa0419c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 0x7ffa0419c980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400e970 tx=0x7ff9f400ec80 comp rx=0 tx=0).stop 2023-10-26T06:35:50.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 shutdown_connections 2023-10-26T06:35:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9ec0a14c0 0x7ff9ec0a3980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa041057c0 0x7ffa04196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa041008a0 0x7ffa0419c980 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 --2- 172.21.15.50:0/908757270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa04101260 0x7ffa0419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 >> 172.21.15.50:0/908757270 conn(0x7ffa040779e0 msgr2=0x7ffa040fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:50.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 shutdown_connections 2023-10-26T06:35:50.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.068+0000 7ffa095b2700 1 -- 172.21.15.50:0/908757270 wait complete. 2023-10-26T06:35:50.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:50 smithi050 ceph-mon[94997]: mgrmap e19: x(active, since 19s), standbys: z, y 2023-10-26T06:35:50.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:50 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-26T06:35:50.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:50 smithi050 ceph-mon[94997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:50.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:50 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:50.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:50 smithi125 ceph-mon[130643]: mgrmap e19: x(active, since 19s), standbys: z, y 2023-10-26T06:35:50.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:50 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-26T06:35:50.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:50 smithi125 ceph-mon[130643]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:50.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:50 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:50.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:50 smithi153 ceph-mon[131657]: mgrmap e19: x(active, since 19s), standbys: z, y 2023-10-26T06:35:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:50 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-26T06:35:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:50 smithi153 ceph-mon[131657]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:50 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:50.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 -- 172.21.15.50:0/2877675547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 msgr2=0x7f362410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 --2- 172.21.15.50:0/2877675547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f362410d650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b0a0 tx=0x7f361c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 -- 172.21.15.50:0/2877675547 shutdown_connections 2023-10-26T06:35:50.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 --2- 172.21.15.50:0/2877675547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f362410d650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 --2- 172.21.15.50:0/2877675547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 0x7f3624105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 --2- 172.21.15.50:0/2877675547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 0x7f3624100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 -- 172.21.15.50:0/2877675547 >> 172.21.15.50:0/2877675547 conn(0x7f36240779e0 msgr2=0x7f3624077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:50.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 -- 172.21.15.50:0/2877675547 shutdown_connections 2023-10-26T06:35:50.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.516+0000 7f362c407700 1 -- 172.21.15.50:0/2877675547 wait complete. 2023-10-26T06:35:50.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.517+0000 7f362c407700 1 Processor -- start 2023-10-26T06:35:50.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 -- start start 2023-10-26T06:35:50.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 0x7f3624072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:50.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f3624073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:50.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 0x7f3624073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:50.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241a5050 con 0x7f3624101260 2023-10-26T06:35:50.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241a51c0 con 0x7f36241057c0 2023-10-26T06:35:50.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362c407700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241a5380 con 0x7f36241008a0 2023-10-26T06:35:50.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f36299a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f3624073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:50.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362a1a3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 0x7f3624072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:50.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f36299a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f3624073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47234/0 (socket says 172.21.15.50:47234) 2023-10-26T06:35:50.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f36299a2700 1 -- 172.21.15.50:0/612524563 learned_addr learned my addr 172.21.15.50:0/612524563 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:50.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.518+0000 7f362a9a4700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 0x7f3624073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:50.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f36299a2700 1 -- 172.21.15.50:0/612524563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 msgr2=0x7f3624072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f36299a2700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 0x7f3624072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f36299a2700 1 -- 172.21.15.50:0/612524563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 msgr2=0x7f3624073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f36299a2700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 0x7f3624073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f36299a2700 1 -- 172.21.15.50:0/612524563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c009d00 con 0x7f3624101260 2023-10-26T06:35:50.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f362a1a3700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 0x7f3624072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:50.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f362a9a4700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 0x7f3624073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:50.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f36299a2700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f3624073030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f361400e9a0 tx=0x7f361400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:50.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614009790 con 0x7f3624101260 2023-10-26T06:35:50.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3614010430 con 0x7f3624101260 2023-10-26T06:35:50.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36241a5660 con 0x7f3624101260 2023-10-26T06:35:50.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614018680 con 0x7f3624101260 2023-10-26T06:35:50.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.519+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36241a5bb0 con 0x7f3624101260 2023-10-26T06:35:50.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.521+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3624101f30 con 0x7f3624101260 2023-10-26T06:35:50.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.523+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f36140105a0 con 0x7f3624101260 2023-10-26T06:35:50.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.524+0000 7f361b7fe700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36100a14c0 0x7f36100a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:50.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.524+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3614014070 con 0x7f3624101260 2023-10-26T06:35:50.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.524+0000 7f362a1a3700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36100a14c0 0x7f36100a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:50.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.525+0000 7f362a1a3700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36100a14c0 0x7f36100a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3624101930 tx=0x7f3620009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:50.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.528+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36140964d0 con 0x7f3624101260 2023-10-26T06:35:50.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.760+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f362404e4c0 con 0x7f3624101260 2023-10-26T06:35:50.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.764+0000 7f361b7fe700 1 -- 172.21.15.50:0/612524563 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) v1 ==== 119+0+0 (secure 0 0 0) 0x7f3614099af0 con 0x7f3624101260 2023-10-26T06:35:50.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36100a14c0 msgr2=0x7f36100a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36100a14c0 0x7f36100a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3624101930 tx=0x7f3620009260 comp rx=0 tx=0).stop 2023-10-26T06:35:50.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 msgr2=0x7f3624073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:50.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f3624073030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f361400e9a0 tx=0x7f361400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 shutdown_connections 2023-10-26T06:35:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36100a14c0 0x7f36100a3980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36241057c0 0x7f3624073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36241008a0 0x7f3624072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 --2- 172.21.15.50:0/612524563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3624101260 0x7f3624073030 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.767+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 >> 172.21.15.50:0/612524563 conn(0x7f36240779e0 msgr2=0x7f36240fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.768+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 shutdown_connections 2023-10-26T06:35:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:50.768+0000 7f362c407700 1 -- 172.21.15.50:0/612524563 wait complete. 2023-10-26T06:35:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 -- 172.21.15.50:0/1432101193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 msgr2=0x7f34c010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:51.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 --2- 172.21.15.50:0/1432101193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c010d670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34b800b0a0 tx=0x7f34b800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:51.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 -- 172.21.15.50:0/1432101193 shutdown_connections 2023-10-26T06:35:51.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 --2- 172.21.15.50:0/1432101193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c010d670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:51.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 --2- 172.21.15.50:0/1432101193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 0x7f34c0106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:51.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 --2- 172.21.15.50:0/1432101193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 0x7f34c00685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:51.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 -- 172.21.15.50:0/1432101193 >> 172.21.15.50:0/1432101193 conn(0x7f34c0075790 msgr2=0x7f34c0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:51.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 -- 172.21.15.50:0/1432101193 shutdown_connections 2023-10-26T06:35:51.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.905+0000 7f34c69b6700 1 -- 172.21.15.50:0/1432101193 wait complete. 2023-10-26T06:35:51.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.907+0000 7f34c69b6700 1 Processor -- start 2023-10-26T06:35:51.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.907+0000 7f34c69b6700 1 -- start start 2023-10-26T06:35:51.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c69b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 0x7f34c0198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:51.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c69b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:51.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c69b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 0x7f34c019d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:51.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c69b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c019de50 con 0x7f34c0068b30 2023-10-26T06:35:51.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c69b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c019dfc0 con 0x7f34c0068190 2023-10-26T06:35:51.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c69b6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c019e180 con 0x7f34c01067a0 2023-10-26T06:35:51.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:51.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c0199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47268/0 (socket says 172.21.15.50:47268) 2023-10-26T06:35:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 0x7f34c0198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 -- 172.21.15.50:0/136191721 learned_addr learned my addr 172.21.15.50:0/136191721 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c4f53700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 0x7f34c019d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 -- 172.21.15.50:0/136191721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 msgr2=0x7f34c019d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:51.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 0x7f34c019d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 -- 172.21.15.50:0/136191721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 msgr2=0x7f34c0198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 0x7f34c0198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bf7fe700 1 -- 172.21.15.50:0/136191721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b8009d00 con 0x7f34c0068b30 2023-10-26T06:35:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34bffff700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 0x7f34c0198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:51.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.908+0000 7f34c4f53700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 0x7f34c019d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:35:51.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.909+0000 7f34bf7fe700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c0199490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34b400e9a0 tx=0x7f34b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:51.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.909+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4009790 con 0x7f34c0068b30 2023-10-26T06:35:51.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.909+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34b400cbd0 con 0x7f34c0068b30 2023-10-26T06:35:51.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.909+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c019e460 con 0x7f34c0068b30 2023-10-26T06:35:51.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.909+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4018680 con 0x7f34c0068b30 2023-10-26T06:35:51.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.909+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c01a5cc0 con 0x7f34c0068b30 2023-10-26T06:35:51.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.910+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c00fed60 con 0x7f34c0068b30 2023-10-26T06:35:51.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.912+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f34b400cd40 con 0x7f34c0068b30 2023-10-26T06:35:51.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.916+0000 7f34bd7fa700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34a80a14c0 0x7f34a80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:51.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.916+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f34b4014070 con 0x7f34c0068b30 2023-10-26T06:35:51.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.916+0000 7f34bffff700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34a80a14c0 0x7f34a80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:51.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.917+0000 7f34bffff700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34a80a14c0 0x7f34a80a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009fd0 tx=0x7f34b0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:51.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.918+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f34b4052100 con 0x7f34c0068b30 2023-10-26T06:35:52.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 -- 172.21.15.50:0/2572818657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b010d220 msgr2=0x7f22b010f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 --2- 172.21.15.50:0/2572818657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b010d220 0x7f22b010f610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22a800b0a0 tx=0x7f22a800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 -- 172.21.15.50:0/2572818657 shutdown_connections 2023-10-26T06:35:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 --2- 172.21.15.50:0/2572818657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b010d220 0x7f22b010f610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 --2- 172.21.15.50:0/2572818657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b0072a20 0x7f22b0072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 --2- 172.21.15.50:0/2572818657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22b0073340 0x7f22b010cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 -- 172.21.15.50:0/2572818657 >> 172.21.15.50:0/2572818657 conn(0x7f22b00779a0 msgr2=0x7f22b0077db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:52.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 -- 172.21.15.50:0/2572818657 shutdown_connections 2023-10-26T06:35:52.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.866+0000 7f22b7235700 1 -- 172.21.15.50:0/2572818657 wait complete. 2023-10-26T06:35:52.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.867+0000 7f22b7235700 1 Processor -- start 2023-10-26T06:35:52.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.867+0000 7f22b7235700 1 -- start start 2023-10-26T06:35:52.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b7235700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b0072a20 0x7f22b0198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b7235700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 0x7f22b01993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b7235700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22b010d220 0x7f22b019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b7235700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b019dd70 con 0x7f22b0073340 2023-10-26T06:35:52.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b7235700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b019dee0 con 0x7f22b010d220 2023-10-26T06:35:52.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b7235700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b019e0a0 con 0x7f22b0072a20 2023-10-26T06:35:52.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22affff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 0x7f22b01993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22affff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 0x7f22b01993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47256/0 (socket says 172.21.15.50:47256) 2023-10-26T06:35:52.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22affff700 1 -- 172.21.15.50:0/4161389203 learned_addr learned my addr 172.21.15.50:0/4161389203 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:52.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b4fd1700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b0072a20 0x7f22b0198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.868+0000 7f22b57d2700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22b010d220 0x7f22b019d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22affff700 1 -- 172.21.15.50:0/4161389203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b0072a20 msgr2=0x7f22b0198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22affff700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b0072a20 0x7f22b0198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22affff700 1 -- 172.21.15.50:0/4161389203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22b010d220 msgr2=0x7f22b019d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22affff700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22b010d220 0x7f22b019d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22affff700 1 -- 172.21.15.50:0/4161389203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009d00 con 0x7f22b0073340 2023-10-26T06:35:52.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22affff700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 0x7f22b01993b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9a0 tx=0x7f229c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:52.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c009790 con 0x7f22b0073340 2023-10-26T06:35:52.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f229c010430 con 0x7f22b0073340 2023-10-26T06:35:52.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b019e380 con 0x7f22b0073340 2023-10-26T06:35:52.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c018680 con 0x7f22b0073340 2023-10-26T06:35:52.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.869+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b01a5be0 con 0x7f22b0073340 2023-10-26T06:35:52.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.870+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0108430 con 0x7f22b0073340 2023-10-26T06:35:52.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.873+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f229c0105a0 con 0x7f22b0073340 2023-10-26T06:35:52.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.874+0000 7f22adffb700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22a00a1440 0x7f22a00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.874+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f229c014070 con 0x7f22b0073340 2023-10-26T06:35:52.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.874+0000 7f22b4fd1700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22a00a1440 0x7f22a00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.875+0000 7f22b4fd1700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22a00a1440 0x7f22a00a3900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009c60 tx=0x7f22a4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:52.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:51.878+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f229c052100 con 0x7f22b0073340 2023-10-26T06:35:52.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.102+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f22b019a180 con 0x7f22b0073340 2023-10-26T06:35:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.106+0000 7f22adffb700 1 -- 172.21.15.50:0/4161389203 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f229c096530 con 0x7f22b0073340 2023-10-26T06:35:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22a00a1440 msgr2=0x7f22a00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22a00a1440 0x7f22a00a3900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009c60 tx=0x7f22a4009260 comp rx=0 tx=0).stop 2023-10-26T06:35:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 msgr2=0x7f22b01993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 0x7f22b01993b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9a0 tx=0x7f229c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 shutdown_connections 2023-10-26T06:35:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22a00a1440 0x7f22a00a3900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22b010d220 0x7f22b019d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b0072a20 0x7f22b0198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 --2- 172.21.15.50:0/4161389203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22b0073340 0x7f22b01993b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.110+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 >> 172.21.15.50:0/4161389203 conn(0x7f22b00779a0 msgr2=0x7f22b00fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.111+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 shutdown_connections 2023-10-26T06:35:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.111+0000 7f22b7235700 1 -- 172.21.15.50:0/4161389203 wait complete. 2023-10-26T06:35:52.134 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:51 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/612524563' entity='client.admin' 2023-10-26T06:35:52.134 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:51 smithi050 ceph-mon[94997]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.136+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f34c004e4f0 con 0x7f34c0068b30 2023-10-26T06:35:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.140+0000 7f34bd7fa700 1 -- 172.21.15.50:0/136191721 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) v1 ==== 106+0+0 (secure 0 0 0) 0x7f34b4096580 con 0x7f34c0068b30 2023-10-26T06:35:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34a80a14c0 msgr2=0x7f34a80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34a80a14c0 0x7f34a80a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009fd0 tx=0x7f34b0009260 comp rx=0 tx=0).stop 2023-10-26T06:35:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 msgr2=0x7f34c0199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c0199490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34b400e9a0 tx=0x7f34b400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 shutdown_connections 2023-10-26T06:35:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34a80a14c0 0x7f34a80a3980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34c01067a0 0x7f34c019d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34c0068190 0x7f34c0198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 --2- 172.21.15.50:0/136191721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c0068b30 0x7f34c0199490 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 >> 172.21.15.50:0/136191721 conn(0x7f34c0075790 msgr2=0x7f34c010bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 shutdown_connections 2023-10-26T06:35:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.143+0000 7f34c69b6700 1 -- 172.21.15.50:0/136191721 wait complete. 2023-10-26T06:35:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:51 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/612524563' entity='client.admin' 2023-10-26T06:35:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:51 smithi125 ceph-mon[130643]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:52.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:51 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/612524563' entity='client.admin' 2023-10-26T06:35:52.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:51 smithi153 ceph-mon[131657]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:52.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1915836410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 msgr2=0x7f0b000685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1915836410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 0x7f0b000685f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0af40098f0 tx=0x7f0af4009c00 comp rx=0 tx=0).stop 2023-10-26T06:35:52.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1915836410 shutdown_connections 2023-10-26T06:35:52.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1915836410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b00068b30 0x7f0b0010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1915836410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b001067a0 0x7f0b00106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1915836410 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 0x7f0b000685f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1915836410 >> 172.21.15.50:0/1915836410 conn(0x7f0b00075790 msgr2=0x7f0b00075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:52.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1915836410 shutdown_connections 2023-10-26T06:35:52.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.247+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1915836410 wait complete. 2023-10-26T06:35:52.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.248+0000 7f0b04bdf700 1 Processor -- start 2023-10-26T06:35:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.249+0000 7f0b04bdf700 1 -- start start 2023-10-26T06:35:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0b04bdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 0x7f0b000ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0b04bdf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00068b30 0x7f0b000ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0b04bdf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 0x7f0b001002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0b04bdf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001a50f0 con 0x7f0b00068b30 2023-10-26T06:35:52.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0b04bdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001a5260 con 0x7f0b00068190 2023-10-26T06:35:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0b04bdf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001a5420 con 0x7f0b001067a0 2023-10-26T06:35:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0afed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 0x7f0b001002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0afdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00068b30 0x7f0b000ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0afed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 0x7f0b001002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:48698/0 (socket says 172.21.15.50:48698) 2023-10-26T06:35:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.250+0000 7f0afed9d700 1 -- 172.21.15.50:0/1206431674 learned_addr learned my addr 172.21.15.50:0/1206431674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:52.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afed9d700 1 -- 172.21.15.50:0/1206431674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 msgr2=0x7f0b000ff820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-26T06:35:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afed9d700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 0x7f0b000ff820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afed9d700 1 -- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00068b30 msgr2=0x7f0b000ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afed9d700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00068b30 0x7f0b000ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afed9d700 1 -- 172.21.15.50:0/1206431674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00095f0 con 0x7f0b001067a0 2023-10-26T06:35:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afdd9b700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00068b30 0x7f0b000ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0afed9d700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 0x7f0b001002a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0af800ef30 tx=0x7f0af800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:52.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8018070 con 0x7f0b001067a0 2023-10-26T06:35:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af4009520 con 0x7f0b001067a0 2023-10-26T06:35:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0af800f040 con 0x7f0b001067a0 2023-10-26T06:35:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800cdb0 con 0x7f0b001067a0 2023-10-26T06:35:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.251+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b001a59e0 con 0x7f0b001067a0 2023-10-26T06:35:52.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.253+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00108d50 con 0x7f0b001067a0 2023-10-26T06:35:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.255+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f0af8003a00 con 0x7f0b001067a0 2023-10-26T06:35:52.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.256+0000 7f0aef7fe700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ae80a14c0 0x7f0ae80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.256+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0af80cad30 con 0x7f0b001067a0 2023-10-26T06:35:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.256+0000 7f0afe59c700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ae80a14c0 0x7f0ae80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:52.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.257+0000 7f0afe59c700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ae80a14c0 0x7f0ae80a3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005fd0 tx=0x7f0af0009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:52.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.260+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0af8095f80 con 0x7f0b001067a0 2023-10-26T06:35:52.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.480+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f0b00100d00 con 0x7f0b001067a0 2023-10-26T06:35:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.486+0000 7f0aef7fe700 1 -- 172.21.15.50:0/1206431674 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f0af80995a0 con 0x7f0b001067a0 2023-10-26T06:35:52.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ae80a14c0 msgr2=0x7f0ae80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ae80a14c0 0x7f0ae80a3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005fd0 tx=0x7f0af0009310 comp rx=0 tx=0).stop 2023-10-26T06:35:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 msgr2=0x7f0b001002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 0x7f0b001002a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0af800ef30 tx=0x7f0af800c3a0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 shutdown_connections 2023-10-26T06:35:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ae80a14c0 0x7f0ae80a3980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b001067a0 0x7f0b001002a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0b00068190 0x7f0b000ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 --2- 172.21.15.50:0/1206431674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00068b30 0x7f0b000ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 >> 172.21.15.50:0/1206431674 conn(0x7f0b00075790 msgr2=0x7f0b000fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.488+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 shutdown_connections 2023-10-26T06:35:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.489+0000 7f0b04bdf700 1 -- 172.21.15.50:0/1206431674 wait complete. 2023-10-26T06:35:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 -- 172.21.15.50:0/4177669445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 msgr2=0x7f3224100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 --2- 172.21.15.50:0/4177669445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224100d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3210009990 tx=0x7f3210009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 -- 172.21.15.50:0/4177669445 shutdown_connections 2023-10-26T06:35:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 --2- 172.21.15.50:0/4177669445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 0x7f322410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 --2- 172.21.15.50:0/4177669445 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32241057c0 0x7f3224105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 --2- 172.21.15.50:0/4177669445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224100d20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 -- 172.21.15.50:0/4177669445 >> 172.21.15.50:0/4177669445 conn(0x7f32240779e0 msgr2=0x7f3224077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:53.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 -- 172.21.15.50:0/4177669445 shutdown_connections 2023-10-26T06:35:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.925+0000 7f322ae92700 1 -- 172.21.15.50:0/4177669445 wait complete. 2023-10-26T06:35:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.926+0000 7f322ae92700 1 Processor -- start 2023-10-26T06:35:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 -- start start 2023-10-26T06:35:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 0x7f3224199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:53.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32241057c0 0x7f322419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322419dd30 con 0x7f32241008a0 2023-10-26T06:35:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322419dea0 con 0x7f32241057c0 2023-10-26T06:35:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322ae92700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322419e060 con 0x7f3224101260 2023-10-26T06:35:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f3228c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:53.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f3228c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47304/0 (socket says 172.21.15.50:47304) 2023-10-26T06:35:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f3228c2e700 1 -- 172.21.15.50:0/2032178336 learned_addr learned my addr 172.21.15.50:0/2032178336 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f322942f700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32241057c0 0x7f322419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.927+0000 7f3223fff700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 0x7f3224199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3228c2e700 1 -- 172.21.15.50:0/2032178336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 msgr2=0x7f3224199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3228c2e700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 0x7f3224199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3228c2e700 1 -- 172.21.15.50:0/2032178336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32241057c0 msgr2=0x7f322419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3228c2e700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32241057c0 0x7f322419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3228c2e700 1 -- 172.21.15.50:0/2032178336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100095f0 con 0x7f32241008a0 2023-10-26T06:35:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3223fff700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 0x7f3224199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:35:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3228c2e700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224198e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f321800d980 tx=0x7f321800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218004020 con 0x7f32241008a0 2023-10-26T06:35:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3218009730 con 0x7f32241008a0 2023-10-26T06:35:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322419e340 con 0x7f32241008a0 2023-10-26T06:35:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218003a80 con 0x7f32241008a0 2023-10-26T06:35:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.928+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32241a5ba0 con 0x7f32241008a0 2023-10-26T06:35:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.929+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3224101f30 con 0x7f32241008a0 2023-10-26T06:35:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.931+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f32180098a0 con 0x7f32241008a0 2023-10-26T06:35:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.932+0000 7f3221ffb700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32140a14c0 0x7f32140a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:53.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.933+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f32180cadb0 con 0x7f32241008a0 2023-10-26T06:35:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.933+0000 7f3223fff700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32140a14c0 0x7f32140a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.933+0000 7f3223fff700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32140a14c0 0x7f32140a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3210006010 tx=0x7f321001a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:52.937+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3218095f70 con 0x7f32241008a0 2023-10-26T06:35:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.157+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f322404e4c0 con 0x7f32241008a0 2023-10-26T06:35:53.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.161+0000 7f3221ffb700 1 -- 172.21.15.50:0/2032178336 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v26)=0 v26) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3218099590 con 0x7f32241008a0 2023-10-26T06:35:53.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32140a14c0 msgr2=0x7f32140a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:53.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32140a14c0 0x7f32140a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3210006010 tx=0x7f321001a040 comp rx=0 tx=0).stop 2023-10-26T06:35:53.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 msgr2=0x7f3224198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224198e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f321800d980 tx=0x7f321800dc90 comp rx=0 tx=0).stop 2023-10-26T06:35:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 shutdown_connections 2023-10-26T06:35:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32140a14c0 0x7f32140a3980 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32241057c0 0x7f322419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32241008a0 0x7f3224198e30 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f321800d980 tx=0x7f321800dc90 comp rx=0 tx=0).stop 2023-10-26T06:35:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 --2- 172.21.15.50:0/2032178336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3224101260 0x7f3224199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.164+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 >> 172.21.15.50:0/2032178336 conn(0x7f32240779e0 msgr2=0x7f322410ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.165+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 shutdown_connections 2023-10-26T06:35:53.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:53.165+0000 7f322ae92700 1 -- 172.21.15.50:0/2032178336 wait complete. 2023-10-26T06:35:53.408 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:53 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4161389203' entity='client.admin' 2023-10-26T06:35:53.408 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:53 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/136191721' entity='client.admin' 2023-10-26T06:35:53.408 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:53 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:53.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:53 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4161389203' entity='client.admin' 2023-10-26T06:35:53.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:53 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/136191721' entity='client.admin' 2023-10-26T06:35:53.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:53 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:53 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4161389203' entity='client.admin' 2023-10-26T06:35:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:53 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/136191721' entity='client.admin' 2023-10-26T06:35:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:53 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:54.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2032178336' entity='client.admin' 2023-10-26T06:35:54.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:54.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:54.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:54.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: Reconfiguring mon.c (monmap changed)... 2023-10-26T06:35:54.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:54.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:54.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:54.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:54 smithi050 ceph-mon[94997]: Reconfiguring daemon mon.c on smithi153 2023-10-26T06:35:54.221 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi050') 2023-10-26T06:35:54.221 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi050') 2023-10-26T06:35:54.222 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi050') 2023-10-26T06:35:54.222 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi050') 2023-10-26T06:35:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2032178336' entity='client.admin' 2023-10-26T06:35:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:54.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:54.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:54.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: Reconfiguring mon.c (monmap changed)... 2023-10-26T06:35:54.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:54.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:54.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:54.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:54 smithi125 ceph-mon[130643]: Reconfiguring daemon mon.c on smithi153 2023-10-26T06:35:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2032178336' entity='client.admin' 2023-10-26T06:35:54.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:54.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:54.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:54.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: Reconfiguring mon.c (monmap changed)... 2023-10-26T06:35:54.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-26T06:35:54.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-26T06:35:54.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:54.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:54 smithi153 ceph-mon[131657]: Reconfiguring daemon mon.c on smithi153 2023-10-26T06:35:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 -- 172.21.15.50:0/2330626284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688410d300 msgr2=0x7f688410f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 --2- 172.21.15.50:0/2330626284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688410d300 0x7f688410f6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f687c009f90 tx=0x7f687c00b330 comp rx=0 tx=0).stop 2023-10-26T06:35:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 -- 172.21.15.50:0/2330626284 shutdown_connections 2023-10-26T06:35:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 --2- 172.21.15.50:0/2330626284 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688410d300 0x7f688410f6f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 --2- 172.21.15.50:0/2330626284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6884068190 0x7f6884068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 --2- 172.21.15.50:0/2330626284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 -- 172.21.15.50:0/2330626284 >> 172.21.15.50:0/2330626284 conn(0x7f6884075790 msgr2=0x7f6884075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 -- 172.21.15.50:0/2330626284 shutdown_connections 2023-10-26T06:35:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.010+0000 7f688b56d700 1 -- 172.21.15.50:0/2330626284 wait complete. 2023-10-26T06:35:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.011+0000 7f688b56d700 1 Processor -- start 2023-10-26T06:35:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 -- start start 2023-10-26T06:35:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6884068190 0x7f6884071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688406b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688410d300 0x7f688406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688406bae0 con 0x7f688410d300 2023-10-26T06:35:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688406bc50 con 0x7f6884068ab0 2023-10-26T06:35:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f688b56d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688406be10 con 0x7f6884068190 2023-10-26T06:35:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f6889309700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6884068190 0x7f6884071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f6888b08700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688406b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f6888b08700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688406b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:33704/0 (socket says 172.21.15.50:33704) 2023-10-26T06:35:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f6888b08700 1 -- 172.21.15.50:0/3612024100 learned_addr learned my addr 172.21.15.50:0/3612024100 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.013+0000 7f6889b0a700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688410d300 0x7f688406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.012+0000 7f6889309700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6884068190 0x7f6884071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37936/0 (socket says 172.21.15.50:37936) 2023-10-26T06:35:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.013+0000 7f6888b08700 1 -- 172.21.15.50:0/3612024100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6884068190 msgr2=0x7f6884071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.013+0000 7f6888b08700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6884068190 0x7f6884071f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.013+0000 7f6888b08700 1 -- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688410d300 msgr2=0x7f688406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f6888b08700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688410d300 0x7f688406b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f6888b08700 1 -- 172.21.15.50:0/3612024100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c009c40 con 0x7f6884068ab0 2023-10-26T06:35:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f6889b0a700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688410d300 0x7f688406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:35:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f6888b08700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688406b060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f687400e9a0 tx=0x7f687400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874009790 con 0x7f6884068ab0 2023-10-26T06:35:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f687400cbd0 con 0x7f6884068ab0 2023-10-26T06:35:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.014+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874018680 con 0x7f6884068ab0 2023-10-26T06:35:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.015+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688406fb80 con 0x7f6884068ab0 2023-10-26T06:35:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.015+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6884070000 con 0x7f6884068ab0 2023-10-26T06:35:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.016+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68840ffd30 con 0x7f6884068ab0 2023-10-26T06:35:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.020+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f687400cd40 con 0x7f6884068ab0 2023-10-26T06:35:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.022+0000 7f687a7fc700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68700a1440 0x7f68700a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.022+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6874014070 con 0x7f6884068ab0 2023-10-26T06:35:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.022+0000 7f6889309700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68700a1440 0x7f68700a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.024+0000 7f6889309700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68700a1440 0x7f68700a3900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6880005fd0 tx=0x7f6880009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.026+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6874096950 con 0x7f6884068ab0 2023-10-26T06:35:55.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 -- 172.21.15.50:0/2728954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8074770 msgr2=0x7f27b8072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2728954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8074770 0x7f27b8072a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27b40098f0 tx=0x7f27b4009c00 comp rx=0 tx=0).stop 2023-10-26T06:35:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 -- 172.21.15.50:0/2728954426 shutdown_connections 2023-10-26T06:35:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2728954426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8111570 0x7f27b81139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2728954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8074770 0x7f27b8072a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2728954426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8072f60 0x7f27b80733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 -- 172.21.15.50:0/2728954426 >> 172.21.15.50:0/2728954426 conn(0x7f27b80779e0 msgr2=0x7f27b8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:55.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 -- 172.21.15.50:0/2728954426 shutdown_connections 2023-10-26T06:35:55.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.124+0000 7f27bfccb700 1 -- 172.21.15.50:0/2728954426 wait complete. 2023-10-26T06:35:55.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.125+0000 7f27bfccb700 1 Processor -- start 2023-10-26T06:35:55.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.125+0000 7f27bfccb700 1 -- start start 2023-10-26T06:35:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bfccb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8072f60 0x7f27b819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bfccb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8074770 0x7f27b819d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bfccb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8111570 0x7f27b81a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bfccb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81a22b0 con 0x7f27b8111570 2023-10-26T06:35:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bfccb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81a2420 con 0x7f27b8074770 2023-10-26T06:35:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bfccb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81a25e0 con 0x7f27b8072f60 2023-10-26T06:35:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bd266700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8074770 0x7f27b819d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27be268700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8111570 0x7f27b81a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bda67700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8072f60 0x7f27b819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bd266700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8074770 0x7f27b819d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:33718/0 (socket says 172.21.15.50:33718) 2023-10-26T06:35:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27be268700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8111570 0x7f27b81a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36400/0 (socket says 172.21.15.50:36400) 2023-10-26T06:35:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bd266700 1 -- 172.21.15.50:0/2795152007 learned_addr learned my addr 172.21.15.50:0/2795152007 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bda67700 1 -- 172.21.15.50:0/2795152007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8074770 msgr2=0x7f27b819d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bda67700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8074770 0x7f27b819d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bda67700 1 -- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8111570 msgr2=0x7f27b81a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bda67700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8111570 0x7f27b81a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.126+0000 7f27bda67700 1 -- 172.21.15.50:0/2795152007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009520 con 0x7f27b8072f60 2023-10-26T06:35:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.127+0000 7f27bda67700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8072f60 0x7f27b819d3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009fd0 tx=0x7f27b400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.127+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b401c070 con 0x7f27b8072f60 2023-10-26T06:35:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.127+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27b400baa0 con 0x7f27b8072f60 2023-10-26T06:35:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.127+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40038e0 con 0x7f27b8072f60 2023-10-26T06:35:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.127+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b81a2860 con 0x7f27b8072f60 2023-10-26T06:35:55.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.127+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b81a9f50 con 0x7f27b8072f60 2023-10-26T06:35:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.129+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b80740b0 con 0x7f27b8072f60 2023-10-26T06:35:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.132+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f27b4020030 con 0x7f27b8072f60 2023-10-26T06:35:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.133+0000 7f27aeffd700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f27a40a14c0 0x7f27a40a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.133+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f27b40cbe50 con 0x7f27b8072f60 2023-10-26T06:35:55.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.133+0000 7f27bd266700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f27a40a14c0 0x7f27a40a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:55.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.134+0000 7f27bd266700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f27a40a14c0 0x7f27a40a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27b819e910 tx=0x7f27a8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:55.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.137+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f27b40cf030 con 0x7f27b8072f60 2023-10-26T06:35:55.198 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:35:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.266+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f688406c540 con 0x7f6884068ab0 2023-10-26T06:35:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.274+0000 7f687a7fc700 1 -- 172.21.15.50:0/3612024100 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6874099f70 con 0x7f6884068ab0 2023-10-26T06:35:55.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68700a1440 msgr2=0x7f68700a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68700a1440 0x7f68700a3900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6880005fd0 tx=0x7f6880009310 comp rx=0 tx=0).stop 2023-10-26T06:35:55.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 msgr2=0x7f688406b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688406b060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f687400e9a0 tx=0x7f687400ed60 comp rx=0 tx=0).stop 2023-10-26T06:35:55.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 shutdown_connections 2023-10-26T06:35:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68700a1440 0x7f68700a3900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f688410d300 0x7f688406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6884068190 0x7f6884071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 --2- 172.21.15.50:0/3612024100 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6884068ab0 0x7f688406b060 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 >> 172.21.15.50:0/3612024100 conn(0x7f6884075790 msgr2=0x7f688410e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:55.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 shutdown_connections 2023-10-26T06:35:55.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.276+0000 7f688b56d700 1 -- 172.21.15.50:0/3612024100 wait complete. 2023-10-26T06:35:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.373+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f27b8116e80 con 0x7f27b8072f60 2023-10-26T06:35:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.379+0000 7f27aeffd700 1 -- 172.21.15.50:0/2795152007 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) v1 ==== 121+0+0 (secure 0 0 0) 0x7f27b40970a0 con 0x7f27b8072f60 2023-10-26T06:35:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f27a40a14c0 msgr2=0x7f27a40a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f27a40a14c0 0x7f27a40a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27b819e910 tx=0x7f27a8009310 comp rx=0 tx=0).stop 2023-10-26T06:35:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8072f60 msgr2=0x7f27b819d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8072f60 0x7f27b819d3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009fd0 tx=0x7f27b400fa00 comp rx=0 tx=0).stop 2023-10-26T06:35:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 shutdown_connections 2023-10-26T06:35:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f27a40a14c0 0x7f27a40a3980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27b8111570 0x7f27b81a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27b8072f60 0x7f27b819d3b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 --2- 172.21.15.50:0/2795152007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27b8074770 0x7f27b819d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 >> 172.21.15.50:0/2795152007 conn(0x7f27b80779e0 msgr2=0x7f27b8110240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 shutdown_connections 2023-10-26T06:35:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:55.382+0000 7f27bfccb700 1 -- 172.21.15.50:0/2795152007 wait complete. 2023-10-26T06:35:56.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:56.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:56.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:56.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:56.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:56.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:55 smithi125 ceph-mon[130643]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:56.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:56.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:55 smithi153 ceph-mon[131657]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:35:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:35:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:35:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:35:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:56.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:55 smithi050 ceph-mon[94997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 -- 172.21.15.50:0/1751635139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c068b30 msgr2=0x7fbb5c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 --2- 172.21.15.50:0/1751635139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c068b30 0x7fbb5c10d690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009f90 tx=0x7fbb5400b330 comp rx=0 tx=0).stop 2023-10-26T06:35:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 -- 172.21.15.50:0/1751635139 shutdown_connections 2023-10-26T06:35:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 --2- 172.21.15.50:0/1751635139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c068b30 0x7fbb5c10d690 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 --2- 172.21.15.50:0/1751635139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb5c1067c0 0x7fbb5c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 --2- 172.21.15.50:0/1751635139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068190 0x7fbb5c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 -- 172.21.15.50:0/1751635139 >> 172.21.15.50:0/1751635139 conn(0x7fbb5c075790 msgr2=0x7fbb5c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 -- 172.21.15.50:0/1751635139 shutdown_connections 2023-10-26T06:35:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.654+0000 7fbb61896700 1 -- 172.21.15.50:0/1751635139 wait complete. 2023-10-26T06:35:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.655+0000 7fbb61896700 1 Processor -- start 2023-10-26T06:35:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.655+0000 7fbb61896700 1 -- start start 2023-10-26T06:35:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb61896700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb5c068190 0x7fbb5c107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb61896700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 0x7fbb5c107c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb61896700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c1067c0 0x7fbb5c108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb61896700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c1a95a0 con 0x7fbb5c068190 2023-10-26T06:35:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb61896700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c198cb0 con 0x7fbb5c068b30 2023-10-26T06:35:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb61896700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c198e70 con 0x7fbb5c1067c0 2023-10-26T06:35:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.656+0000 7fbb5a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 0x7fbb5c107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 0x7fbb5c107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:33730/0 (socket says 172.21.15.50:33730) 2023-10-26T06:35:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb5c068190 0x7fbb5c107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 -- 172.21.15.50:0/511438221 learned_addr learned my addr 172.21.15.50:0/511438221 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5b7fe700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c1067c0 0x7fbb5c108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 -- 172.21.15.50:0/511438221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c1067c0 msgr2=0x7fbb5c108190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c1067c0 0x7fbb5c108190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 -- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb5c068190 msgr2=0x7fbb5c107710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb5c068190 0x7fbb5c107710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.657+0000 7fbb5a7fc700 1 -- 172.21.15.50:0/511438221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54009c40 con 0x7fbb5c068b30 2023-10-26T06:35:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.658+0000 7fbb5a7fc700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 0x7fbb5c107c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000e9c0 tx=0x7fbb5000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.658+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50004a30 con 0x7fbb5c068b30 2023-10-26T06:35:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.658+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb5000cc80 con 0x7fbb5c068b30 2023-10-26T06:35:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.658+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500054e0 con 0x7fbb5c068b30 2023-10-26T06:35:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.658+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c199150 con 0x7fbb5c068b30 2023-10-26T06:35:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.658+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c199600 con 0x7fbb5c068b30 2023-10-26T06:35:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.659+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c0fed60 con 0x7fbb5c068b30 2023-10-26T06:35:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.661+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fbb50004b90 con 0x7fbb5c068b30 2023-10-26T06:35:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.663+0000 7fbb60894700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbb440a14c0 0x7fbb440a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.663+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbb50014070 con 0x7fbb5c068b30 2023-10-26T06:35:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.663+0000 7fbb5affd700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbb440a14c0 0x7fbb440a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.664+0000 7fbb5affd700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbb440a14c0 0x7fbb440a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009be0 tx=0x7fbb4c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.667+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb50096420 con 0x7fbb5c068b30 2023-10-26T06:35:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2216647740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc068b30 msgr2=0x7f7ccc10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2216647740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc068b30 0x7f7ccc10d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400b0a0 tx=0x7f7cc400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2216647740 shutdown_connections 2023-10-26T06:35:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2216647740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc068b30 0x7f7ccc10d670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2216647740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ccc1067a0 0x7f7ccc106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2216647740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.826+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2216647740 >> 172.21.15.50:0/2216647740 conn(0x7f7ccc075790 msgr2=0x7f7ccc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:56.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.827+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2216647740 shutdown_connections 2023-10-26T06:35:56.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.827+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2216647740 wait complete. 2023-10-26T06:35:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.828+0000 7f7cd0ab6700 1 Processor -- start 2023-10-26T06:35:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.829+0000 7f7cd0ab6700 1 -- start start 2023-10-26T06:35:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.829+0000 7f7cd0ab6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc10b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.829+0000 7f7cd0ab6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ccc068b30 0x7f7ccc10bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.829+0000 7f7cd0ab6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc1067a0 0x7f7ccc19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.829+0000 7f7cd0ab6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc19dbc0 con 0x7f7ccc068190 2023-10-26T06:35:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.830+0000 7f7cd0ab6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc19dd30 con 0x7f7ccc068b30 2023-10-26T06:35:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.830+0000 7f7cd0ab6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc19def0 con 0x7f7ccc1067a0 2023-10-26T06:35:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.830+0000 7f7cca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc10b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.830+0000 7f7cca59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc10b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36442/0 (socket says 172.21.15.50:36442) 2023-10-26T06:35:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.830+0000 7f7cca59c700 1 -- 172.21.15.50:0/2570790766 learned_addr learned my addr 172.21.15.50:0/2570790766 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.831+0000 7f7cca59c700 1 -- 172.21.15.50:0/2570790766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc1067a0 msgr2=0x7f7ccc19d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-26T06:35:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.831+0000 7f7cca59c700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc1067a0 0x7f7ccc19d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.831+0000 7f7cca59c700 1 -- 172.21.15.50:0/2570790766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ccc068b30 msgr2=0x7f7ccc10bb10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-26T06:35:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.831+0000 7f7cca59c700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ccc068b30 0x7f7ccc10bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.831+0000 7f7cca59c700 1 -- 172.21.15.50:0/2570790766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009d00 con 0x7f7ccc068190 2023-10-26T06:35:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.832+0000 7f7cca59c700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc10b5d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00d950 tx=0x7f7cbc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.836+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc009b40 con 0x7f7ccc068190 2023-10-26T06:35:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.837+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc19e1d0 con 0x7f7ccc068190 2023-10-26T06:35:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.837+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc19a6c0 con 0x7f7ccc068190 2023-10-26T06:35:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.838+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cbc009ca0 con 0x7f7ccc068190 2023-10-26T06:35:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.838+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc009b40 con 0x7f7ccc068190 2023-10-26T06:35:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.839+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac0052f0 con 0x7f7ccc068190 2023-10-26T06:35:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.844+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f7cbc010460 con 0x7f7ccc068190 2023-10-26T06:35:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.845+0000 7f7cbb7fe700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7cb40a1530 0x7f7cb40a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.845+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7cbc0cade0 con 0x7f7ccc068190 2023-10-26T06:35:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.846+0000 7f7cc9d9b700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7cb40a1530 0x7f7cb40a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.846+0000 7f7cc9d9b700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7cb40a1530 0x7f7cb40a39f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc195fe0 tx=0x7f7cc0005c90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:56.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.853+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7cbc096040 con 0x7f7ccc068190 2023-10-26T06:35:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.963+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fbb5c108bf0 con 0x7fbb5c068b30 2023-10-26T06:35:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.971+0000 7fbb60894700 1 -- 172.21.15.50:0/511438221 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v29)=0 v29) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbb50099a40 con 0x7fbb5c068b30 2023-10-26T06:35:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbb440a14c0 msgr2=0x7fbb440a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbb440a14c0 0x7fbb440a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009be0 tx=0x7fbb4c009260 comp rx=0 tx=0).stop 2023-10-26T06:35:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 msgr2=0x7fbb5c107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 0x7fbb5c107c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000e9c0 tx=0x7fbb5000ecd0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 shutdown_connections 2023-10-26T06:35:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbb440a14c0 0x7fbb440a3980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb5c1067c0 0x7fbb5c108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb5c068190 0x7fbb5c107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 --2- 172.21.15.50:0/511438221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb5c068b30 0x7fbb5c107c50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 >> 172.21.15.50:0/511438221 conn(0x7fbb5c075790 msgr2=0x7fbb5c10bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 shutdown_connections 2023-10-26T06:35:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:56.973+0000 7fbb61896700 1 -- 172.21.15.50:0/511438221 wait complete. 2023-10-26T06:35:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.098+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f7cac005b20 con 0x7f7ccc068190 2023-10-26T06:35:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.103+0000 7f7cbb7fe700 1 -- 172.21.15.50:0/2570790766 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v30)=0 v30) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7cbc099660 con 0x7f7ccc068190 2023-10-26T06:35:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.105+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7cb40a1530 msgr2=0x7f7cb40a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.105+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7cb40a1530 0x7f7cb40a39f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc195fe0 tx=0x7f7cc0005c90 comp rx=0 tx=0).stop 2023-10-26T06:35:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.105+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 msgr2=0x7f7ccc10b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:57.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.105+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc10b5d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00d950 tx=0x7f7cbc00dd10 comp rx=0 tx=0).stop 2023-10-26T06:35:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 shutdown_connections 2023-10-26T06:35:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7cb40a1530 0x7f7cb40a39f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ccc1067a0 0x7f7ccc19d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:57.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ccc068190 0x7f7ccc10b5d0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00d950 tx=0x7f7cbc00dd10 comp rx=0 tx=0).stop 2023-10-26T06:35:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 --2- 172.21.15.50:0/2570790766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ccc068b30 0x7f7ccc10bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 >> 172.21.15.50:0/2570790766 conn(0x7f7ccc075790 msgr2=0x7f7ccc1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.106+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 shutdown_connections 2023-10-26T06:35:57.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:57.107+0000 7f7cd0ab6700 1 -- 172.21.15.50:0/2570790766 wait complete. 2023-10-26T06:35:58.059 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:57 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:35:58.059 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:57 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2570790766' entity='client.admin' 2023-10-26T06:35:58.060 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:57 smithi050 ceph-mon[94997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:58.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:57 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:35:58.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:57 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2570790766' entity='client.admin' 2023-10-26T06:35:58.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:57 smithi153 ceph-mon[131657]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:58.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:57 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:35:58.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:57 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2570790766' entity='client.admin' 2023-10-26T06:35:58.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:57 smithi125 ceph-mon[130643]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:58.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 -- 172.21.15.50:0/3438826426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 msgr2=0x7fd688068190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/3438826426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 0x7fd688068190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd678009990 tx=0x7fd678009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 -- 172.21.15.50:0/3438826426 shutdown_connections 2023-10-26T06:35:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/3438826426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd688103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/3438826426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 0x7fd688068190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/3438826426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 0x7fd688068b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 -- 172.21.15.50:0/3438826426 >> 172.21.15.50:0/3438826426 conn(0x7fd688075790 msgr2=0x7fd688075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 -- 172.21.15.50:0/3438826426 shutdown_connections 2023-10-26T06:35:58.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.550+0000 7fd68d3e3700 1 -- 172.21.15.50:0/3438826426 wait complete. 2023-10-26T06:35:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.551+0000 7fd68d3e3700 1 Processor -- start 2023-10-26T06:35:58.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.551+0000 7fd68d3e3700 1 -- start start 2023-10-26T06:35:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd68d3e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 0x7fd68819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd68d3e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd68819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd68d3e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 0x7fd6881a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd68d3e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881a2260 con 0x7fd688103250 2023-10-26T06:35:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd68d3e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881a23d0 con 0x7fd6880686d0 2023-10-26T06:35:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd68d3e3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881a2590 con 0x7fd6881056f0 2023-10-26T06:35:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd6867fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd68819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd6867fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd68819d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36468/0 (socket says 172.21.15.50:36468) 2023-10-26T06:35:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd686ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 0x7fd68819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd6867fc700 1 -- 172.21.15.50:0/2842642628 learned_addr learned my addr 172.21.15.50:0/2842642628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.552+0000 7fd6877fe700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 0x7fd6881a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd6867fc700 1 -- 172.21.15.50:0/2842642628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 msgr2=0x7fd6881a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd6867fc700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 0x7fd6881a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd6867fc700 1 -- 172.21.15.50:0/2842642628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 msgr2=0x7fd68819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd6867fc700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 0x7fd68819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd6867fc700 1 -- 172.21.15.50:0/2842642628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780095f0 con 0x7fd688103250 2023-10-26T06:35:58.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd686ffd700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 0x7fd68819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd6867fc700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd68819d8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00b550 tx=0x7fd67c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c011830 con 0x7fd688103250 2023-10-26T06:35:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd67c011e50 con 0x7fd688103250 2023-10-26T06:35:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6881a2870 con 0x7fd688103250 2023-10-26T06:35:58.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c010dc0 con 0x7fd688103250 2023-10-26T06:35:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.553+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6881aa0d0 con 0x7fd688103250 2023-10-26T06:35:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.554+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880ffd30 con 0x7fd688103250 2023-10-26T06:35:58.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.557+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fd67c010380 con 0x7fd688103250 2023-10-26T06:35:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.559+0000 7fd66ffff700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6700a1440 0x7fd6700a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.559+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd67c0cab60 con 0x7fd688103250 2023-10-26T06:35:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.559+0000 7fd686ffd700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6700a1440 0x7fd6700a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.560+0000 7fd686ffd700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6700a1440 0x7fd6700a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd678003800 tx=0x7fd67800b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:58.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.564+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd67c095da0 con 0x7fd688103250 2023-10-26T06:35:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.798+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fd68804e4c0 con 0x7fd688103250 2023-10-26T06:35:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.802+0000 7fd66ffff700 1 -- 172.21.15.50:0/2842642628 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v31)=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd67c0993c0 con 0x7fd688103250 2023-10-26T06:35:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6700a1440 msgr2=0x7fd6700a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6700a1440 0x7fd6700a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd678003800 tx=0x7fd67800b540 comp rx=0 tx=0).stop 2023-10-26T06:35:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 msgr2=0x7fd68819d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd68819d8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00b550 tx=0x7fd67c00b860 comp rx=0 tx=0).stop 2023-10-26T06:35:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 shutdown_connections 2023-10-26T06:35:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6700a1440 0x7fd6700a3900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6881056f0 0x7fd6881a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6880686d0 0x7fd68819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 --2- 172.21.15.50:0/2842642628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd688103250 0x7fd68819d8a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 >> 172.21.15.50:0/2842642628 conn(0x7fd688075790 msgr2=0x7fd6880fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 shutdown_connections 2023-10-26T06:35:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.805+0000 7fd68d3e3700 1 -- 172.21.15.50:0/2842642628 wait complete. 2023-10-26T06:35:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 -- 172.21.15.50:0/3519666281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef8101200 msgr2=0x7f3ef810d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 --2- 172.21.15.50:0/3519666281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef8101200 0x7f3ef810d630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000b0a0 tx=0x7f3ef000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 -- 172.21.15.50:0/3519666281 shutdown_connections 2023-10-26T06:35:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 --2- 172.21.15.50:0/3519666281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef8101200 0x7f3ef810d630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 --2- 172.21.15.50:0/3519666281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef81056a0 0x7f3ef8105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 --2- 172.21.15.50:0/3519666281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8100840 0x7f3ef8100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 -- 172.21.15.50:0/3519666281 >> 172.21.15.50:0/3519666281 conn(0x7f3ef8077950 msgr2=0x7f3ef8077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 -- 172.21.15.50:0/3519666281 shutdown_connections 2023-10-26T06:35:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.844+0000 7f3efca3b700 1 -- 172.21.15.50:0/3519666281 wait complete. 2023-10-26T06:35:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 Processor -- start 2023-10-26T06:35:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 -- start start 2023-10-26T06:35:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 0x7f3ef8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8101200 0x7f3ef81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef81056a0 0x7f3ef819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef819de50 con 0x7f3ef81056a0 2023-10-26T06:35:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef819dfc0 con 0x7f3ef8101200 2023-10-26T06:35:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.845+0000 7f3efca3b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef819e180 con 0x7f3ef8100840 2023-10-26T06:35:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef81056a0 0x7f3ef819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 0x7f3ef8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 0x7f3ef8198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:38032/0 (socket says 172.21.15.50:38032) 2023-10-26T06:35:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef659c700 1 -- 172.21.15.50:0/2639594086 learned_addr learned my addr 172.21.15.50:0/2639594086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef5d9b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8101200 0x7f3ef81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef6d9d700 1 -- 172.21.15.50:0/2639594086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 msgr2=0x7f3ef8198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef6d9d700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 0x7f3ef8198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef6d9d700 1 -- 172.21.15.50:0/2639594086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8101200 msgr2=0x7f3ef81994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef6d9d700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8101200 0x7f3ef81994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef6d9d700 1 -- 172.21.15.50:0/2639594086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0009d00 con 0x7f3ef81056a0 2023-10-26T06:35:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef5d9b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8101200 0x7f3ef81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:35:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.846+0000 7f3ef659c700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 0x7f3ef8198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:35:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.847+0000 7f3ef6d9d700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef81056a0 0x7f3ef819d840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000b070 tx=0x7f3ef0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:58.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.847+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000e040 con 0x7f3ef81056a0 2023-10-26T06:35:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.847+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ef001d470 con 0x7f3ef81056a0 2023-10-26T06:35:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.847+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef819e400 con 0x7f3ef81056a0 2023-10-26T06:35:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.847+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef81a5cc0 con 0x7f3ef81056a0 2023-10-26T06:35:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.847+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0005280 con 0x7f3ef81056a0 2023-10-26T06:35:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.848+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef8101ec0 con 0x7f3ef81056a0 2023-10-26T06:35:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.850+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f3ef001d5e0 con 0x7f3ef81056a0 2023-10-26T06:35:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.851+0000 7f3ee77fe700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ee00a1440 0x7f3ee00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.852+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3ef00cc700 con 0x7f3ef81056a0 2023-10-26T06:35:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.852+0000 7f3ef659c700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ee00a1440 0x7f3ee00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.852+0000 7f3ef659c700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ee00a1440 0x7f3ee00a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8011550 tx=0x7f3ee8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:58.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:58.853+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3ef00979f0 con 0x7f3ef81056a0 2023-10-26T06:35:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.091+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f3ef819a260 con 0x7f3ef81056a0 2023-10-26T06:35:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.095+0000 7f3ee77fe700 1 -- 172.21.15.50:0/2639594086 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) v1 ==== 121+0+0 (secure 0 0 0) 0x7f3ef009b010 con 0x7f3ef81056a0 2023-10-26T06:35:59.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ee00a1440 msgr2=0x7f3ee00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ee00a1440 0x7f3ee00a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8011550 tx=0x7f3ee8009260 comp rx=0 tx=0).stop 2023-10-26T06:35:59.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef81056a0 msgr2=0x7f3ef819d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef81056a0 0x7f3ef819d840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000b070 tx=0x7f3ef0007860 comp rx=0 tx=0).stop 2023-10-26T06:35:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 shutdown_connections 2023-10-26T06:35:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ee00a1440 0x7f3ee00a3900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ef81056a0 0x7f3ef819d840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef8100840 0x7f3ef8198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 --2- 172.21.15.50:0/2639594086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ef8101200 0x7f3ef81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.098+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 >> 172.21.15.50:0/2639594086 conn(0x7f3ef8077950 msgr2=0x7f3ef80fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.099+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 shutdown_connections 2023-10-26T06:35:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.099+0000 7f3efca3b700 1 -- 172.21.15.50:0/2639594086 wait complete. 2023-10-26T06:35:59.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 -- 172.21.15.50:0/4171203298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801057c0 msgr2=0x7f3280105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 --2- 172.21.15.50:0/4171203298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801057c0 0x7f3280105ba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3274009990 tx=0x7f3274009ca0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 -- 172.21.15.50:0/4171203298 shutdown_connections 2023-10-26T06:35:59.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 --2- 172.21.15.50:0/4171203298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f328010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 --2- 172.21.15.50:0/4171203298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801057c0 0x7f3280105ba0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 --2- 172.21.15.50:0/4171203298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32801008a0 0x7f3280100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.408+0000 7f3286c3f700 1 -- 172.21.15.50:0/4171203298 >> 172.21.15.50:0/4171203298 conn(0x7f32800779e0 msgr2=0x7f3280077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.409+0000 7f3286c3f700 1 -- 172.21.15.50:0/4171203298 shutdown_connections 2023-10-26T06:35:59.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.409+0000 7f3286c3f700 1 -- 172.21.15.50:0/4171203298 wait complete. 2023-10-26T06:35:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 Processor -- start 2023-10-26T06:35:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 -- start start 2023-10-26T06:35:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801008a0 0x7f3280072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:59.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f3280073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32801057c0 0x7f3280073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801a4fa0 con 0x7f32801008a0 2023-10-26T06:35:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801a5110 con 0x7f32801057c0 2023-10-26T06:35:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f3286c3f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801a52d0 con 0x7f3280101260 2023-10-26T06:35:59.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f32849db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801008a0 0x7f3280072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f327ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f3280073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f327ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f3280073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:38048/0 (socket says 172.21.15.50:38048) 2023-10-26T06:35:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f32849db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801008a0 0x7f3280072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36484/0 (socket says 172.21.15.50:36484) 2023-10-26T06:35:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.410+0000 7f327ffff700 1 -- 172.21.15.50:0/1271729860 learned_addr learned my addr 172.21.15.50:0/1271729860 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:35:59.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f32851dc700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32801057c0 0x7f3280073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327ffff700 1 -- 172.21.15.50:0/1271729860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32801057c0 msgr2=0x7f3280073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327ffff700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32801057c0 0x7f3280073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327ffff700 1 -- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801008a0 msgr2=0x7f3280072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327ffff700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801008a0 0x7f3280072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327ffff700 1 -- 172.21.15.50:0/1271729860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740095f0 con 0x7f3280101260 2023-10-26T06:35:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327ffff700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f3280073030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f326c00e9a0 tx=0x7f326c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c009790 con 0x7f3280101260 2023-10-26T06:35:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f326c010430 con 0x7f3280101260 2023-10-26T06:35:59.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32801a55b0 con 0x7f3280101260 2023-10-26T06:35:59.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.411+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c018680 con 0x7f3280101260 2023-10-26T06:35:59.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.412+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32801a5ab0 con 0x7f3280101260 2023-10-26T06:35:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.413+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280108d80 con 0x7f3280101260 2023-10-26T06:35:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.414+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f326c0105a0 con 0x7f3280101260 2023-10-26T06:35:59.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.416+0000 7f327dffb700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32700a14c0 0x7f32700a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:35:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.416+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f326c014070 con 0x7f3280101260 2023-10-26T06:35:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.416+0000 7f32849db700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32700a14c0 0x7f32700a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:35:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.417+0000 7f32849db700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32700a14c0 0x7f32700a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3274006010 tx=0x7f3274005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:35:59.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.420+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f326c052100 con 0x7f3280101260 2023-10-26T06:35:59.457 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi050') 2023-10-26T06:35:59.457 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi050') 2023-10-26T06:35:59.458 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi050') 2023-10-26T06:35:59.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.641+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f3280073fd0 con 0x7f3280101260 2023-10-26T06:35:59.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.647+0000 7f327dffb700 1 -- 172.21.15.50:0/1271729860 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) v1 ==== 121+0+0 (secure 0 0 0) 0x7f326c096530 con 0x7f3280101260 2023-10-26T06:35:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32700a14c0 msgr2=0x7f32700a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32700a14c0 0x7f32700a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3274006010 tx=0x7f3274005960 comp rx=0 tx=0).stop 2023-10-26T06:35:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 msgr2=0x7f3280073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:35:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f3280073030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f326c00e9a0 tx=0x7f326c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 shutdown_connections 2023-10-26T06:35:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f32700a14c0 0x7f32700a3980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32801057c0 0x7f3280073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32801008a0 0x7f3280072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 --2- 172.21.15.50:0/1271729860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3280101260 0x7f3280073030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:35:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 >> 172.21.15.50:0/1271729860 conn(0x7f32800779e0 msgr2=0x7f32800fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:35:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 shutdown_connections 2023-10-26T06:35:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:35:59.650+0000 7f3286c3f700 1 -- 172.21.15.50:0/1271729860 wait complete. 2023-10-26T06:35:59.915 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:59 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2842642628' entity='client.admin' 2023-10-26T06:35:59.915 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:59 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2639594086' entity='client.admin' 2023-10-26T06:35:59.916 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:59 smithi050 ceph-mon[94997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:35:59.916 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:35:59 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' 2023-10-26T06:36:00.066 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.067 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.067 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.067 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.069 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:59 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2842642628' entity='client.admin' 2023-10-26T06:36:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:59 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2639594086' entity='client.admin' 2023-10-26T06:36:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:59 smithi125 ceph-mon[130643]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:35:59 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' 2023-10-26T06:36:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:59 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2842642628' entity='client.admin' 2023-10-26T06:36:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:59 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2639594086' entity='client.admin' 2023-10-26T06:36:00.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:59 smithi153 ceph-mon[131657]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:00.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:35:59 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' 2023-10-26T06:36:00.293 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6f658e7e-73c9-11ee-8db9-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi050') 2023-10-26T06:36:00.294 INFO:tasks.cephadm:Deploying OSDs... 2023-10-26T06:36:00.294 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:36:00.295 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-10-26T06:36:00.340 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-26T06:36:00.341 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-10-26T06:36:00.425 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-26T06:36:00.425 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:00.426 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-10-26T06:36:00.426 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:00.426 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:00.426 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-26 06:34:29.083533133 +0000 2023-10-26T06:36:00.426 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-26 06:28:39.314019080 +0000 2023-10-26T06:36:00.427 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-26 06:28:39.314019080 +0000 2023-10-26T06:36:00.427 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-26 06:28:39.290019661 +0000 2023-10-26T06:36:00.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-26T06:36:00.534 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-26T06:36:00.535 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-26T06:36:00.535 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.0001943 s, 2.6 MB/s 2023-10-26T06:36:00.537 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-26T06:36:00.584 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-10-26T06:36:00.668 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-26T06:36:00.669 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:00.669 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-10-26T06:36:00.669 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:00.669 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:00.669 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-26 06:34:29.169531038 +0000 2023-10-26T06:36:00.670 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-26 06:28:40.143998999 +0000 2023-10-26T06:36:00.670 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-26 06:28:40.143998999 +0000 2023-10-26T06:36:00.670 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-26 06:28:40.120999556 +0000 2023-10-26T06:36:00.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-26T06:36:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-26T06:36:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-26T06:36:00.776 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00018458 s, 2.8 MB/s 2023-10-26T06:36:00.778 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-26T06:36:00.824 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-10-26T06:36:00.909 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-26T06:36:00.909 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:00.910 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-10-26T06:36:00.910 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:00.910 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:00.910 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-26 06:34:29.237529382 +0000 2023-10-26T06:36:00.911 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-26 06:28:40.969979015 +0000 2023-10-26T06:36:00.911 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-26 06:28:40.969979015 +0000 2023-10-26T06:36:00.911 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-26 06:28:40.945979596 +0000 2023-10-26T06:36:00.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-26T06:36:01.015 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-26T06:36:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-26T06:36:01.016 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000183975 s, 2.8 MB/s 2023-10-26T06:36:01.018 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-26T06:36:01.064 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-10-26T06:36:01.149 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-26T06:36:01.149 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:01.149 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 468 Links: 1 2023-10-26T06:36:01.149 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:01.150 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:01.150 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-26 06:34:29.303527774 +0000 2023-10-26T06:36:01.150 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-26 06:28:41.828958233 +0000 2023-10-26T06:36:01.150 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-26 06:28:41.828958233 +0000 2023-10-26T06:36:01.150 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-26 06:28:41.805958789 +0000 2023-10-26T06:36:01.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-26T06:36:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-10-26T06:36:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-10-26T06:36:01.257 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000183379 s, 2.8 MB/s 2023-10-26T06:36:01.259 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-26T06:36:01.305 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-26T06:36:01.306 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2023-10-26T06:36:01.330 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-26T06:36:01.330 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2023-10-26T06:36:01.391 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-26T06:36:01.392 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:01.392 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 379935 Links: 1 2023-10-26T06:36:01.392 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:01.392 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:01.392 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-26 06:35:41.834083750 +0000 2023-10-26T06:36:01.393 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-26 06:25:14.943741438 +0000 2023-10-26T06:36:01.393 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-26 06:25:14.943741438 +0000 2023-10-26T06:36:01.393 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-26T06:36:01.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-26T06:36:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-26T06:36:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-26T06:36:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000240511 s, 2.1 MB/s 2023-10-26T06:36:01.465 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-26T06:36:01.525 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2023-10-26T06:36:01.584 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-26T06:36:01.584 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:01.584 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 380050 Links: 1 2023-10-26T06:36:01.585 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:01.585 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:01.585 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-26 06:35:41.834083750 +0000 2023-10-26T06:36:01.585 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-26 06:25:15.484732223 +0000 2023-10-26T06:36:01.585 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-26 06:25:15.484732223 +0000 2023-10-26T06:36:01.586 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-26T06:36:01.586 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-26T06:36:01.652 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-26T06:36:01.652 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-26T06:36:01.652 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000237071 s, 2.2 MB/s 2023-10-26T06:36:01.653 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-26T06:36:01.712 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2023-10-26T06:36:01.770 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-26T06:36:01.770 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:01.770 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 379361 Links: 1 2023-10-26T06:36:01.770 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:01.771 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:01.771 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-26 06:35:41.834083750 +0000 2023-10-26T06:36:01.771 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-26 06:25:16.006723332 +0000 2023-10-26T06:36:01.771 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-26 06:25:16.006723332 +0000 2023-10-26T06:36:01.771 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-26T06:36:01.772 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-26T06:36:01.835 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-26T06:36:01.835 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-26T06:36:01.835 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000245219 s, 2.1 MB/s 2023-10-26T06:36:01.836 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-26T06:36:01.894 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2023-10-26T06:36:01.952 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-26T06:36:01.952 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:01.952 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 379470 Links: 1 2023-10-26T06:36:01.953 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:01.953 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:01.953 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-26 06:35:41.834083750 +0000 2023-10-26T06:36:01.953 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-26 06:25:16.545714151 +0000 2023-10-26T06:36:01.953 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-26 06:25:16.545714151 +0000 2023-10-26T06:36:01.954 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-26T06:36:01.954 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-26T06:36:02.018 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-26T06:36:02.018 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-26T06:36:02.018 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000211161 s, 2.4 MB/s 2023-10-26T06:36:02.019 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-26T06:36:02.077 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-26T06:36:02.078 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2023-10-26T06:36:02.100 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-26T06:36:02.100 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2023-10-26T06:36:02.160 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-26T06:36:02.161 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:02.161 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 378066 Links: 1 2023-10-26T06:36:02.161 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:02.161 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:02.162 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-26 06:35:39.455967553 +0000 2023-10-26T06:36:02.162 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-26 06:25:14.926944393 +0000 2023-10-26T06:36:02.162 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-26 06:25:14.926944393 +0000 2023-10-26T06:36:02.162 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-26T06:36:02.163 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-26T06:36:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-26T06:36:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-26T06:36:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000248383 s, 2.1 MB/s 2023-10-26T06:36:02.235 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-26T06:36:02.295 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2023-10-26T06:36:02.353 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-26T06:36:02.354 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:02.354 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 367546 Links: 1 2023-10-26T06:36:02.354 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:02.354 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:02.355 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-26 06:35:39.455967553 +0000 2023-10-26T06:36:02.355 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-26 06:25:15.449934484 +0000 2023-10-26T06:36:02.355 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-26 06:25:15.449934484 +0000 2023-10-26T06:36:02.355 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-26T06:36:02.356 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-26T06:36:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-26T06:36:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-26T06:36:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000231212 s, 2.2 MB/s 2023-10-26T06:36:02.422 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-26T06:36:02.481 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2023-10-26T06:36:02.538 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-26T06:36:02.539 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:02.539 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 378940 Links: 1 2023-10-26T06:36:02.539 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:02.539 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:02.540 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-26 06:35:39.455967553 +0000 2023-10-26T06:36:02.540 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-26 06:25:15.995924140 +0000 2023-10-26T06:36:02.540 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-26 06:25:15.995924140 +0000 2023-10-26T06:36:02.540 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-26T06:36:02.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-26T06:36:02.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-26T06:36:02.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-26T06:36:02.605 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000210464 s, 2.4 MB/s 2023-10-26T06:36:02.607 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-26T06:36:02.665 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2023-10-26T06:36:02.723 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-26T06:36:02.723 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-26T06:36:02.723 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 378288 Links: 1 2023-10-26T06:36:02.724 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:36:02.724 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2023-10-26T06:36:02.724 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-10-26 06:35:39.455967553 +0000 2023-10-26T06:36:02.724 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-10-26 06:25:16.509914402 +0000 2023-10-26T06:36:02.725 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-10-26 06:25:16.509914402 +0000 2023-10-26T06:36:02.725 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-10-26T06:36:02.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-26T06:36:02.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-10-26T06:36:02.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-10-26T06:36:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000320682 s, 1.6 MB/s 2023-10-26T06:36:02.790 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-26T06:36:02.847 INFO:tasks.cephadm:Deploying osd.0 on smithi050 with /dev/vg_nvme/lv_4... 2023-10-26T06:36:02.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-26T06:36:02.915 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:02 smithi050 ceph-mon[94997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:02.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:02 smithi125 ceph-mon[130643]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:02.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:02 smithi153 ceph-mon[131657]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:03.596 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:36:04.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:03 smithi050 ceph-mon[94997]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:03 smithi125 ceph-mon[130643]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:03 smithi153 ceph-mon[131657]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-26T06:36:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-26T06:36:05.594 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-10-26T06:36:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-10-26T06:36:05.595 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0390646 s, 268 MB/s 2023-10-26T06:36:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-10-26T06:36:06.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2023-10-26T06:36:06.823 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:36:06.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:06 smithi125 ceph-mon[130643]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:06.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:06 smithi153 ceph-mon[131657]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:06 smithi050 ceph-mon[94997]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 -- 172.21.15.50:0/4026454262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe8073340 msgr2=0x7f4fe810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 --2- 172.21.15.50:0/4026454262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe8073340 0x7f4fe810cd10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009990 tx=0x7f4fd8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:36:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 -- 172.21.15.50:0/4026454262 shutdown_connections 2023-10-26T06:36:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 --2- 172.21.15.50:0/4026454262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fe810d250 0x7f4fe810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 --2- 172.21.15.50:0/4026454262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8072a20 0x7f4fe8072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 --2- 172.21.15.50:0/4026454262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe8073340 0x7f4fe810cd10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 -- 172.21.15.50:0/4026454262 >> 172.21.15.50:0/4026454262 conn(0x7f4fe80779e0 msgr2=0x7f4fe8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:36:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 -- 172.21.15.50:0/4026454262 shutdown_connections 2023-10-26T06:36:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.321+0000 7f4fef884700 1 -- 172.21.15.50:0/4026454262 wait complete. 2023-10-26T06:36:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.322+0000 7f4fef884700 1 Processor -- start 2023-10-26T06:36:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.322+0000 7f4fef884700 1 -- start start 2023-10-26T06:36:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fef884700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fe8072a20 0x7f4fe8198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fef884700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8073340 0x7f4fe8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fef884700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 0x7f4fe819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fef884700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe819ddc0 con 0x7f4fe810d250 2023-10-26T06:36:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fef884700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe819df30 con 0x7f4fe8073340 2023-10-26T06:36:08.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fef884700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe819e0f0 con 0x7f4fe8072a20 2023-10-26T06:36:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fede21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 0x7f4fe819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fede21700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 0x7f4fe819d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50962/0 (socket says 172.21.15.50:50962) 2023-10-26T06:36:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fede21700 1 -- 172.21.15.50:0/1830492692 learned_addr learned my addr 172.21.15.50:0/1830492692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:36:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fed620700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fe8072a20 0x7f4fe8198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.323+0000 7f4fece1f700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8073340 0x7f4fe8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:08.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fede21700 1 -- 172.21.15.50:0/1830492692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fe8072a20 msgr2=0x7f4fe8198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:08.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fede21700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fe8072a20 0x7f4fe8198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:08.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fede21700 1 -- 172.21.15.50:0/1830492692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8073340 msgr2=0x7f4fe8199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:08.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fede21700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8073340 0x7f4fe8199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fede21700 1 -- 172.21.15.50:0/1830492692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80095f0 con 0x7f4fe810d250 2023-10-26T06:36:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fece1f700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8073340 0x7f4fe8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:36:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fede21700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 0x7f4fe819d7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0007ee0 tx=0x7f4fe000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:36:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0004db0 con 0x7f4fe810d250 2023-10-26T06:36:08.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe819e3d0 con 0x7f4fe810d250 2023-10-26T06:36:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fe000f040 con 0x7f4fe810d250 2023-10-26T06:36:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00058a0 con 0x7f4fe810d250 2023-10-26T06:36:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.324+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe81a5c30 con 0x7f4fe810d250 2023-10-26T06:36:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.325+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe8108460 con 0x7f4fe810d250 2023-10-26T06:36:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.327+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f4fe000db20 con 0x7f4fe810d250 2023-10-26T06:36:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.328+0000 7f4fde7fc700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4fd40a1540 0x7f4fd40a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.329+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4fe00caa10 con 0x7f4fe810d250 2023-10-26T06:36:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.329+0000 7f4fed620700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4fd40a1540 0x7f4fd40a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.329+0000 7f4fed620700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4fd40a1540 0x7f4fd40a3a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009c60 tx=0x7f4fe4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:36:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.332+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4fe004f100 con 0x7f4fe810d250 2023-10-26T06:36:08.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:08.553+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fe819a1d0 con 0x7f4fd40a1540 2023-10-26T06:36:08.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:08 smithi125 ceph-mon[130643]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:08.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:08.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:08.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:08.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:08 smithi153 ceph-mon[131657]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:08.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:08.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:08.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:08 smithi050 ceph-mon[94997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:09.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:09 smithi050 ceph-mon[94997]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:09.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:09 smithi125 ceph-mon[130643]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:09.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:09 smithi153 ceph-mon[131657]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:10.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:10 smithi125 ceph-mon[130643]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:10.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:10 smithi153 ceph-mon[131657]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:10 smithi050 ceph-mon[94997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:12.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:12 smithi125 ceph-mon[130643]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:12.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:12 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/843155263' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7"}]: dispatch 2023-10-26T06:36:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:12 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/843155263' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7"}]': finished 2023-10-26T06:36:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:12 smithi125 ceph-mon[130643]: osdmap e6: 1 total, 0 up, 1 in 2023-10-26T06:36:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:12 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1590171597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:12.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:12 smithi153 ceph-mon[131657]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:12.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:12 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/843155263' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7"}]: dispatch 2023-10-26T06:36:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:12 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/843155263' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7"}]': finished 2023-10-26T06:36:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:12 smithi153 ceph-mon[131657]: osdmap e6: 1 total, 0 up, 1 in 2023-10-26T06:36:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:12 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1590171597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:12 smithi050 ceph-mon[94997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:12 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/843155263' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7"}]: dispatch 2023-10-26T06:36:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:12 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/843155263' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7"}]': finished 2023-10-26T06:36:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:12 smithi050 ceph-mon[94997]: osdmap e6: 1 total, 0 up, 1 in 2023-10-26T06:36:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:12 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1590171597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:13 smithi125 ceph-mon[130643]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:13 smithi153 ceph-mon[131657]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:13 smithi050 ceph-mon[94997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:16.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:16 smithi125 ceph-mon[130643]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:16.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:16 smithi153 ceph-mon[131657]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:17.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:16 smithi050 ceph-mon[94997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:18.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:18 smithi125 ceph-mon[130643]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:18.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:18 smithi153 ceph-mon[131657]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:18 smithi050 ceph-mon[94997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:19.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-26T06:36:19.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:19.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-26T06:36:19.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:20.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-26T06:36:20.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:20 smithi125 ceph-mon[130643]: Deploying daemon osd.0 on smithi050 2023-10-26T06:36:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:20 smithi125 ceph-mon[130643]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:20.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:20 smithi153 ceph-mon[131657]: Deploying daemon osd.0 on smithi050 2023-10-26T06:36:20.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:20 smithi153 ceph-mon[131657]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:20 smithi050 ceph-mon[94997]: Deploying daemon osd.0 on smithi050 2023-10-26T06:36:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:20 smithi050 ceph-mon[94997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:22.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:22 smithi050 ceph-mon[94997]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:22.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:22 smithi125 ceph-mon[130643]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:22.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:22 smithi153 ceph-mon[131657]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:24.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:23 smithi050 ceph-mon[94997]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:23 smithi125 ceph-mon[130643]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:23 smithi153 ceph-mon[131657]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:26.645 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:26 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:26.645 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:26 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:26.645 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:26 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:26.645 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:26 smithi050 ceph-mon[94997]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:26.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:26 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:26.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:26 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:26.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:26 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:26.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:26 smithi125 ceph-mon[130643]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:26.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:26 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:26.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:26 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:26.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:26 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:26.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:26 smithi153 ceph-mon[131657]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.662+0000 7f4fde7fc700 1 -- 172.21.15.50:0/1830492692 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4fe819a1d0 con 0x7f4fd40a1540 2023-10-26T06:36:28.665 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 0 on host 'smithi050' 2023-10-26T06:36:28.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4fd40a1540 msgr2=0x7f4fd40a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:28.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4fd40a1540 0x7f4fd40a3a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009c60 tx=0x7f4fe4009260 comp rx=0 tx=0).stop 2023-10-26T06:36:28.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 msgr2=0x7f4fe819d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:28.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 0x7f4fe819d7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0007ee0 tx=0x7f4fe000d3b0 comp rx=0 tx=0).stop 2023-10-26T06:36:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 shutdown_connections 2023-10-26T06:36:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4fd40a1540 0x7f4fd40a3a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fe810d250 0x7f4fe819d7b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fe8072a20 0x7f4fe8198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:28.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 --2- 172.21.15.50:0/1830492692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fe8073340 0x7f4fe8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.666+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 >> 172.21.15.50:0/1830492692 conn(0x7f4fe80779e0 msgr2=0x7f4fe80fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:36:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.667+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 shutdown_connections 2023-10-26T06:36:28.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:36:28.667+0000 7f4fef884700 1 -- 172.21.15.50:0/1830492692 wait complete. 2023-10-26T06:36:28.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:28.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:28.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:28.872 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.872 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.872 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:28.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:28.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:28.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:28.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:29.158 DEBUG:teuthology.orchestra.run.smithi050:osd.0> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.0.service 2023-10-26T06:36:29.162 INFO:tasks.cephadm:Deploying osd.1 on smithi125 with /dev/vg_nvme/lv_4... 2023-10-26T06:36:29.163 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-26T06:36:29.244 INFO:journalctl@ceph.osd.0.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:36:29.517 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:36:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0[119332]: 2023-10-26T06:36:29.284+0000 7fc271e67640 -1 osd.0 0 log_to_monitors true 2023-10-26T06:36:29.732 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:36:29.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:29.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:29 smithi050 ceph-mon[94997]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-26T06:36:29.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:29.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:29 smithi125 ceph-mon[130643]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-26T06:36:29.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:29.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:29 smithi153 ceph-mon[131657]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-26T06:36:30.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:30 smithi125 ceph-mon[130643]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:30 smithi125 ceph-mon[130643]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-26T06:36:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:30 smithi125 ceph-mon[130643]: osdmap e7: 1 total, 0 up, 1 in 2023-10-26T06:36:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:30 smithi125 ceph-mon[130643]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:36:30.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:30 smithi153 ceph-mon[131657]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:30 smithi153 ceph-mon[131657]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-26T06:36:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:30 smithi153 ceph-mon[131657]: osdmap e7: 1 total, 0 up, 1 in 2023-10-26T06:36:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:30 smithi153 ceph-mon[131657]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:36:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:31.017 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0[119332]: 2023-10-26T06:36:30.641+0000 7fc2684e0700 -1 osd.0 0 waiting for initial osdmap 2023-10-26T06:36:31.018 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0[119332]: 2023-10-26T06:36:30.645+0000 7fc25facc700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:36:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-mon[94997]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-mon[94997]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-26T06:36:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-mon[94997]: osdmap e7: 1 total, 0 up, 1 in 2023-10-26T06:36:31.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-mon[94997]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:36:31.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:31.319 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-26T06:36:31.319 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-26T06:36:31.320 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2023-10-26T06:36:31.320 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2023-10-26T06:36:31.320 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119927 s, 874 MB/s 2023-10-26T06:36:31.320 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2023-10-26T06:36:31.672 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi125:vg_nvme/lv_4 2023-10-26T06:36:31.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:31 smithi125 ceph-mon[130643]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:36:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:31 smithi125 ceph-mon[130643]: osdmap e8: 1 total, 0 up, 1 in 2023-10-26T06:36:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:31 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:31.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:31 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:31.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:31 smithi153 ceph-mon[131657]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:36:31.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:31 smithi153 ceph-mon[131657]: osdmap e8: 1 total, 0 up, 1 in 2023-10-26T06:36:31.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:31 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:31.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:31 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:32.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:31 smithi050 ceph-mon[94997]: from='osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:36:32.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:31 smithi050 ceph-mon[94997]: osdmap e8: 1 total, 0 up, 1 in 2023-10-26T06:36:32.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:31 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:32.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:31 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:32.228 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:36:32.717 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:32 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:36:32.718 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:32 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:36:32.718 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:32 smithi125 ceph-mon[130643]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:32.718 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:32 smithi125 ceph-mon[130643]: osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] boot 2023-10-26T06:36:32.718 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:32 smithi125 ceph-mon[130643]: osdmap e9: 1 total, 1 up, 1 in 2023-10-26T06:36:32.719 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:32 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:36:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:32 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:36:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:32 smithi153 ceph-mon[131657]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:32 smithi153 ceph-mon[131657]: osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] boot 2023-10-26T06:36:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:32 smithi153 ceph-mon[131657]: osdmap e9: 1 total, 1 up, 1 in 2023-10-26T06:36:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:32 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:36:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:32 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:36:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:32 smithi050 ceph-mon[94997]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-26T06:36:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:32 smithi050 ceph-mon[94997]: osd.0 [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] boot 2023-10-26T06:36:33.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:32 smithi050 ceph-mon[94997]: osdmap e9: 1 total, 1 up, 1 in 2023-10-26T06:36:33.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-26T06:36:33.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 -- 172.21.15.125:0/2314269928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c100110 msgr2=0x7fd07c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:33.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 --2- 172.21.15.125:0/2314269928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c100110 0x7fd07c10c580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd07400b0a0 tx=0x7fd07400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:36:33.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 -- 172.21.15.125:0/2314269928 shutdown_connections 2023-10-26T06:36:33.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 --2- 172.21.15.125:0/2314269928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c100110 0x7fd07c10c580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:33.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 --2- 172.21.15.125:0/2314269928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c1056b0 0x7fd07c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:33.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 --2- 172.21.15.125:0/2314269928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd07c0ff750 0x7fd07c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:33.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 -- 172.21.15.125:0/2314269928 >> 172.21.15.125:0/2314269928 conn(0x7fd07c075790 msgr2=0x7fd07c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:36:33.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 -- 172.21.15.125:0/2314269928 shutdown_connections 2023-10-26T06:36:33.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.470+0000 7fd082276700 1 -- 172.21.15.125:0/2314269928 wait complete. 2023-10-26T06:36:33.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 Processor -- start 2023-10-26T06:36:33.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 -- start start 2023-10-26T06:36:33.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c0ff750 0x7fd07c197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:33.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd07c100110 0x7fd07c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:33.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 0x7fd07c1a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:33.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c198a40 con 0x7fd07c0ff750 2023-10-26T06:36:33.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c1a31f0 con 0x7fd07c1056b0 2023-10-26T06:36:33.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.471+0000 7fd082276700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c1a3330 con 0x7fd07c100110 2023-10-26T06:36:33.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 0x7fd07c1a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:33.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 0x7fd07c1a2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37522/0 (socket says 172.21.15.125:37522) 2023-10-26T06:36:33.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 -- 172.21.15.125:0/2322515824 learned_addr learned my addr 172.21.15.125:0/2322515824 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-26T06:36:33.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 -- 172.21.15.125:0/2322515824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd07c100110 msgr2=0x7fd07c198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:33.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd07b7fe700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd07c100110 0x7fd07c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:33.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd07bfff700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c0ff750 0x7fd07c197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:33.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd07c100110 0x7fd07c198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:33.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 -- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c0ff750 msgr2=0x7fd07c197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:33.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c0ff750 0x7fd07c197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:33.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 -- 172.21.15.125:0/2322515824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009d00 con 0x7fd07c1056b0 2023-10-26T06:36:33.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd07bfff700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c0ff750 0x7fd07c197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:36:33.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd080813700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 0x7fd07c1a2cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0740077f0 tx=0x7fd0740078d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:36:33.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400e040 con 0x7fd07c1056b0 2023-10-26T06:36:33.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd074004c60 con 0x7fd07c1056b0 2023-10-26T06:36:33.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c1a35b0 con 0x7fd07c1056b0 2023-10-26T06:36:33.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074005370 con 0x7fd07c1056b0 2023-10-26T06:36:33.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.472+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c1a3a20 con 0x7fd07c1056b0 2023-10-26T06:36:33.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.473+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c107cd0 con 0x7fd07c1056b0 2023-10-26T06:36:33.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.474+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fd07401ba10 con 0x7fd07c1056b0 2023-10-26T06:36:33.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.475+0000 7fd0797fa700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd0640a1440 0x7fd0640a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:33.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.475+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fd0740cd1f0 con 0x7fd07c1056b0 2023-10-26T06:36:33.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.475+0000 7fd07bfff700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd0640a1440 0x7fd0640a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:33.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.475+0000 7fd07bfff700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd0640a1440 0x7fd0640a3900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd070005fd0 tx=0x7fd070005ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:36:33.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.478+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd074098280 con 0x7fd07c1056b0 2023-10-26T06:36:33.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:33.675+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd07c068740 con 0x7fd0640a1440 2023-10-26T06:36:33.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: osdmap e10: 1 total, 1 up, 1 in 2023-10-26T06:36:33.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:36:33.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:33.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:33.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: osdmap e10: 1 total, 1 up, 1 in 2023-10-26T06:36:33.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:36:33.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:33.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:33.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:33.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:34.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: osdmap e10: 1 total, 1 up, 1 in 2023-10-26T06:36:34.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:34.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:34.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:36:34.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:34.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:34.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:34.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:34.816 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi050 2023-10-26T06:36:34.817 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi050 to 17276M 2023-10-26T06:36:34.817 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:34.817 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:34.818 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:34.818 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:34.818 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:34 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:34.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi050 2023-10-26T06:36:34.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi050 to 17276M 2023-10-26T06:36:34.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:34.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:34.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:34.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:34.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:34 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:35.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi050 2023-10-26T06:36:35.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi050 to 17276M 2023-10-26T06:36:35.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:35.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:35.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:35.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:35.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:34 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:36.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:36 smithi125 ceph-mon[130643]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:36.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:36 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/470026844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]: dispatch 2023-10-26T06:36:36.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:36 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]: dispatch 2023-10-26T06:36:36.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:36 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]': finished 2023-10-26T06:36:36.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:36 smithi125 ceph-mon[130643]: osdmap e11: 2 total, 1 up, 2 in 2023-10-26T06:36:36.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:36.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:36 smithi153 ceph-mon[131657]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:36.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:36 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/470026844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]: dispatch 2023-10-26T06:36:36.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:36 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]: dispatch 2023-10-26T06:36:36.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:36 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]': finished 2023-10-26T06:36:36.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:36 smithi153 ceph-mon[131657]: osdmap e11: 2 total, 1 up, 2 in 2023-10-26T06:36:36.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:36 smithi050 ceph-mon[94997]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:36 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/470026844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]: dispatch 2023-10-26T06:36:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:36 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]: dispatch 2023-10-26T06:36:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:36 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0dee837-e527-4d2c-a2b7-6be86efb66bb"}]': finished 2023-10-26T06:36:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:36 smithi050 ceph-mon[94997]: osdmap e11: 2 total, 1 up, 2 in 2023-10-26T06:36:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:37.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:37 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/3498578108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:37.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:37 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/3498578108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:38.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:37 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/3498578108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:38.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:38 smithi125 ceph-mon[130643]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:38.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:38 smithi153 ceph-mon[131657]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:39.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:38 smithi050 ceph-mon[94997]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:40.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:40 smithi125 ceph-mon[130643]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:40.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:40 smithi153 ceph-mon[131657]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:41.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:40 smithi050 ceph-mon[94997]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:42.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:42 smithi125 ceph-mon[130643]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:42.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:42 smithi153 ceph-mon[131657]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:42 smithi050 ceph-mon[94997]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:43.906 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-26T06:36:43.906 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:43.906 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:43 smithi125 ceph-mon[130643]: Deploying daemon osd.1 on smithi125 2023-10-26T06:36:43.906 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:43 smithi125 ceph-mon[130643]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-26T06:36:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:44.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:43 smithi153 ceph-mon[131657]: Deploying daemon osd.1 on smithi125 2023-10-26T06:36:44.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:43 smithi153 ceph-mon[131657]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-26T06:36:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:43 smithi050 ceph-mon[94997]: Deploying daemon osd.1 on smithi125 2023-10-26T06:36:44.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:43 smithi050 ceph-mon[94997]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:46.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:46 smithi125 ceph-mon[130643]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:46 smithi153 ceph-mon[131657]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:47.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:46 smithi050 ceph-mon[94997]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:48.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:48 smithi125 ceph-mon[130643]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:48.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:48.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:48.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:48.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:48 smithi153 ceph-mon[131657]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:48.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:48.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:48.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:48.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:48 smithi050 ceph-mon[94997]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:49.948 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 1 on host 'smithi125' 2023-10-26T06:36:49.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.946+0000 7fd0797fa700 1 -- 172.21.15.125:0/2322515824 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd07c068740 con 0x7fd0640a1440 2023-10-26T06:36:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd0640a1440 msgr2=0x7fd0640a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd0640a1440 0x7fd0640a3900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd070005fd0 tx=0x7fd070005ee0 comp rx=0 tx=0).stop 2023-10-26T06:36:49.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 msgr2=0x7fd07c1a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:49.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 0x7fd07c1a2cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0740077f0 tx=0x7fd0740078d0 comp rx=0 tx=0).stop 2023-10-26T06:36:49.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 shutdown_connections 2023-10-26T06:36:49.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd0640a1440 0x7fd0640a3900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:49.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd07c1056b0 0x7fd07c1a2cb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:49.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd07c0ff750 0x7fd07c197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:49.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 --2- 172.21.15.125:0/2322515824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd07c100110 0x7fd07c198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:49.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 >> 172.21.15.125:0/2322515824 conn(0x7fd07c075790 msgr2=0x7fd07c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:36:49.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 shutdown_connections 2023-10-26T06:36:49.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:36:49.948+0000 7fd082276700 1 -- 172.21.15.125:0/2322515824 wait complete. 2023-10-26T06:36:50.317 DEBUG:teuthology.orchestra.run.smithi125:osd.1> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.1.service 2023-10-26T06:36:50.319 INFO:tasks.cephadm:Deploying osd.2 on smithi153 with /dev/vg_nvme/lv_4... 2023-10-26T06:36:50.319 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-26T06:36:50.348 INFO:journalctl@ceph.osd.1.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:36:50.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:50 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:50 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:50 smithi125 ceph-mon[130643]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:50.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:50 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:50 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:50 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:50 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:50 smithi153 ceph-mon[131657]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:50.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:50 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:50 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:50 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:50 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:50 smithi050 ceph-mon[94997]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:50.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:50 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:50 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:50.886 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:36:51.422 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:36:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1[136795]: 2023-10-26T06:36:51.299+0000 7ff0670bb640 -1 osd.1 0 log_to_monitors true 2023-10-26T06:36:51.717 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:51 smithi125 ceph-mon[130643]: from='osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-26T06:36:51.718 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:51 smithi125 ceph-mon[130643]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-26T06:36:51.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:51 smithi153 ceph-mon[131657]: from='osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-26T06:36:51.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:51 smithi153 ceph-mon[131657]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-26T06:36:51.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:51 smithi050 ceph-mon[94997]: from='osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-26T06:36:51.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:51 smithi050 ceph-mon[94997]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-26T06:36:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-26T06:36:52.404 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-26T06:36:52.404 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2023-10-26T06:36:52.404 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2023-10-26T06:36:52.404 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112978 s, 928 MB/s 2023-10-26T06:36:52.405 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2023-10-26T06:36:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:52 smithi153 ceph-mon[131657]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-26T06:36:52.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:52 smithi153 ceph-mon[131657]: osdmap e12: 2 total, 1 up, 2 in 2023-10-26T06:36:52.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:52.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:52 smithi153 ceph-mon[131657]: from='osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:36:52.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:52 smithi153 ceph-mon[131657]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:36:52.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:52 smithi153 ceph-mon[131657]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:52.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:52 smithi050 ceph-mon[94997]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-26T06:36:52.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:52 smithi050 ceph-mon[94997]: osdmap e12: 2 total, 1 up, 2 in 2023-10-26T06:36:52.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:52.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:52 smithi050 ceph-mon[94997]: from='osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:36:52.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:52 smithi050 ceph-mon[94997]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:36:52.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:52 smithi050 ceph-mon[94997]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:52.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2023-10-26T06:36:52.922 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1[136795]: 2023-10-26T06:36:52.462+0000 7ff05bf31700 -1 osd.1 0 waiting for initial osdmap 2023-10-26T06:36:52.923 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1[136795]: 2023-10-26T06:36:52.467+0000 7ff058527700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:36:52.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-mon[130643]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-26T06:36:52.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-mon[130643]: osdmap e12: 2 total, 1 up, 2 in 2023-10-26T06:36:52.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:52.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-mon[130643]: from='osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:36:52.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-mon[130643]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:36:52.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:52 smithi125 ceph-mon[130643]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:53.405 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:36:53.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:36:53.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: osdmap e13: 2 total, 1 up, 2 in 2023-10-26T06:36:53.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:53.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:53.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:36:53.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:53.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:53.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:53.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:53.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:53.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:36:53.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: osdmap e13: 2 total, 1 up, 2 in 2023-10-26T06:36:53.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:53.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:53.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:36:53.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:53.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:53.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:53.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:53.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:53.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:36:53.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: osdmap e13: 2 total, 1 up, 2 in 2023-10-26T06:36:53.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:53.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:53.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:36:53.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:53.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:53.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:53.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:36:53.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:53.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:36:53.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:36:54.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 -- 172.21.15.153:0/3150900827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 msgr2=0x7f59f80ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3150900827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f80ffbd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009990 tx=0x7f59e4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:36:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 -- 172.21.15.153:0/3150900827 shutdown_connections 2023-10-26T06:36:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3150900827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f8100110 0x7f59f810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:54.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3150900827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f81056b0 0x7f59f8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:54.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3150900827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f80ffbd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:54.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 -- 172.21.15.153:0/3150900827 >> 172.21.15.153:0/3150900827 conn(0x7f59f8075790 msgr2=0x7f59f8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:36:54.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 -- 172.21.15.153:0/3150900827 shutdown_connections 2023-10-26T06:36:54.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.479+0000 7f59fed1b700 1 -- 172.21.15.153:0/3150900827 wait complete. 2023-10-26T06:36:54.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 Processor -- start 2023-10-26T06:36:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 -- start start 2023-10-26T06:36:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f8197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f8100110 0x7f59f8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f81056b0 0x7f59f81a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8198870 con 0x7f59f8100110 2023-10-26T06:36:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f81a3030 con 0x7f59f81056b0 2023-10-26T06:36:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fed1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f81a3170 con 0x7f59f80ff750 2023-10-26T06:36:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fcab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f8197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fcab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f8197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35652/0 (socket says 172.21.15.153:35652) 2023-10-26T06:36:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.480+0000 7f59fcab7700 1 -- 172.21.15.153:0/3221754824 learned_addr learned my addr 172.21.15.153:0/3221754824 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-26T06:36:54.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fd2b8700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f81056b0 0x7f59f81a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:54.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59f7fff700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f8100110 0x7f59f8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:54.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fcab7700 1 -- 172.21.15.153:0/3221754824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f81056b0 msgr2=0x7f59f81a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:54.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fcab7700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f81056b0 0x7f59f81a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:54.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fcab7700 1 -- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f8100110 msgr2=0x7f59f8197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:36:54.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fcab7700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f8100110 0x7f59f8197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:36:54.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fcab7700 1 -- 172.21.15.153:0/3221754824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40095f0 con 0x7f59f80ff750 2023-10-26T06:36:54.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59f7fff700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f8100110 0x7f59f8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:36:54.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fcab7700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f8197a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00d950 tx=0x7f59ec00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:36:54.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec009940 con 0x7f59f80ff750 2023-10-26T06:36:54.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59ec010460 con 0x7f59f80ff750 2023-10-26T06:36:54.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f81a33f0 con 0x7f59f80ff750 2023-10-26T06:36:54.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00f620 con 0x7f59f80ff750 2023-10-26T06:36:54.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.481+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f81a3940 con 0x7f59f80ff750 2023-10-26T06:36:54.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.482+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f8107cd0 con 0x7f59f80ff750 2023-10-26T06:36:54.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.483+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f59ec0108d0 con 0x7f59f80ff750 2023-10-26T06:36:54.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.484+0000 7f59f5ffb700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59e80a14c0 0x7f59e80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:36:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.484+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2524+0+0 (secure 0 0 0) 0x7f59ec0cb330 con 0x7f59f80ff750 2023-10-26T06:36:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.484+0000 7f59f7fff700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59e80a14c0 0x7f59e80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:36:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.485+0000 7f59f7fff700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59e80a14c0 0x7f59e80a3980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59e400b2e0 tx=0x7f59e4005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:36:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.488+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f59ec096110 con 0x7f59f80ff750 2023-10-26T06:36:54.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:36:54.683+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f59f8068750 con 0x7f59e80a14c0 2023-10-26T06:36:54.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:36:54.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:36:54.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi125 2023-10-26T06:36:54.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi125 to 17168M 2023-10-26T06:36:54.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] boot 2023-10-26T06:36:54.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: osdmap e14: 2 total, 2 up, 2 in 2023-10-26T06:36:54.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:54.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:54 smithi153 ceph-mon[131657]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:54.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:36:54.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:36:54.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi125 2023-10-26T06:36:54.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi125 to 17168M 2023-10-26T06:36:54.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] boot 2023-10-26T06:36:54.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: osdmap e14: 2 total, 2 up, 2 in 2023-10-26T06:36:54.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:54.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:54 smithi050 ceph-mon[94997]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:54.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:36:54.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:36:54.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi125 2023-10-26T06:36:54.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi125 to 17168M 2023-10-26T06:36:54.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: osd.1 [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] boot 2023-10-26T06:36:54.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: osdmap e14: 2 total, 2 up, 2 in 2023-10-26T06:36:54.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-26T06:36:54.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:54 smithi125 ceph-mon[130643]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-26T06:36:55.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:55 smithi153 ceph-mon[131657]: osdmap e15: 2 total, 2 up, 2 in 2023-10-26T06:36:55.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:55 smithi153 ceph-mon[131657]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:55.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:55.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:55.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:55.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:55 smithi050 ceph-mon[94997]: osdmap e15: 2 total, 2 up, 2 in 2023-10-26T06:36:55.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:55 smithi050 ceph-mon[94997]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:55.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:55.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:55.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:55.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:55 smithi125 ceph-mon[130643]: osdmap e15: 2 total, 2 up, 2 in 2023-10-26T06:36:55.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:55 smithi125 ceph-mon[130643]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:36:55.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:36:55.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:36:55.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:36:56.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:56 smithi153 ceph-mon[131657]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:36:56.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:56 smithi050 ceph-mon[94997]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:36:56.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:56 smithi125 ceph-mon[130643]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:36:57.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:57 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/1377063090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]: dispatch 2023-10-26T06:36:57.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:57 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]: dispatch 2023-10-26T06:36:57.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:57 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]': finished 2023-10-26T06:36:57.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:57 smithi050 ceph-mon[94997]: osdmap e16: 3 total, 2 up, 3 in 2023-10-26T06:36:57.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:36:57.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:57 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/1377063090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]: dispatch 2023-10-26T06:36:57.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:57 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]: dispatch 2023-10-26T06:36:57.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:57 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]': finished 2023-10-26T06:36:57.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:57 smithi125 ceph-mon[130643]: osdmap e16: 3 total, 2 up, 3 in 2023-10-26T06:36:57.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:36:57.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:57 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/1377063090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]: dispatch 2023-10-26T06:36:57.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:57 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]: dispatch 2023-10-26T06:36:57.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:57 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e6a6b09-22ef-4586-af08-5d4a22e70fb4"}]': finished 2023-10-26T06:36:57.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:57 smithi153 ceph-mon[131657]: osdmap e16: 3 total, 2 up, 3 in 2023-10-26T06:36:57.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:36:58.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:58 smithi050 ceph-mon[94997]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:36:58.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:36:58 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/3973641981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:58.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:58 smithi125 ceph-mon[130643]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:36:58.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:36:58 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/3973641981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:36:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:58 smithi153 ceph-mon[131657]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:36:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:36:58 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/3973641981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:00.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:00 smithi125 ceph-mon[130643]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:00.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:00 smithi153 ceph-mon[131657]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:01.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:00 smithi050 ceph-mon[94997]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:02.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:02 smithi125 ceph-mon[130643]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:02.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:02 smithi153 ceph-mon[131657]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:02 smithi050 ceph-mon[94997]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:03 smithi125 ceph-mon[130643]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:03 smithi153 ceph-mon[131657]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:03 smithi050 ceph-mon[94997]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:04.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-26T06:37:04.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:04.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:04 smithi153 ceph-mon[131657]: Deploying daemon osd.2 on smithi153 2023-10-26T06:37:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-26T06:37:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:05.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:04 smithi125 ceph-mon[130643]: Deploying daemon osd.2 on smithi153 2023-10-26T06:37:05.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-26T06:37:05.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:05.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:04 smithi050 ceph-mon[94997]: Deploying daemon osd.2 on smithi153 2023-10-26T06:37:05.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:05 smithi153 ceph-mon[131657]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:06.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:05 smithi125 ceph-mon[130643]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:06.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:05 smithi050 ceph-mon[94997]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:08.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:08 smithi153 ceph-mon[131657]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:08.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:08.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:08.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:08.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:08 smithi125 ceph-mon[130643]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:08.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:08.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:08.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:08 smithi050 ceph-mon[94997]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:10.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.600+0000 7f59f5ffb700 1 -- 172.21.15.153:0/3221754824 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f59f8068750 con 0x7f59e80a14c0 2023-10-26T06:37:10.601 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 2 on host 'smithi153' 2023-10-26T06:37:10.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59e80a14c0 msgr2=0x7f59e80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:10.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59e80a14c0 0x7f59e80a3980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59e400b2e0 tx=0x7f59e4005fb0 comp rx=0 tx=0).stop 2023-10-26T06:37:10.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 msgr2=0x7f59f8197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:10.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f8197a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00d950 tx=0x7f59ec00dc60 comp rx=0 tx=0).stop 2023-10-26T06:37:10.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 shutdown_connections 2023-10-26T06:37:10.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59e80a14c0 0x7f59e80a3980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:10.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59f81056b0 0x7f59f81a2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:10.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59f80ff750 0x7f59f8197a70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:10.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 --2- 172.21.15.153:0/3221754824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59f8100110 0x7f59f8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:10.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 >> 172.21.15.153:0/3221754824 conn(0x7f59f8075790 msgr2=0x7f59f80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:37:10.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 shutdown_connections 2023-10-26T06:37:10.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:37:10.602+0000 7f59fed1b700 1 -- 172.21.15.153:0/3221754824 wait complete. 2023-10-26T06:37:10.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:10.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:10.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:10.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:10.998 DEBUG:teuthology.orchestra.run.smithi153:osd.2> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.2.service 2023-10-26T06:37:11.001 INFO:tasks.cephadm:Deploying osd.3 on smithi050 with /dev/vg_nvme/lv_3... 2023-10-26T06:37:11.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-26T06:37:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:11.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:11.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:11.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:11.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:11.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:11.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:11.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:11.030 INFO:journalctl@ceph.osd.2.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:37:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:37:12.199 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:11 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2[138802]: 2023-10-26T06:37:11.955+0000 7f85f176a640 -1 osd.2 0 log_to_monitors true 2023-10-26T06:37:12.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:12 smithi125 ceph-mon[130643]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:12.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:12 smithi125 ceph-mon[130643]: from='osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-26T06:37:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:12 smithi125 ceph-mon[130643]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-26T06:37:12.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:12 smithi153 ceph-mon[131657]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:12 smithi153 ceph-mon[131657]: from='osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-26T06:37:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:12 smithi153 ceph-mon[131657]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-26T06:37:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:12 smithi050 ceph-mon[94997]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:12 smithi050 ceph-mon[94997]: from='osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-26T06:37:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:12 smithi050 ceph-mon[94997]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-26T06:37:13.869 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-26T06:37:13.870 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-26T06:37:13.870 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-10-26T06:37:13.870 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-10-26T06:37:13.870 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0323156 s, 324 MB/s 2023-10-26T06:37:13.871 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-10-26T06:37:13.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-26T06:37:13.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: osdmap e17: 3 total, 2 up, 3 in 2023-10-26T06:37:13.906 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:13.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:37:13.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:37:13.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:13.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:13.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:13.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-26T06:37:13.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: osdmap e17: 3 total, 2 up, 3 in 2023-10-26T06:37:13.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:13.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:37:13.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:37:13.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:13.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:13.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:13.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.984 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2[138802]: 2023-10-26T06:37:13.646+0000 7f85e7de3700 -1 osd.2 0 waiting for initial osdmap 2023-10-26T06:37:13.984 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2[138802]: 2023-10-26T06:37:13.651+0000 7f85e23d5700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:37:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-26T06:37:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: osdmap e17: 3 total, 2 up, 3 in 2023-10-26T06:37:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:37:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:37:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:13.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:13.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:13.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:14.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2023-10-26T06:37:14.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:14.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi153 2023-10-26T06:37:14.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi153 to 17168M 2023-10-26T06:37:14.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:37:14.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: osdmap e18: 3 total, 2 up, 3 in 2023-10-26T06:37:14.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:14.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:14.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:14.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi153 2023-10-26T06:37:14.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi153 to 17168M 2023-10-26T06:37:14.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:37:14.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: osdmap e18: 3 total, 2 up, 3 in 2023-10-26T06:37:14.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:14.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:15.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:15.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi153 2023-10-26T06:37:15.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi153 to 17168M 2023-10-26T06:37:15.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:37:15.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: osdmap e18: 3 total, 2 up, 3 in 2023-10-26T06:37:15.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:15.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:37:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:16 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:37:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:16 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:37:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:16 smithi125 ceph-mon[130643]: osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] boot 2023-10-26T06:37:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:16 smithi125 ceph-mon[130643]: osdmap e19: 3 total, 3 up, 3 in 2023-10-26T06:37:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:37:16.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:16 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:37:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:16 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:37:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:16 smithi153 ceph-mon[131657]: osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] boot 2023-10-26T06:37:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:16 smithi153 ceph-mon[131657]: osdmap e19: 3 total, 3 up, 3 in 2023-10-26T06:37:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:16.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:37:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:16 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:37:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:16 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:37:16.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:16 smithi050 ceph-mon[94997]: osd.2 [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] boot 2023-10-26T06:37:16.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:16 smithi050 ceph-mon[94997]: osdmap e19: 3 total, 3 up, 3 in 2023-10-26T06:37:16.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-26T06:37:16.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:37:16.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.571+0000 7fe285fb1700 1 -- 172.21.15.50:0/1459756212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 msgr2=0x7fe28010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.571+0000 7fe285fb1700 1 --2- 172.21.15.50:0/1459756212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe28010d650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe27800b0a0 tx=0x7fe27800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:37:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.571+0000 7fe285fb1700 1 -- 172.21.15.50:0/1459756212 shutdown_connections 2023-10-26T06:37:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.571+0000 7fe285fb1700 1 --2- 172.21.15.50:0/1459756212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe28010d650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.571+0000 7fe285fb1700 1 --2- 172.21.15.50:0/1459756212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2801057c0 0x7fe280105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:16.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.571+0000 7fe285fb1700 1 --2- 172.21.15.50:0/1459756212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2801008a0 0x7fe280100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:16.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.572+0000 7fe285fb1700 1 -- 172.21.15.50:0/1459756212 >> 172.21.15.50:0/1459756212 conn(0x7fe2800779e0 msgr2=0x7fe280077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:37:16.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.572+0000 7fe285fb1700 1 -- 172.21.15.50:0/1459756212 shutdown_connections 2023-10-26T06:37:16.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.572+0000 7fe285fb1700 1 -- 172.21.15.50:0/1459756212 wait complete. 2023-10-26T06:37:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 Processor -- start 2023-10-26T06:37:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 -- start start 2023-10-26T06:37:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2801008a0 0x7fe280072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe280073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:16.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2801057c0 0x7fe280073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801a5050 con 0x7fe280101260 2023-10-26T06:37:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801a51c0 con 0x7fe2801057c0 2023-10-26T06:37:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.573+0000 7fe285fb1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2801a5380 con 0x7fe2801008a0 2023-10-26T06:37:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe280073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:16.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe280073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58236/0 (socket says 172.21.15.50:58236) 2023-10-26T06:37:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 -- 172.21.15.50:0/774875017 learned_addr learned my addr 172.21.15.50:0/774875017 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:37:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27f7fe700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2801008a0 0x7fe280072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27ffff700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2801057c0 0x7fe280073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 -- 172.21.15.50:0/774875017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2801008a0 msgr2=0x7fe280072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:16.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2801008a0 0x7fe280072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 -- 172.21.15.50:0/774875017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2801057c0 msgr2=0x7fe280073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2801057c0 0x7fe280073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 -- 172.21.15.50:0/774875017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009d00 con 0x7fe280101260 2023-10-26T06:37:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.574+0000 7fe27effd700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe280073030 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe27400e9a0 tx=0x7fe27400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:37:16.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.575+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274009790 con 0x7fe280101260 2023-10-26T06:37:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.575+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2801a5660 con 0x7fe280101260 2023-10-26T06:37:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.575+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe27400cbd0 con 0x7fe280101260 2023-10-26T06:37:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.575+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274018680 con 0x7fe280101260 2023-10-26T06:37:16.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.575+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2801a5bb0 con 0x7fe280101260 2023-10-26T06:37:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.576+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe280101f30 con 0x7fe280101260 2023-10-26T06:37:16.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.578+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fe27400cd40 con 0x7fe280101260 2023-10-26T06:37:16.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.579+0000 7fe27cff9700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2680a1440 0x7fe2680a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:16.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.580+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3441+0+0 (secure 0 0 0) 0x7fe274014070 con 0x7fe280101260 2023-10-26T06:37:16.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.580+0000 7fe27f7fe700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2680a1440 0x7fe2680a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:16.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.580+0000 7fe27f7fe700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2680a1440 0x7fe2680a3900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe280101930 tx=0x7fe270009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:37:16.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.582+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe274096ba0 con 0x7fe280101260 2023-10-26T06:37:16.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:16.803+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe280110780 con 0x7fe2680a1440 2023-10-26T06:37:17.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-26T06:37:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: osdmap e20: 3 total, 3 up, 3 in 2023-10-26T06:37:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:37:17.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:37:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:37:17.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:17 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:17.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-26T06:37:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: osdmap e20: 3 total, 3 up, 3 in 2023-10-26T06:37:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:37:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:37:17.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:37:17.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:17 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:17.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-26T06:37:17.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-26T06:37:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: osdmap e20: 3 total, 3 up, 3 in 2023-10-26T06:37:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:37:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:37:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:37:17.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:17 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:18.081 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:17 smithi050 sudo[125529]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-26T06:37:18.081 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:17 smithi050 sudo[125529]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:18.081 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:17 smithi050 sudo[125529]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:18.082 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:17 smithi050 sudo[125529]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:18.182+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe274096f70 con 0x7fe280101260 2023-10-26T06:37:18.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:18 smithi050 ceph-mon[94997]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:37:18.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-26T06:37:18.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:18 smithi050 ceph-mon[94997]: osdmap e21: 3 total, 3 up, 3 in 2023-10-26T06:37:18.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:18 smithi050 ceph-mon[94997]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:18.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:18 smithi153 ceph-mon[131657]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:37:18.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-26T06:37:18.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:18 smithi153 ceph-mon[131657]: osdmap e21: 3 total, 3 up, 3 in 2023-10-26T06:37:18.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:18 smithi153 ceph-mon[131657]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:18.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:18 smithi125 ceph-mon[130643]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:37:18.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-26T06:37:18.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:18 smithi125 ceph-mon[130643]: osdmap e21: 3 total, 3 up, 3 in 2023-10-26T06:37:18.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:18 smithi125 ceph-mon[130643]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:18.767 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:18 smithi050 sudo[125580]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-26T06:37:18.768 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:18 smithi050 sudo[125580]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:18.768 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:18 smithi050 sudo[125580]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:18.768 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:37:18 smithi050 sudo[125580]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:18.946 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141645]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-26T06:37:18.946 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141645]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:18.946 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141645]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:18.946 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141645]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:19.422 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141648]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-26T06:37:19.422 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141648]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:19.423 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141648]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:19.423 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:37:18 smithi125 sudo[141648]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:19.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:19 smithi125 ceph-mon[130643]: mgrmap e20: x(active, since 108s), standbys: z, y 2023-10-26T06:37:19.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:19 smithi125 ceph-mon[130643]: osdmap e22: 3 total, 3 up, 3 in 2023-10-26T06:37:19.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:19.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:19.468 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:19 smithi153 ceph-mon[131657]: mgrmap e20: x(active, since 108s), standbys: z, y 2023-10-26T06:37:19.468 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:19 smithi153 ceph-mon[131657]: osdmap e22: 3 total, 3 up, 3 in 2023-10-26T06:37:19.469 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:19.469 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:19.469 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143487]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-26T06:37:19.469 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:19.470 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143487]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:19.470 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143487]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:19.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:19 smithi050 ceph-mon[94997]: mgrmap e20: x(active, since 108s), standbys: z, y 2023-10-26T06:37:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:19 smithi050 ceph-mon[94997]: osdmap e22: 3 total, 3 up, 3 in 2023-10-26T06:37:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:19.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:19.734 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143490]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-26T06:37:19.734 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143490]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:19.735 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143490]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:19.735 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:37:19 smithi153 sudo[143490]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:20.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125678]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-26T06:37:20.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:20.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125678]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:20.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125678]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:20.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:20.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:20 smithi153 ceph-mon[131657]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:20.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:20 smithi153 sudo[143493]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-26T06:37:20.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:20 smithi153 sudo[143493]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:20.864 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:20 smithi153 sudo[143493]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:20.864 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:20 smithi153 sudo[143493]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:20 smithi125 ceph-mon[130643]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125682]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-26T06:37:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125682]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125682]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 sudo[125682]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:20 smithi050 ceph-mon[94997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:21.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 sudo[143496]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-26T06:37:21.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 sudo[143496]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:21.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 sudo[143496]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:21.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 sudo[143496]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:21.596 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141651]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-26T06:37:21.596 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141651]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:21.597 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141651]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:21.597 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141651]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:21.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141654]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-26T06:37:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141654]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-26T06:37:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141654]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-26T06:37:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 sudo[141654]: pam_unix(sudo:session): session closed for user root 2023-10-26T06:37:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1465155068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]: dispatch 2023-10-26T06:37:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]: dispatch 2023-10-26T06:37:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]': finished 2023-10-26T06:37:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: osdmap e23: 4 total, 3 up, 4 in 2023-10-26T06:37:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:21.927 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:21.927 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:21.927 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:21.927 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/455354719' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:21.927 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:21 smithi125 ceph-mon[130643]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1465155068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]: dispatch 2023-10-26T06:37:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]: dispatch 2023-10-26T06:37:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]': finished 2023-10-26T06:37:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: osdmap e23: 4 total, 3 up, 4 in 2023-10-26T06:37:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:21.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:21.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:21.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:21.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:21.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/455354719' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:21.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:21 smithi153 ceph-mon[131657]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1465155068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]: dispatch 2023-10-26T06:37:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]: dispatch 2023-10-26T06:37:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13dce44a-ed55-4e67-9a10-1d728d5481e3"}]': finished 2023-10-26T06:37:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: osdmap e23: 4 total, 3 up, 4 in 2023-10-26T06:37:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:22.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:22.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-26T06:37:22.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-26T06:37:22.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-26T06:37:22.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-26T06:37:22.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/455354719' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:22.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:21 smithi050 ceph-mon[94997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-26T06:37:22.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:22 smithi125 ceph-mon[130643]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:22.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:22 smithi153 ceph-mon[131657]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:22 smithi050 ceph-mon[94997]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:23 smithi125 ceph-mon[130643]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:23 smithi153 ceph-mon[131657]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:24.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:23 smithi050 ceph-mon[94997]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:26.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:26 smithi125 ceph-mon[130643]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-26T06:37:26.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:26 smithi153 ceph-mon[131657]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-26T06:37:26.999 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:26 smithi050 ceph-mon[94997]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-26T06:37:28.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:28 smithi125 ceph-mon[130643]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-10-26T06:37:28.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-26T06:37:28.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:28.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:28 smithi050 ceph-mon[94997]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-10-26T06:37:28.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-26T06:37:28.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:28 smithi153 ceph-mon[131657]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-10-26T06:37:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-26T06:37:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:29.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:29 smithi125 ceph-mon[130643]: Deploying daemon osd.3 on smithi050 2023-10-26T06:37:29.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:29 smithi050 ceph-mon[94997]: Deploying daemon osd.3 on smithi050 2023-10-26T06:37:29.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:29 smithi153 ceph-mon[131657]: Deploying daemon osd.3 on smithi050 2023-10-26T06:37:30.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:30 smithi125 ceph-mon[130643]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-10-26T06:37:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:30 smithi153 ceph-mon[131657]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-10-26T06:37:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:30 smithi050 ceph-mon[94997]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-10-26T06:37:32.891 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:32 smithi050 ceph-mon[94997]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-10-26T06:37:32.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:32 smithi125 ceph-mon[130643]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-10-26T06:37:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:32 smithi153 ceph-mon[131657]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-10-26T06:37:34.105 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:33 smithi050 ceph-mon[94997]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-26T06:37:34.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:33 smithi125 ceph-mon[130643]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-26T06:37:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:33 smithi153 ceph-mon[131657]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-26T06:37:35.612 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:35 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:35.613 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:35 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:35.613 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:35 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:35.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:35 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:35.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:35 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:35.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:35 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:35.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:35 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:35.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:35 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:35.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:35 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:36.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:36 smithi050 ceph-mon[94997]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-26T06:37:36.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:36 smithi125 ceph-mon[130643]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-26T06:37:36.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:36 smithi153 ceph-mon[131657]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-26T06:37:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.768+0000 7fe27cff9700 1 -- 172.21.15.50:0/774875017 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe280110780 con 0x7fe2680a1440 2023-10-26T06:37:37.771 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 3 on host 'smithi050' 2023-10-26T06:37:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2680a1440 msgr2=0x7fe2680a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2680a1440 0x7fe2680a3900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe280101930 tx=0x7fe270009260 comp rx=0 tx=0).stop 2023-10-26T06:37:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 msgr2=0x7fe280073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe280073030 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe27400e9a0 tx=0x7fe27400ed60 comp rx=0 tx=0).stop 2023-10-26T06:37:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 shutdown_connections 2023-10-26T06:37:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2680a1440 0x7fe2680a3900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2801057c0 0x7fe280073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2801008a0 0x7fe280072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 --2- 172.21.15.50:0/774875017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe280101260 0x7fe280073030 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:37.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 >> 172.21.15.50:0/774875017 conn(0x7fe2800779e0 msgr2=0x7fe2800fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:37:37.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 shutdown_connections 2023-10-26T06:37:37.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:37:37.771+0000 7fe285fb1700 1 -- 172.21.15.50:0/774875017 wait complete. 2023-10-26T06:37:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:38.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:38.265 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.265 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.265 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:38.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:38.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:38.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:38.269 DEBUG:teuthology.orchestra.run.smithi050:osd.3> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.3.service 2023-10-26T06:37:38.273 INFO:tasks.cephadm:Deploying osd.4 on smithi125 with /dev/vg_nvme/lv_3... 2023-10-26T06:37:38.274 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-26T06:37:38.320 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.320 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.321 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:38.321 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:38.321 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.322 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:38.322 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.322 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:38.322 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:38.384 INFO:journalctl@ceph.osd.3.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:37:38.860 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:37:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:38 smithi153 ceph-mon[131657]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-26T06:37:39.235 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:38 smithi050 ceph-mon[94997]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-26T06:37:39.275 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:38 smithi125 ceph-mon[130643]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-26T06:37:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-mon[94997]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-26T06:37:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-mon[94997]: osdmap e24: 4 total, 3 up, 4 in 2023-10-26T06:37:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-mon[94997]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:37:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-mon[94997]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:40.269 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-3[127970]: 2023-10-26T06:37:40.009+0000 7f87d4a5b700 -1 osd.3 0 waiting for initial osdmap 2023-10-26T06:37:40.269 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:37:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-3[127970]: 2023-10-26T06:37:40.017+0000 7f87cc047700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:37:40.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:40 smithi125 ceph-mon[130643]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-26T06:37:40.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:40 smithi125 ceph-mon[130643]: osdmap e24: 4 total, 3 up, 4 in 2023-10-26T06:37:40.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:40 smithi125 ceph-mon[130643]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:37:40.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:40.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:40 smithi125 ceph-mon[130643]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:40.448 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-26T06:37:40.448 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-26T06:37:40.448 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2023-10-26T06:37:40.449 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2023-10-26T06:37:40.449 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131788 s, 796 MB/s 2023-10-26T06:37:40.449 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2023-10-26T06:37:40.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:40 smithi153 ceph-mon[131657]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-26T06:37:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:40 smithi153 ceph-mon[131657]: osdmap e24: 4 total, 3 up, 4 in 2023-10-26T06:37:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:40 smithi153 ceph-mon[131657]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:37:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:40 smithi153 ceph-mon[131657]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:40.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi125:vg_nvme/lv_3 2023-10-26T06:37:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:41 smithi125 ceph-mon[130643]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:37:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:41 smithi125 ceph-mon[130643]: osdmap e25: 4 total, 3 up, 4 in 2023-10-26T06:37:41.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:41 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:41.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:41 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:41 smithi050 ceph-mon[94997]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:37:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:41 smithi050 ceph-mon[94997]: osdmap e25: 4 total, 3 up, 4 in 2023-10-26T06:37:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:41 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:41.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:41 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:37:41.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:41 smithi153 ceph-mon[131657]: from='osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:37:41.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:41 smithi153 ceph-mon[131657]: osdmap e25: 4 total, 3 up, 4 in 2023-10-26T06:37:41.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:41 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:41.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:41 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:37:42.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:37:42.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] boot 2023-10-26T06:37:42.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: osdmap e26: 4 total, 4 up, 4 in 2023-10-26T06:37:42.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:42 smithi125 ceph-mon[130643]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:37:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:37:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] boot 2023-10-26T06:37:42.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: osdmap e26: 4 total, 4 up, 4 in 2023-10-26T06:37:42.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:42 smithi050 ceph-mon[94997]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:42.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:37:42.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:37:42.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: osd.3 [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] boot 2023-10-26T06:37:42.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: osdmap e26: 4 total, 4 up, 4 in 2023-10-26T06:37:42.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-26T06:37:42.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:42 smithi153 ceph-mon[131657]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-26T06:37:42.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 -- 172.21.15.125:0/504179492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d40ff190 msgr2=0x7fd4d40ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:42.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 --2- 172.21.15.125:0/504179492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d40ff190 0x7fd4d40ff610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009990 tx=0x7fd4c8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:37:42.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 -- 172.21.15.125:0/504179492 shutdown_connections 2023-10-26T06:37:42.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 --2- 172.21.15.125:0/504179492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d40ffb50 0x7fd4d410bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:42.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 --2- 172.21.15.125:0/504179492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d4103e70 0x7fd4d4104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:42.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 --2- 172.21.15.125:0/504179492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d40ff190 0x7fd4d40ff610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:42.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 -- 172.21.15.125:0/504179492 >> 172.21.15.125:0/504179492 conn(0x7fd4d4074a10 msgr2=0x7fd4d4074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:37:42.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 -- 172.21.15.125:0/504179492 shutdown_connections 2023-10-26T06:37:42.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.558+0000 7fd4da899700 1 -- 172.21.15.125:0/504179492 wait complete. 2023-10-26T06:37:42.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 Processor -- start 2023-10-26T06:37:42.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 -- start start 2023-10-26T06:37:42.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d40ff190 0x7fd4d41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:42.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40ffb50 0x7fd4d4197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:42.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 0x7fd4d41a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:42.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41987d0 con 0x7fd4d40ffb50 2023-10-26T06:37:42.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41a2f90 con 0x7fd4d4103e70 2023-10-26T06:37:42.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4da899700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41a30d0 con 0x7fd4d40ff190 2023-10-26T06:37:42.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 0x7fd4d41a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:42.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 0x7fd4d41a2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37604/0 (socket says 172.21.15.125:37604) 2023-10-26T06:37:42.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 -- 172.21.15.125:0/2068362299 learned_addr learned my addr 172.21.15.125:0/2068362299 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-26T06:37:42.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d3fff700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d40ff190 0x7fd4d41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:42.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d37fe700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40ffb50 0x7fd4d4197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:42.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 -- 172.21.15.125:0/2068362299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d40ff190 msgr2=0x7fd4d41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:42.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d40ff190 0x7fd4d41979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:42.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 -- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40ffb50 msgr2=0x7fd4d4197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:42.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40ffb50 0x7fd4d4197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:42.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d8e36700 1 -- 172.21.15.125:0/2068362299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c80095f0 con 0x7fd4d4103e70 2023-10-26T06:37:42.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.559+0000 7fd4d37fe700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40ffb50 0x7fd4d4197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:37:42.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.560+0000 7fd4d8e36700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 0x7fd4d41a2a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc007ee0 tx=0x7fd4cc00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:37:42.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.560+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc017070 con 0x7fd4d4103e70 2023-10-26T06:37:42.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.560+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4cc00f040 con 0x7fd4d4103e70 2023-10-26T06:37:42.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.560+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d41a3350 con 0x7fd4d4103e70 2023-10-26T06:37:42.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.560+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc005740 con 0x7fd4d4103e70 2023-10-26T06:37:42.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.560+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d41a3850 con 0x7fd4d4103e70 2023-10-26T06:37:42.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.561+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d4107440 con 0x7fd4d4103e70 2023-10-26T06:37:42.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.563+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd4cc00dc60 con 0x7fd4d4103e70 2023-10-26T06:37:42.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.563+0000 7fd4d17fa700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd4bc0a1550 0x7fd4bc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:37:42.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.563+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3913+0+0 (secure 0 0 0) 0x7fd4cc0cba40 con 0x7fd4d4103e70 2023-10-26T06:37:42.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.563+0000 7fd4d3fff700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd4bc0a1550 0x7fd4bc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:37:42.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.564+0000 7fd4d3fff700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd4bc0a1550 0x7fd4bc0a3a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4077270 tx=0x7fd4c4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:37:42.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.567+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd4cc0961d0 con 0x7fd4d4103e70 2023-10-26T06:37:42.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:42.765+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d410c810 con 0x7fd4bc0a1550 2023-10-26T06:37:43.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: osdmap e27: 4 total, 4 up, 4 in 2023-10-26T06:37:43.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi050 2023-10-26T06:37:43.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:43.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:43.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi050 to 8638M 2023-10-26T06:37:43.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:43.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:43.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:37:43.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:37:43.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:43.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: osdmap e27: 4 total, 4 up, 4 in 2023-10-26T06:37:43.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi050 2023-10-26T06:37:43.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:43.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:43.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi050 to 8638M 2023-10-26T06:37:43.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:43.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:43.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:37:43.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:37:43.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:43.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: osdmap e27: 4 total, 4 up, 4 in 2023-10-26T06:37:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi050 2023-10-26T06:37:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:37:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi050 to 8638M 2023-10-26T06:37:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:37:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:43.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:37:43.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:37:43.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:44.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:44 smithi125 ceph-mon[130643]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:37:44.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:44 smithi125 ceph-mon[130643]: osdmap e28: 4 total, 4 up, 4 in 2023-10-26T06:37:44.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:44 smithi125 ceph-mon[130643]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:44 smithi153 ceph-mon[131657]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:37:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:44 smithi153 ceph-mon[131657]: osdmap e28: 4 total, 4 up, 4 in 2023-10-26T06:37:44.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:44 smithi153 ceph-mon[131657]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:44 smithi050 ceph-mon[94997]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:37:44.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:44 smithi050 ceph-mon[94997]: osdmap e28: 4 total, 4 up, 4 in 2023-10-26T06:37:44.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:44 smithi050 ceph-mon[94997]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:45.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:45 smithi125 ceph-mon[130643]: osdmap e29: 4 total, 4 up, 4 in 2023-10-26T06:37:45.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:45 smithi153 ceph-mon[131657]: osdmap e29: 4 total, 4 up, 4 in 2023-10-26T06:37:45.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:45 smithi050 ceph-mon[94997]: osdmap e29: 4 total, 4 up, 4 in 2023-10-26T06:37:46.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: osdmap e30: 4 total, 4 up, 4 in 2023-10-26T06:37:46.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/1687736835' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]: dispatch 2023-10-26T06:37:46.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]: dispatch 2023-10-26T06:37:46.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]': finished 2023-10-26T06:37:46.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: osdmap e31: 5 total, 4 up, 5 in 2023-10-26T06:37:46.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:37:46.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 162 KiB/s, 0 objects/s recovering 2023-10-26T06:37:46.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:46 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/3365080853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:46.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: osdmap e30: 4 total, 4 up, 4 in 2023-10-26T06:37:46.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/1687736835' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]: dispatch 2023-10-26T06:37:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]: dispatch 2023-10-26T06:37:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]': finished 2023-10-26T06:37:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: osdmap e31: 5 total, 4 up, 5 in 2023-10-26T06:37:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:37:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 162 KiB/s, 0 objects/s recovering 2023-10-26T06:37:46.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:46 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/3365080853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:46.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: osdmap e30: 4 total, 4 up, 4 in 2023-10-26T06:37:46.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/1687736835' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]: dispatch 2023-10-26T06:37:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]: dispatch 2023-10-26T06:37:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3204503f-f6de-43fa-a3cb-f4d7e5213c4f"}]': finished 2023-10-26T06:37:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: osdmap e31: 5 total, 4 up, 5 in 2023-10-26T06:37:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:37:46.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 162 KiB/s, 0 objects/s recovering 2023-10-26T06:37:46.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:46 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/3365080853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:37:48.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:48 smithi125 ceph-mon[130643]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-10-26T06:37:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:48 smithi153 ceph-mon[131657]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-10-26T06:37:49.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:48 smithi050 ceph-mon[94997]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 126 KiB/s, 0 objects/s recovering 2023-10-26T06:37:50.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:50 smithi125 ceph-mon[130643]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:37:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:50 smithi153 ceph-mon[131657]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:37:51.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:50 smithi050 ceph-mon[94997]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:37:52.919 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:52 smithi125 ceph-mon[130643]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2023-10-26T06:37:52.920 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-26T06:37:52.920 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:52 smithi153 ceph-mon[131657]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2023-10-26T06:37:52.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-26T06:37:52.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:53.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:52 smithi050 ceph-mon[94997]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2023-10-26T06:37:53.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-26T06:37:53.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:37:53.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:53 smithi125 ceph-mon[130643]: Deploying daemon osd.4 on smithi125 2023-10-26T06:37:53.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:53 smithi153 ceph-mon[131657]: Deploying daemon osd.4 on smithi125 2023-10-26T06:37:54.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:53 smithi050 ceph-mon[94997]: Deploying daemon osd.4 on smithi125 2023-10-26T06:37:54.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:54 smithi125 ceph-mon[130643]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:54.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:54 smithi153 ceph-mon[131657]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:54 smithi050 ceph-mon[94997]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:56.689 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:56 smithi125 ceph-mon[130643]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:56.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:56 smithi153 ceph-mon[131657]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:57.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:56 smithi050 ceph-mon[94997]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:57.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:57.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:57.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:57.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:57 smithi125 ceph-mon[130643]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:57.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:57.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:57.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:57.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:57 smithi153 ceph-mon[131657]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:58.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:58.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:37:58.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:37:58.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:57 smithi050 ceph-mon[94997]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:37:59.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.535+0000 7fd4d17fa700 1 -- 172.21.15.125:0/2068362299 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd4d410c810 con 0x7fd4bc0a1550 2023-10-26T06:37:59.538 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 4 on host 'smithi125' 2023-10-26T06:37:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd4bc0a1550 msgr2=0x7fd4bc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd4bc0a1550 0x7fd4bc0a3a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4077270 tx=0x7fd4c4009260 comp rx=0 tx=0).stop 2023-10-26T06:37:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 msgr2=0x7fd4d41a2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:37:59.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 0x7fd4d41a2a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc007ee0 tx=0x7fd4cc00d3b0 comp rx=0 tx=0).stop 2023-10-26T06:37:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 shutdown_connections 2023-10-26T06:37:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd4bc0a1550 0x7fd4bc0a3a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4d4103e70 0x7fd4d41a2a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4d40ff190 0x7fd4d41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:59.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 --2- 172.21.15.125:0/2068362299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d40ffb50 0x7fd4d4197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:37:59.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 >> 172.21.15.125:0/2068362299 conn(0x7fd4d4074a10 msgr2=0x7fd4d40fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:37:59.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 shutdown_connections 2023-10-26T06:37:59.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:37:59.538+0000 7fd4da899700 1 -- 172.21.15.125:0/2068362299 wait complete. 2023-10-26T06:37:59.986 DEBUG:teuthology.orchestra.run.smithi125:osd.4> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.4.service 2023-10-26T06:37:59.989 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_3... 2023-10-26T06:37:59.989 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-26T06:38:00.021 INFO:journalctl@ceph.osd.4.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:38:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:37:59 smithi050 ceph-mon[94997]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:00.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:37:59 smithi125 ceph-mon[130643]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:00.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:00.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:37:59 smithi153 ceph-mon[131657]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:00.566 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:38:00.751 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:38:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:38:00.694+0000 7f119f8fd640 -1 osd.4 0 log_to_monitors true 2023-10-26T06:38:01.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:01 smithi050 ceph-mon[94997]: from='osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-26T06:38:01.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:01 smithi050 ceph-mon[94997]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-26T06:38:01.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:01 smithi125 ceph-mon[130643]: from='osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-26T06:38:01.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:01 smithi125 ceph-mon[130643]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-26T06:38:01.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:01 smithi153 ceph-mon[131657]: from='osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-26T06:38:01.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:01 smithi153 ceph-mon[131657]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-26T06:38:02.121 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-26T06:38:02.123 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-26T06:38:02.123 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2023-10-26T06:38:02.123 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2023-10-26T06:38:02.123 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151674 s, 691 MB/s 2023-10-26T06:38:02.124 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2023-10-26T06:38:02.517 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2023-10-26T06:38:02.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:02 smithi153 ceph-mon[131657]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-26T06:38:02.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:02 smithi153 ceph-mon[131657]: osdmap e32: 5 total, 4 up, 5 in 2023-10-26T06:38:02.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:02 smithi153 ceph-mon[131657]: from='osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:38:02.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:02.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:02 smithi153 ceph-mon[131657]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:38:02.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:02 smithi153 ceph-mon[131657]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:02.938 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:38:02.523+0000 7f1194773700 -1 osd.4 0 waiting for initial osdmap 2023-10-26T06:38:02.939 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:38:02.532+0000 7f118fd67700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:38:02.940 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-mon[130643]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-26T06:38:02.940 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-mon[130643]: osdmap e32: 5 total, 4 up, 5 in 2023-10-26T06:38:02.940 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-mon[130643]: from='osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:38:02.940 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:02.941 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-mon[130643]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:38:02.941 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:02 smithi125 ceph-mon[130643]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:02 smithi050 ceph-mon[94997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-26T06:38:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:02 smithi050 ceph-mon[94997]: osdmap e32: 5 total, 4 up, 5 in 2023-10-26T06:38:03.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:02 smithi050 ceph-mon[94997]: from='osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:38:03.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:03.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:02 smithi050 ceph-mon[94997]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:38:03.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:02 smithi050 ceph-mon[94997]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:03.078 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:38:03.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:38:03.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: osdmap e33: 5 total, 4 up, 5 in 2023-10-26T06:38:03.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:03.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:03.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi125 2023-10-26T06:38:03.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:03.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:03.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi125 to 8584M 2023-10-26T06:38:03.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:03.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:03.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:03.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:03.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:03.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:38:03.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: osdmap e33: 5 total, 4 up, 5 in 2023-10-26T06:38:03.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:03.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:03.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi125 2023-10-26T06:38:03.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:03.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:03.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi125 to 8584M 2023-10-26T06:38:03.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:03.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:03.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:03.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:03.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:03.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:03.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:04.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:38:04.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: osdmap e33: 5 total, 4 up, 5 in 2023-10-26T06:38:04.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:04.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:04.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi125 2023-10-26T06:38:04.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:04.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:04.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:04.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:04.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi125 to 8584M 2023-10-26T06:38:04.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:04.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:04.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:04.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:04.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:04.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:04.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:04.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:04.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 -- 172.21.15.153:0/2866277709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 msgr2=0x7f39fc104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:04.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 --2- 172.21.15.153:0/2866277709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc104b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009990 tx=0x7f39f0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:38:04.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 -- 172.21.15.153:0/2866277709 shutdown_connections 2023-10-26T06:38:04.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 --2- 172.21.15.153:0/2866277709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39fc100c60 0x7f39fc10c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:04.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 --2- 172.21.15.153:0/2866277709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc104b00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:04.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 --2- 172.21.15.153:0/2866277709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 0x7f39fc100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:04.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.262+0000 7f3a03067700 1 -- 172.21.15.153:0/2866277709 >> 172.21.15.153:0/2866277709 conn(0x7f39fc074a10 msgr2=0x7f39fc074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:38:04.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 -- 172.21.15.153:0/2866277709 shutdown_connections 2023-10-26T06:38:04.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 -- 172.21.15.153:0/2866277709 wait complete. 2023-10-26T06:38:04.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 Processor -- start 2023-10-26T06:38:04.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 -- start start 2023-10-26T06:38:04.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 0x7f39fc197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:04.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39fc100c60 0x7f39fc198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:04.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:04.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a2e60 con 0x7f39fc1002a0 2023-10-26T06:38:04.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a2fd0 con 0x7f39fc100c60 2023-10-26T06:38:04.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.263+0000 7f3a03067700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a3190 con 0x7f39fc104720 2023-10-26T06:38:04.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:04.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f39fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39fc100c60 0x7f39fc198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:04.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35734/0 (socket says 172.21.15.153:35734) 2023-10-26T06:38:04.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 -- 172.21.15.153:0/4188969271 learned_addr learned my addr 172.21.15.153:0/4188969271 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-26T06:38:04.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a00e03700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 0x7f39fc197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:04.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 -- 172.21.15.153:0/4188969271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39fc100c60 msgr2=0x7f39fc198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:04.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39fc100c60 0x7f39fc198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:04.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 -- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 msgr2=0x7f39fc197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:04.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 0x7f39fc197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:04.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 -- 172.21.15.153:0/4188969271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00095f0 con 0x7f39fc104720 2023-10-26T06:38:04.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a00e03700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 0x7f39fc197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:38:04.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a01604700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc198610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007ee0 tx=0x7f39f400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:38:04.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4017070 con 0x7f39fc104720 2023-10-26T06:38:04.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc1a3470 con 0x7f39fc104720 2023-10-26T06:38:04.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39f400f040 con 0x7f39fc104720 2023-10-26T06:38:04.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4005740 con 0x7f39fc104720 2023-10-26T06:38:04.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.264+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc1a3920 con 0x7f39fc104720 2023-10-26T06:38:04.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.266+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc067d10 con 0x7f39fc104720 2023-10-26T06:38:04.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.267+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f39f400dc60 con 0x7f39fc104720 2023-10-26T06:38:04.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.267+0000 7f39f9ffb700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f39ec0a1550 0x7f39ec0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:04.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.267+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f39f40cb690 con 0x7f39fc104720 2023-10-26T06:38:04.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.267+0000 7f3a00e03700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f39ec0a1550 0x7f39ec0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:04.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.268+0000 7f3a00e03700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f39ec0a1550 0x7f39ec0a3a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39f000b5c0 tx=0x7f39f0005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:38:04.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.271+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f39f4095bf0 con 0x7f39fc104720 2023-10-26T06:38:04.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:04.469+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f39fc0ff700 con 0x7f39ec0a1550 2023-10-26T06:38:04.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:38:04.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:38:04.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:04.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] boot 2023-10-26T06:38:04.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: osdmap e34: 5 total, 5 up, 5 in 2023-10-26T06:38:04.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:04.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:04.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:04.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:04.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:04.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:38:04.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:38:04.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:04.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] boot 2023-10-26T06:38:04.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: osdmap e34: 5 total, 5 up, 5 in 2023-10-26T06:38:04.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:04.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:04.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:04.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:04.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:05.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:38:05.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:38:05.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:05.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: osd.4 [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] boot 2023-10-26T06:38:05.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: osdmap e34: 5 total, 5 up, 5 in 2023-10-26T06:38:05.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-26T06:38:05.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-26T06:38:05.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:05.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:05.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:05.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:05 smithi153 ceph-mon[131657]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:05.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:05 smithi153 ceph-mon[131657]: osdmap e35: 5 total, 5 up, 5 in 2023-10-26T06:38:05.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:05 smithi125 ceph-mon[130643]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:05.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:05 smithi125 ceph-mon[130643]: osdmap e35: 5 total, 5 up, 5 in 2023-10-26T06:38:06.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:05 smithi050 ceph-mon[94997]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:06.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:05 smithi050 ceph-mon[94997]: osdmap e35: 5 total, 5 up, 5 in 2023-10-26T06:38:06.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:06 smithi125 ceph-mon[130643]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:06.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:06 smithi153 ceph-mon[131657]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:06 smithi050 ceph-mon[94997]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:07.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:07 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/4207341120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]: dispatch 2023-10-26T06:38:07.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:07 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]: dispatch 2023-10-26T06:38:07.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:07 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]': finished 2023-10-26T06:38:07.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:07 smithi125 ceph-mon[130643]: osdmap e36: 6 total, 5 up, 6 in 2023-10-26T06:38:07.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:07.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:07 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/453582584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:07.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:07 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/4207341120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]: dispatch 2023-10-26T06:38:07.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:07 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]: dispatch 2023-10-26T06:38:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:07 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]': finished 2023-10-26T06:38:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:07 smithi153 ceph-mon[131657]: osdmap e36: 6 total, 5 up, 6 in 2023-10-26T06:38:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:07 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/453582584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:08.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:07 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/4207341120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]: dispatch 2023-10-26T06:38:08.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:07 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]: dispatch 2023-10-26T06:38:08.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:07 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8da6ddc7-6f23-4f38-972e-57bac47dfd40"}]': finished 2023-10-26T06:38:08.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:07 smithi050 ceph-mon[94997]: osdmap e36: 6 total, 5 up, 6 in 2023-10-26T06:38:08.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:08.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:07 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/453582584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:08.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:08 smithi125 ceph-mon[130643]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:08.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:08 smithi153 ceph-mon[131657]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:08 smithi050 ceph-mon[94997]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:10.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:10 smithi125 ceph-mon[130643]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:10.957 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:10 smithi153 ceph-mon[131657]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:10 smithi050 ceph-mon[94997]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:12.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:12 smithi125 ceph-mon[130643]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:12.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:12 smithi153 ceph-mon[131657]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:12 smithi050 ceph-mon[94997]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:13 smithi125 ceph-mon[130643]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-26T06:38:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:13 smithi125 ceph-mon[130643]: Deploying daemon osd.5 on smithi153 2023-10-26T06:38:14.187 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:13 smithi153 ceph-mon[131657]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:14.187 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-26T06:38:14.188 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:14.188 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:13 smithi153 ceph-mon[131657]: Deploying daemon osd.5 on smithi153 2023-10-26T06:38:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:13 smithi050 ceph-mon[94997]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-26T06:38:14.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:14.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:13 smithi050 ceph-mon[94997]: Deploying daemon osd.5 on smithi153 2023-10-26T06:38:16.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:16 smithi125 ceph-mon[130643]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:16 smithi153 ceph-mon[131657]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:17.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:16 smithi050 ceph-mon[94997]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:18.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:18 smithi125 ceph-mon[130643]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:18.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:18.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:18.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:18.923 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:18 smithi153 ceph-mon[131657]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:18.923 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:18.924 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:18.924 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:18 smithi050 ceph-mon[94997]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:20.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.582+0000 7f39f9ffb700 1 -- 172.21.15.153:0/4188969271 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f39fc0ff700 con 0x7f39ec0a1550 2023-10-26T06:38:20.585 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2023-10-26T06:38:20.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f39ec0a1550 msgr2=0x7f39ec0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:20.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f39ec0a1550 0x7f39ec0a3a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39f000b5c0 tx=0x7f39f0005fd0 comp rx=0 tx=0).stop 2023-10-26T06:38:20.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 msgr2=0x7f39fc198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:20.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc198610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007ee0 tx=0x7f39f400d3b0 comp rx=0 tx=0).stop 2023-10-26T06:38:20.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 shutdown_connections 2023-10-26T06:38:20.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f39ec0a1550 0x7f39ec0a3a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:20.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc104720 0x7f39fc198610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:20.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39fc1002a0 0x7f39fc197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:20.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 --2- 172.21.15.153:0/4188969271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39fc100c60 0x7f39fc198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:20.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 >> 172.21.15.153:0/4188969271 conn(0x7f39fc074a10 msgr2=0x7f39fc0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:38:20.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 shutdown_connections 2023-10-26T06:38:20.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:38:20.585+0000 7f3a03067700 1 -- 172.21.15.153:0/4188969271 wait complete. 2023-10-26T06:38:20.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:20.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:20.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:20.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:20.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:20.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:20.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:20.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:21.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:21.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:21.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:21.066 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.5.service 2023-10-26T06:38:21.069 INFO:tasks.cephadm:Deploying osd.6 on smithi050 with /dev/vg_nvme/lv_2... 2023-10-26T06:38:21.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-26T06:38:21.103 INFO:journalctl@ceph.osd.5.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:38:21.827 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:38:22.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:38:21 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:38:21.885+0000 7f266c914640 -1 osd.5 0 log_to_monitors true 2023-10-26T06:38:22.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:22 smithi050 ceph-mon[94997]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:22.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:22 smithi050 ceph-mon[94997]: from='osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-26T06:38:22.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:22 smithi050 ceph-mon[94997]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-26T06:38:22.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:22 smithi125 ceph-mon[130643]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:22.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:22 smithi125 ceph-mon[130643]: from='osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-26T06:38:22.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:22 smithi125 ceph-mon[130643]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-26T06:38:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:22 smithi153 ceph-mon[131657]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:22 smithi153 ceph-mon[131657]: from='osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-26T06:38:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:22 smithi153 ceph-mon[131657]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-26T06:38:23.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-26T06:38:23.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: osdmap e37: 6 total, 5 up, 6 in 2023-10-26T06:38:23.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:23.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:38:23.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:38:23.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:23.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:23.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:23.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:23.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.984 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:38:23.665+0000 7f266178a700 -1 osd.5 0 waiting for initial osdmap 2023-10-26T06:38:23.985 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:38:23.674+0000 7f265dd80700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:38:23.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-26T06:38:23.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: osdmap e37: 6 total, 5 up, 6 in 2023-10-26T06:38:23.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:23.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:38:23.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:38:23.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:23.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:23.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:23.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:23.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-26T06:38:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-26T06:38:23.994 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-10-26T06:38:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-10-26T06:38:23.994 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0406114 s, 258 MB/s 2023-10-26T06:38:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-10-26T06:38:24.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-26T06:38:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: osdmap e37: 6 total, 5 up, 6 in 2023-10-26T06:38:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:38:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:38:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:24.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:24.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:24.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:24.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:24.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:24.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:24.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:24.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2023-10-26T06:38:24.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi153 2023-10-26T06:38:24.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi153 to 8584M 2023-10-26T06:38:24.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:24.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:38:24.770 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: osdmap e38: 6 total, 5 up, 6 in 2023-10-26T06:38:24.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:24.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:24.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi153 2023-10-26T06:38:24.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi153 to 8584M 2023-10-26T06:38:24.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:24.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:38:24.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: osdmap e38: 6 total, 5 up, 6 in 2023-10-26T06:38:24.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:24.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:24.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi153 2023-10-26T06:38:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi153 to 8584M 2023-10-26T06:38:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:38:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: osdmap e38: 6 total, 5 up, 6 in 2023-10-26T06:38:24.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:24.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:25.264 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:38:25.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:25 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:38:25.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:25 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:38:25.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:25 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:25.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:25 smithi125 ceph-mon[130643]: osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] boot 2023-10-26T06:38:25.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:25 smithi125 ceph-mon[130643]: osdmap e39: 6 total, 6 up, 6 in 2023-10-26T06:38:25.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:25 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:25.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:25 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:38:25.963 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:25 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:38:25.963 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:25 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:25.963 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:25 smithi050 ceph-mon[94997]: osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] boot 2023-10-26T06:38:25.963 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:25 smithi050 ceph-mon[94997]: osdmap e39: 6 total, 6 up, 6 in 2023-10-26T06:38:25.964 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:25 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:25.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:25 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:38:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:25 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:38:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:25 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:25.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:25 smithi153 ceph-mon[131657]: osd.5 [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] boot 2023-10-26T06:38:25.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:25 smithi153 ceph-mon[131657]: osdmap e39: 6 total, 6 up, 6 in 2023-10-26T06:38:25.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:25 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-26T06:38:26.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.887+0000 7f6d94ca3700 1 -- 172.21.15.50:0/1822636864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 msgr2=0x7f6d9010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.887+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/1822636864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d9010d650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800b0a0 tx=0x7f6d8800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:38:26.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 -- 172.21.15.50:0/1822636864 shutdown_connections 2023-10-26T06:38:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/1822636864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d9010d650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/1822636864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901057c0 0x7f6d90105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/1822636864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d901008a0 0x7f6d90100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 -- 172.21.15.50:0/1822636864 >> 172.21.15.50:0/1822636864 conn(0x7f6d900779e0 msgr2=0x7f6d90077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:38:26.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 -- 172.21.15.50:0/1822636864 shutdown_connections 2023-10-26T06:38:26.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.888+0000 7f6d94ca3700 1 -- 172.21.15.50:0/1822636864 wait complete. 2023-10-26T06:38:26.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 Processor -- start 2023-10-26T06:38:26.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 -- start start 2023-10-26T06:38:26.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901008a0 0x7f6d90072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:26.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d90073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:26.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d901057c0 0x7f6d90073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:26.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d901a5050 con 0x7f6d90101260 2023-10-26T06:38:26.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d901a51c0 con 0x7f6d901008a0 2023-10-26T06:38:26.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.889+0000 7f6d94ca3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d901a5380 con 0x7f6d901057c0 2023-10-26T06:38:26.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d90073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:26.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901008a0 0x7f6d90072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:26.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d90073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36550/0 (socket says 172.21.15.50:36550) 2023-10-26T06:38:26.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 -- 172.21.15.50:0/2863955118 learned_addr learned my addr 172.21.15.50:0/2863955118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:38:26.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8ed9d700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d901057c0 0x7f6d90073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:26.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 -- 172.21.15.50:0/2863955118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d901057c0 msgr2=0x7f6d90073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:26.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d901057c0 0x7f6d90073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 -- 172.21.15.50:0/2863955118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901008a0 msgr2=0x7f6d90072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901008a0 0x7f6d90072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 -- 172.21.15.50:0/2863955118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88009d00 con 0x7f6d90101260 2023-10-26T06:38:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8e59c700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901008a0 0x7f6d90072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:38:26.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.890+0000 7f6d8dd9b700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d90073030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400e9a0 tx=0x7f6d8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:38:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.891+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84009790 con 0x7f6d90101260 2023-10-26T06:38:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.891+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d84010430 con 0x7f6d90101260 2023-10-26T06:38:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.891+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84018680 con 0x7f6d90101260 2023-10-26T06:38:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.891+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d901a5660 con 0x7f6d90101260 2023-10-26T06:38:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.891+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d901a5b60 con 0x7f6d90101260 2023-10-26T06:38:26.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.892+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d90101f30 con 0x7f6d90101260 2023-10-26T06:38:26.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.894+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6d840105a0 con 0x7f6d90101260 2023-10-26T06:38:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.895+0000 7f6d7f7fe700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6d780a1550 0x7f6d780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.896+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4777+0+0 (secure 0 0 0) 0x7f6d84014070 con 0x7f6d90101260 2023-10-26T06:38:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.896+0000 7f6d8e59c700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6d780a1550 0x7f6d780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:26.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.896+0000 7f6d8e59c700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6d780a1550 0x7f6d780a3a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d90101930 tx=0x7f6d80009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:38:26.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:26.898+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6d840967b0 con 0x7f6d90101260 2023-10-26T06:38:26.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:26 smithi153 ceph-mon[131657]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:26.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:26 smithi153 ceph-mon[131657]: osdmap e40: 6 total, 6 up, 6 in 2023-10-26T06:38:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:26 smithi050 ceph-mon[94997]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:26 smithi050 ceph-mon[94997]: osdmap e40: 6 total, 6 up, 6 in 2023-10-26T06:38:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:27.118+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d90110780 con 0x7f6d780a1550 2023-10-26T06:38:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:26 smithi125 ceph-mon[130643]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-26T06:38:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:26 smithi125 ceph-mon[130643]: osdmap e40: 6 total, 6 up, 6 in 2023-10-26T06:38:27.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:27 smithi153 ceph-mon[131657]: osdmap e41: 6 total, 6 up, 6 in 2023-10-26T06:38:27.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:27.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:27.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:28.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:27 smithi050 ceph-mon[94997]: osdmap e41: 6 total, 6 up, 6 in 2023-10-26T06:38:28.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:28.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:28.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:28.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:27 smithi125 ceph-mon[130643]: osdmap e41: 6 total, 6 up, 6 in 2023-10-26T06:38:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:28.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:28 smithi050 ceph-mon[94997]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:28.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:28 smithi050 ceph-mon[94997]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:28.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:28 smithi050 ceph-mon[94997]: osdmap e42: 6 total, 6 up, 6 in 2023-10-26T06:38:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:28 smithi153 ceph-mon[131657]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:28 smithi153 ceph-mon[131657]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:28.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:28 smithi153 ceph-mon[131657]: osdmap e42: 6 total, 6 up, 6 in 2023-10-26T06:38:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:28 smithi125 ceph-mon[130643]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:28 smithi125 ceph-mon[130643]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:29.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:28 smithi125 ceph-mon[130643]: osdmap e42: 6 total, 6 up, 6 in 2023-10-26T06:38:29.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:29 smithi153 ceph-mon[131657]: osdmap e43: 6 total, 6 up, 6 in 2023-10-26T06:38:30.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:29 smithi050 ceph-mon[94997]: osdmap e43: 6 total, 6 up, 6 in 2023-10-26T06:38:30.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:29 smithi125 ceph-mon[130643]: osdmap e43: 6 total, 6 up, 6 in 2023-10-26T06:38:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:30 smithi153 ceph-mon[131657]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-26T06:38:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:30 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2802951097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]: dispatch 2023-10-26T06:38:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:30 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]: dispatch 2023-10-26T06:38:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:30 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]': finished 2023-10-26T06:38:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:30 smithi153 ceph-mon[131657]: osdmap e44: 7 total, 6 up, 7 in 2023-10-26T06:38:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:30 smithi050 ceph-mon[94997]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-26T06:38:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:30 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2802951097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]: dispatch 2023-10-26T06:38:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:30 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]: dispatch 2023-10-26T06:38:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:30 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]': finished 2023-10-26T06:38:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:30 smithi050 ceph-mon[94997]: osdmap e44: 7 total, 6 up, 7 in 2023-10-26T06:38:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:30 smithi125 ceph-mon[130643]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-26T06:38:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:30 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2802951097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]: dispatch 2023-10-26T06:38:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:30 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]: dispatch 2023-10-26T06:38:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:30 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6b0ab31-fd81-4000-945c-064c4d303b22"}]': finished 2023-10-26T06:38:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:30 smithi125 ceph-mon[130643]: osdmap e44: 7 total, 6 up, 7 in 2023-10-26T06:38:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:31.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:31 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3867551505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:32.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:31 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3867551505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:32.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:31 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3867551505' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:32 smithi153 ceph-mon[131657]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-10-26T06:38:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:32 smithi050 ceph-mon[94997]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-10-26T06:38:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:32 smithi125 ceph-mon[130643]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-10-26T06:38:34.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:33 smithi125 ceph-mon[130643]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:38:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:33 smithi153 ceph-mon[131657]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:38:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:33 smithi050 ceph-mon[94997]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:38:36.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:36 smithi050 ceph-mon[94997]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-26T06:38:36.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:36 smithi125 ceph-mon[130643]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-26T06:38:36.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:36 smithi153 ceph-mon[131657]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-26T06:38:38.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:38 smithi050 ceph-mon[94997]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-26T06:38:38.918 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-26T06:38:38.918 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:38.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:38 smithi125 ceph-mon[130643]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-26T06:38:38.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-26T06:38:38.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:38.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:38 smithi153 ceph-mon[131657]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-26T06:38:38.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-26T06:38:38.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:39.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:39 smithi125 ceph-mon[130643]: Deploying daemon osd.6 on smithi050 2023-10-26T06:38:39.984 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:39 smithi050 ceph-mon[94997]: Deploying daemon osd.6 on smithi050 2023-10-26T06:38:39.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:39 smithi153 ceph-mon[131657]: Deploying daemon osd.6 on smithi050 2023-10-26T06:38:40.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:40 smithi050 ceph-mon[94997]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:40.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:40 smithi125 ceph-mon[130643]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:40.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:40 smithi153 ceph-mon[131657]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:42.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:42 smithi125 ceph-mon[130643]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:42.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:42 smithi050 ceph-mon[94997]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:42.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:42 smithi153 ceph-mon[131657]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:44.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:43 smithi050 ceph-mon[94997]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:44.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:43 smithi125 ceph-mon[130643]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:43 smithi153 ceph-mon[131657]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:45.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:45 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:45.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:45 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:45.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:45 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:45.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:45 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:45.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:45 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:45.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:45 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:45.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:45 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:45.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:45 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:45.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:45 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:46.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:46 smithi050 ceph-mon[94997]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:46.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:46 smithi153 ceph-mon[131657]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:46.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:46 smithi125 ceph-mon[130643]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.632+0000 7f6d7f7fe700 1 -- 172.21.15.50:0/2863955118 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6d90110780 con 0x7f6d780a1550 2023-10-26T06:38:47.635 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 6 on host 'smithi050' 2023-10-26T06:38:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6d780a1550 msgr2=0x7f6d780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6d780a1550 0x7f6d780a3a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d90101930 tx=0x7f6d80009260 comp rx=0 tx=0).stop 2023-10-26T06:38:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 msgr2=0x7f6d90073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d90073030 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400e9a0 tx=0x7f6d8400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:38:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 shutdown_connections 2023-10-26T06:38:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6d780a1550 0x7f6d780a3a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d901057c0 0x7f6d90073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d901008a0 0x7f6d90072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 --2- 172.21.15.50:0/2863955118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d90101260 0x7f6d90073030 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 >> 172.21.15.50:0/2863955118 conn(0x7f6d900779e0 msgr2=0x7f6d900fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:38:47.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 shutdown_connections 2023-10-26T06:38:47.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:38:47.635+0000 7f6d94ca3700 1 -- 172.21.15.50:0/2863955118 wait complete. 2023-10-26T06:38:48.093 DEBUG:teuthology.orchestra.run.smithi050:osd.6> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.6.service 2023-10-26T06:38:48.099 INFO:tasks.cephadm:Deploying osd.7 on smithi125 with /dev/vg_nvme/lv_2... 2023-10-26T06:38:48.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-26T06:38:48.185 INFO:journalctl@ceph.osd.6.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:38:48.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:48.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:48.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:48.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:48.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:48.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:48.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:48.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:48.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:48.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:48.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:38:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:38:49.084 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:49 smithi050 ceph-mon[94997]: from='osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-26T06:38:49.084 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:49 smithi050 ceph-mon[94997]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-26T06:38:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:49 smithi125 ceph-mon[130643]: from='osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-26T06:38:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:49 smithi125 ceph-mon[130643]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-26T06:38:49.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:49 smithi153 ceph-mon[131657]: from='osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-26T06:38:49.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:49 smithi153 ceph-mon[131657]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-26T06:38:50.280 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-26T06:38:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-26T06:38:50.281 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2023-10-26T06:38:50.281 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2023-10-26T06:38:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0158129 s, 663 MB/s 2023-10-26T06:38:50.282 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2023-10-26T06:38:50.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:50 smithi125 ceph-mon[130643]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-26T06:38:50.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:50 smithi125 ceph-mon[130643]: osdmap e45: 7 total, 6 up, 7 in 2023-10-26T06:38:50.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:50 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:50.326 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:50 smithi125 ceph-mon[130643]: from='osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:38:50.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:50 smithi125 ceph-mon[130643]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:38:50.327 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:50 smithi125 ceph-mon[130643]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:50.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:50 smithi153 ceph-mon[131657]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-26T06:38:50.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:50 smithi153 ceph-mon[131657]: osdmap e45: 7 total, 6 up, 7 in 2023-10-26T06:38:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:50 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:50 smithi153 ceph-mon[131657]: from='osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:38:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:50 smithi153 ceph-mon[131657]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:38:50.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:50 smithi153 ceph-mon[131657]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:50.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-mon[94997]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-26T06:38:50.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-mon[94997]: osdmap e45: 7 total, 6 up, 7 in 2023-10-26T06:38:50.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:50.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-mon[94997]: from='osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:38:50.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-mon[94997]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:38:50.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-mon[94997]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-26T06:38:50.519 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:38:50.047+0000 7f64cb32e700 -1 osd.6 0 waiting for initial osdmap 2023-10-26T06:38:50.519 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:38:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:38:50.059+0000 7f64c5920700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:38:50.633 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi125:vg_nvme/lv_2 2023-10-26T06:38:51.191 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:38:51.401 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:51 smithi050 ceph-mon[94997]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:38:51.402 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:51 smithi050 ceph-mon[94997]: osdmap e46: 7 total, 6 up, 7 in 2023-10-26T06:38:51.402 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:51 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:51.402 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:51 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:51.407 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:51 smithi125 ceph-mon[130643]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:38:51.407 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:51 smithi125 ceph-mon[130643]: osdmap e46: 7 total, 6 up, 7 in 2023-10-26T06:38:51.407 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:51 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:51.407 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:51 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:51.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:51 smithi153 ceph-mon[131657]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:38:51.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:51 smithi153 ceph-mon[131657]: osdmap e46: 7 total, 6 up, 7 in 2023-10-26T06:38:51.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:51 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:51.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:51 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:52.238 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:38:52.238 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:38:52.238 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] boot 2023-10-26T06:38:52.238 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: osdmap e47: 7 total, 7 up, 7 in 2023-10-26T06:38:52.239 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:52.239 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:52.239 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi050 2023-10-26T06:38:52.239 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.239 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.240 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.240 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.240 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.240 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi050 to 5758M 2023-10-26T06:38:52.240 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.241 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:52.241 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:52.241 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:52 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 -- 172.21.15.125:0/533431922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28068b30 msgr2=0x7efe2810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:52.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 --2- 172.21.15.125:0/533431922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28068b30 0x7efe2810d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe2000b0a0 tx=0x7efe2000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:38:52.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 -- 172.21.15.125:0/533431922 shutdown_connections 2023-10-26T06:38:52.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 --2- 172.21.15.125:0/533431922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe28068b30 0x7efe2810d690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:52.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 --2- 172.21.15.125:0/533431922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe281067c0 0x7efe28106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:52.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 --2- 172.21.15.125:0/533431922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe28068190 0x7efe280685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:52.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.415+0000 7efe2fda9700 1 -- 172.21.15.125:0/533431922 >> 172.21.15.125:0/533431922 conn(0x7efe28075790 msgr2=0x7efe28075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:38:52.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.416+0000 7efe2fda9700 1 -- 172.21.15.125:0/533431922 shutdown_connections 2023-10-26T06:38:52.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.416+0000 7efe2fda9700 1 -- 172.21.15.125:0/533431922 wait complete. 2023-10-26T06:38:52.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.416+0000 7efe2fda9700 1 Processor -- start 2023-10-26T06:38:52.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.416+0000 7efe2fda9700 1 -- start start 2023-10-26T06:38:52.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe28068190 0x7efe28196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:52.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe28068b30 0x7efe28197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:52.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 0x7efe2819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:52.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2819bce0 con 0x7efe28068b30 2023-10-26T06:38:52.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2819be50 con 0x7efe281067c0 2023-10-26T06:38:52.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2819c010 con 0x7efe28068190 2023-10-26T06:38:52.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 0x7efe2819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:52.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 0x7efe2819b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37716/0 (socket says 172.21.15.125:37716) 2023-10-26T06:38:52.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 -- 172.21.15.125:0/3727758048 learned_addr learned my addr 172.21.15.125:0/3727758048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-26T06:38:52.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2db45700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe28068190 0x7efe28196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:52.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 -- 172.21.15.125:0/3727758048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe28068190 msgr2=0x7efe28196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:52.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe28068190 0x7efe28196de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:52.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 -- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe28068b30 msgr2=0x7efe28197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:38:52.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe28068b30 0x7efe28197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:38:52.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 -- 172.21.15.125:0/3727758048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20009d00 con 0x7efe281067c0 2023-10-26T06:38:52.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2e346700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 0x7efe2819b6d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe2000b830 tx=0x7efe200077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:38:52.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000e040 con 0x7efe281067c0 2023-10-26T06:38:52.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe20004e60 con 0x7efe281067c0 2023-10-26T06:38:52.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2819c290 con 0x7efe281067c0 2023-10-26T06:38:52.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200053c0 con 0x7efe281067c0 2023-10-26T06:38:52.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.417+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe281a3b50 con 0x7efe281067c0 2023-10-26T06:38:52.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.418+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe28108dc0 con 0x7efe281067c0 2023-10-26T06:38:52.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.419+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efe2001b450 con 0x7efe281067c0 2023-10-26T06:38:52.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.420+0000 7efe1effd700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efe140a14d0 0x7efe140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:38:52.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.420+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5180+0+0 (secure 0 0 0) 0x7efe200ce140 con 0x7efe281067c0 2023-10-26T06:38:52.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.420+0000 7efe2db45700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efe140a14d0 0x7efe140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:38:52.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.421+0000 7efe2db45700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efe140a14d0 0x7efe140a3990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe18009a10 tx=0x7efe18009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:38:52.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.423+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe20098470 con 0x7efe281067c0 2023-10-26T06:38:52.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:38:52.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:38:52.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] boot 2023-10-26T06:38:52.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: osdmap e47: 7 total, 7 up, 7 in 2023-10-26T06:38:52.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:52.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:52.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi050 2023-10-26T06:38:52.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi050 to 5758M 2023-10-26T06:38:52.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:52.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:52.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:52 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:38:52.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:38:52.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: osd.6 [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] boot 2023-10-26T06:38:52.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: osdmap e47: 7 total, 7 up, 7 in 2023-10-26T06:38:52.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-26T06:38:52.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:52.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi050 2023-10-26T06:38:52.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:38:52.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi050 to 5758M 2023-10-26T06:38:52.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:52.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:38:52.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:52 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:38:52.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:38:52.619+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efe2804e530 con 0x7efe140a14d0 2023-10-26T06:38:53.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:53 smithi125 ceph-mon[130643]: osdmap e48: 7 total, 7 up, 7 in 2023-10-26T06:38:53.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:53 smithi125 ceph-mon[130643]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:53.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:53.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:53.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:53.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:53 smithi153 ceph-mon[131657]: osdmap e48: 7 total, 7 up, 7 in 2023-10-26T06:38:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:53 smithi153 ceph-mon[131657]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:53.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:53.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:53 smithi050 ceph-mon[94997]: osdmap e48: 7 total, 7 up, 7 in 2023-10-26T06:38:53.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:53 smithi050 ceph-mon[94997]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:38:53.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:38:53.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:38:53.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:38:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:54 smithi125 ceph-mon[130643]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:54 smithi153 ceph-mon[131657]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:54.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:54 smithi050 ceph-mon[94997]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:55 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/1621805050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]: dispatch 2023-10-26T06:38:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:55 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]: dispatch 2023-10-26T06:38:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:55 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]': finished 2023-10-26T06:38:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:55 smithi125 ceph-mon[130643]: osdmap e49: 8 total, 7 up, 8 in 2023-10-26T06:38:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:38:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:55 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/1621805050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]: dispatch 2023-10-26T06:38:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:55 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]: dispatch 2023-10-26T06:38:55.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:55 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]': finished 2023-10-26T06:38:55.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:55 smithi153 ceph-mon[131657]: osdmap e49: 8 total, 7 up, 8 in 2023-10-26T06:38:55.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:38:55.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:55 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/1621805050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]: dispatch 2023-10-26T06:38:55.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:55 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]: dispatch 2023-10-26T06:38:55.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:55 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7657f951-0ca2-4e41-adfd-ff76ea7c65eb"}]': finished 2023-10-26T06:38:55.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:55 smithi050 ceph-mon[94997]: osdmap e49: 8 total, 7 up, 8 in 2023-10-26T06:38:55.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:38:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:56 smithi125 ceph-mon[130643]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:56.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:56 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/961791514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:56.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:56 smithi153 ceph-mon[131657]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:56.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:56 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/961791514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:56.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:56 smithi050 ceph-mon[94997]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:56.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:56 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/961791514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:38:58.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:38:58 smithi125 ceph-mon[130643]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:38:58 smithi153 ceph-mon[131657]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:38:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:38:58 smithi050 ceph-mon[94997]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:00.914 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:00 smithi125 ceph-mon[130643]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:00.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:00 smithi153 ceph-mon[131657]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:01.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:00 smithi050 ceph-mon[94997]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:01.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-26T06:39:01.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:01.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-26T06:39:01.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:02.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-26T06:39:02.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:02.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:02 smithi125 ceph-mon[130643]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:02.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:02 smithi125 ceph-mon[130643]: Deploying daemon osd.7 on smithi125 2023-10-26T06:39:02.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:02 smithi153 ceph-mon[131657]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:02.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:02 smithi153 ceph-mon[131657]: Deploying daemon osd.7 on smithi125 2023-10-26T06:39:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:02 smithi050 ceph-mon[94997]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:02 smithi050 ceph-mon[94997]: Deploying daemon osd.7 on smithi125 2023-10-26T06:39:04.042 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:03 smithi125 ceph-mon[130643]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:03 smithi153 ceph-mon[131657]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:03 smithi050 ceph-mon[94997]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:06.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:06 smithi125 ceph-mon[130643]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:06.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:06.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:06.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:06.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:06 smithi153 ceph-mon[131657]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:06.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:06.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:06.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:06 smithi050 ceph-mon[94997]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:07.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:07.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:07.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.434+0000 7efe1effd700 1 -- 172.21.15.125:0/3727758048 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efe2804e530 con 0x7efe140a14d0 2023-10-26T06:39:08.437 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 7 on host 'smithi125' 2023-10-26T06:39:08.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.436+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efe140a14d0 msgr2=0x7efe140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:08.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.436+0000 7efe2fda9700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efe140a14d0 0x7efe140a3990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe18009a10 tx=0x7efe18009190 comp rx=0 tx=0).stop 2023-10-26T06:39:08.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 msgr2=0x7efe2819b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:08.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 0x7efe2819b6d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe2000b830 tx=0x7efe200077f0 comp rx=0 tx=0).stop 2023-10-26T06:39:08.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 shutdown_connections 2023-10-26T06:39:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efe140a14d0 0x7efe140a3990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe281067c0 0x7efe2819b6d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe28068190 0x7efe28196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 --2- 172.21.15.125:0/3727758048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe28068b30 0x7efe28197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 >> 172.21.15.125:0/3727758048 conn(0x7efe28075790 msgr2=0x7efe280fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:39:08.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 shutdown_connections 2023-10-26T06:39:08.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:39:08.437+0000 7efe2fda9700 1 -- 172.21.15.125:0/3727758048 wait complete. 2023-10-26T06:39:08.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:08 smithi125 ceph-mon[130643]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:08 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.872 DEBUG:teuthology.orchestra.run.smithi125:osd.7> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.7.service 2023-10-26T06:39:08.874 INFO:tasks.cephadm:Deploying osd.8 on smithi153 with /dev/vg_nvme/lv_2... 2023-10-26T06:39:08.874 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-26T06:39:08.902 INFO:journalctl@ceph.osd.7.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:39:08.907 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:08 smithi153 ceph-mon[131657]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:08.907 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.907 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.907 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:08.908 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:08 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:08 smithi050 ceph-mon[94997]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:09.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:08 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:09.448 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:39:09.906 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:39:09 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:39:09.824+0000 7f52940f0640 -1 osd.7 0 log_to_monitors true 2023-10-26T06:39:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:10 smithi125 ceph-mon[130643]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:10 smithi125 ceph-mon[130643]: from='osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-26T06:39:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:10 smithi125 ceph-mon[130643]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-26T06:39:10.937 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-26T06:39:10.937 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-26T06:39:10.938 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2023-10-26T06:39:10.938 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2023-10-26T06:39:10.938 INFO:teuthology.orchestra.run.smithi153.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110774 s, 947 MB/s 2023-10-26T06:39:10.938 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 2023-10-26T06:39:10.938 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2023-10-26T06:39:10.972 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:10 smithi153 ceph-mon[131657]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:10.972 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:10 smithi153 ceph-mon[131657]: from='osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-26T06:39:10.972 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:10 smithi153 ceph-mon[131657]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-26T06:39:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:10 smithi050 ceph-mon[94997]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:10 smithi050 ceph-mon[94997]: from='osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-26T06:39:11.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:10 smithi050 ceph-mon[94997]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-26T06:39:11.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2023-10-26T06:39:11.893 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:39:11.922 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:39:11.659+0000 7f5288f66700 -1 osd.7 0 waiting for initial osdmap 2023-10-26T06:39:11.922 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:39:11.670+0000 7f5281d55700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:39:11.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-26T06:39:11.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: from='osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:39:11.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: osdmap e50: 8 total, 7 up, 8 in 2023-10-26T06:39:11.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:11.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:39:11.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:39:11.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: osdmap e51: 8 total, 7 up, 8 in 2023-10-26T06:39:11.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:11 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:11.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-26T06:39:11.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: from='osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:39:11.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: osdmap e50: 8 total, 7 up, 8 in 2023-10-26T06:39:11.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:11.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:39:11.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:39:11.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: osdmap e51: 8 total, 7 up, 8 in 2023-10-26T06:39:11.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:11 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:12.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-26T06:39:12.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: from='osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:39:12.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: osdmap e50: 8 total, 7 up, 8 in 2023-10-26T06:39:12.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:12.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:39:12.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:39:12.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: osdmap e51: 8 total, 7 up, 8 in 2023-10-26T06:39:12.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:11 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:12.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:12.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:12.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:12.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:12.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:12.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:12.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:12.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:12.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:12.950 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:12.951 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:12.951 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.951 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.951 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:12.952 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:12.952 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:12.952 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.953 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:12.953 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:12.953 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.953 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:12.954 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:12.954 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:12.954 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:12.955 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:13.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:13.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:13.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:13.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:13.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:13.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:13.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:13.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:13.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:13.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:13.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:13.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:13.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 -- 172.21.15.153:0/1809347188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a41056b0 msgr2=0x7fb8a4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 --2- 172.21.15.153:0/1809347188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a41056b0 0x7fb8a4105a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb894009990 tx=0x7fb894009ca0 comp rx=0 tx=0).stop 2023-10-26T06:39:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 -- 172.21.15.153:0/1809347188 shutdown_connections 2023-10-26T06:39:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 --2- 172.21.15.153:0/1809347188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8a4100110 0x7fb8a410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:13.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 --2- 172.21.15.153:0/1809347188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a41056b0 0x7fb8a4105a90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 --2- 172.21.15.153:0/1809347188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8a40ff750 0x7fb8a40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 -- 172.21.15.153:0/1809347188 >> 172.21.15.153:0/1809347188 conn(0x7fb8a4075790 msgr2=0x7fb8a4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:39:13.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 -- 172.21.15.153:0/1809347188 shutdown_connections 2023-10-26T06:39:13.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.084+0000 7fb8ac127700 1 -- 172.21.15.153:0/1809347188 wait complete. 2023-10-26T06:39:13.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 Processor -- start 2023-10-26T06:39:13.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 -- start start 2023-10-26T06:39:13.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8a40ff750 0x7fb8a419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:13.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 0x7fb8a419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:13.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8a41056b0 0x7fb8a4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:13.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4197080 con 0x7fb8a40ff750 2023-10-26T06:39:13.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41971f0 con 0x7fb8a41056b0 2023-10-26T06:39:13.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8ac127700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41973b0 con 0x7fb8a4100110 2023-10-26T06:39:13.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 0x7fb8a419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:13.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 0x7fb8a419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35854/0 (socket says 172.21.15.153:35854) 2023-10-26T06:39:13.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 -- 172.21.15.153:0/2168522908 learned_addr learned my addr 172.21.15.153:0/2168522908 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-26T06:39:13.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8aa6c4700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8a41056b0 0x7fb8a4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:13.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a9ec3700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8a40ff750 0x7fb8a419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:13.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 -- 172.21.15.153:0/2168522908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8a41056b0 msgr2=0x7fb8a4196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:13.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8a41056b0 0x7fb8a4196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:13.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 -- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8a40ff750 msgr2=0x7fb8a419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:13.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8a40ff750 0x7fb8a419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:13.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.085+0000 7fb8a96c2700 1 -- 172.21.15.153:0/2168522908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940095f0 con 0x7fb8a4100110 2023-10-26T06:39:13.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.086+0000 7fb8a96c2700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 0x7fb8a419ce20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000d950 tx=0x7fb8a000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:39:13.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.086+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0009940 con 0x7fb8a4100110 2023-10-26T06:39:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.086+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8a0010460 con 0x7fb8a4100110 2023-10-26T06:39:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.086+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a4197690 con 0x7fb8a4100110 2023-10-26T06:39:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.086+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000f620 con 0x7fb8a4100110 2023-10-26T06:39:13.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.086+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a4101380 con 0x7fb8a4100110 2023-10-26T06:39:13.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.087+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a4108cc0 con 0x7fb8a4100110 2023-10-26T06:39:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.088+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb8a00108d0 con 0x7fb8a4100110 2023-10-26T06:39:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.088+0000 7fb89affd700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8900a1550 0x7fb8900a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.088+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5641+0+0 (secure 0 0 0) 0x7fb8a00cc0c0 con 0x7fb8a4100110 2023-10-26T06:39:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.089+0000 7fb8a9ec3700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8900a1550 0x7fb8900a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:13.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.089+0000 7fb8a9ec3700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8900a1550 0x7fb8900a3a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb894005850 tx=0x7fb89401a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:39:13.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.093+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb8a0096190 con 0x7fb8a4100110 2023-10-26T06:39:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:13.288+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8a4197ee0 con 0x7fb8900a1550 2023-10-26T06:39:13.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:39:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:39:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi125 2023-10-26T06:39:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi125 to 5722M 2023-10-26T06:39:13.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] boot 2023-10-26T06:39:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: osdmap e52: 8 total, 8 up, 8 in 2023-10-26T06:39:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: osdmap e53: 8 total, 8 up, 8 in 2023-10-26T06:39:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:39:13.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:39:13.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:13 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:14.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:39:14.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:39:14.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi125 2023-10-26T06:39:14.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi125 to 5722M 2023-10-26T06:39:14.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] boot 2023-10-26T06:39:14.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: osdmap e52: 8 total, 8 up, 8 in 2023-10-26T06:39:14.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:14.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: osdmap e53: 8 total, 8 up, 8 in 2023-10-26T06:39:14.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:39:14.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:39:14.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:13 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:39:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:39:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi125 2023-10-26T06:39:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi125 to 5722M 2023-10-26T06:39:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: osd.7 [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] boot 2023-10-26T06:39:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: osdmap e52: 8 total, 8 up, 8 in 2023-10-26T06:39:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-26T06:39:14.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: osdmap e53: 8 total, 8 up, 8 in 2023-10-26T06:39:14.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:39:14.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:39:14.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:13 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:14.938 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:14 smithi153 ceph-mon[131657]: from='client.24478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:39:14.938 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:14 smithi153 ceph-mon[131657]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:14.938 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:14 smithi153 ceph-mon[131657]: osdmap e54: 8 total, 8 up, 8 in 2023-10-26T06:39:15.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:14 smithi050 ceph-mon[94997]: from='client.24478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:39:15.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:14 smithi050 ceph-mon[94997]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:15.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:14 smithi050 ceph-mon[94997]: osdmap e54: 8 total, 8 up, 8 in 2023-10-26T06:39:15.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:14 smithi125 ceph-mon[130643]: from='client.24478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:39:15.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:14 smithi125 ceph-mon[130643]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-26T06:39:15.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:14 smithi125 ceph-mon[130643]: osdmap e54: 8 total, 8 up, 8 in 2023-10-26T06:39:16.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: osdmap e55: 8 total, 8 up, 8 in 2023-10-26T06:39:16.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:16.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/4134922041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]: dispatch 2023-10-26T06:39:16.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]: dispatch 2023-10-26T06:39:16.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]': finished 2023-10-26T06:39:16.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: osdmap e56: 9 total, 8 up, 9 in 2023-10-26T06:39:16.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:15 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:16.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: osdmap e55: 8 total, 8 up, 8 in 2023-10-26T06:39:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/4134922041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]: dispatch 2023-10-26T06:39:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]: dispatch 2023-10-26T06:39:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]': finished 2023-10-26T06:39:16.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: osdmap e56: 9 total, 8 up, 9 in 2023-10-26T06:39:16.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:15 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: osdmap e55: 8 total, 8 up, 8 in 2023-10-26T06:39:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:16.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/4134922041' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]: dispatch 2023-10-26T06:39:16.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]: dispatch 2023-10-26T06:39:16.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "863809b1-9944-4b1a-8e37-a8c0ce125f5c"}]': finished 2023-10-26T06:39:16.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: osdmap e56: 9 total, 8 up, 9 in 2023-10-26T06:39:16.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:15 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:16 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/3647827768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:39:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:16 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/3647827768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:39:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:16 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/3647827768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:39:18.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:17 smithi125 ceph-mon[130643]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:18.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:17 smithi153 ceph-mon[131657]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:17 smithi050 ceph-mon[94997]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:20.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:20 smithi125 ceph-mon[130643]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:20.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:20 smithi153 ceph-mon[131657]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:20 smithi050 ceph-mon[94997]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:22.909 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:22 smithi153 ceph-mon[131657]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:22.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-26T06:39:22.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:22.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:22 smithi125 ceph-mon[130643]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:22.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-26T06:39:22.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:22 smithi050 ceph-mon[94997]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-26T06:39:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:23.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:23 smithi125 ceph-mon[130643]: Deploying daemon osd.8 on smithi153 2023-10-26T06:39:23.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:23 smithi153 ceph-mon[131657]: Deploying daemon osd.8 on smithi153 2023-10-26T06:39:24.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:23 smithi050 ceph-mon[94997]: Deploying daemon osd.8 on smithi153 2023-10-26T06:39:24.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:24 smithi153 ceph-mon[131657]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:24.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:24 smithi125 ceph-mon[130643]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:24 smithi050 ceph-mon[94997]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:26.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:26 smithi125 ceph-mon[130643]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:26.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:26 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:26.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:26 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:26.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:26 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:26.946 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:26 smithi153 ceph-mon[131657]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:26.946 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:26 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:26.947 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:26 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:26.947 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:26 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:26 smithi050 ceph-mon[94997]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:26 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:27.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:26 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:27.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:26 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:28.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:28 smithi125 ceph-mon[130643]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:28 smithi153 ceph-mon[131657]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:29.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:28 smithi050 ceph-mon[94997]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:29.105 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 8 on host 'smithi153' 2023-10-26T06:39:29.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.103+0000 7fb89affd700 1 -- 172.21.15.153:0/2168522908 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb8a4197ee0 con 0x7fb8900a1550 2023-10-26T06:39:29.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8900a1550 msgr2=0x7fb8900a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:29.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8900a1550 0x7fb8900a3a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb894005850 tx=0x7fb89401a040 comp rx=0 tx=0).stop 2023-10-26T06:39:29.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 msgr2=0x7fb8a419ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:29.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 0x7fb8a419ce20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000d950 tx=0x7fb8a000dc60 comp rx=0 tx=0).stop 2023-10-26T06:39:29.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 shutdown_connections 2023-10-26T06:39:29.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8900a1550 0x7fb8900a3a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:29.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb8a41056b0 0x7fb8a4196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:29.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8a40ff750 0x7fb8a419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:29.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.105+0000 7fb8ac127700 1 --2- 172.21.15.153:0/2168522908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8a4100110 0x7fb8a419ce20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:29.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.106+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 >> 172.21.15.153:0/2168522908 conn(0x7fb8a4075790 msgr2=0x7fb8a40684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:39:29.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.106+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 shutdown_connections 2023-10-26T06:39:29.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:39:29.106+0000 7fb8ac127700 1 -- 172.21.15.153:0/2168522908 wait complete. 2023-10-26T06:39:29.481 DEBUG:teuthology.orchestra.run.smithi153:osd.8> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.8.service 2023-10-26T06:39:29.483 INFO:tasks.cephadm:Deploying osd.9 on smithi050 with /dev/vg_nvme/lv_1... 2023-10-26T06:39:29.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-26T06:39:29.513 INFO:journalctl@ceph.osd.8.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:39:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:39:30.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:30 smithi153 ceph-mon[131657]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:30.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:30 smithi125 ceph-mon[130643]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:30.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.503 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:30.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:30 smithi050 ceph-mon[94997]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:30.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:39:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:39:30.504+0000 7fd56cd3d640 -1 osd.8 0 log_to_monitors true 2023-10-26T06:39:31.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:31 smithi153 ceph-mon[131657]: from='osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-26T06:39:31.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:31 smithi153 ceph-mon[131657]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-26T06:39:31.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:31 smithi050 ceph-mon[94997]: from='osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-26T06:39:31.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:31 smithi050 ceph-mon[94997]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-26T06:39:31.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:31 smithi125 ceph-mon[130643]: from='osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-26T06:39:31.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:31 smithi125 ceph-mon[130643]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-26T06:39:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-26T06:39:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-26T06:39:32.483 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10+0 records in 2023-10-26T06:39:32.483 INFO:teuthology.orchestra.run.smithi050.stderr:10+0 records out 2023-10-26T06:39:32.484 INFO:teuthology.orchestra.run.smithi050.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0322376 s, 325 MB/s 2023-10-26T06:39:32.484 INFO:teuthology.orchestra.run.smithi050.stderr:--> Zapping successful for: 2023-10-26T06:39:32.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:39:32.198+0000 7fd561bb3700 -1 osd.8 0 waiting for initial osdmap 2023-10-26T06:39:32.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:39:32.212+0000 7fd55a1a1700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:39:32.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-mon[131657]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-26T06:39:32.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-mon[131657]: osdmap e57: 9 total, 8 up, 9 in 2023-10-26T06:39:32.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:32.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-mon[131657]: from='osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:39:32.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-mon[131657]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:39:32.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:32 smithi153 ceph-mon[131657]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:32.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:32 smithi050 ceph-mon[94997]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-26T06:39:32.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:32 smithi050 ceph-mon[94997]: osdmap e57: 9 total, 8 up, 9 in 2023-10-26T06:39:32.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:32.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:32 smithi050 ceph-mon[94997]: from='osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:39:32.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:32 smithi050 ceph-mon[94997]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:39:32.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:32 smithi050 ceph-mon[94997]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:32.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:32 smithi125 ceph-mon[130643]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-26T06:39:32.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:32 smithi125 ceph-mon[130643]: osdmap e57: 9 total, 8 up, 9 in 2023-10-26T06:39:32.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:32.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:32 smithi125 ceph-mon[130643]: from='osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:39:32.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:32 smithi125 ceph-mon[130643]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:39:32.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:32 smithi125 ceph-mon[130643]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-26T06:39:33.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2023-10-26T06:39:33.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:39:33.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: osdmap e58: 9 total, 8 up, 9 in 2023-10-26T06:39:33.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi153 2023-10-26T06:39:33.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi153 to 5722M 2023-10-26T06:39:33.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:33.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:33.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:33.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:33.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:33.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] boot 2023-10-26T06:39:33.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: osdmap e59: 9 total, 9 up, 9 in 2023-10-26T06:39:33.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:39:33.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: osdmap e58: 9 total, 8 up, 9 in 2023-10-26T06:39:33.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi153 2023-10-26T06:39:33.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi153 to 5722M 2023-10-26T06:39:33.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:33.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:33.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:33.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:33.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:33.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] boot 2023-10-26T06:39:33.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: osdmap e59: 9 total, 9 up, 9 in 2023-10-26T06:39:33.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:39:33.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: osdmap e58: 9 total, 8 up, 9 in 2023-10-26T06:39:33.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi153 2023-10-26T06:39:33.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:39:33.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi153 to 5722M 2023-10-26T06:39:33.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:33.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:33.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:33.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:33.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:33.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:33.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: osd.8 [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] boot 2023-10-26T06:39:33.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: osdmap e59: 9 total, 9 up, 9 in 2023-10-26T06:39:33.679 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-26T06:39:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:39:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:34 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:39:34.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:34 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:39:34.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:34 smithi153 ceph-mon[131657]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:34.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:34 smithi153 ceph-mon[131657]: osdmap e60: 9 total, 9 up, 9 in 2023-10-26T06:39:34.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:34 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:39:34.504 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:34 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:39:34.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:34 smithi050 ceph-mon[94997]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:34.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:34 smithi050 ceph-mon[94997]: osdmap e60: 9 total, 9 up, 9 in 2023-10-26T06:39:34.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:34 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:39:34.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:34 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:39:34.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:34 smithi125 ceph-mon[130643]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:34.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:34 smithi125 ceph-mon[130643]: osdmap e60: 9 total, 9 up, 9 in 2023-10-26T06:39:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 -- 172.21.15.50:0/2649159181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 msgr2=0x7ff798100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 --2- 172.21.15.50:0/2649159181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff798100d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff788009990 tx=0x7ff788009ca0 comp rx=0 tx=0).stop 2023-10-26T06:39:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 -- 172.21.15.50:0/2649159181 shutdown_connections 2023-10-26T06:39:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 --2- 172.21.15.50:0/2649159181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff798101260 0x7ff79810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 --2- 172.21.15.50:0/2649159181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 0x7ff798105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 --2- 172.21.15.50:0/2649159181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff798100d20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 -- 172.21.15.50:0/2649159181 >> 172.21.15.50:0/2649159181 conn(0x7ff7980779e0 msgr2=0x7ff798077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:39:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 -- 172.21.15.50:0/2649159181 shutdown_connections 2023-10-26T06:39:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.571+0000 7ff79f936700 1 -- 172.21.15.50:0/2649159181 wait complete. 2023-10-26T06:39:35.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 Processor -- start 2023-10-26T06:39:35.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 -- start start 2023-10-26T06:39:35.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff79819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:35.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff798101260 0x7ff79819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:35.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 0x7ff798196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:35.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798197140 con 0x7ff7981008a0 2023-10-26T06:39:35.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7981972b0 con 0x7ff798101260 2023-10-26T06:39:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.572+0000 7ff79f936700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798197470 con 0x7ff7981057c0 2023-10-26T06:39:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff79819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff79819c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39950/0 (socket says 172.21.15.50:39950) 2023-10-26T06:39:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 -- 172.21.15.50:0/416132527 learned_addr learned my addr 172.21.15.50:0/416132527 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:39:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79ced1700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff798101260 0x7ff79819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:35.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79ded3700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 0x7ff798196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:35.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 -- 172.21.15.50:0/416132527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 msgr2=0x7ff798196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:35.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 0x7ff798196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:35.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 -- 172.21.15.50:0/416132527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff798101260 msgr2=0x7ff79819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:35.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff798101260 0x7ff79819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:35.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 -- 172.21.15.50:0/416132527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009c40 con 0x7ff7981008a0 2023-10-26T06:39:35.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79ded3700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 0x7ff798196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:39:35.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.573+0000 7ff79d6d2700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff79819c950 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff79400e970 tx=0x7ff79400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:39:35.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.574+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794009790 con 0x7ff7981008a0 2023-10-26T06:39:35.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.574+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff79400eec0 con 0x7ff7981008a0 2023-10-26T06:39:35.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.574+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794003cf0 con 0x7ff7981008a0 2023-10-26T06:39:35.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.574+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7880095f0 con 0x7ff7981008a0 2023-10-26T06:39:35.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.574+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7981a3770 con 0x7ff7981008a0 2023-10-26T06:39:35.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.575+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798108da0 con 0x7ff7981008a0 2023-10-26T06:39:35.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.577+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff79400ccd0 con 0x7ff7981008a0 2023-10-26T06:39:35.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.579+0000 7ff78e7fc700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a14d0 0x7ff7840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:39:35.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.579+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff794014070 con 0x7ff7981008a0 2023-10-26T06:39:35.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.579+0000 7ff79ced1700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a14d0 0x7ff7840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:39:35.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.580+0000 7ff79ced1700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a14d0 0x7ff7840a3990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff798197c50 tx=0x7ff78800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:39:35.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.581+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff794096780 con 0x7ff7981008a0 2023-10-26T06:39:35.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:35.805+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff798197f50 con 0x7ff7840a14d0 2023-10-26T06:39:36.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:35 smithi125 ceph-mon[130643]: osdmap e61: 9 total, 9 up, 9 in 2023-10-26T06:39:36.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:35 smithi125 ceph-mon[130643]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:36.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:35 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:39:36.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:35 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:39:36.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:35 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:35 smithi153 ceph-mon[131657]: osdmap e61: 9 total, 9 up, 9 in 2023-10-26T06:39:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:35 smithi153 ceph-mon[131657]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:35 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:39:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:35 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:39:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:35 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:35 smithi050 ceph-mon[94997]: osdmap e61: 9 total, 9 up, 9 in 2023-10-26T06:39:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:35 smithi050 ceph-mon[94997]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:35 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:39:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:35 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:39:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:35 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:36 smithi125 ceph-mon[130643]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:39:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:36 smithi125 ceph-mon[130643]: osdmap e62: 9 total, 9 up, 9 in 2023-10-26T06:39:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:36 smithi153 ceph-mon[131657]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:39:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:36 smithi153 ceph-mon[131657]: osdmap e62: 9 total, 9 up, 9 in 2023-10-26T06:39:37.244 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:36 smithi050 ceph-mon[94997]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:39:37.244 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:36 smithi050 ceph-mon[94997]: osdmap e62: 9 total, 9 up, 9 in 2023-10-26T06:39:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:37 smithi125 ceph-mon[130643]: osdmap e63: 9 total, 9 up, 9 in 2023-10-26T06:39:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:37 smithi125 ceph-mon[130643]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:37 smithi153 ceph-mon[131657]: osdmap e63: 9 total, 9 up, 9 in 2023-10-26T06:39:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:37 smithi153 ceph-mon[131657]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:38.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:37 smithi050 ceph-mon[94997]: osdmap e63: 9 total, 9 up, 9 in 2023-10-26T06:39:38.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:37 smithi050 ceph-mon[94997]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:39.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:39 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3411442113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]: dispatch 2023-10-26T06:39:39.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:39 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]: dispatch 2023-10-26T06:39:39.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:39 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]': finished 2023-10-26T06:39:39.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:39 smithi125 ceph-mon[130643]: osdmap e64: 10 total, 9 up, 10 in 2023-10-26T06:39:39.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:39 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:39.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:39 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3411442113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]: dispatch 2023-10-26T06:39:39.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:39 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]: dispatch 2023-10-26T06:39:39.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:39 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]': finished 2023-10-26T06:39:39.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:39 smithi153 ceph-mon[131657]: osdmap e64: 10 total, 9 up, 10 in 2023-10-26T06:39:39.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:39 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:39.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:39 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3411442113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]: dispatch 2023-10-26T06:39:39.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:39 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]: dispatch 2023-10-26T06:39:39.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:39 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "238027b3-5f4d-49a2-be84-e1b201ef5db3"}]': finished 2023-10-26T06:39:39.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:39 smithi050 ceph-mon[94997]: osdmap e64: 10 total, 9 up, 10 in 2023-10-26T06:39:39.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:39 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:40.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:40 smithi125 ceph-mon[130643]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2023-10-26T06:39:40.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:40 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3593057664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:39:40.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:40 smithi153 ceph-mon[131657]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2023-10-26T06:39:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:40 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3593057664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:39:40.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:40 smithi050 ceph-mon[94997]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2023-10-26T06:39:40.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:40 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3593057664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:39:42.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:42 smithi125 ceph-mon[130643]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:39:42.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:42 smithi153 ceph-mon[131657]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:39:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:42 smithi050 ceph-mon[94997]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:39:44.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:43 smithi125 ceph-mon[130643]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-10-26T06:39:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:43 smithi153 ceph-mon[131657]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-10-26T06:39:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:43 smithi050 ceph-mon[94997]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-10-26T06:39:46.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:46 smithi125 ceph-mon[130643]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-26T06:39:46.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-26T06:39:46.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:46 smithi153 ceph-mon[131657]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-26T06:39:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-26T06:39:46.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:46 smithi050 ceph-mon[94997]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-26T06:39:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-26T06:39:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:47.743 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:47 smithi050 ceph-mon[94997]: Deploying daemon osd.9 on smithi050 2023-10-26T06:39:47.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:47 smithi125 ceph-mon[130643]: Deploying daemon osd.9 on smithi050 2023-10-26T06:39:47.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:47 smithi153 ceph-mon[131657]: Deploying daemon osd.9 on smithi050 2023-10-26T06:39:48.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:48 smithi050 ceph-mon[94997]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-26T06:39:48.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:48 smithi125 ceph-mon[130643]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-26T06:39:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:48 smithi153 ceph-mon[131657]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-26T06:39:50.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:50 smithi125 ceph-mon[130643]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:50 smithi153 ceph-mon[131657]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:51.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:50 smithi050 ceph-mon[94997]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:52.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:52 smithi125 ceph-mon[130643]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:52 smithi153 ceph-mon[131657]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:52 smithi050 ceph-mon[94997]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:54.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:54.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:54.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:53 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:54.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:53 smithi050 ceph-mon[94997]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:54.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:53 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:54.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:53 smithi125 ceph-mon[130643]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:54.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:53 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:54.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:53 smithi153 ceph-mon[131657]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:56.564 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 9 on host 'smithi050' 2023-10-26T06:39:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.562+0000 7ff78e7fc700 1 -- 172.21.15.50:0/416132527 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff798197f50 con 0x7ff7840a14d0 2023-10-26T06:39:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.565+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a14d0 msgr2=0x7ff7840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.565+0000 7ff79f936700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a14d0 0x7ff7840a3990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff798197c50 tx=0x7ff78800b260 comp rx=0 tx=0).stop 2023-10-26T06:39:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.565+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 msgr2=0x7ff79819c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:39:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.565+0000 7ff79f936700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff79819c950 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff79400e970 tx=0x7ff79400ec80 comp rx=0 tx=0).stop 2023-10-26T06:39:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 shutdown_connections 2023-10-26T06:39:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a14d0 0x7ff7840a3990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7981057c0 0x7ff798196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7981008a0 0x7ff79819c950 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 --2- 172.21.15.50:0/416132527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff798101260 0x7ff79819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:39:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 >> 172.21.15.50:0/416132527 conn(0x7ff7980779e0 msgr2=0x7ff7980fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:39:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 shutdown_connections 2023-10-26T06:39:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:39:56.566+0000 7ff79f936700 1 -- 172.21.15.50:0/416132527 wait complete. 2023-10-26T06:39:56.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:56.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:56.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:56.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.780 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:56.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:56.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:56.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:56.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:56.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:56.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:39:56.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:39:56.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:39:56.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:39:57.113 DEBUG:teuthology.orchestra.run.smithi050:osd.9> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.9.service 2023-10-26T06:39:57.118 INFO:tasks.cephadm:Deploying osd.10 on smithi125 with /dev/vg_nvme/lv_1... 2023-10-26T06:39:57.118 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-26T06:39:57.196 INFO:journalctl@ceph.osd.9.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:39:57.692 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:39:57.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:57 smithi125 ceph-mon[130643]: from='osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-26T06:39:57.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:57 smithi125 ceph-mon[130643]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-26T06:39:57.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:57 smithi153 ceph-mon[131657]: from='osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-26T06:39:57.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:57 smithi153 ceph-mon[131657]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-26T06:39:58.009 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:57 smithi050 ceph-mon[94997]: from='osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-26T06:39:58.009 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:57 smithi050 ceph-mon[94997]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-26T06:39:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:58 smithi153 ceph-mon[131657]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:58.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:58 smithi153 ceph-mon[131657]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-26T06:39:58.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:58 smithi153 ceph-mon[131657]: osdmap e65: 10 total, 9 up, 10 in 2023-10-26T06:39:58.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:58 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:58.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:58 smithi153 ceph-mon[131657]: from='osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:39:58.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:58 smithi153 ceph-mon[131657]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:39:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-mon[94997]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-mon[94997]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-26T06:39:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-mon[94997]: osdmap e65: 10 total, 9 up, 10 in 2023-10-26T06:39:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-mon[94997]: from='osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:39:59.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-mon[94997]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:39:59.018 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:39:58.673+0000 7fb226cf5700 -1 osd.9 0 waiting for initial osdmap 2023-10-26T06:39:59.018 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:39:58 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:39:58.704+0000 7fb222aea700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:39:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:58 smithi125 ceph-mon[130643]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:39:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:58 smithi125 ceph-mon[130643]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-26T06:39:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:58 smithi125 ceph-mon[130643]: osdmap e65: 10 total, 9 up, 10 in 2023-10-26T06:39:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:58 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:58 smithi125 ceph-mon[130643]: from='osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:39:59.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:58 smithi125 ceph-mon[130643]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2023-10-26T06:39:59.250 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-26T06:39:59.250 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-26T06:39:59.250 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2023-10-26T06:39:59.250 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2023-10-26T06:39:59.251 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116929 s, 897 MB/s 2023-10-26T06:39:59.251 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2023-10-26T06:39:59.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi125:vg_nvme/lv_1 2023-10-26T06:39:59.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:59 smithi125 ceph-mon[130643]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:39:59.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:59 smithi125 ceph-mon[130643]: osdmap e66: 10 total, 9 up, 10 in 2023-10-26T06:39:59.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:39:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:59 smithi153 ceph-mon[131657]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:59 smithi153 ceph-mon[131657]: osdmap e66: 10 total, 9 up, 10 in 2023-10-26T06:39:59.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:39:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.987 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:59 smithi050 ceph-mon[94997]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2023-10-26T06:39:59.988 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:59 smithi050 ceph-mon[94997]: osdmap e66: 10 total, 9 up, 10 in 2023-10-26T06:39:59.988 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:39:59.988 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:39:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:00.195 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:40:00.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:40:00.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:40:00.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:40:00.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] boot 2023-10-26T06:40:00.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: osdmap e67: 10 total, 10 up, 10 in 2023-10-26T06:40:00.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:00.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:00.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: overall HEALTH_OK 2023-10-26T06:40:00.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:00.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:00.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:00.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:00.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:00.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:00.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:00.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:00.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:00.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:00 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:40:01.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:40:01.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:40:01.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] boot 2023-10-26T06:40:01.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: osdmap e67: 10 total, 10 up, 10 in 2023-10-26T06:40:01.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:01.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:01.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: overall HEALTH_OK 2023-10-26T06:40:01.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:01.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:01.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:00 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:40:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:40:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-26T06:40:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: osd.9 [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] boot 2023-10-26T06:40:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: osdmap e67: 10 total, 10 up, 10 in 2023-10-26T06:40:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:01.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-26T06:40:01.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: overall HEALTH_OK 2023-10-26T06:40:01.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:01.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:01.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:01.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:00 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:01.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 -- 172.21.15.125:0/429879783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed8101260 msgr2=0x7f0ed810d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:01.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 --2- 172.21.15.125:0/429879783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed8101260 0x7f0ed810d630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000b0a0 tx=0x7f0ed000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:40:01.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 -- 172.21.15.125:0/429879783 shutdown_connections 2023-10-26T06:40:01.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 --2- 172.21.15.125:0/429879783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed8101260 0x7f0ed810d630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:01.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 --2- 172.21.15.125:0/429879783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed81056a0 0x7f0ed8105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:01.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 --2- 172.21.15.125:0/429879783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed81008a0 0x7f0ed8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:01.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 -- 172.21.15.125:0/429879783 >> 172.21.15.125:0/429879783 conn(0x7f0ed8077950 msgr2=0x7f0ed8077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:01.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 -- 172.21.15.125:0/429879783 shutdown_connections 2023-10-26T06:40:01.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.453+0000 7f0ede9db700 1 -- 172.21.15.125:0/429879783 wait complete. 2023-10-26T06:40:01.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 Processor -- start 2023-10-26T06:40:01.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 -- start start 2023-10-26T06:40:01.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 0x7f0ed8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:01.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8101260 0x7f0ed8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:01.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed81056a0 0x7f0ed8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:01.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81a5150 con 0x7f0ed81056a0 2023-10-26T06:40:01.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81a52c0 con 0x7f0ed81008a0 2023-10-26T06:40:01.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ede9db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81a5480 con 0x7f0ed8101260 2023-10-26T06:40:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ed7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 0x7f0ed8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ed7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 0x7f0ed8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37858/0 (socket says 172.21.15.125:37858) 2023-10-26T06:40:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ed7fff700 1 -- 172.21.15.125:0/3464637697 learned_addr learned my addr 172.21.15.125:0/3464637697 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-26T06:40:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0edcf78700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed81056a0 0x7f0ed8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:01.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.454+0000 7f0ed77fe700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8101260 0x7f0ed8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed7fff700 1 -- 172.21.15.125:0/3464637697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8101260 msgr2=0x7f0ed8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed7fff700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8101260 0x7f0ed8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed7fff700 1 -- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed81056a0 msgr2=0x7f0ed8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed7fff700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed81056a0 0x7f0ed8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:01.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed7fff700 1 -- 172.21.15.125:0/3464637697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009d00 con 0x7f0ed81008a0 2023-10-26T06:40:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed77fe700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8101260 0x7f0ed8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:40:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed7fff700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 0x7f0ed8072af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00b530 tx=0x7f0ecc00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011830 con 0x7f0ed81008a0 2023-10-26T06:40:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ecc011e50 con 0x7f0ed81008a0 2023-10-26T06:40:01.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed81a5760 con 0x7f0ed81008a0 2023-10-26T06:40:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00f2e0 con 0x7f0ed81008a0 2023-10-26T06:40:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.455+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed81a5c60 con 0x7f0ed81008a0 2023-10-26T06:40:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.456+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed8108d10 con 0x7f0ed81008a0 2023-10-26T06:40:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.457+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0ecc010380 con 0x7f0ed81008a0 2023-10-26T06:40:01.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.458+0000 7f0ed57fa700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ec00a1550 0x7f0ec00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.458+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6476+0+0 (secure 0 0 0) 0x7f0ecc0cc7c0 con 0x7f0ed81008a0 2023-10-26T06:40:01.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.458+0000 7f0ed77fe700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ec00a1550 0x7f0ec00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.459+0000 7f0ed77fe700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ec00a1550 0x7f0ec00a3a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005950 tx=0x7f0ec80058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:01.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.461+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ecc0964b0 con 0x7f0ed81008a0 2023-10-26T06:40:01.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:01.662+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ed8073f80 con 0x7f0ec00a1550 2023-10-26T06:40:01.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:01 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi050 2023-10-26T06:40:01.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:01 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi050 to 4319M 2023-10-26T06:40:01.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:01 smithi153 ceph-mon[131657]: osdmap e68: 10 total, 10 up, 10 in 2023-10-26T06:40:01.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:40:01.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:40:01.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:02.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:01 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi050 2023-10-26T06:40:02.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:01 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi050 to 4319M 2023-10-26T06:40:02.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:01 smithi050 ceph-mon[94997]: osdmap e68: 10 total, 10 up, 10 in 2023-10-26T06:40:02.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:40:02.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:40:02.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:01 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi050 2023-10-26T06:40:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:01 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi050 to 4319M 2023-10-26T06:40:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:01 smithi125 ceph-mon[130643]: osdmap e68: 10 total, 10 up, 10 in 2023-10-26T06:40:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:40:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:40:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:02.814 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:02 smithi125 ceph-mon[130643]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:02.814 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:02 smithi125 ceph-mon[130643]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:02.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:02 smithi153 ceph-mon[131657]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:02.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:02 smithi153 ceph-mon[131657]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:02 smithi050 ceph-mon[94997]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:02 smithi050 ceph-mon[94997]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:04.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:03 smithi153 ceph-mon[131657]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:03 smithi125 ceph-mon[130643]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:03 smithi050 ceph-mon[94997]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:04 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/2554105159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]: dispatch 2023-10-26T06:40:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:04 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]: dispatch 2023-10-26T06:40:05.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:04 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]': finished 2023-10-26T06:40:05.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:04 smithi125 ceph-mon[130643]: osdmap e69: 11 total, 10 up, 11 in 2023-10-26T06:40:05.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:04 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:05.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:04 smithi125 ceph-mon[130643]: from='client.? 172.21.15.125:0/2291233474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:40:05.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:04 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/2554105159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]: dispatch 2023-10-26T06:40:05.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:04 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]: dispatch 2023-10-26T06:40:05.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:04 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]': finished 2023-10-26T06:40:05.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:04 smithi153 ceph-mon[131657]: osdmap e69: 11 total, 10 up, 11 in 2023-10-26T06:40:05.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:04 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:05.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:04 smithi153 ceph-mon[131657]: from='client.? 172.21.15.125:0/2291233474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:40:05.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:04 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/2554105159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]: dispatch 2023-10-26T06:40:05.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:04 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]: dispatch 2023-10-26T06:40:05.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:04 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1dfbdc7-aa84-41c3-a312-1e0b72311863"}]': finished 2023-10-26T06:40:05.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:04 smithi050 ceph-mon[94997]: osdmap e69: 11 total, 10 up, 11 in 2023-10-26T06:40:05.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:04 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:05.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:04 smithi050 ceph-mon[94997]: from='client.? 172.21.15.125:0/2291233474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:40:06.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:05 smithi125 ceph-mon[130643]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:06.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:05 smithi153 ceph-mon[131657]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:06.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:05 smithi050 ceph-mon[94997]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:08.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:08 smithi125 ceph-mon[130643]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:08.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:08 smithi153 ceph-mon[131657]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:08 smithi050 ceph-mon[94997]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:10 smithi125 ceph-mon[130643]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:10.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:10 smithi153 ceph-mon[131657]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:10 smithi050 ceph-mon[94997]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:11.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:11 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-26T06:40:11.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:11 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:11.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:11 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-26T06:40:11.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:11 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:12.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:11 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-26T06:40:12.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:11 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:12.769 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:12 smithi125 ceph-mon[130643]: Deploying daemon osd.10 on smithi125 2023-10-26T06:40:12.770 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:12 smithi125 ceph-mon[130643]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:12.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:12 smithi153 ceph-mon[131657]: Deploying daemon osd.10 on smithi125 2023-10-26T06:40:12.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:12 smithi153 ceph-mon[131657]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:12 smithi050 ceph-mon[94997]: Deploying daemon osd.10 on smithi125 2023-10-26T06:40:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:12 smithi050 ceph-mon[94997]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:13 smithi125 ceph-mon[130643]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:13 smithi153 ceph-mon[131657]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:13 smithi050 ceph-mon[94997]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:16.353 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:16.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:16.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:16.354 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:16 smithi125 ceph-mon[130643]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:16.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:16.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:16.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:16 smithi153 ceph-mon[131657]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:16.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:16.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:16 smithi050 ceph-mon[94997]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:17.981 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 10 on host 'smithi125' 2023-10-26T06:40:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.979+0000 7f0ed57fa700 1 -- 172.21.15.125:0/3464637697 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f0ed8073f80 con 0x7f0ec00a1550 2023-10-26T06:40:17.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ec00a1550 msgr2=0x7f0ec00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:17.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ec00a1550 0x7f0ec00a3a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005950 tx=0x7f0ec80058e0 comp rx=0 tx=0).stop 2023-10-26T06:40:17.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 msgr2=0x7f0ed8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:17.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 0x7f0ed8072af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00b530 tx=0x7f0ecc00b840 comp rx=0 tx=0).stop 2023-10-26T06:40:17.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 shutdown_connections 2023-10-26T06:40:17.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ec00a1550 0x7f0ec00a3a10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:17.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed81056a0 0x7f0ed8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:17.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ed81008a0 0x7f0ed8072af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:17.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 --2- 172.21.15.125:0/3464637697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8101260 0x7f0ed8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:17.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 >> 172.21.15.125:0/3464637697 conn(0x7f0ed8077950 msgr2=0x7f0ed80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:17.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 shutdown_connections 2023-10-26T06:40:17.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-26T06:40:17.981+0000 7f0ede9db700 1 -- 172.21.15.125:0/3464637697 wait complete. 2023-10-26T06:40:18.397 DEBUG:teuthology.orchestra.run.smithi125:osd.10> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.10.service 2023-10-26T06:40:18.400 INFO:tasks.cephadm:Deploying osd.11 on smithi153 with /dev/vg_nvme/lv_1... 2023-10-26T06:40:18.400 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-26T06:40:18.434 INFO:journalctl@ceph.osd.10.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:40:18.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:18 smithi153 ceph-mon[131657]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:18.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:18 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:18 smithi125 ceph-mon[130643]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:18.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:18 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:18.969 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:40:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:18 smithi050 ceph-mon[94997]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:18 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:19.422 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:40:19 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:40:19.159+0000 7f13e3f61640 -1 osd.10 0 log_to_monitors true 2023-10-26T06:40:19.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:19 smithi153 ceph-mon[131657]: from='osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-26T06:40:19.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:19 smithi153 ceph-mon[131657]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-26T06:40:19.752 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:19 smithi125 ceph-mon[130643]: from='osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-26T06:40:19.753 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:19 smithi125 ceph-mon[130643]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-26T06:40:20.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:19 smithi050 ceph-mon[94997]: from='osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-26T06:40:20.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:19 smithi050 ceph-mon[94997]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-26T06:40:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-26T06:40:20.529 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-26T06:40:20.530 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2023-10-26T06:40:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2023-10-26T06:40:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.014986 s, 700 MB/s 2023-10-26T06:40:20.530 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2023-10-26T06:40:20.831 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:20 smithi153 ceph-mon[131657]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:20.832 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:20 smithi153 ceph-mon[131657]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-26T06:40:20.832 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:20 smithi153 ceph-mon[131657]: osdmap e70: 11 total, 10 up, 11 in 2023-10-26T06:40:20.832 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:20.832 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:20 smithi153 ceph-mon[131657]: from='osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:40:20.833 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:20 smithi153 ceph-mon[131657]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:40:20.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch daemon add osd smithi153:vg_nvme/lv_1 2023-10-26T06:40:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:20 smithi050 ceph-mon[94997]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:20 smithi050 ceph-mon[94997]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-26T06:40:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:20 smithi050 ceph-mon[94997]: osdmap e70: 11 total, 10 up, 11 in 2023-10-26T06:40:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:20 smithi050 ceph-mon[94997]: from='osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:40:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:20 smithi050 ceph-mon[94997]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:40:21.146 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:40:20.674+0000 7f13d8dd7700 -1 osd.10 0 waiting for initial osdmap 2023-10-26T06:40:21.146 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:40:20.692+0000 7f13d3bca700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:40:21.147 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-mon[130643]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:21.147 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-mon[130643]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-26T06:40:21.147 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-mon[130643]: osdmap e70: 11 total, 10 up, 11 in 2023-10-26T06:40:21.147 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:21.147 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-mon[130643]: from='osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:40:21.148 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:20 smithi125 ceph-mon[130643]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2023-10-26T06:40:21.480 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:40:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:40:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: osdmap e71: 11 total, 10 up, 11 in 2023-10-26T06:40:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:21.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.925 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:21.926 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:21 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:40:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: osdmap e71: 11 total, 10 up, 11 in 2023-10-26T06:40:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:21.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:21.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:21.988 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:21 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2023-10-26T06:40:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: osdmap e71: 11 total, 10 up, 11 in 2023-10-26T06:40:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:22.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:21 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:22.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 -- 172.21.15.153:0/2590892466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 msgr2=0x7f7a54104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:22.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 --2- 172.21.15.153:0/2590892466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54104990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009990 tx=0x7f7a44009ca0 comp rx=0 tx=0).stop 2023-10-26T06:40:22.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 -- 172.21.15.153:0/2590892466 shutdown_connections 2023-10-26T06:40:22.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 --2- 172.21.15.153:0/2590892466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a541000a0 0x7f7a5410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:22.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 --2- 172.21.15.153:0/2590892466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54104990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:22.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 --2- 172.21.15.153:0/2590892466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a540ff6e0 0x7f7a540ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 -- 172.21.15.153:0/2590892466 >> 172.21.15.153:0/2590892466 conn(0x7f7a540766c0 msgr2=0x7f7a54076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 -- 172.21.15.153:0/2590892466 shutdown_connections 2023-10-26T06:40:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.629+0000 7f7a5be40700 1 -- 172.21.15.153:0/2590892466 wait complete. 2023-10-26T06:40:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.630+0000 7f7a5be40700 1 Processor -- start 2023-10-26T06:40:22.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.630+0000 7f7a5be40700 1 -- start start 2023-10-26T06:40:22.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a540ff6e0 0x7f7a5419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:22.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a541000a0 0x7f7a5419be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:22.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:22.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541960e0 con 0x7f7a540ff6e0 2023-10-26T06:40:22.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54196250 con 0x7f7a541000a0 2023-10-26T06:40:22.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54196410 con 0x7f7a541045b0 2023-10-26T06:40:22.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:22.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35998/0 (socket says 172.21.15.153:35998) 2023-10-26T06:40:22.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 -- 172.21.15.153:0/3331421477 learned_addr learned my addr 172.21.15.153:0/3331421477 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-26T06:40:22.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a593db700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a541000a0 0x7f7a5419be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:22.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 -- 172.21.15.153:0/3331421477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a541000a0 msgr2=0x7f7a5419be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:22.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a541000a0 0x7f7a5419be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:22.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 -- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a540ff6e0 msgr2=0x7f7a5419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:22.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a540ff6e0 0x7f7a5419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:22.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 -- 172.21.15.153:0/3331421477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440095f0 con 0x7f7a541045b0 2023-10-26T06:40:22.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5a3dd700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54195a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00b970 tx=0x7f7a4c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:22.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c00c930 con 0x7f7a541045b0 2023-10-26T06:40:22.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a4c014440 con 0x7f7a541045b0 2023-10-26T06:40:22.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a541966f0 con 0x7f7a541045b0 2023-10-26T06:40:22.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0075d0 con 0x7f7a541045b0 2023-10-26T06:40:22.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.631+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a541a2930 con 0x7f7a541045b0 2023-10-26T06:40:22.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.633+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a54107c20 con 0x7f7a541045b0 2023-10-26T06:40:22.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.633+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7a4c0145b0 con 0x7f7a541045b0 2023-10-26T06:40:22.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.634+0000 7f7a4affd700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7a400a1550 0x7f7a400a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:22.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.634+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6942+0+0 (secure 0 0 0) 0x7f7a4c006e40 con 0x7f7a541045b0 2023-10-26T06:40:22.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.634+0000 7f7a59bdc700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7a400a1550 0x7f7a400a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:22.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.635+0000 7f7a59bdc700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7a400a1550 0x7f7a400a3a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a440095c0 tx=0x7f7a44009510 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:22.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.638+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7a4c04f100 con 0x7f7a541045b0 2023-10-26T06:40:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:40:22.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:40:22.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi125 2023-10-26T06:40:22.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi125 to 4292M 2023-10-26T06:40:22.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:22.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] boot 2023-10-26T06:40:22.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: osdmap e72: 11 total, 11 up, 11 in 2023-10-26T06:40:22.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:22.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:22.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:22.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:22.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:22.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:22.839+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a54196f40 con 0x7f7a400a1550 2023-10-26T06:40:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:40:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:40:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi125 2023-10-26T06:40:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi125 to 4292M 2023-10-26T06:40:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] boot 2023-10-26T06:40:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: osdmap e72: 11 total, 11 up, 11 in 2023-10-26T06:40:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:40:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:40:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi125 2023-10-26T06:40:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi125 to 4292M 2023-10-26T06:40:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-26T06:40:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: osd.10 [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] boot 2023-10-26T06:40:23.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: osdmap e72: 11 total, 11 up, 11 in 2023-10-26T06:40:23.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-26T06:40:23.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:23.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:23.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:23.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:23.902 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:23 smithi153 ceph-mon[131657]: osdmap e73: 11 total, 11 up, 11 in 2023-10-26T06:40:23.902 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:40:23.903 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:40:23.903 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:24.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:23 smithi050 ceph-mon[94997]: osdmap e73: 11 total, 11 up, 11 in 2023-10-26T06:40:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:40:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:40:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:23 smithi125 ceph-mon[130643]: osdmap e73: 11 total, 11 up, 11 in 2023-10-26T06:40:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-26T06:40:24.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-26T06:40:24.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:24 smithi153 ceph-mon[131657]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:24 smithi153 ceph-mon[131657]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:24.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:24 smithi153 ceph-mon[131657]: osdmap e74: 11 total, 11 up, 11 in 2023-10-26T06:40:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:24 smithi050 ceph-mon[94997]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:24 smithi050 ceph-mon[94997]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:24 smithi050 ceph-mon[94997]: osdmap e74: 11 total, 11 up, 11 in 2023-10-26T06:40:25.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:24 smithi125 ceph-mon[130643]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:25.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:24 smithi125 ceph-mon[130643]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:25.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:24 smithi125 ceph-mon[130643]: osdmap e74: 11 total, 11 up, 11 in 2023-10-26T06:40:26.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: osdmap e75: 11 total, 11 up, 11 in 2023-10-26T06:40:26.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/349902725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]: dispatch 2023-10-26T06:40:26.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]: dispatch 2023-10-26T06:40:26.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]': finished 2023-10-26T06:40:26.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: osdmap e76: 12 total, 11 up, 12 in 2023-10-26T06:40:26.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:26.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:25 smithi125 ceph-mon[130643]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:26.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: osdmap e75: 11 total, 11 up, 11 in 2023-10-26T06:40:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/349902725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]: dispatch 2023-10-26T06:40:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]: dispatch 2023-10-26T06:40:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]': finished 2023-10-26T06:40:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: osdmap e76: 12 total, 11 up, 12 in 2023-10-26T06:40:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:26.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:25 smithi153 ceph-mon[131657]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:26.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: osdmap e75: 11 total, 11 up, 11 in 2023-10-26T06:40:26.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/349902725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]: dispatch 2023-10-26T06:40:26.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]: dispatch 2023-10-26T06:40:26.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3c32b99-ba7b-41b0-82b8-f3c139e5c21a"}]': finished 2023-10-26T06:40:26.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: osdmap e76: 12 total, 11 up, 12 in 2023-10-26T06:40:26.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:26.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:25 smithi050 ceph-mon[94997]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:26 smithi125 ceph-mon[130643]: from='client.? 172.21.15.153:0/3982007116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:40:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:26 smithi153 ceph-mon[131657]: from='client.? 172.21.15.153:0/3982007116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:40:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:26 smithi050 ceph-mon[94997]: from='client.? 172.21.15.153:0/3982007116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-26T06:40:28.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:27 smithi125 ceph-mon[130643]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:28.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:27 smithi153 ceph-mon[131657]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:28.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:27 smithi050 ceph-mon[94997]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:30.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:30 smithi125 ceph-mon[130643]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:40:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:30 smithi153 ceph-mon[131657]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:40:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:30 smithi050 ceph-mon[94997]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-26T06:40:32.818 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:32 smithi153 ceph-mon[131657]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-26T06:40:32.818 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-26T06:40:32.819 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:32.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:32 smithi125 ceph-mon[130643]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-26T06:40:32.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-26T06:40:32.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:32 smithi050 ceph-mon[94997]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-26T06:40:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-26T06:40:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:33.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:33 smithi125 ceph-mon[130643]: Deploying daemon osd.11 on smithi153 2023-10-26T06:40:33.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:33 smithi153 ceph-mon[131657]: Deploying daemon osd.11 on smithi153 2023-10-26T06:40:34.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:33 smithi050 ceph-mon[94997]: Deploying daemon osd.11 on smithi153 2023-10-26T06:40:34.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:34 smithi125 ceph-mon[130643]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-26T06:40:34.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:34 smithi153 ceph-mon[131657]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-26T06:40:35.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:34 smithi050 ceph-mon[94997]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-26T06:40:36.947 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:36 smithi153 ceph-mon[131657]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-26T06:40:36.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:36.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:36.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:36 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:36 smithi050 ceph-mon[94997]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-26T06:40:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:37.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:36 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:36 smithi125 ceph-mon[130643]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-26T06:40:37.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:37.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:37.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:36 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:38.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.655+0000 7f7a4affd700 1 -- 172.21.15.153:0/3331421477 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f7a54196f40 con 0x7f7a400a1550 2023-10-26T06:40:38.656 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 11 on host 'smithi153' 2023-10-26T06:40:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7a400a1550 msgr2=0x7f7a400a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7a400a1550 0x7f7a400a3a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a440095c0 tx=0x7f7a44009510 comp rx=0 tx=0).stop 2023-10-26T06:40:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 msgr2=0x7f7a54195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54195a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00b970 tx=0x7f7a4c00bc80 comp rx=0 tx=0).stop 2023-10-26T06:40:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 shutdown_connections 2023-10-26T06:40:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7a400a1550 0x7f7a400a3a10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a541045b0 0x7f7a54195a80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:38.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a540ff6e0 0x7f7a5419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:38.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 --2- 172.21.15.153:0/3331421477 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a541000a0 0x7f7a5419be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:38.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 >> 172.21.15.153:0/3331421477 conn(0x7f7a540766c0 msgr2=0x7f7a540fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:38.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 shutdown_connections 2023-10-26T06:40:38.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:38.657+0000 7f7a5be40700 1 -- 172.21.15.153:0/3331421477 wait complete. 2023-10-26T06:40:38.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:38 smithi153 ceph-mon[131657]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-26T06:40:38.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:38.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:38.967 DEBUG:teuthology.orchestra.run.smithi153:osd.11> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.11.service 2023-10-26T06:40:38.971 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-26T06:40:38.971 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd stat -f json 2023-10-26T06:40:39.001 INFO:journalctl@ceph.osd.11.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:40:39.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:38 smithi050 ceph-mon[94997]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-26T06:40:39.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:39.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:38 smithi125 ceph-mon[130643]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-26T06:40:39.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:39.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:39.728 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:40:40.199 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:40:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:40:40.060+0000 7feacd292640 -1 osd.11 0 log_to_monitors true 2023-10-26T06:40:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:40 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:40 smithi050 ceph-mon[94997]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-26T06:40:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:40 smithi050 ceph-mon[94997]: from='osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-26T06:40:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:40 smithi050 ceph-mon[94997]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-26T06:40:40.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:40.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:40 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:40 smithi153 ceph-mon[131657]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-26T06:40:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:40 smithi153 ceph-mon[131657]: from='osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-26T06:40:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:40 smithi153 ceph-mon[131657]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-26T06:40:40.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:40.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:40 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:40.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:40 smithi125 ceph-mon[130643]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-26T06:40:40.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:40 smithi125 ceph-mon[130643]: from='osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-26T06:40:40.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:40 smithi125 ceph-mon[130643]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-26T06:40:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 -- 172.21.15.50:0/1290010088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad3010d250 msgr2=0x7fad3010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 --2- 172.21.15.50:0/1290010088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad3010d250 0x7fad3010f640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad28009f90 tx=0x7fad2800b330 comp rx=0 tx=0).stop 2023-10-26T06:40:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 -- 172.21.15.50:0/1290010088 shutdown_connections 2023-10-26T06:40:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 --2- 172.21.15.50:0/1290010088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad3010d250 0x7fad3010f640 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 --2- 172.21.15.50:0/1290010088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad30072a20 0x7fad30072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 --2- 172.21.15.50:0/1290010088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30073340 0x7fad3010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 -- 172.21.15.50:0/1290010088 >> 172.21.15.50:0/1290010088 conn(0x7fad300779e0 msgr2=0x7fad30077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.276+0000 7fad36f33700 1 -- 172.21.15.50:0/1290010088 shutdown_connections 2023-10-26T06:40:41.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.277+0000 7fad36f33700 1 -- 172.21.15.50:0/1290010088 wait complete. 2023-10-26T06:40:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 Processor -- start 2023-10-26T06:40:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 -- start start 2023-10-26T06:40:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 0x7fad30199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30073340 0x7fad301995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad3010d250 0x7fad3019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:41.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3019df90 con 0x7fad30073340 2023-10-26T06:40:41.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3019e100 con 0x7fad3010d250 2023-10-26T06:40:41.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad36f33700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3019e2c0 con 0x7fad30072a20 2023-10-26T06:40:41.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad34ccf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 0x7fad30199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:41.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30073340 0x7fad301995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad34ccf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 0x7fad30199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:45684/0 (socket says 172.21.15.50:45684) 2023-10-26T06:40:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.278+0000 7fad34ccf700 1 -- 172.21.15.50:0/4104415068 learned_addr learned my addr 172.21.15.50:0/4104415068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad354d0700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad3010d250 0x7fad3019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad34ccf700 1 -- 172.21.15.50:0/4104415068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad3010d250 msgr2=0x7fad3019d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad34ccf700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad3010d250 0x7fad3019d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad34ccf700 1 -- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30073340 msgr2=0x7fad301995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:41.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad34ccf700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30073340 0x7fad301995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad34ccf700 1 -- 172.21.15.50:0/4104415068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0095f0 con 0x7fad30072a20 2023-10-26T06:40:41.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad354d0700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad3010d250 0x7fad3019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:40:41.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad34ccf700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 0x7fad30199090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad2400e9a0 tx=0x7fad2400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:41.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24009790 con 0x7fad30072a20 2023-10-26T06:40:41.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad28009c40 con 0x7fad30072a20 2023-10-26T06:40:41.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad2400cbd0 con 0x7fad30072a20 2023-10-26T06:40:41.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.279+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24018680 con 0x7fad30072a20 2023-10-26T06:40:41.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.280+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad301a5c30 con 0x7fad30072a20 2023-10-26T06:40:41.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.281+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad30108460 con 0x7fad30072a20 2023-10-26T06:40:41.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.283+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fad2400cd40 con 0x7fad30072a20 2023-10-26T06:40:41.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.284+0000 7fad2dffb700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fad200a14d0 0x7fad200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:41.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.284+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7062+0+0 (secure 0 0 0) 0x7fad24014070 con 0x7fad30072a20 2023-10-26T06:40:41.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.284+0000 7fad2ffff700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fad200a14d0 0x7fad200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:41.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.285+0000 7fad2ffff700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fad200a14d0 0x7fad200a3990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad3019a5f0 tx=0x7fad1c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:41.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.286+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad24096750 con 0x7fad30072a20 2023-10-26T06:40:41.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-mon[131657]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-26T06:40:41.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-mon[131657]: from='osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:40:41.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-mon[131657]: osdmap e77: 12 total, 11 up, 12 in 2023-10-26T06:40:41.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:41.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-mon[131657]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:40:41.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:40:41.234+0000 7feac2108700 -1 osd.11 0 waiting for initial osdmap 2023-10-26T06:40:41.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:40:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:40:41.250+0000 7feabc6fa700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-26T06:40:41.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.498+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fad3004e4f0 con 0x7fad30072a20 2023-10-26T06:40:41.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.499+0000 7fad2dffb700 1 -- 172.21.15.50:0/4104415068 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7fad24099d70 con 0x7fad30072a20 2023-10-26T06:40:41.500 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:40:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fad200a14d0 msgr2=0x7fad200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fad200a14d0 0x7fad200a3990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad3019a5f0 tx=0x7fad1c009310 comp rx=0 tx=0).stop 2023-10-26T06:40:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 msgr2=0x7fad30199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 0x7fad30199090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fad2400e9a0 tx=0x7fad2400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 shutdown_connections 2023-10-26T06:40:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fad200a14d0 0x7fad200a3990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad3010d250 0x7fad3019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30072a20 0x7fad30199090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 --2- 172.21.15.50:0/4104415068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad30073340 0x7fad301995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:41.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 >> 172.21.15.50:0/4104415068 conn(0x7fad300779e0 msgr2=0x7fad300feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:41.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 shutdown_connections 2023-10-26T06:40:41.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:41.501+0000 7fad36f33700 1 -- 172.21.15.50:0/4104415068 wait complete. 2023-10-26T06:40:41.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:41 smithi050 ceph-mon[94997]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-26T06:40:41.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:41 smithi050 ceph-mon[94997]: from='osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:40:41.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:41 smithi050 ceph-mon[94997]: osdmap e77: 12 total, 11 up, 12 in 2023-10-26T06:40:41.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:41 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:41.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:41 smithi050 ceph-mon[94997]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:40:41.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:41 smithi125 ceph-mon[130643]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-26T06:40:41.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:41 smithi125 ceph-mon[130643]: from='osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:40:41.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:41 smithi125 ceph-mon[130643]: osdmap e77: 12 total, 11 up, 12 in 2023-10-26T06:40:41.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:41 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:41.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:41 smithi125 ceph-mon[130643]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2023-10-26T06:40:42.023 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"num_osds":12,"num_up_osds":11,"osd_up_since":1698302421,"num_in_osds":12,"osd_in_since":1698302425,"num_remapped_pgs":0} 2023-10-26T06:40:42.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:40:42.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: osdmap e78: 12 total, 11 up, 12 in 2023-10-26T06:40:42.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:42.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:42.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4104415068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-26T06:40:42.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:42.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.488 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.489 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:42.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:42.490 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:40:42.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: osdmap e78: 12 total, 11 up, 12 in 2023-10-26T06:40:42.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:42.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:42.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4104415068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-26T06:40:42.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:42.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:42.522 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:42.523 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2023-10-26T06:40:42.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: osdmap e78: 12 total, 11 up, 12 in 2023-10-26T06:40:42.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:42.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:42.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4104415068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-26T06:40:42.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-26T06:40:42.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:40:42.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:42.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:42.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:42.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:43.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd stat -f json 2023-10-26T06:40:43.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: purged_snaps scrub starts 2023-10-26T06:40:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: purged_snaps scrub ok 2023-10-26T06:40:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: Detected new or changed devices on smithi153 2023-10-26T06:40:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi153 to 4292M 2023-10-26T06:40:43.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] boot 2023-10-26T06:40:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: osdmap e79: 12 total, 12 up, 12 in 2023-10-26T06:40:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:43.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:43.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:43.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:43.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:43 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:43.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: purged_snaps scrub starts 2023-10-26T06:40:43.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: purged_snaps scrub ok 2023-10-26T06:40:43.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: Detected new or changed devices on smithi153 2023-10-26T06:40:43.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi153 to 4292M 2023-10-26T06:40:43.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:43.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] boot 2023-10-26T06:40:43.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: osdmap e79: 12 total, 12 up, 12 in 2023-10-26T06:40:43.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:43.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:43.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:43.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:43.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:43 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:43.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: purged_snaps scrub starts 2023-10-26T06:40:43.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: purged_snaps scrub ok 2023-10-26T06:40:43.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: Detected new or changed devices on smithi153 2023-10-26T06:40:43.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi153 to 4292M 2023-10-26T06:40:43.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:43.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: osd.11 [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] boot 2023-10-26T06:40:43.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: osdmap e79: 12 total, 12 up, 12 in 2023-10-26T06:40:43.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-26T06:40:43.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:43.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:43.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:43.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:43 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:43.778 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:40:44.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:44 smithi050 ceph-mon[94997]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:44.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:44 smithi050 ceph-mon[94997]: osdmap e80: 12 total, 12 up, 12 in 2023-10-26T06:40:44.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:44 smithi125 ceph-mon[130643]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:44.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:44 smithi125 ceph-mon[130643]: osdmap e80: 12 total, 12 up, 12 in 2023-10-26T06:40:44.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:44 smithi153 ceph-mon[131657]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:44.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:44 smithi153 ceph-mon[131657]: osdmap e80: 12 total, 12 up, 12 in 2023-10-26T06:40:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.284+0000 7f852eba3700 1 -- 172.21.15.50:0/2449751511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8528101260 msgr2=0x7f852810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.284+0000 7f852eba3700 1 --2- 172.21.15.50:0/2449751511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8528101260 0x7f852810d650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f852000b0a0 tx=0x7f852000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 -- 172.21.15.50:0/2449751511 shutdown_connections 2023-10-26T06:40:45.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 --2- 172.21.15.50:0/2449751511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8528101260 0x7f852810d650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 --2- 172.21.15.50:0/2449751511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85281057c0 0x7f8528105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 --2- 172.21.15.50:0/2449751511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85281008a0 0x7f8528100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 -- 172.21.15.50:0/2449751511 >> 172.21.15.50:0/2449751511 conn(0x7f85280779e0 msgr2=0x7f8528077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 -- 172.21.15.50:0/2449751511 shutdown_connections 2023-10-26T06:40:45.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.285+0000 7f852eba3700 1 -- 172.21.15.50:0/2449751511 wait complete. 2023-10-26T06:40:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 Processor -- start 2023-10-26T06:40:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 -- start start 2023-10-26T06:40:45.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85281008a0 0x7f8528072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 0x7f8528073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85281057c0 0x7f8528073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281a5130 con 0x7f8528101260 2023-10-26T06:40:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281a52a0 con 0x7f85281057c0 2023-10-26T06:40:45.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f852eba3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281a5460 con 0x7f85281008a0 2023-10-26T06:40:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.286+0000 7f8527fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 0x7f8528073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 0x7f8528073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40078/0 (socket says 172.21.15.50:40078) 2023-10-26T06:40:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 -- 172.21.15.50:0/1025825516 learned_addr learned my addr 172.21.15.50:0/1025825516 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f852c93f700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85281008a0 0x7f8528072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:45.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f852d140700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85281057c0 0x7f8528073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 -- 172.21.15.50:0/1025825516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85281008a0 msgr2=0x7f8528072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85281008a0 0x7f8528072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 -- 172.21.15.50:0/1025825516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85281057c0 msgr2=0x7f8528073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:45.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85281057c0 0x7f8528073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 -- 172.21.15.50:0/1025825516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009520 con 0x7f8528101260 2023-10-26T06:40:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.287+0000 7f8527fff700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 0x7f8528073030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f851400e9a0 tx=0x7f851400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.288+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514009790 con 0x7f8528101260 2023-10-26T06:40:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.288+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8520009d00 con 0x7f8528101260 2023-10-26T06:40:45.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.288+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8514010430 con 0x7f8528101260 2023-10-26T06:40:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.288+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85281a5ab0 con 0x7f8528101260 2023-10-26T06:40:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.288+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514018620 con 0x7f8528101260 2023-10-26T06:40:45.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.289+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528108da0 con 0x7f8528101260 2023-10-26T06:40:45.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.291+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f85140105a0 con 0x7f8528101260 2023-10-26T06:40:45.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.292+0000 7f8525ffb700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f85180a14d0 0x7f85180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:45.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.292+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f8514014070 con 0x7f8528101260 2023-10-26T06:40:45.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.292+0000 7f852c93f700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f85180a14d0 0x7f85180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.293+0000 7f852c93f700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f85180a14d0 0x7f85180a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8528101930 tx=0x7f851c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:45.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.296+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8514052100 con 0x7f8528101260 2023-10-26T06:40:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.507+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8528101f30 con 0x7f8528101260 2023-10-26T06:40:45.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.508+0000 7f8525ffb700 1 -- 172.21.15.50:0/1025825516 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f8514096510 con 0x7f8528101260 2023-10-26T06:40:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:40:45.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f85180a14d0 msgr2=0x7f85180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f85180a14d0 0x7f85180a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8528101930 tx=0x7f851c009260 comp rx=0 tx=0).stop 2023-10-26T06:40:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 msgr2=0x7f8528073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 0x7f8528073030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f851400e9a0 tx=0x7f851400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 shutdown_connections 2023-10-26T06:40:45.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f85180a14d0 0x7f85180a3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85281057c0 0x7f8528073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85281008a0 0x7f8528072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 --2- 172.21.15.50:0/1025825516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8528101260 0x7f8528073030 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 >> 172.21.15.50:0/1025825516 conn(0x7f85280779e0 msgr2=0x7f85280fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 shutdown_connections 2023-10-26T06:40:45.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:45.510+0000 7f852eba3700 1 -- 172.21.15.50:0/1025825516 wait complete. 2023-10-26T06:40:45.797 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:45 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1025825516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-26T06:40:45.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:45 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1025825516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-26T06:40:45.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:45 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1025825516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-26T06:40:46.065 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1698302442,"num_in_osds":12,"osd_in_since":1698302425,"num_remapped_pgs":0} 2023-10-26T06:40:46.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd dump --format=json 2023-10-26T06:40:46.814 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:40:46.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:46 smithi125 ceph-mon[130643]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:46.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:46 smithi153 ceph-mon[131657]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:46 smithi050 ceph-mon[94997]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 -- 172.21.15.50:0/611844256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 msgr2=0x7f53fc106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:48.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 --2- 172.21.15.50:0/611844256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 0x7f53fc106a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009990 tx=0x7f53ec009ca0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 -- 172.21.15.50:0/611844256 shutdown_connections 2023-10-26T06:40:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 --2- 172.21.15.50:0/611844256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc100fb0 0x7f53fc10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 --2- 172.21.15.50:0/611844256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 0x7f53fc106a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 --2- 172.21.15.50:0/611844256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53fc1005f0 0x7f53fc100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 -- 172.21.15.50:0/611844256 >> 172.21.15.50:0/611844256 conn(0x7f53fc0fc120 msgr2=0x7f53fc0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 -- 172.21.15.50:0/611844256 shutdown_connections 2023-10-26T06:40:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.233+0000 7f53fbfff700 1 -- 172.21.15.50:0/611844256 wait complete. 2023-10-26T06:40:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.235+0000 7f53fbfff700 1 Processor -- start 2023-10-26T06:40:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.235+0000 7f53fbfff700 1 -- start start 2023-10-26T06:40:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 0x7f53fc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53fc100fb0 0x7f53fc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 0x7f53fc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1a4da0 con 0x7f53fc1005f0 2023-10-26T06:40:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fbfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1a4f10 con 0x7f53fc106680 2023-10-26T06:40:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fbfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1a50d0 con 0x7f53fc100fb0 2023-10-26T06:40:48.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 0x7f53fc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:48.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 0x7f53fc072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40106/0 (socket says 172.21.15.50:40106) 2023-10-26T06:40:48.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 -- 172.21.15.50:0/3456559373 learned_addr learned my addr 172.21.15.50:0/3456559373 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:48.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fb7fe700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 0x7f53fc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:48.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53fa7fc700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53fc100fb0 0x7f53fc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:48.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 -- 172.21.15.50:0/3456559373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53fc100fb0 msgr2=0x7f53fc073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:48.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53fc100fb0 0x7f53fc073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 -- 172.21.15.50:0/3456559373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 msgr2=0x7f53fc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:48.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 0x7f53fc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.236+0000 7f53faffd700 1 -- 172.21.15.50:0/3456559373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4009c40 con 0x7f53fc1005f0 2023-10-26T06:40:48.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.237+0000 7f53faffd700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 0x7f53fc072af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.237+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec01d070 con 0x7f53fc1005f0 2023-10-26T06:40:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.237+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53ec021410 con 0x7f53fc1005f0 2023-10-26T06:40:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.237+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec0095f0 con 0x7f53fc1005f0 2023-10-26T06:40:48.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.237+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec017650 con 0x7f53fc1005f0 2023-10-26T06:40:48.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.237+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc1a55d0 con 0x7f53fc1005f0 2023-10-26T06:40:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.238+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc108bf0 con 0x7f53fc1005f0 2023-10-26T06:40:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.240+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f53ec021580 con 0x7f53fc1005f0 2023-10-26T06:40:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.242+0000 7f540097c700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f53e40a14d0 0x7f53e40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.242+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f53ec0ce280 con 0x7f53fc1005f0 2023-10-26T06:40:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.242+0000 7f53fa7fc700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f53e40a14d0 0x7f53e40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.243+0000 7f53fa7fc700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f53e40a14d0 0x7f53e40a3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53fc074220 tx=0x7f53f0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.244+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f53ec097d30 con 0x7f53fc1005f0 2023-10-26T06:40:48.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.455+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53fc073fd0 con 0x7f53fc1005f0 2023-10-26T06:40:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.456+0000 7f540097c700 1 -- 172.21.15.50:0/3456559373 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18762 (secure 0 0 0) 0x7f53ec0b9e60 con 0x7f53fc1005f0 2023-10-26T06:40:48.458 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:40:48.459 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:40:43.836331+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:40:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f53e40a14d0 msgr2=0x7f53e40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f53e40a14d0 0x7f53e40a3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53fc074220 tx=0x7f53f0009260 comp rx=0 tx=0).stop 2023-10-26T06:40:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 msgr2=0x7f53fc072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 0x7f53fc072af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec004730 comp rx=0 tx=0).stop 2023-10-26T06:40:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 shutdown_connections 2023-10-26T06:40:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f53e40a14d0 0x7f53e40a3990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53fc106680 0x7f53fc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53fc1005f0 0x7f53fc072af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 --2- 172.21.15.50:0/3456559373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53fc100fb0 0x7f53fc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.458+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 >> 172.21.15.50:0/3456559373 conn(0x7f53fc0fc120 msgr2=0x7f53fc0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.459+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 shutdown_connections 2023-10-26T06:40:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:48.459+0000 7f53fbfff700 1 -- 172.21.15.50:0/3456559373 wait complete. 2023-10-26T06:40:48.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:48 smithi050 ceph-mon[94997]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:48.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:48 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3456559373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:40:48.904 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:40:48.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-26T06:40:48.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:48 smithi125 ceph-mon[130643]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:48.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:48 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3456559373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:40:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:48 smithi153 ceph-mon[131657]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:48 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3456559373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:40:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:40:50.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:50 smithi050 ceph-mon[94997]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:50.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:50 smithi125 ceph-mon[130643]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:50 smithi153 ceph-mon[131657]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 -- 172.21.15.50:0/362187290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 msgr2=0x7fdcdc1139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/362187290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1139a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400b0a0 tx=0x7fdcd400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 -- 172.21.15.50:0/362187290 shutdown_connections 2023-10-26T06:40:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/362187290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1139a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/362187290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcdc074770 0x7fdcdc072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/362187290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc072f60 0x7fdcdc0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.169+0000 7fdce3d5d700 1 -- 172.21.15.50:0/362187290 >> 172.21.15.50:0/362187290 conn(0x7fdcdc0779e0 msgr2=0x7fdcdc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.170+0000 7fdce3d5d700 1 -- 172.21.15.50:0/362187290 shutdown_connections 2023-10-26T06:40:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.170+0000 7fdce3d5d700 1 -- 172.21.15.50:0/362187290 wait complete. 2023-10-26T06:40:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 Processor -- start 2023-10-26T06:40:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 -- start start 2023-10-26T06:40:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc072f60 0x7fdcdc19d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcdc074770 0x7fdcdc19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a22b0 con 0x7fdcdc111570 2023-10-26T06:40:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a2420 con 0x7fdcdc074770 2023-10-26T06:40:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce3d5d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a25e0 con 0x7fdcdc072f60 2023-10-26T06:40:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce22fa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce22fa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40124/0 (socket says 172.21.15.50:40124) 2023-10-26T06:40:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce22fa700 1 -- 172.21.15.50:0/809432611 learned_addr learned my addr 172.21.15.50:0/809432611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce1af9700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc072f60 0x7fdcdc19d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.171+0000 7fdce12f8700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcdc074770 0x7fdcdc19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce22fa700 1 -- 172.21.15.50:0/809432611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc072f60 msgr2=0x7fdcdc19d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce22fa700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc072f60 0x7fdcdc19d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce22fa700 1 -- 172.21.15.50:0/809432611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcdc074770 msgr2=0x7fdcdc19d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce22fa700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcdc074770 0x7fdcdc19d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce22fa700 1 -- 172.21.15.50:0/809432611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4009d00 con 0x7fdcdc111570 2023-10-26T06:40:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce22fa700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1a1ca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4006070 tx=0x7fdcd40078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400e040 con 0x7fdcdc111570 2023-10-26T06:40:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc1a2860 con 0x7fdcdc111570 2023-10-26T06:40:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.172+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcd401d470 con 0x7fdcdc111570 2023-10-26T06:40:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.173+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd401b660 con 0x7fdcdc111570 2023-10-26T06:40:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.173+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc1aa120 con 0x7fdcdc111570 2023-10-26T06:40:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.174+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0740b0 con 0x7fdcdc111570 2023-10-26T06:40:51.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.175+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdcd401d5e0 con 0x7fdcdc111570 2023-10-26T06:40:51.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.177+0000 7fdcd2ffd700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc80a14d0 0x7fdcc80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:51.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.177+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fdcd40cd510 con 0x7fdcdc111570 2023-10-26T06:40:51.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.177+0000 7fdce1af9700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc80a14d0 0x7fdcc80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:51.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.178+0000 7fdce1af9700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc80a14d0 0x7fdcc80a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009c60 tx=0x7fdcd8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:51.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.181+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdcd4096fd0 con 0x7fdcdc111570 2023-10-26T06:40:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.397+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcdc19e6c0 con 0x7fdcdc111570 2023-10-26T06:40:51.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.397+0000 7fdcd2ffd700 1 -- 172.21.15.50:0/809432611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcd409a5f0 con 0x7fdcdc111570 2023-10-26T06:40:51.399 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:40:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc80a14d0 msgr2=0x7fdcc80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc80a14d0 0x7fdcc80a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009c60 tx=0x7fdcd8009260 comp rx=0 tx=0).stop 2023-10-26T06:40:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 msgr2=0x7fdcdc1a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1a1ca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4006070 tx=0x7fdcd40078c0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 shutdown_connections 2023-10-26T06:40:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc80a14d0 0x7fdcc80a3990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcdc111570 0x7fdcdc1a1ca0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcdc072f60 0x7fdcdc19d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 --2- 172.21.15.50:0/809432611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcdc074770 0x7fdcdc19d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 >> 172.21.15.50:0/809432611 conn(0x7fdcdc0779e0 msgr2=0x7fdcdc110140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.399+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 shutdown_connections 2023-10-26T06:40:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:51.400+0000 7fdce3d5d700 1 -- 172.21.15.50:0/809432611 wait complete. 2023-10-26T06:40:51.929 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:51 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/809432611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:40:51.935 INFO:tasks.cephadm:Adding mds.a on smithi050 2023-10-26T06:40:51.935 INFO:tasks.cephadm:Adding mds.d on smithi050 2023-10-26T06:40:51.936 INFO:tasks.cephadm:Adding mds.g on smithi050 2023-10-26T06:40:51.936 INFO:tasks.cephadm:Adding mds.j on smithi050 2023-10-26T06:40:51.936 INFO:tasks.cephadm:Adding mds.b on smithi125 2023-10-26T06:40:51.936 INFO:tasks.cephadm:Adding mds.e on smithi125 2023-10-26T06:40:51.937 INFO:tasks.cephadm:Adding mds.h on smithi125 2023-10-26T06:40:51.937 INFO:tasks.cephadm:Adding mds.k on smithi125 2023-10-26T06:40:51.937 INFO:tasks.cephadm:Adding mds.c on smithi153 2023-10-26T06:40:51.938 INFO:tasks.cephadm:Adding mds.f on smithi153 2023-10-26T06:40:51.938 INFO:tasks.cephadm:Adding mds.i on smithi153 2023-10-26T06:40:51.938 INFO:tasks.cephadm:Adding mds.l on smithi153 2023-10-26T06:40:51.939 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph orch apply mds all '12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l' 2023-10-26T06:40:51.972 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:51 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/809432611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:40:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:51 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/809432611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:40:52.514 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:40:52.972 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:52 smithi153 ceph-mon[131657]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:52 smithi050 ceph-mon[94997]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:52 smithi125 ceph-mon[130643]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:53.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1017917326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b341045b0 msgr2=0x7f5b34104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:53.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1017917326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b341045b0 0x7f5b34104990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009990 tx=0x7f5b28009ca0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1017917326 shutdown_connections 2023-10-26T06:40:53.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1017917326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b341000a0 0x7f5b3410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1017917326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b341045b0 0x7f5b34104990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1017917326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b340ff6e0 0x7f5b340ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1017917326 >> 172.21.15.153:0/1017917326 conn(0x7f5b340766c0 msgr2=0x7f5b34076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:53.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1017917326 shutdown_connections 2023-10-26T06:40:53.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.719+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1017917326 wait complete. 2023-10-26T06:40:53.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 Processor -- start 2023-10-26T06:40:53.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 -- start start 2023-10-26T06:40:53.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 0x7f5b34197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:53.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b341000a0 0x7f5b34198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:53.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b341045b0 0x7f5b341a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:53.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34198880 con 0x7f5b341000a0 2023-10-26T06:40:53.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b341a30b0 con 0x7f5b341045b0 2023-10-26T06:40:53.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b3af3f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b341a31f0 con 0x7f5b340ff6e0 2023-10-26T06:40:53.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 0x7f5b34197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:53.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 0x7f5b34197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36124/0 (socket says 172.21.15.153:36124) 2023-10-26T06:40:53.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 -- 172.21.15.153:0/1221759357 learned_addr learned my addr 172.21.15.153:0/1221759357 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-10-26T06:40:53.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b394dc700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b341045b0 0x7f5b341a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:53.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 -- 172.21.15.153:0/1221759357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b341045b0 msgr2=0x7f5b341a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:53.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b341045b0 0x7f5b341a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 -- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b341000a0 msgr2=0x7f5b34198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:53.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b341000a0 0x7f5b34198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 -- 172.21.15.153:0/1221759357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280095f0 con 0x7f5b340ff6e0 2023-10-26T06:40:53.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b394dc700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b341045b0 0x7f5b341a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:40:53.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.720+0000 7f5b38cdb700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 0x7f5b34197af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b280098e0 tx=0x7f5b2800f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:53.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.721+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2801d070 con 0x7f5b340ff6e0 2023-10-26T06:40:53.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.721+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b341a33f0 con 0x7f5b340ff6e0 2023-10-26T06:40:53.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.721+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b2800fb90 con 0x7f5b340ff6e0 2023-10-26T06:40:53.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.721+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28017650 con 0x7f5b340ff6e0 2023-10-26T06:40:53.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.721+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b341a3890 con 0x7f5b340ff6e0 2023-10-26T06:40:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.722+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b34107c20 con 0x7f5b340ff6e0 2023-10-26T06:40:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.723+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5b2800fd00 con 0x7f5b340ff6e0 2023-10-26T06:40:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.723+0000 7f5b31ffb700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b240a14d0 0x7f5b240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:53.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.724+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f5b280cdc20 con 0x7f5b340ff6e0 2023-10-26T06:40:53.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.724+0000 7f5b33fff700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b240a14d0 0x7f5b240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:53.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.724+0000 7f5b33fff700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b240a14d0 0x7f5b240a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b20005950 tx=0x7f5b200058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:53.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.728+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b28097640 con 0x7f5b340ff6e0 2023-10-26T06:40:53.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.926+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3410f690 con 0x7f5b240a14d0 2023-10-26T06:40:53.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.935+0000 7f5b31ffb700 1 -- 172.21.15.153:0/1221759357 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f5b3410f690 con 0x7f5b240a14d0 2023-10-26T06:40:53.936 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mds.all update... 2023-10-26T06:40:53.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b240a14d0 msgr2=0x7f5b240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:53.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b240a14d0 0x7f5b240a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b20005950 tx=0x7f5b200058e0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 msgr2=0x7f5b34197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 0x7f5b34197af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b280098e0 tx=0x7f5b2800f720 comp rx=0 tx=0).stop 2023-10-26T06:40:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 shutdown_connections 2023-10-26T06:40:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b240a14d0 0x7f5b240a3990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b341045b0 0x7f5b341a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b340ff6e0 0x7f5b34197af0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 --2- 172.21.15.153:0/1221759357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b341000a0 0x7f5b34198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:53.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 >> 172.21.15.153:0/1221759357 conn(0x7f5b340766c0 msgr2=0x7f5b340fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:53.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 shutdown_connections 2023-10-26T06:40:53.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-26T06:40:53.937+0000 7f5b3af3f700 1 -- 172.21.15.153:0/1221759357 wait complete. 2023-10-26T06:40:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:53 smithi125 ceph-mon[130643]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:53 smithi153 ceph-mon[131657]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:53 smithi050 ceph-mon[94997]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:54.376 DEBUG:teuthology.orchestra.run.smithi050:mds.a> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.a.service 2023-10-26T06:40:54.382 DEBUG:teuthology.orchestra.run.smithi050:mds.d> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.d.service 2023-10-26T06:40:54.427 DEBUG:teuthology.orchestra.run.smithi050:mds.g> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.g.service 2023-10-26T06:40:54.464 INFO:journalctl@ceph.mds.a.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:40:54.467 DEBUG:teuthology.orchestra.run.smithi050:mds.j> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.j.service 2023-10-26T06:40:54.502 INFO:journalctl@ceph.mds.d.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:40:54.506 DEBUG:teuthology.orchestra.run.smithi125:mds.b> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.b.service 2023-10-26T06:40:54.508 DEBUG:teuthology.orchestra.run.smithi125:mds.e> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.e.service 2023-10-26T06:40:54.540 INFO:journalctl@ceph.mds.g.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:40:54.546 INFO:journalctl@ceph.mds.b.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:40:54.548 DEBUG:teuthology.orchestra.run.smithi125:mds.h> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.h.service 2023-10-26T06:40:54.577 INFO:journalctl@ceph.mds.j.smithi050.stdout:-- Logs begin at Thu 2023-10-26 06:16:34 UTC. -- 2023-10-26T06:40:54.579 INFO:journalctl@ceph.mds.e.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:40:54.580 DEBUG:teuthology.orchestra.run.smithi125:mds.k> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.k.service 2023-10-26T06:40:54.612 INFO:journalctl@ceph.mds.h.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:40:54.614 DEBUG:teuthology.orchestra.run.smithi153:mds.c> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.c.service 2023-10-26T06:40:54.616 DEBUG:teuthology.orchestra.run.smithi153:mds.f> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.f.service 2023-10-26T06:40:54.645 INFO:journalctl@ceph.mds.k.smithi125.stdout:-- Logs begin at Thu 2023-10-26 06:12:34 UTC. -- 2023-10-26T06:40:54.646 INFO:journalctl@ceph.mds.c.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:40:54.647 DEBUG:teuthology.orchestra.run.smithi153:mds.i> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.i.service 2023-10-26T06:40:54.673 INFO:journalctl@ceph.mds.f.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:40:54.674 DEBUG:teuthology.orchestra.run.smithi153:mds.l> sudo journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.l.service 2023-10-26T06:40:54.699 INFO:journalctl@ceph.mds.i.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:40:54.700 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-26T06:40:54.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:40:54.726 INFO:journalctl@ceph.mds.l.smithi153.stdout:-- Logs begin at Thu 2023-10-26 06:12:46 UTC. -- 2023-10-26T06:40:54.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.920+0000 7fd457bff700 1 -- 172.21.15.50:0/3111816019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd450073540 msgr2=0x7fd45010c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:54.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.920+0000 7fd457bff700 1 --2- 172.21.15.50:0/3111816019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd450073540 0x7fd45010c9a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd440009990 tx=0x7fd440009ca0 comp rx=0 tx=0).stop 2023-10-26T06:40:54.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 -- 172.21.15.50:0/3111816019 shutdown_connections 2023-10-26T06:40:54.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 --2- 172.21.15.50:0/3111816019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd45010cee0 0x7fd45010f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:54.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 --2- 172.21.15.50:0/3111816019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd450072c20 0x7fd450073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:54.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 --2- 172.21.15.50:0/3111816019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd450073540 0x7fd45010c9a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:54.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 -- 172.21.15.50:0/3111816019 >> 172.21.15.50:0/3111816019 conn(0x7fd4500fc170 msgr2=0x7fd4500fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:54.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 -- 172.21.15.50:0/3111816019 shutdown_connections 2023-10-26T06:40:54.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.921+0000 7fd457bff700 1 -- 172.21.15.50:0/3111816019 wait complete. 2023-10-26T06:40:54.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 Processor -- start 2023-10-26T06:40:54.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 -- start start 2023-10-26T06:40:54.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd450072c20 0x7fd450198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:54.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd450073540 0x7fd450199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:54.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 0x7fd45019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:54.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019dca0 con 0x7fd45010cee0 2023-10-26T06:40:54.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019de10 con 0x7fd450073540 2023-10-26T06:40:54.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd457bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019dfd0 con 0x7fd450072c20 2023-10-26T06:40:54.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd45619c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 0x7fd45019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:54.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd45619c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 0x7fd45019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41216/0 (socket says 172.21.15.50:41216) 2023-10-26T06:40:54.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.922+0000 7fd45619c700 1 -- 172.21.15.50:0/1247466329 learned_addr learned my addr 172.21.15.50:0/1247466329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:54.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45519a700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd450073540 0x7fd450199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:54.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45599b700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd450072c20 0x7fd450198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:54.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45619c700 1 -- 172.21.15.50:0/1247466329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd450072c20 msgr2=0x7fd450198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:54.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45619c700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd450072c20 0x7fd450198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:54.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45619c700 1 -- 172.21.15.50:0/1247466329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd450073540 msgr2=0x7fd450199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:54.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45619c700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd450073540 0x7fd450199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:54.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45619c700 1 -- 172.21.15.50:0/1247466329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400095f0 con 0x7fd45010cee0 2023-10-26T06:40:54.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd45619c700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 0x7fd45019d660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd448007ee0 tx=0x7fd44800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:54.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448017070 con 0x7fd45010cee0 2023-10-26T06:40:54.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd44800f040 con 0x7fd45010cee0 2023-10-26T06:40:54.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448005580 con 0x7fd45010cee0 2023-10-26T06:40:54.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.923+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45019e2b0 con 0x7fd45010cee0 2023-10-26T06:40:54.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.924+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4501a5af0 con 0x7fd45010cee0 2023-10-26T06:40:54.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.925+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4501080f0 con 0x7fd45010cee0 2023-10-26T06:40:54.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.927+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd44800db20 con 0x7fd45010cee0 2023-10-26T06:40:54.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.928+0000 7fd446ffd700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd43c0a1550 0x7fd43c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:54.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.928+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd4480cc710 con 0x7fd45010cee0 2023-10-26T06:40:54.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.928+0000 7fd45599b700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd43c0a1550 0x7fd43c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:54.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.929+0000 7fd45599b700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd43c0a1550 0x7fd43c0a3a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009c60 tx=0x7fd44c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:54.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:54.931+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd4480960a0 con 0x7fd45010cee0 2023-10-26T06:40:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2023-10-26T06:40:55.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:55.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:55.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:55.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:55.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:55.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:55.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:55.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:55.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:54 smithi050 ceph-mon[94997]: Deploying daemon mds.l on smithi153 2023-10-26T06:40:55.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.144+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd45019a080 con 0x7fd45010cee0 2023-10-26T06:40:55.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.145+0000 7fd446ffd700 1 -- 172.21.15.50:0/1247466329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18762 (secure 0 0 0) 0x7fd4480996c0 con 0x7fd45010cee0 2023-10-26T06:40:55.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:40:55.148 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:40:43.836331+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:40:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd43c0a1550 msgr2=0x7fd43c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd43c0a1550 0x7fd43c0a3a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009c60 tx=0x7fd44c009260 comp rx=0 tx=0).stop 2023-10-26T06:40:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 msgr2=0x7fd45019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 0x7fd45019d660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd448007ee0 tx=0x7fd44800d3b0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 shutdown_connections 2023-10-26T06:40:55.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd43c0a1550 0x7fd43c0a3a10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd45010cee0 0x7fd45019d660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd450072c20 0x7fd450198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 --2- 172.21.15.50:0/1247466329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd450073540 0x7fd450199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 >> 172.21.15.50:0/1247466329 conn(0x7fd4500fc170 msgr2=0x7fd4500fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 shutdown_connections 2023-10-26T06:40:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.148+0000 7fd457bff700 1 -- 172.21.15.50:0/1247466329 wait complete. 2023-10-26T06:40:55.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:40:55.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:40:55.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:55.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2023-10-26T06:40:55.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:55.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:55.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:55.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:55.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:55.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:55.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:55.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:55.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:54 smithi153 ceph-mon[131657]: Deploying daemon mds.l on smithi153 2023-10-26T06:40:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 -- 172.21.15.50:0/2461716347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c100720 msgr2=0x7fd75c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 --2- 172.21.15.50:0/2461716347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c100720 0x7fd75c100ba0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd750009990 tx=0x7fd750009ca0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 -- 172.21.15.50:0/2461716347 shutdown_connections 2023-10-26T06:40:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 --2- 172.21.15.50:0/2461716347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c1010e0 0x7fd75c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 --2- 172.21.15.50:0/2461716347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd75c106730 0x7fd75c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 --2- 172.21.15.50:0/2461716347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c100720 0x7fd75c100ba0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 -- 172.21.15.50:0/2461716347 >> 172.21.15.50:0/2461716347 conn(0x7fd75c0fc1b0 msgr2=0x7fd75c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 -- 172.21.15.50:0/2461716347 shutdown_connections 2023-10-26T06:40:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.378+0000 7fd761bff700 1 -- 172.21.15.50:0/2461716347 wait complete. 2023-10-26T06:40:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.379+0000 7fd761bff700 1 Processor -- start 2023-10-26T06:40:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.379+0000 7fd761bff700 1 -- start start 2023-10-26T06:40:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.379+0000 7fd761bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c100720 0x7fd75c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd761bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 0x7fd75c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd761bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd75c106730 0x7fd75c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd761bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1a4f30 con 0x7fd75c1010e0 2023-10-26T06:40:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd761bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1a50a0 con 0x7fd75c100720 2023-10-26T06:40:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd761bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c1a5260 con 0x7fd75c106730 2023-10-26T06:40:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 0x7fd75c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 0x7fd75c073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41244/0 (socket says 172.21.15.50:41244) 2023-10-26T06:40:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 -- 172.21.15.50:0/2482264707 learned_addr learned my addr 172.21.15.50:0/2482264707 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75b7fe700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c100720 0x7fd75c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 -- 172.21.15.50:0/2482264707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd75c106730 msgr2=0x7fd75c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd75c106730 0x7fd75c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 -- 172.21.15.50:0/2482264707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c100720 msgr2=0x7fd75c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c100720 0x7fd75c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 -- 172.21.15.50:0/2482264707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500095f0 con 0x7fd75c1010e0 2023-10-26T06:40:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.380+0000 7fd75affd700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 0x7fd75c073030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd750005910 tx=0x7fd750004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.381+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75001d070 con 0x7fd75c1010e0 2023-10-26T06:40:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.381+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd750022470 con 0x7fd75c1010e0 2023-10-26T06:40:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.381+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c1a54e0 con 0x7fd75c1010e0 2023-10-26T06:40:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.381+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750017650 con 0x7fd75c1010e0 2023-10-26T06:40:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.381+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c1a59c0 con 0x7fd75c1010e0 2023-10-26T06:40:55.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.382+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c108cb0 con 0x7fd75c1010e0 2023-10-26T06:40:55.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.384+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd7500225e0 con 0x7fd75c1010e0 2023-10-26T06:40:55.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.385+0000 7fd758ff9700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7440a14d0 0x7fd7440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.385+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd7500ce130 con 0x7fd75c1010e0 2023-10-26T06:40:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.385+0000 7fd75b7fe700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7440a14d0 0x7fd7440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.386+0000 7fd75b7fe700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7440a14d0 0x7fd7440a3990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005950 tx=0x7fd74c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.387+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd750097b50 con 0x7fd75c1010e0 2023-10-26T06:40:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:40:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2023-10-26T06:40:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:40:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:40:55.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:55.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:55.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:55.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:55.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:54 smithi125 ceph-mon[130643]: Deploying daemon mds.l on smithi153 2023-10-26T06:40:55.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.601+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd75c073fd0 con 0x7fd75c1010e0 2023-10-26T06:40:55.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.601+0000 7fd758ff9700 1 -- 172.21.15.50:0/2482264707 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd75009b170 con 0x7fd75c1010e0 2023-10-26T06:40:55.603 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:40:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7440a14d0 msgr2=0x7fd7440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7440a14d0 0x7fd7440a3990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005950 tx=0x7fd74c00b410 comp rx=0 tx=0).stop 2023-10-26T06:40:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 msgr2=0x7fd75c073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 0x7fd75c073030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd750005910 tx=0x7fd750004730 comp rx=0 tx=0).stop 2023-10-26T06:40:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 shutdown_connections 2023-10-26T06:40:55.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7440a14d0 0x7fd7440a3990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd75c106730 0x7fd75c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd75c100720 0x7fd75c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 --2- 172.21.15.50:0/2482264707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd75c1010e0 0x7fd75c073030 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 >> 172.21.15.50:0/2482264707 conn(0x7fd75c0fc1b0 msgr2=0x7fd75c0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 shutdown_connections 2023-10-26T06:40:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.604+0000 7fd761bff700 1 -- 172.21.15.50:0/2482264707 wait complete. 2023-10-26T06:40:55.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:40:55.734 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:40:55 smithi153 systemd[1]: Starting Ceph mds.l for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:40:55.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 -- 172.21.15.50:0/3727521378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d94101060 msgr2=0x7f0d9410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 --2- 172.21.15.50:0/3727521378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d94101060 0x7f0d9410d570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00b0a0 tx=0x7f0d8c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 -- 172.21.15.50:0/3727521378 shutdown_connections 2023-10-26T06:40:55.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 --2- 172.21.15.50:0/3727521378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d94101060 0x7f0d9410d570 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 --2- 172.21.15.50:0/3727521378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d941066b0 0x7f0d94106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 --2- 172.21.15.50:0/3727521378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d941006a0 0x7f0d94100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 -- 172.21.15.50:0/3727521378 >> 172.21.15.50:0/3727521378 conn(0x7f0d940fc170 msgr2=0x7f0d940fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:55.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 -- 172.21.15.50:0/3727521378 shutdown_connections 2023-10-26T06:40:55.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.829+0000 7f0d98bff700 1 -- 172.21.15.50:0/3727521378 wait complete. 2023-10-26T06:40:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.830+0000 7f0d98bff700 1 Processor -- start 2023-10-26T06:40:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.830+0000 7f0d98bff700 1 -- start start 2023-10-26T06:40:55.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d98bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d941006a0 0x7f0d9419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d98bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 0x7f0d9419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d98bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d941066b0 0x7f0d94198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d98bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94199240 con 0x7f0d941066b0 2023-10-26T06:40:55.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d98bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941993b0 con 0x7f0d941006a0 2023-10-26T06:40:55.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d98bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94199570 con 0x7f0d94101060 2023-10-26T06:40:55.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 0x7f0d9419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 0x7f0d9419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34520/0 (socket says 172.21.15.50:34520) 2023-10-26T06:40:55.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 -- 172.21.15.50:0/1027537441 learned_addr learned my addr 172.21.15.50:0/1027537441 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:55.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d9259c700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d941006a0 0x7f0d9419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d92d9d700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d941066b0 0x7f0d94198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 -- 172.21.15.50:0/1027537441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d941006a0 msgr2=0x7f0d9419e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d941006a0 0x7f0d9419e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 -- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d941066b0 msgr2=0x7f0d94198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:55.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d941066b0 0x7f0d94198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.831+0000 7f0d91d9b700 1 -- 172.21.15.50:0/1027537441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c009d00 con 0x7f0d94101060 2023-10-26T06:40:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.832+0000 7f0d91d9b700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 0x7f0d9419ef10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e9a0 tx=0x7f0d8800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.832+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88009790 con 0x7f0d94101060 2023-10-26T06:40:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.832+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d88010430 con 0x7f0d94101060 2023-10-26T06:40:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.832+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d94199850 con 0x7f0d94101060 2023-10-26T06:40:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.832+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88018680 con 0x7f0d94101060 2023-10-26T06:40:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.832+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d941a5950 con 0x7f0d94101060 2023-10-26T06:40:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.833+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94101de0 con 0x7f0d94101060 2023-10-26T06:40:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.835+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0d880105a0 con 0x7f0d94101060 2023-10-26T06:40:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.836+0000 7f0d837fe700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0d7c0a14d0 0x7f0d7c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.836+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f0d88014070 con 0x7f0d94101060 2023-10-26T06:40:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.836+0000 7f0d9259c700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0d7c0a14d0 0x7f0d7c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.837+0000 7f0d9259c700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0d7c0a14d0 0x7f0d7c0a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009be0 tx=0x7f0d84009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:55.838+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d880965a0 con 0x7f0d94101060 2023-10-26T06:40:56.052 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:40:55 smithi153 podman[169793]: 2023-10-26T06:40:56.053 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:40:55 smithi153 bash[169793]: f84cd7fe016d60e96650138e096027a1179e07e3a1ae09e9851e3f743c887734 2023-10-26T06:40:56.053 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:40:55 smithi153 ceph-mds[169833]: -- 172.21.15.153:0/207802419 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a8214451e0 con 0x55a82141ac00 2023-10-26T06:40:56.053 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:40:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-l[169809]: starting mds.l at 2023-10-26T06:40:56.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:55 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1247466329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:40:56.054 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:55 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2482264707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:40:56.054 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:55 smithi153 ceph-mon[131657]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:56.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.100+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d94110620 con 0x7f0d94101060 2023-10-26T06:40:56.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.101+0000 7f0d837fe700 1 -- 172.21.15.50:0/1027537441 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f0d880cae60 con 0x7f0d94101060 2023-10-26T06:40:56.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:40:56.103 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-26T06:40:56.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.103+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0d7c0a14d0 msgr2=0x7f0d7c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:56.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.103+0000 7f0d98bff700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0d7c0a14d0 0x7f0d7c0a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009be0 tx=0x7f0d84009260 comp rx=0 tx=0).stop 2023-10-26T06:40:56.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.103+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 msgr2=0x7f0d9419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:56.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.103+0000 7f0d98bff700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 0x7f0d9419ef10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e9a0 tx=0x7f0d8800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:40:56.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 shutdown_connections 2023-10-26T06:40:56.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0d7c0a14d0 0x7f0d7c0a3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:56.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d941066b0 0x7f0d94198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:56.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d941006a0 0x7f0d9419e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:56.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 --2- 172.21.15.50:0/1027537441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d94101060 0x7f0d9419ef10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:56.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 >> 172.21.15.50:0/1027537441 conn(0x7f0d940fc170 msgr2=0x7f0d940fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 shutdown_connections 2023-10-26T06:40:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:56.104+0000 7f0d98bff700 1 -- 172.21.15.50:0/1027537441 wait complete. 2023-10-26T06:40:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2023-10-26T06:40:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:55 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1247466329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:40:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:55 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2482264707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:40:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:55 smithi050 ceph-mon[94997]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:55 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1247466329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:40:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:55 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2482264707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:40:56.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:55 smithi125 ceph-mon[130643]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:56.484 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:40:56 smithi153 systemd[1]: Started Ceph mds.l for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:40:57.088 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6832/2111783202,v1:172.21.15.153:6833/2111783202] up:boot 2023-10-26T06:40:57.089 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: fsmap 1 up:standby 2023-10-26T06:40:57.089 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-26T06:40:57.089 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.089 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.089 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1027537441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:40:57.090 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.090 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:57.090 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:57.090 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:57.090 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:56 smithi125 ceph-mon[130643]: Deploying daemon mds.k on smithi125 2023-10-26T06:40:57.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6832/2111783202,v1:172.21.15.153:6833/2111783202] up:boot 2023-10-26T06:40:57.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: fsmap 1 up:standby 2023-10-26T06:40:57.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-26T06:40:57.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1027537441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:40:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:56 smithi050 ceph-mon[94997]: Deploying daemon mds.k on smithi125 2023-10-26T06:40:57.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6832/2111783202,v1:172.21.15.153:6833/2111783202] up:boot 2023-10-26T06:40:57.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: fsmap 1 up:standby 2023-10-26T06:40:57.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-26T06:40:57.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1027537441' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:40:57.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:57.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:57.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:57.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:57.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:56 smithi153 ceph-mon[131657]: Deploying daemon mds.k on smithi125 2023-10-26T06:40:57.672 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:40:57 smithi125 systemd[1]: Starting Ceph mds.k for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:40:58.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:40:58.136 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:40:57 smithi125 podman[167130]: 2023-10-26T06:40:58.136 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:58 smithi125 ceph-mon[130643]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:58 smithi050 ceph-mon[94997]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:58.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 -- 172.21.15.50:0/4060550634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff958073540 msgr2=0x7ff95810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:58.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/4060550634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff958073540 0x7ff95810c9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009990 tx=0x7ff94c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 -- 172.21.15.50:0/4060550634 shutdown_connections 2023-10-26T06:40:58.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/4060550634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff95810cee0 0x7ff95810f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/4060550634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958072c20 0x7ff958073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/4060550634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff958073540 0x7ff95810c9a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 -- 172.21.15.50:0/4060550634 >> 172.21.15.50:0/4060550634 conn(0x7ff9580fc170 msgr2=0x7ff9580fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 -- 172.21.15.50:0/4060550634 shutdown_connections 2023-10-26T06:40:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.354+0000 7ff95e7ff700 1 -- 172.21.15.50:0/4060550634 wait complete. 2023-10-26T06:40:58.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 Processor -- start 2023-10-26T06:40:58.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 -- start start 2023-10-26T06:40:58.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff958072c20 0x7ff958198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:58.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958073540 0x7ff9581992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:58.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 0x7ff95819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95819dcd0 con 0x7ff95810cee0 2023-10-26T06:40:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95819de40 con 0x7ff958073540 2023-10-26T06:40:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.355+0000 7ff95e7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95819e000 con 0x7ff958072c20 2023-10-26T06:40:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 0x7ff95819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 0x7ff95819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41294/0 (socket says 172.21.15.50:41294) 2023-10-26T06:40:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 -- 172.21.15.50:0/3921306173 learned_addr learned my addr 172.21.15.50:0/3921306173 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:40:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff957fff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff958072c20 0x7ff958198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff9577fe700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958073540 0x7ff9581992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 -- 172.21.15.50:0/3921306173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff958072c20 msgr2=0x7ff958198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff958072c20 0x7ff958198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 -- 172.21.15.50:0/3921306173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958073540 msgr2=0x7ff9581992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958073540 0x7ff9581992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff95cd9c700 1 -- 172.21.15.50:0/3921306173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c0095f0 con 0x7ff95810cee0 2023-10-26T06:40:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.356+0000 7ff9577fe700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958073540 0x7ff9581992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:40:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.357+0000 7ff95cd9c700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 0x7ff95819d690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff95000ef30 tx=0x7ff95000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.357+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950018070 con 0x7ff95810cee0 2023-10-26T06:40:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.357+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff95000f040 con 0x7ff95810cee0 2023-10-26T06:40:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.357+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000cd00 con 0x7ff95810cee0 2023-10-26T06:40:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.357+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95819e280 con 0x7ff95810cee0 2023-10-26T06:40:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.357+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9581a5b20 con 0x7ff95810cee0 2023-10-26T06:40:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.358+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9581080f0 con 0x7ff95810cee0 2023-10-26T06:40:58.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.360+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff950003a00 con 0x7ff95810cee0 2023-10-26T06:40:58.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.361+0000 7ff9557fa700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9400a14d0 0x7ff9400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:40:58.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.361+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff9500cc4f0 con 0x7ff95810cee0 2023-10-26T06:40:58.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.362+0000 7ff957fff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9400a14d0 0x7ff9400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:40:58.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.362+0000 7ff957fff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9400a14d0 0x7ff9400a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff948009c60 tx=0x7ff948009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:40:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.367+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff950095f10 con 0x7ff95810cee0 2023-10-26T06:40:58.422 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:40:58 smithi125 ceph-mds[167171]: -- 172.21.15.125:0/1666632368 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5557358d71e0 con 0x5557358ad000 2023-10-26T06:40:58.423 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:40:58 smithi125 bash[167130]: c655bdf56206d1c659c5176080a9da15e36c7b0f8f8058d0d6390616b945bfed 2023-10-26T06:40:58.423 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:40:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-k[167146]: starting mds.k at 2023-10-26T06:40:58.423 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:40:58 smithi125 systemd[1]: Started Ceph mds.k for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:40:58.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:58 smithi153 ceph-mon[131657]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:40:58.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.633+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9580742d0 con 0x7ff95810cee0 2023-10-26T06:40:58.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.634+0000 7ff9557fa700 1 -- 172.21.15.50:0/3921306173 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7ff950099530 con 0x7ff95810cee0 2023-10-26T06:40:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:40:58.636 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-26T06:40:58.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9400a14d0 msgr2=0x7ff9400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:58.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9400a14d0 0x7ff9400a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff948009c60 tx=0x7ff948009260 comp rx=0 tx=0).stop 2023-10-26T06:40:58.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 msgr2=0x7ff95819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:40:58.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 0x7ff95819d690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff95000ef30 tx=0x7ff95000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 shutdown_connections 2023-10-26T06:40:58.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9400a14d0 0x7ff9400a3990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff95810cee0 0x7ff95819d690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff958072c20 0x7ff958198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 --2- 172.21.15.50:0/3921306173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff958073540 0x7ff9581992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:40:58.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 >> 172.21.15.50:0/3921306173 conn(0x7ff9580fc170 msgr2=0x7ff9580fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:40:58.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 shutdown_connections 2023-10-26T06:40:58.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:40:58.637+0000 7ff95e7ff700 1 -- 172.21.15.50:0/3921306173 wait complete. 2023-10-26T06:40:58.641 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2023-10-26T06:40:59.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:59.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:59.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:59.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: Deploying daemon mds.j on smithi050 2023-10-26T06:40:59.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3921306173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:40:59.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6832/1915771333,v1:172.21.15.125:6833/1915771333] up:boot 2023-10-26T06:40:59.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: fsmap 2 up:standby 2023-10-26T06:40:59.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:40:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-26T06:40:59.492 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.492 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.492 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:59.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:59.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:59.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: Deploying daemon mds.j on smithi050 2023-10-26T06:40:59.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3921306173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:40:59.494 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6832/1915771333,v1:172.21.15.125:6833/1915771333] up:boot 2023-10-26T06:40:59.494 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: fsmap 2 up:standby 2023-10-26T06:40:59.494 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:40:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-26T06:40:59.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:40:59.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:40:59.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:40:59.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:40:59.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: Deploying daemon mds.j on smithi050 2023-10-26T06:40:59.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3921306173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:40:59.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6832/1915771333,v1:172.21.15.125:6833/1915771333] up:boot 2023-10-26T06:40:59.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: fsmap 2 up:standby 2023-10-26T06:40:59.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:40:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-26T06:41:00.400 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:00 smithi050 ceph-mon[94997]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:00.400 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:41:00 smithi050 systemd[1]: Starting Ceph mds.j for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:00.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:00 smithi153 ceph-mon[131657]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:00.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:00.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:00 smithi125 ceph-mon[130643]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:00.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.887+0000 7f68d9dff700 1 -- 172.21.15.50:0/1457945044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4073540 msgr2=0x7f68d410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.887+0000 7f68d9dff700 1 --2- 172.21.15.50:0/1457945044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4073540 0x7f68d410c9a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009990 tx=0x7f68bc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 -- 172.21.15.50:0/1457945044 shutdown_connections 2023-10-26T06:41:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 --2- 172.21.15.50:0/1457945044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68d410cee0 0x7f68d410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 --2- 172.21.15.50:0/1457945044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4072c20 0x7f68d4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:00.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 --2- 172.21.15.50:0/1457945044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4073540 0x7f68d410c9a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:00.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 -- 172.21.15.50:0/1457945044 >> 172.21.15.50:0/1457945044 conn(0x7f68d40fc170 msgr2=0x7f68d40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:00.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 -- 172.21.15.50:0/1457945044 shutdown_connections 2023-10-26T06:41:00.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.888+0000 7f68d9dff700 1 -- 172.21.15.50:0/1457945044 wait complete. 2023-10-26T06:41:00.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 Processor -- start 2023-10-26T06:41:00.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 -- start start 2023-10-26T06:41:00.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 0x7f68d4198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:00.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4073540 0x7f68d4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:00.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68d410cee0 0x7f68d419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419dcc0 con 0x7f68d4072c20 2023-10-26T06:41:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419de30 con 0x7f68d410cee0 2023-10-26T06:41:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.889+0000 7f68d9dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419dff0 con 0x7f68d4073540 2023-10-26T06:41:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 0x7f68d4198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 0x7f68d4198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41306/0 (socket says 172.21.15.50:41306) 2023-10-26T06:41:00.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 -- 172.21.15.50:0/4158055091 learned_addr learned my addr 172.21.15.50:0/4158055091 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:00.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68cbfff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4073540 0x7f68d4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:00.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d3fff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68d410cee0 0x7f68d419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:00.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 -- 172.21.15.50:0/4158055091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4073540 msgr2=0x7f68d4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:00.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4073540 0x7f68d4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 -- 172.21.15.50:0/4158055091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68d410cee0 msgr2=0x7f68d419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68d410cee0 0x7f68d419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 -- 172.21.15.50:0/4158055091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0095f0 con 0x7f68d4072c20 2023-10-26T06:41:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d37fe700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 0x7f68d4198df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f68c400d980 tx=0x7f68c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4004a30 con 0x7f68d4072c20 2023-10-26T06:41:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68c40054e0 con 0x7f68d4072c20 2023-10-26T06:41:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c400fbc0 con 0x7f68d4072c20 2023-10-26T06:41:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.890+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d419e2d0 con 0x7f68d4072c20 2023-10-26T06:41:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.891+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d41a5b10 con 0x7f68d4072c20 2023-10-26T06:41:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.892+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d41080f0 con 0x7f68d4072c20 2023-10-26T06:41:00.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.894+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f68c4004c20 con 0x7f68d4072c20 2023-10-26T06:41:00.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.895+0000 7f68d17fa700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68c00a1550 0x7f68c00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:00.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.895+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f68c40cc800 con 0x7f68d4072c20 2023-10-26T06:41:00.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.895+0000 7f68cbfff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68c00a1550 0x7f68c00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:00.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.896+0000 7f68cbfff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68c00a1550 0x7f68c00a3a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68d419a2f0 tx=0x7f68bc00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:00.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:00.899+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f68c4096190 con 0x7f68d4072c20 2023-10-26T06:41:01.011 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:41:00 smithi050 podman[151504]: 2023-10-26T06:41:01.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.168+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68d40742d0 con 0x7f68d4072c20 2023-10-26T06:41:01.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.168+0000 7f68d17fa700 1 -- 172.21.15.50:0/4158055091 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f68c40997b0 con 0x7f68d4072c20 2023-10-26T06:41:01.170 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:01.170 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-26T06:41:01.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68c00a1550 msgr2=0x7f68c00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68c00a1550 0x7f68c00a3a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68d419a2f0 tx=0x7f68bc00b260 comp rx=0 tx=0).stop 2023-10-26T06:41:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 msgr2=0x7f68d4198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 0x7f68d4198df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f68c400d980 tx=0x7f68c400dc90 comp rx=0 tx=0).stop 2023-10-26T06:41:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 shutdown_connections 2023-10-26T06:41:01.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f68c00a1550 0x7f68c00a3a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f68d410cee0 0x7f68d419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68d4072c20 0x7f68d4198df0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 --2- 172.21.15.50:0/4158055091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68d4073540 0x7f68d4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 >> 172.21.15.50:0/4158055091 conn(0x7f68d40fc170 msgr2=0x7f68d40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:01.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 shutdown_connections 2023-10-26T06:41:01.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:01.171+0000 7f68d9dff700 1 -- 172.21.15.50:0/4158055091 wait complete. 2023-10-26T06:41:01.175 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2023-10-26T06:41:01.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:01 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4158055091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:01.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:01 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4158055091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:01.517 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:41:01 smithi050 bash[151504]: a3f2e81b9e910c08860bbdb0ae7af22e10c4e71251a64d3cf3bb1f94fdc7ed1d 2023-10-26T06:41:01.518 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:41:01 smithi050 ceph-mds[151572]: -- 172.21.15.50:0/2133268043 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556f7962f1e0 con 0x556f79606c00 2023-10-26T06:41:01.518 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:41:01 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-j[151548]: starting mds.j at 2023-10-26T06:41:01.518 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:41:01 smithi050 systemd[1]: Started Ceph mds.j for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:01.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:01 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4158055091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:02.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.50:6834/817994746,v1:172.21.15.50:6835/817994746] up:boot 2023-10-26T06:41:02.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: fsmap 3 up:standby 2023-10-26T06:41:02.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-26T06:41:02.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:02.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:02.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:02.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: Deploying daemon mds.d on smithi050 2023-10-26T06:41:02.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:02 smithi153 ceph-mon[131657]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:02.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.50:6834/817994746,v1:172.21.15.50:6835/817994746] up:boot 2023-10-26T06:41:02.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: fsmap 3 up:standby 2023-10-26T06:41:02.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-26T06:41:02.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:02.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:02.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:02.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: Deploying daemon mds.d on smithi050 2023-10-26T06:41:02.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:02 smithi050 ceph-mon[94997]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:02.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.50:6834/817994746,v1:172.21.15.50:6835/817994746] up:boot 2023-10-26T06:41:02.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: fsmap 3 up:standby 2023-10-26T06:41:02.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-26T06:41:02.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:02.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:02.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:02.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:02.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: Deploying daemon mds.d on smithi050 2023-10-26T06:41:02.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:02 smithi125 ceph-mon[130643]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:03.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 -- 172.21.15.50:0/112511581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31841066a0 msgr2=0x7f3184106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:03.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 --2- 172.21.15.50:0/112511581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31841066a0 0x7f3184106a80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3174009990 tx=0x7f3174009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 -- 172.21.15.50:0/112511581 shutdown_connections 2023-10-26T06:41:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 --2- 172.21.15.50:0/112511581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184101050 0x7f318410d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 --2- 172.21.15.50:0/112511581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31841066a0 0x7f3184106a80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 --2- 172.21.15.50:0/112511581 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3184100690 0x7f3184100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 -- 172.21.15.50:0/112511581 >> 172.21.15.50:0/112511581 conn(0x7f31840fc180 msgr2=0x7f31840fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 -- 172.21.15.50:0/112511581 shutdown_connections 2023-10-26T06:41:03.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.427+0000 7f3189dff700 1 -- 172.21.15.50:0/112511581 wait complete. 2023-10-26T06:41:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.429+0000 7f3189dff700 1 Processor -- start 2023-10-26T06:41:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.429+0000 7f3189dff700 1 -- start start 2023-10-26T06:41:03.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3189dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 0x7f318419ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3189dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184101050 0x7f318419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3189dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31841066a0 0x7f3184198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3189dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3184199190 con 0x7f3184101050 2023-10-26T06:41:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3189dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3184199300 con 0x7f31841066a0 2023-10-26T06:41:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3189dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841994c0 con 0x7f3184100690 2023-10-26T06:41:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 0x7f318419ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 0x7f318419ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34604/0 (socket says 172.21.15.50:34604) 2023-10-26T06:41:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 -- 172.21.15.50:0/1562303345 learned_addr learned my addr 172.21.15.50:0/1562303345 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:03.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3182ffd700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184101050 0x7f318419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f3183fff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31841066a0 0x7f3184198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 -- 172.21.15.50:0/1562303345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31841066a0 msgr2=0x7f3184198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31841066a0 0x7f3184198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 -- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184101050 msgr2=0x7f318419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184101050 0x7f318419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.430+0000 7f31837fe700 1 -- 172.21.15.50:0/1562303345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740095f0 con 0x7f3184100690 2023-10-26T06:41:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.431+0000 7f31837fe700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 0x7f318419ea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3174000c00 tx=0x7f3174005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.431+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317401d070 con 0x7f3184100690 2023-10-26T06:41:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.431+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3174022470 con 0x7f3184100690 2023-10-26T06:41:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.431+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3184199740 con 0x7f3184100690 2023-10-26T06:41:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.431+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174017650 con 0x7f3184100690 2023-10-26T06:41:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.431+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31841a59f0 con 0x7f3184100690 2023-10-26T06:41:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.432+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3184101dd0 con 0x7f3184100690 2023-10-26T06:41:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.434+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f31740225e0 con 0x7f3184100690 2023-10-26T06:41:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.436+0000 7f3180ff9700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f316c0a14d0 0x7f316c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.436+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f31740cde00 con 0x7f3184100690 2023-10-26T06:41:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.436+0000 7f3182ffd700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f316c0a14d0 0x7f316c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:03.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.437+0000 7f3182ffd700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f316c0a14d0 0x7f316c0a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3184199cf0 tx=0x7f3178009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.438+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3174097820 con 0x7f3184100690 2023-10-26T06:41:03.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.706+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3184067980 con 0x7f3184100690 2023-10-26T06:41:03.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.707+0000 7f3180ff9700 1 -- 172.21.15.50:0/1562303345 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2910 (secure 0 0 0) 0x7f317409ae40 con 0x7f3184100690 2023-10-26T06:41:03.709 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:03.709 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-10-26T06:41:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f316c0a14d0 msgr2=0x7f316c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f316c0a14d0 0x7f316c0a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3184199cf0 tx=0x7f3178009260 comp rx=0 tx=0).stop 2023-10-26T06:41:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 msgr2=0x7f318419ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 0x7f318419ea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3174000c00 tx=0x7f3174005740 comp rx=0 tx=0).stop 2023-10-26T06:41:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 shutdown_connections 2023-10-26T06:41:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f316c0a14d0 0x7f316c0a3990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31841066a0 0x7f3184198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3184100690 0x7f318419ea00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 --2- 172.21.15.50:0/1562303345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3184101050 0x7f318419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 >> 172.21.15.50:0/1562303345 conn(0x7f31840fc180 msgr2=0x7f318410bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.709+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 shutdown_connections 2023-10-26T06:41:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:03.710+0000 7f3189dff700 1 -- 172.21.15.50:0/1562303345 wait complete. 2023-10-26T06:41:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 4 2023-10-26T06:41:03.848 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:03 smithi050 systemd[1]: Starting Ceph mds.d for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:03 smithi125 ceph-mon[130643]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:03 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1562303345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:04.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:03 smithi050 ceph-mon[94997]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:04.191 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:03 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1562303345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:04.192 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:04 smithi050 podman[151926]: 2023-10-26T06:41:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:03 smithi153 ceph-mon[131657]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:03 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1562303345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:04.767 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:04 smithi050 bash[151926]: 87ddb7156ad43cd7b2bb508d99e3d98524b21ad7e066f3b8df551c73c3bd73ba 2023-10-26T06:41:04.767 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:04 smithi050 ceph-mds[151966]: -- 172.21.15.50:0/3656185452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e6a6b3d1e0 con 0x55e6a6b00c00 2023-10-26T06:41:04.767 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:04 smithi050 ceph-mds[151966]: -- 172.21.15.50:0/3656185452 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e6a6b291e0 con 0x55e6a6b00c00 2023-10-26T06:41:04.768 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:04 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-d[151942]: starting mds.d at 2023-10-26T06:41:04.768 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:41:04 smithi050 systemd[1]: Started Ceph mds.d for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:05.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:05.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:05.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:05.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: Deploying daemon mds.e on smithi125 2023-10-26T06:41:05.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.50:6836/373696388,v1:172.21.15.50:6837/373696388] up:boot 2023-10-26T06:41:05.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: fsmap 4 up:standby 2023-10-26T06:41:05.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:05 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-26T06:41:05.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:05.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:05.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:05.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:05.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: Deploying daemon mds.e on smithi125 2023-10-26T06:41:05.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.50:6836/373696388,v1:172.21.15.50:6837/373696388] up:boot 2023-10-26T06:41:05.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: fsmap 4 up:standby 2023-10-26T06:41:05.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:05 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-26T06:41:05.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:05.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:05.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:05.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:05.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: Deploying daemon mds.e on smithi125 2023-10-26T06:41:05.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.50:6836/373696388,v1:172.21.15.50:6837/373696388] up:boot 2023-10-26T06:41:05.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: fsmap 4 up:standby 2023-10-26T06:41:05.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:05 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-26T06:41:05.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3388859979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2181066b0 msgr2=0x7ff218106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:05.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3388859979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2181066b0 0x7ff218106a90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff208009990 tx=0x7ff208009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3388859979 shutdown_connections 2023-10-26T06:41:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3388859979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff218101060 0x7ff21810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3388859979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2181066b0 0x7ff218106a90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3388859979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2181006a0 0x7ff218100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:05.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3388859979 >> 172.21.15.50:0/3388859979 conn(0x7ff2180fc1d0 msgr2=0x7ff2180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:05.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.951+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3388859979 shutdown_connections 2023-10-26T06:41:05.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.952+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3388859979 wait complete. 2023-10-26T06:41:05.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.952+0000 7ff21e9ff700 1 Processor -- start 2023-10-26T06:41:05.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 -- start start 2023-10-26T06:41:05.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2181006a0 0x7ff218198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 0x7ff2181992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2181066b0 0x7ff21819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21819dca0 con 0x7ff218101060 2023-10-26T06:41:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21819de10 con 0x7ff2181006a0 2023-10-26T06:41:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21e9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21819dfd0 con 0x7ff2181066b0 2023-10-26T06:41:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff2177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 0x7ff2181992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff2177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 0x7ff2181992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55154/0 (socket says 172.21.15.50:55154) 2023-10-26T06:41:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff2177fe700 1 -- 172.21.15.50:0/3854599774 learned_addr learned my addr 172.21.15.50:0/3854599774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.953+0000 7ff21cf9c700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2181066b0 0x7ff21819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:05.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2177fe700 1 -- 172.21.15.50:0/3854599774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2181066b0 msgr2=0x7ff21819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2177fe700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2181066b0 0x7ff21819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2177fe700 1 -- 172.21.15.50:0/3854599774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2181006a0 msgr2=0x7ff218198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2177fe700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2181006a0 0x7ff218198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2177fe700 1 -- 172.21.15.50:0/3854599774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080095f0 con 0x7ff218101060 2023-10-26T06:41:05.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2177fe700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 0x7ff2181992c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00b530 tx=0x7ff20c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011830 con 0x7ff218101060 2023-10-26T06:41:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff20c011e50 con 0x7ff218101060 2023-10-26T06:41:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21819e2b0 con 0x7ff218101060 2023-10-26T06:41:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00f2e0 con 0x7ff218101060 2023-10-26T06:41:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.954+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2181a5af0 con 0x7ff218101060 2023-10-26T06:41:05.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.955+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff218101de0 con 0x7ff218101060 2023-10-26T06:41:05.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.957+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff20c010380 con 0x7ff218101060 2023-10-26T06:41:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.959+0000 7ff2157fa700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff2000a1550 0x7ff2000a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.959+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff20c0cc550 con 0x7ff218101060 2023-10-26T06:41:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.959+0000 7ff217fff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff2000a1550 0x7ff2000a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:05.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.960+0000 7ff217fff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff2000a1550 0x7ff2000a3a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b2e0 tx=0x7ff208005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:05.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:05.963+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff20c095ee0 con 0x7ff218101060 2023-10-26T06:41:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.219+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff218067500 con 0x7ff218101060 2023-10-26T06:41:06.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.219+0000 7ff2157fa700 1 -- 172.21.15.50:0/3854599774 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7ff20c015e90 con 0x7ff218101060 2023-10-26T06:41:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:06.222 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2023-10-26T06:41:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff2000a1550 msgr2=0x7ff2000a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff2000a1550 0x7ff2000a3a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b2e0 tx=0x7ff208005fb0 comp rx=0 tx=0).stop 2023-10-26T06:41:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 msgr2=0x7ff2181992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:06.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 0x7ff2181992c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00b530 tx=0x7ff20c00b840 comp rx=0 tx=0).stop 2023-10-26T06:41:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 shutdown_connections 2023-10-26T06:41:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff2000a1550 0x7ff2000a3a10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2181066b0 0x7ff21819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2181006a0 0x7ff218198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 --2- 172.21.15.50:0/3854599774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101060 0x7ff2181992c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 >> 172.21.15.50:0/3854599774 conn(0x7ff2180fc1d0 msgr2=0x7ff21810bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 shutdown_connections 2023-10-26T06:41:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:06.222+0000 7ff21e9ff700 1 -- 172.21.15.50:0/3854599774 wait complete. 2023-10-26T06:41:06.227 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 5 2023-10-26T06:41:06.328 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:41:06 smithi125 systemd[1]: Starting Ceph mds.e for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:06 smithi050 ceph-mon[94997]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:06 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3854599774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:06.643 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:41:06 smithi125 podman[167476]: 2023-10-26T06:41:06.644 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:06 smithi125 ceph-mon[130643]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:06.644 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:06 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3854599774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:06.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:06 smithi153 ceph-mon[131657]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:06.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:06 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3854599774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:06.922 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:41:06 smithi125 bash[167476]: 21307d5125982235d51678be68c2cfcfa5f6dd732495c8914fd92fa4c1fb603f 2023-10-26T06:41:06.922 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:41:06 smithi125 ceph-mds[167516]: -- 172.21.15.125:0/1574133652 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5587842951e0 con 0x55878426a800 2023-10-26T06:41:06.923 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:41:06 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e[167492]: starting mds.e at 2023-10-26T06:41:06.923 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:41:06 smithi125 systemd[1]: Started Ceph mds.e for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:07.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:07.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:07.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:07.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: Deploying daemon mds.f on smithi153 2023-10-26T06:41:07.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6834/3214904167,v1:172.21.15.125:6835/3214904167] up:boot 2023-10-26T06:41:07.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: fsmap 5 up:standby 2023-10-26T06:41:07.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-26T06:41:07.987 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:07 smithi153 ceph-mon[131657]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:08.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:08.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:08.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:08.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:08.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:08.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:08.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: Deploying daemon mds.f on smithi153 2023-10-26T06:41:08.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6834/3214904167,v1:172.21.15.125:6835/3214904167] up:boot 2023-10-26T06:41:08.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: fsmap 5 up:standby 2023-10-26T06:41:08.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-26T06:41:08.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:07 smithi125 ceph-mon[130643]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:08.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:08.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:08.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:08.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: Deploying daemon mds.f on smithi153 2023-10-26T06:41:08.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6834/3214904167,v1:172.21.15.125:6835/3214904167] up:boot 2023-10-26T06:41:08.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: fsmap 5 up:standby 2023-10-26T06:41:08.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-26T06:41:08.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:07 smithi050 ceph-mon[94997]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 -- 172.21.15.50:0/2474748980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac10cee0 msgr2=0x7fc8ac10f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/2474748980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac10cee0 0x7fc8ac10f350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009f90 tx=0x7fc8a400b330 comp rx=0 tx=0).stop 2023-10-26T06:41:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 -- 172.21.15.50:0/2474748980 shutdown_connections 2023-10-26T06:41:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/2474748980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac10cee0 0x7fc8ac10f350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/2474748980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8ac072c20 0x7fc8ac073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/2474748980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8ac073540 0x7fc8ac10c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 -- 172.21.15.50:0/2474748980 >> 172.21.15.50:0/2474748980 conn(0x7fc8ac0fc170 msgr2=0x7fc8ac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 -- 172.21.15.50:0/2474748980 shutdown_connections 2023-10-26T06:41:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.459+0000 7fc8b39ff700 1 -- 172.21.15.50:0/2474748980 wait complete. 2023-10-26T06:41:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.460+0000 7fc8b39ff700 1 Processor -- start 2023-10-26T06:41:08.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.460+0000 7fc8b39ff700 1 -- start start 2023-10-26T06:41:08.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.460+0000 7fc8b39ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 0x7fc8ac198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:08.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.460+0000 7fc8b39ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8ac073540 0x7fc8ac199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:08.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b39ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8ac10cee0 0x7fc8ac19d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b39ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac19de20 con 0x7fc8ac073540 2023-10-26T06:41:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b39ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac19df90 con 0x7fc8ac10cee0 2023-10-26T06:41:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b39ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac19e150 con 0x7fc8ac072c20 2023-10-26T06:41:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 0x7fc8ac198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 0x7fc8ac198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:52138/0 (socket says 172.21.15.50:52138) 2023-10-26T06:41:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 -- 172.21.15.50:0/1779569499 learned_addr learned my addr 172.21.15.50:0/1779569499 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b0f9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8ac073540 0x7fc8ac199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b1f9c700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8ac10cee0 0x7fc8ac19d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 -- 172.21.15.50:0/1779569499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8ac10cee0 msgr2=0x7fc8ac19d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8ac10cee0 0x7fc8ac19d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 -- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8ac073540 msgr2=0x7fc8ac199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8ac073540 0x7fc8ac199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 -- 172.21.15.50:0/1779569499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4009c40 con 0x7fc8ac072c20 2023-10-26T06:41:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.461+0000 7fc8b179b700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 0x7fc8ac198f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800e9a0 tx=0x7fc8a800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.462+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8009790 con 0x7fc8ac072c20 2023-10-26T06:41:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.462+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8a800cbd0 con 0x7fc8ac072c20 2023-10-26T06:41:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.462+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800eee0 con 0x7fc8ac072c20 2023-10-26T06:41:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.462+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac19e430 con 0x7fc8ac072c20 2023-10-26T06:41:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.462+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac1a5c70 con 0x7fc8ac072c20 2023-10-26T06:41:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.463+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ac1080f0 con 0x7fc8ac072c20 2023-10-26T06:41:08.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.465+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc8a800cd40 con 0x7fc8ac072c20 2023-10-26T06:41:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.466+0000 7fc8a27fc700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc8980a14d0 0x7fc8980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.466+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc8a8014070 con 0x7fc8ac072c20 2023-10-26T06:41:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.466+0000 7fc8b0f9a700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc8980a14d0 0x7fc8980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.467+0000 7fc8b0f9a700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc8980a14d0 0x7fc8980a3990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac19a450 tx=0x7fc89c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.470+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc8a8096ac0 con 0x7fc8ac072c20 2023-10-26T06:41:08.485 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:41:08 smithi153 systemd[1]: Starting Ceph mds.f for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:08.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.725+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8ac0742d0 con 0x7fc8ac072c20 2023-10-26T06:41:08.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.726+0000 7fc8a27fc700 1 -- 172.21.15.50:0/1779569499 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4492 (secure 0 0 0) 0x7fc8a809a0e0 con 0x7fc8ac072c20 2023-10-26T06:41:08.728 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:08.728 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-26T06:41:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.728+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc8980a14d0 msgr2=0x7fc8980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:08.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.728+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc8980a14d0 0x7fc8980a3990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac19a450 tx=0x7fc89c009310 comp rx=0 tx=0).stop 2023-10-26T06:41:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 msgr2=0x7fc8ac198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 0x7fc8ac198f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800e9a0 tx=0x7fc8a800ed60 comp rx=0 tx=0).stop 2023-10-26T06:41:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 shutdown_connections 2023-10-26T06:41:08.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc8980a14d0 0x7fc8980a3990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc8ac10cee0 0x7fc8ac19d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8ac072c20 0x7fc8ac198f00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 --2- 172.21.15.50:0/1779569499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8ac073540 0x7fc8ac199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 >> 172.21.15.50:0/1779569499 conn(0x7fc8ac0fc170 msgr2=0x7fc8ac0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:08.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 shutdown_connections 2023-10-26T06:41:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:08.729+0000 7fc8b39ff700 1 -- 172.21.15.50:0/1779569499 wait complete. 2023-10-26T06:41:08.733 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2023-10-26T06:41:08.865 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:41:08 smithi153 podman[170129]: 2023-10-26T06:41:08.865 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:41:08 smithi153 ceph-mds[170169]: -- 172.21.15.153:0/1822798304 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563ae915b1e0 con 0x563ae9130c00 2023-10-26T06:41:08.865 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:41:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f[170145]: starting mds.f at 2023-10-26T06:41:08.865 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:41:08 smithi153 bash[170129]: 6077184dda60dc18aabaf1b5331394735be9bcef38ec1732c2d484d44c63e960 2023-10-26T06:41:09.234 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:41:08 smithi153 systemd[1]: Started Ceph mds.f for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:09.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1779569499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:09.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:09.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:09.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:09 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:09.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1779569499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:09.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:09.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:09.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:09 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:09.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1779569499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:09.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:09.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:09.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:09.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:09 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:10.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:10 smithi153 ceph-mon[131657]: Deploying daemon mds.c on smithi153 2023-10-26T06:41:10.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:10 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6834/2747210301,v1:172.21.15.153:6835/2747210301] up:boot 2023-10-26T06:41:10.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:10 smithi153 ceph-mon[131657]: fsmap 6 up:standby 2023-10-26T06:41:10.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:10 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-26T06:41:10.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:10 smithi153 ceph-mon[131657]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:10.728 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:41:10 smithi153 systemd[1]: Starting Ceph mds.c for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:10.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:10.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:10 smithi050 ceph-mon[94997]: Deploying daemon mds.c on smithi153 2023-10-26T06:41:10.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:10 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6834/2747210301,v1:172.21.15.153:6835/2747210301] up:boot 2023-10-26T06:41:10.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:10 smithi050 ceph-mon[94997]: fsmap 6 up:standby 2023-10-26T06:41:10.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:10 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-26T06:41:10.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:10 smithi050 ceph-mon[94997]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:10.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:10 smithi125 ceph-mon[130643]: Deploying daemon mds.c on smithi153 2023-10-26T06:41:10.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:10 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6834/2747210301,v1:172.21.15.153:6835/2747210301] up:boot 2023-10-26T06:41:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:10 smithi125 ceph-mon[130643]: fsmap 6 up:standby 2023-10-26T06:41:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:10 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-26T06:41:10.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:10 smithi125 ceph-mon[130643]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:10.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.964+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/1424981057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81006a0 msgr2=0x7ff1f8100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.964+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/1424981057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81006a0 0x7ff1f8100b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009990 tx=0x7ff1ec009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.964+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/1424981057 shutdown_connections 2023-10-26T06:41:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.964+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/1424981057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f8101060 0x7ff1f810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.965+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/1424981057 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1f81066b0 0x7ff1f8106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:10.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.965+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/1424981057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81006a0 0x7ff1f8100b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.965+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/1424981057 >> 172.21.15.50:0/1424981057 conn(0x7ff1f80fc170 msgr2=0x7ff1f80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.965+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/1424981057 shutdown_connections 2023-10-26T06:41:10.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.965+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/1424981057 wait complete. 2023-10-26T06:41:10.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 Processor -- start 2023-10-26T06:41:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 -- start start 2023-10-26T06:41:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 0x7ff1f819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1f8101060 0x7ff1f819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81066b0 0x7ff1f8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:10.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8199190 con 0x7ff1f81006a0 2023-10-26T06:41:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8199300 con 0x7ff1f8101060 2023-10-26T06:41:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fe3ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81994c0 con 0x7ff1f81066b0 2023-10-26T06:41:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 0x7ff1f819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 0x7ff1f819e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55186/0 (socket says 172.21.15.50:55186) 2023-10-26T06:41:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1f7fff700 1 -- 172.21.15.50:0/3053693840 learned_addr learned my addr 172.21.15.50:0/3053693840 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.966+0000 7ff1fc99c700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81066b0 0x7ff1f8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f77fe700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1f8101060 0x7ff1f819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f7fff700 1 -- 172.21.15.50:0/3053693840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81066b0 msgr2=0x7ff1f8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f7fff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81066b0 0x7ff1f8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f7fff700 1 -- 172.21.15.50:0/3053693840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1f8101060 msgr2=0x7ff1f819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f7fff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1f8101060 0x7ff1f819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f7fff700 1 -- 172.21.15.50:0/3053693840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec0095f0 con 0x7ff1f81006a0 2023-10-26T06:41:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f7fff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 0x7ff1f819e9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e9a0 tx=0x7ff1e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8009790 con 0x7ff1f81006a0 2023-10-26T06:41:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1e8010430 con 0x7ff1f81006a0 2023-10-26T06:41:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8018680 con 0x7ff1f81006a0 2023-10-26T06:41:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.967+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f81997a0 con 0x7ff1f81006a0 2023-10-26T06:41:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.968+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f81a5a40 con 0x7ff1f81006a0 2023-10-26T06:41:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.968+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8101de0 con 0x7ff1f81006a0 2023-10-26T06:41:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.971+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff1e80105a0 con 0x7ff1f81006a0 2023-10-26T06:41:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.972+0000 7ff1f57fa700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1e00a1550 0x7ff1e00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.972+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff1e8014070 con 0x7ff1f81006a0 2023-10-26T06:41:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.972+0000 7ff1f77fe700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1e00a1550 0x7ff1e00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.973+0000 7ff1f77fe700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1e00a1550 0x7ff1e00a3a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff1f819a220 tx=0x7ff1ec005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:10.974+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff1e8096700 con 0x7ff1f81006a0 2023-10-26T06:41:10.984 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:41:10 smithi153 podman[170472]: 2023-10-26T06:41:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.235+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1f8067530 con 0x7ff1f81006a0 2023-10-26T06:41:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.236+0000 7ff1f57fa700 1 -- 172.21.15.50:0/3053693840 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5286 (secure 0 0 0) 0x7ff1e8099d20 con 0x7ff1f81006a0 2023-10-26T06:41:11.238 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:11.238 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-26T06:41:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1e00a1550 msgr2=0x7ff1e00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1e00a1550 0x7ff1e00a3a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff1f819a220 tx=0x7ff1ec005fd0 comp rx=0 tx=0).stop 2023-10-26T06:41:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 msgr2=0x7ff1f819e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 0x7ff1f819e9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e9a0 tx=0x7ff1e800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 shutdown_connections 2023-10-26T06:41:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1e00a1550 0x7ff1e00a3a10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f81066b0 0x7ff1f8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1f81006a0 0x7ff1f819e9a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 --2- 172.21.15.50:0/3053693840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1f8101060 0x7ff1f819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 >> 172.21.15.50:0/3053693840 conn(0x7ff1f80fc170 msgr2=0x7ff1f80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 shutdown_connections 2023-10-26T06:41:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:11.238+0000 7ff1fe3ff700 1 -- 172.21.15.50:0/3053693840 wait complete. 2023-10-26T06:41:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-10-26T06:41:11.484 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:41:11 smithi153 ceph-mds[170512]: -- 172.21.15.153:0/128816131 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55709226b1e0 con 0x557092240c00 2023-10-26T06:41:11.485 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:41:11 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c[170488]: starting mds.c at 2023-10-26T06:41:11.485 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:41:11 smithi153 bash[170472]: 4482f876b7967f4925187df14c32ad8cf5b5ec36f9ad051c6ca140773b29e6a4 2023-10-26T06:41:11.485 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:41:11 smithi153 systemd[1]: Started Ceph mds.c for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:12.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.338 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:12.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:12.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:12.339 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: Deploying daemon mds.h on smithi125 2023-10-26T06:41:12.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3053693840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:12.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] up:boot 2023-10-26T06:41:12.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: fsmap 7 up:standby 2023-10-26T06:41:12.340 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-26T06:41:12.341 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:12 smithi125 ceph-mon[130643]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:12.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:12.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:12.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:12.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: Deploying daemon mds.h on smithi125 2023-10-26T06:41:12.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3053693840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:12.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] up:boot 2023-10-26T06:41:12.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: fsmap 7 up:standby 2023-10-26T06:41:12.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-26T06:41:12.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:12 smithi153 ceph-mon[131657]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:12.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:12.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:12.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:12.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:12.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: Deploying daemon mds.h on smithi125 2023-10-26T06:41:12.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3053693840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:12.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] up:boot 2023-10-26T06:41:12.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: fsmap 7 up:standby 2023-10-26T06:41:12.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-26T06:41:12.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:12 smithi050 ceph-mon[94997]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:12.951 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:41:12 smithi125 systemd[1]: Starting Ceph mds.h for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:13.205 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:41:12 smithi125 podman[167816]: 2023-10-26T06:41:13.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:13.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/574767983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981066b0 msgr2=0x7fbd98106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/574767983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981066b0 0x7fbd98106a90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009990 tx=0x7fbd88009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/574767983 shutdown_connections 2023-10-26T06:41:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/574767983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 0x7fbd9810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/574767983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981066b0 0x7fbd98106a90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/574767983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd981006a0 0x7fbd98100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/574767983 >> 172.21.15.50:0/574767983 conn(0x7fbd980fc170 msgr2=0x7fbd980fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/574767983 shutdown_connections 2023-10-26T06:41:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.478+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/574767983 wait complete. 2023-10-26T06:41:13.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 Processor -- start 2023-10-26T06:41:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 -- start start 2023-10-26T06:41:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981006a0 0x7fbd9819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 0x7fbd9819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd981066b0 0x7fbd98196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:13.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98196ec0 con 0x7fbd981006a0 2023-10-26T06:41:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd98197030 con 0x7fbd98101060 2023-10-26T06:41:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.479+0000 7fbd9d9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd981971f0 con 0x7fbd981066b0 2023-10-26T06:41:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd96ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981006a0 0x7fbd9819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd981066b0 0x7fbd98196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 0x7fbd9819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:13.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd96ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981006a0 0x7fbd9819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55200/0 (socket says 172.21.15.50:55200) 2023-10-26T06:41:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd96ffd700 1 -- 172.21.15.50:0/3587255132 learned_addr learned my addr 172.21.15.50:0/3587255132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 -- 172.21.15.50:0/3587255132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd981066b0 msgr2=0x7fbd98196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd981066b0 0x7fbd98196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 -- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981006a0 msgr2=0x7fbd9819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981006a0 0x7fbd9819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 -- 172.21.15.50:0/3587255132 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd880095f0 con 0x7fbd98101060 2023-10-26T06:41:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd8ffff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 0x7fbd9819cc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c970 tx=0x7fbd8000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.480+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80004440 con 0x7fbd98101060 2023-10-26T06:41:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.481+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd80003b40 con 0x7fbd98101060 2023-10-26T06:41:13.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.481+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd981974d0 con 0x7fbd98101060 2023-10-26T06:41:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.481+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80007bc0 con 0x7fbd98101060 2023-10-26T06:41:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.481+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd981a3770 con 0x7fbd98101060 2023-10-26T06:41:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.482+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd98108ca0 con 0x7fbd98101060 2023-10-26T06:41:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.483+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbd80003cb0 con 0x7fbd98101060 2023-10-26T06:41:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.485+0000 7fbd9c9fd700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbd840a1550 0x7fbd840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.486+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fbd800cc860 con 0x7fbd98101060 2023-10-26T06:41:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.486+0000 7fbd96ffd700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbd840a1550 0x7fbd840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.486+0000 7fbd96ffd700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbd840a1550 0x7fbd840a3a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd88006010 tx=0x7fbd8800b280 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.488+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd800961f0 con 0x7fbd98101060 2023-10-26T06:41:13.672 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:41:13 smithi125 ceph-mds[167856]: -- 172.21.15.125:0/1481395137 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ce60a011e0 con 0x55ce609d6800 2023-10-26T06:41:13.672 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:41:13 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h[167832]: starting mds.h at 2023-10-26T06:41:13.673 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:41:13 smithi125 bash[167816]: 1aff41cc7c0a325e378f5006a841e7a6e11ee1ab5f7917fc49bada1b14af5d7b 2023-10-26T06:41:13.673 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:41:13 smithi125 systemd[1]: Started Ceph mds.h for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.745+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd98101de0 con 0x7fbd98101060 2023-10-26T06:41:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.745+0000 7fbd9c9fd700 1 -- 172.21.15.50:0/3587255132 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6080 (secure 0 0 0) 0x7fbd80099810 con 0x7fbd98101060 2023-10-26T06:41:13.748 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:13.748 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24694,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-26T06:41:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbd840a1550 msgr2=0x7fbd840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbd840a1550 0x7fbd840a3a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd88006010 tx=0x7fbd8800b280 comp rx=0 tx=0).stop 2023-10-26T06:41:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 msgr2=0x7fbd9819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:13.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 0x7fbd9819cc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c970 tx=0x7fbd8000cc80 comp rx=0 tx=0).stop 2023-10-26T06:41:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 shutdown_connections 2023-10-26T06:41:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbd840a1550 0x7fbd840a3a10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd981066b0 0x7fbd98196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd981006a0 0x7fbd9819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 --2- 172.21.15.50:0/3587255132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd98101060 0x7fbd9819cc10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 >> 172.21.15.50:0/3587255132 conn(0x7fbd980fc170 msgr2=0x7fbd980fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 shutdown_connections 2023-10-26T06:41:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:13.748+0000 7fbd9d9ff700 1 -- 172.21.15.50:0/3587255132 wait complete. 2023-10-26T06:41:13.752 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2023-10-26T06:41:14.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:14.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:14.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:14.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: Deploying daemon mds.i on smithi153 2023-10-26T06:41:14.486 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:14.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3587255132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:14.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6836/2652114750,v1:172.21.15.125:6837/2652114750] up:boot 2023-10-26T06:41:14.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: fsmap 8 up:standby 2023-10-26T06:41:14.487 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:14 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-26T06:41:14.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:14.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:14.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:14.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: Deploying daemon mds.i on smithi153 2023-10-26T06:41:14.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:14.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3587255132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:14.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6836/2652114750,v1:172.21.15.125:6837/2652114750] up:boot 2023-10-26T06:41:14.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: fsmap 8 up:standby 2023-10-26T06:41:14.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:14 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-26T06:41:14.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:14.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: Deploying daemon mds.i on smithi153 2023-10-26T06:41:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3587255132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6836/2652114750,v1:172.21.15.125:6837/2652114750] up:boot 2023-10-26T06:41:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: fsmap 8 up:standby 2023-10-26T06:41:14.769 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:14 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-26T06:41:15.235 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:41:15 smithi153 systemd[1]: Starting Ceph mds.i for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:15.650 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:41:15 smithi153 podman[170812]: 2023-10-26T06:41:15.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:15.984 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:41:15 smithi153 ceph-mds[170852]: -- 172.21.15.153:0/3049471120 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e123d631e0 con 0x55e123d38800 2023-10-26T06:41:15.985 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:41:15 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: starting mds.i at 2023-10-26T06:41:15.985 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:41:15 smithi153 bash[170812]: 2f49872fe9a1f14ea93dd67b91400e0c6e4af21abee7bd10a013c31107a96a5d 2023-10-26T06:41:15.985 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:41:15 smithi153 systemd[1]: Started Ceph mds.i for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:15.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 -- 172.21.15.50:0/2303741335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 msgr2=0x7ff0f8106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/2303741335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 0x7ff0f8106ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009990 tx=0x7ff0f4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 -- 172.21.15.50:0/2303741335 shutdown_connections 2023-10-26T06:41:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/2303741335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f80681f0 0x7ff0f810d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/2303741335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 0x7ff0f8106ab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:15.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/2303741335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f8067830 0x7ff0f8067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 -- 172.21.15.50:0/2303741335 >> 172.21.15.50:0/2303741335 conn(0x7ff0f8076400 msgr2=0x7ff0f8076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 -- 172.21.15.50:0/2303741335 shutdown_connections 2023-10-26T06:41:15.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.993+0000 7ff0ffdff700 1 -- 172.21.15.50:0/2303741335 wait complete. 2023-10-26T06:41:15.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 Processor -- start 2023-10-26T06:41:15.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 -- start start 2023-10-26T06:41:15.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f8067830 0x7ff0f819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:15.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 0x7ff0f819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:15.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 0x7ff0f8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:16.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8199140 con 0x7ff0f80681f0 2023-10-26T06:41:16.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f81992b0 con 0x7ff0f8067830 2023-10-26T06:41:16.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.994+0000 7ff0ffdff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8199470 con 0x7ff0f81066d0 2023-10-26T06:41:16.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 0x7ff0f819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:16.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fdb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f8067830 0x7ff0f819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:16.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 0x7ff0f819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33950/0 (socket says 172.21.15.50:33950) 2023-10-26T06:41:16.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 -- 172.21.15.50:0/901674726 learned_addr learned my addr 172.21.15.50:0/901674726 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:16.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fe39c700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 0x7ff0f8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:16.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 -- 172.21.15.50:0/901674726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 msgr2=0x7ff0f8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:16.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 0x7ff0f8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 -- 172.21.15.50:0/901674726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f8067830 msgr2=0x7ff0f819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:16.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f8067830 0x7ff0f819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fd39a700 1 -- 172.21.15.50:0/901674726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40095f0 con 0x7ff0f80681f0 2023-10-26T06:41:16.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.995+0000 7ff0fdb9b700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f8067830 0x7ff0f819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:16.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.996+0000 7ff0fd39a700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 0x7ff0f819eef0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800e9a0 tx=0x7ff0e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:16.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.996+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8009790 con 0x7ff0f80681f0 2023-10-26T06:41:16.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.996+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0e8010430 con 0x7ff0f80681f0 2023-10-26T06:41:16.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.996+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f8199750 con 0x7ff0f80681f0 2023-10-26T06:41:16.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.996+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8018680 con 0x7ff0f80681f0 2023-10-26T06:41:16.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.996+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f81a59a0 con 0x7ff0f80681f0 2023-10-26T06:41:16.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.997+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f80febc0 con 0x7ff0f80681f0 2023-10-26T06:41:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:15.999+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff0e80105a0 con 0x7ff0f80681f0 2023-10-26T06:41:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.001+0000 7ff0eeffd700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff0e40a1550 0x7ff0e40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:16.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.001+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff0e8014070 con 0x7ff0f80681f0 2023-10-26T06:41:16.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.001+0000 7ff0fdb9b700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff0e40a1550 0x7ff0e40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:16.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.002+0000 7ff0fdb9b700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff0e40a1550 0x7ff0e40a3a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4006010 tx=0x7ff0f4005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:16.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.004+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0e8096510 con 0x7ff0f80681f0 2023-10-26T06:41:16.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.266+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0f8101d90 con 0x7ff0f80681f0 2023-10-26T06:41:16.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.267+0000 7ff0eeffd700 1 -- 172.21.15.50:0/901674726 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7670 (secure 0 0 0) 0x7ff0e8099b30 con 0x7ff0f80681f0 2023-10-26T06:41:16.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:16.269 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24692,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24694,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-26T06:41:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff0e40a1550 msgr2=0x7ff0e40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff0e40a1550 0x7ff0e40a3a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4006010 tx=0x7ff0f4005960 comp rx=0 tx=0).stop 2023-10-26T06:41:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 msgr2=0x7ff0f819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 0x7ff0f819eef0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800e9a0 tx=0x7ff0e800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 shutdown_connections 2023-10-26T06:41:16.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff0e40a1550 0x7ff0e40a3a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f81066d0 0x7ff0f8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff0f8067830 0x7ff0f819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 --2- 172.21.15.50:0/901674726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0f80681f0 0x7ff0f819eef0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 >> 172.21.15.50:0/901674726 conn(0x7ff0f8076400 msgr2=0x7ff0f810bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 shutdown_connections 2023-10-26T06:41:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:16.270+0000 7ff0ffdff700 1 -- 172.21.15.50:0/901674726 wait complete. 2023-10-26T06:41:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 10 2023-10-26T06:41:16.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:16.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:boot 2023-10-26T06:41:16.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: fsmap 9 up:standby 2023-10-26T06:41:16.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-26T06:41:16.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:16.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:16.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:16.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:16.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:16.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:16.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:16 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/901674726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:16.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:boot 2023-10-26T06:41:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: fsmap 9 up:standby 2023-10-26T06:41:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-26T06:41:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:16.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:16.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:16.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:16.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:16.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:16 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/901674726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:17.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:boot 2023-10-26T06:41:17.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: fsmap 9 up:standby 2023-10-26T06:41:17.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-26T06:41:17.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:17.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:17.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:17.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:17.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:17.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:17.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:16 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/901674726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:17.869 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:17 smithi050 ceph-mon[94997]: Deploying daemon mds.g on smithi050 2023-10-26T06:41:17.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:17 smithi153 ceph-mon[131657]: Deploying daemon mds.g on smithi050 2023-10-26T06:41:18.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:17 smithi125 ceph-mon[130643]: Deploying daemon mds.g on smithi050 2023-10-26T06:41:18.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:18.365 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:41:18 smithi050 systemd[1]: Starting Ceph mds.g for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 -- 172.21.15.50:0/3975418901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d810cee0 msgr2=0x7fd6d810f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 --2- 172.21.15.50:0/3975418901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d810cee0 0x7fd6d810f350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000b0a0 tx=0x7fd6d000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 -- 172.21.15.50:0/3975418901 shutdown_connections 2023-10-26T06:41:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 --2- 172.21.15.50:0/3975418901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d810cee0 0x7fd6d810f350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 --2- 172.21.15.50:0/3975418901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d8072c20 0x7fd6d8073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 --2- 172.21.15.50:0/3975418901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d8073540 0x7fd6d810c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 -- 172.21.15.50:0/3975418901 >> 172.21.15.50:0/3975418901 conn(0x7fd6d80fc170 msgr2=0x7fd6d80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 -- 172.21.15.50:0/3975418901 shutdown_connections 2023-10-26T06:41:18.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.517+0000 7fd6defff700 1 -- 172.21.15.50:0/3975418901 wait complete. 2023-10-26T06:41:18.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 Processor -- start 2023-10-26T06:41:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 -- start start 2023-10-26T06:41:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 0x7fd6d8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d8073540 0x7fd6d81993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d810cee0 0x7fd6d819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:18.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d819ddc0 con 0x7fd6d8072c20 2023-10-26T06:41:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d819df30 con 0x7fd6d8073540 2023-10-26T06:41:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.519+0000 7fd6defff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d819e0f0 con 0x7fd6d810cee0 2023-10-26T06:41:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 0x7fd6d8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 0x7fd6d8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33972/0 (socket says 172.21.15.50:33972) 2023-10-26T06:41:18.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 -- 172.21.15.50:0/989227065 learned_addr learned my addr 172.21.15.50:0/989227065 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dd59c700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d810cee0 0x7fd6d819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6d7fff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d8073540 0x7fd6d81993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 -- 172.21.15.50:0/989227065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d810cee0 msgr2=0x7fd6d819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d810cee0 0x7fd6d819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 -- 172.21.15.50:0/989227065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d8073540 msgr2=0x7fd6d81993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d8073540 0x7fd6d81993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 -- 172.21.15.50:0/989227065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009d00 con 0x7fd6d8072c20 2023-10-26T06:41:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6dcd9b700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 0x7fd6d8198ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00e9a0 tx=0x7fd6cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc009790 con 0x7fd6d8072c20 2023-10-26T06:41:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6cc00cbd0 con 0x7fd6d8072c20 2023-10-26T06:41:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d819e3d0 con 0x7fd6d8072c20 2023-10-26T06:41:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.520+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc018680 con 0x7fd6d8072c20 2023-10-26T06:41:18.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.521+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81a5c10 con 0x7fd6d8072c20 2023-10-26T06:41:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.522+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d81080f0 con 0x7fd6d8072c20 2023-10-26T06:41:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.524+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd6cc00cd40 con 0x7fd6d8072c20 2023-10-26T06:41:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.525+0000 7fd6d5ffb700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6c80a1550 0x7fd6c80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:18.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.525+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd6cc014070 con 0x7fd6d8072c20 2023-10-26T06:41:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.525+0000 7fd6d7fff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6c80a1550 0x7fd6c80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.526+0000 7fd6d7fff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6c80a1550 0x7fd6c80a3a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6d819a3f0 tx=0x7fd6c4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:18.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.529+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6cc052100 con 0x7fd6d8072c20 2023-10-26T06:41:18.715 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:41:18 smithi050 podman[152512]: 2023-10-26T06:41:18.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.794+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6d80742d0 con 0x7fd6d8072c20 2023-10-26T06:41:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.795+0000 7fd6d5ffb700 1 -- 172.21.15.50:0/989227065 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7670 (secure 0 0 0) 0x7fd6cc094e60 con 0x7fd6d8072c20 2023-10-26T06:41:18.797 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:18.797 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24692,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24694,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-26T06:41:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6c80a1550 msgr2=0x7fd6c80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6c80a1550 0x7fd6c80a3a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6d819a3f0 tx=0x7fd6c4009260 comp rx=0 tx=0).stop 2023-10-26T06:41:18.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 msgr2=0x7fd6d8198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 0x7fd6d8198ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00e9a0 tx=0x7fd6cc00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 shutdown_connections 2023-10-26T06:41:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd6c80a1550 0x7fd6c80a3a10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d810cee0 0x7fd6d819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8072c20 0x7fd6d8198ea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 --2- 172.21.15.50:0/989227065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d8073540 0x7fd6d81993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.797+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 >> 172.21.15.50:0/989227065 conn(0x7fd6d80fc170 msgr2=0x7fd6d80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.798+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 shutdown_connections 2023-10-26T06:41:18.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:18.798+0000 7fd6defff700 1 -- 172.21.15.50:0/989227065 wait complete. 2023-10-26T06:41:18.802 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 10 2023-10-26T06:41:18.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:18 smithi153 ceph-mon[131657]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:18 smithi050 ceph-mon[94997]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:19.018 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:41:18 smithi050 bash[152512]: 42e694213ffcca91403d5c12c5c91db8e7a50c7faf3fd1e46485e54d97a5164d 2023-10-26T06:41:19.018 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:41:18 smithi050 ceph-mds[152575]: -- 172.21.15.50:0/955278701 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5643e31ab1e0 con 0x5643e3182c00 2023-10-26T06:41:19.018 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:41:18 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-g[152548]: starting mds.g at 2023-10-26T06:41:19.019 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:41:18 smithi050 systemd[1]: Started Ceph mds.g for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:19.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:18 smithi125 ceph-mon[130643]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:19.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/989227065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:19.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:19.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:19.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:19.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:19.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:19.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:19 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:20.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/989227065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:20.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:20.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:20.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:20.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:20.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:20.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:19 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:20.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/989227065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:20.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:20.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:20.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:20.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:20.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:20.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:19 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:20.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:20.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:20 smithi050 ceph-mon[94997]: Deploying daemon mds.a on smithi050 2023-10-26T06:41:20.924 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:20 smithi050 ceph-mon[94997]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:20.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:20 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.50:6838/212825483,v1:172.21.15.50:6839/212825483] up:boot 2023-10-26T06:41:20.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:20 smithi050 ceph-mon[94997]: fsmap 10 up:standby 2023-10-26T06:41:20.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:20 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-26T06:41:20.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:20 smithi153 ceph-mon[131657]: Deploying daemon mds.a on smithi050 2023-10-26T06:41:20.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:20 smithi153 ceph-mon[131657]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:20.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:20 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.50:6838/212825483,v1:172.21.15.50:6839/212825483] up:boot 2023-10-26T06:41:20.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:20 smithi153 ceph-mon[131657]: fsmap 10 up:standby 2023-10-26T06:41:20.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:20 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-26T06:41:21.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 -- 172.21.15.50:0/4031879775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8067fa0 msgr2=0x7ff1e810d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:21.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 --2- 172.21.15.50:0/4031879775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8067fa0 0x7ff1e810d530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009f90 tx=0x7ff1e000b330 comp rx=0 tx=0).stop 2023-10-26T06:41:21.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 -- 172.21.15.50:0/4031879775 shutdown_connections 2023-10-26T06:41:21.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 --2- 172.21.15.50:0/4031879775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8067fa0 0x7ff1e810d530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 --2- 172.21.15.50:0/4031879775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e81066c0 0x7ff1e8106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 --2- 172.21.15.50:0/4031879775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e8106fe0 0x7ff1e8067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 -- 172.21.15.50:0/4031879775 >> 172.21.15.50:0/4031879775 conn(0x7ff1e8076400 msgr2=0x7ff1e8076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:21.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 -- 172.21.15.50:0/4031879775 shutdown_connections 2023-10-26T06:41:21.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.095+0000 7ff1efbff700 1 -- 172.21.15.50:0/4031879775 wait complete. 2023-10-26T06:41:21.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.096+0000 7ff1efbff700 1 Processor -- start 2023-10-26T06:41:21.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.096+0000 7ff1efbff700 1 -- start start 2023-10-26T06:41:21.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.096+0000 7ff1efbff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 0x7ff1e8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:21.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.096+0000 7ff1efbff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e81066c0 0x7ff1e81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:21.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1efbff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 0x7ff1e819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:21.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1efbff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e819ddd0 con 0x7ff1e8106fe0 2023-10-26T06:41:21.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1efbff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e819df40 con 0x7ff1e81066c0 2023-10-26T06:41:21.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1efbff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e819e100 con 0x7ff1e8067fa0 2023-10-26T06:41:21.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ee19c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 0x7ff1e819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:21.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 0x7ff1e8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:21.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ee19c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 0x7ff1e819d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33992/0 (socket says 172.21.15.50:33992) 2023-10-26T06:41:21.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ee19c700 1 -- 172.21.15.50:0/324862352 learned_addr learned my addr 172.21.15.50:0/324862352 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:21.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 0x7ff1e8198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:56440/0 (socket says 172.21.15.50:56440) 2023-10-26T06:41:21.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed19a700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e81066c0 0x7ff1e81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:21.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 -- 172.21.15.50:0/324862352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e81066c0 msgr2=0x7ff1e81993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:21.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e81066c0 0x7ff1e81993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 -- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 msgr2=0x7ff1e819d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:21.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 0x7ff1e819d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed99b700 1 -- 172.21.15.50:0/324862352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0095f0 con 0x7ff1e8067fa0 2023-10-26T06:41:21.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ee19c700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 0x7ff1e819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:21.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.097+0000 7ff1ed19a700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e81066c0 0x7ff1e81993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:21.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.098+0000 7ff1ed99b700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 0x7ff1e8198eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00eb90 tx=0x7ff1dc00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:21.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.098+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc009970 con 0x7ff1e8067fa0 2023-10-26T06:41:21.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.098+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4009520 con 0x7ff1e8067fa0 2023-10-26T06:41:21.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.098+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1dc0044e0 con 0x7ff1e8067fa0 2023-10-26T06:41:21.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.098+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc003e40 con 0x7ff1e8067fa0 2023-10-26T06:41:21.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.098+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e0009c40 con 0x7ff1e8067fa0 2023-10-26T06:41:21.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.099+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e8101de0 con 0x7ff1e8067fa0 2023-10-26T06:41:21.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.101+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff1dc003fc0 con 0x7ff1e8067fa0 2023-10-26T06:41:21.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.103+0000 7ff1daffd700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1d40a14d0 0x7ff1d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:21.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.103+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff1dc014070 con 0x7ff1e8067fa0 2023-10-26T06:41:21.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.103+0000 7ff1ed19a700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1d40a14d0 0x7ff1d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:21.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.103+0000 7ff1ed19a700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1d40a14d0 0x7ff1d40a3990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1e819a400 tx=0x7ff1e4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:21.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.105+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff1dc0969e0 con 0x7ff1e8067fa0 2023-10-26T06:41:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:20 smithi125 ceph-mon[130643]: Deploying daemon mds.a on smithi050 2023-10-26T06:41:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:20 smithi125 ceph-mon[130643]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:21.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:20 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.50:6838/212825483,v1:172.21.15.50:6839/212825483] up:boot 2023-10-26T06:41:21.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:20 smithi125 ceph-mon[130643]: fsmap 10 up:standby 2023-10-26T06:41:21.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:20 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-26T06:41:21.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.365+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1e8067530 con 0x7ff1e8067fa0 2023-10-26T06:41:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.366+0000 7ff1daffd700 1 -- 172.21.15.50:0/324862352 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8459 (secure 0 0 0) 0x7ff1dc09a000 con 0x7ff1e8067fa0 2023-10-26T06:41:21.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:21.368 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24692,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24694,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-26T06:41:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1d40a14d0 msgr2=0x7ff1d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1d40a14d0 0x7ff1d40a3990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1e819a400 tx=0x7ff1e4009260 comp rx=0 tx=0).stop 2023-10-26T06:41:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 msgr2=0x7ff1e8198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 0x7ff1e8198eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00eb90 tx=0x7ff1dc00eea0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 shutdown_connections 2023-10-26T06:41:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1d40a14d0 0x7ff1d40a3990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1e8106fe0 0x7ff1e819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e8067fa0 0x7ff1e8198eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 --2- 172.21.15.50:0/324862352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e81066c0 0x7ff1e81993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:21.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 >> 172.21.15.50:0/324862352 conn(0x7ff1e8076400 msgr2=0x7ff1e80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:21.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 shutdown_connections 2023-10-26T06:41:21.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:21.369+0000 7ff1efbff700 1 -- 172.21.15.50:0/324862352 wait complete. 2023-10-26T06:41:21.373 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 11 2023-10-26T06:41:21.730 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:41:21 smithi050 systemd[1]: Starting Ceph mds.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:21.982 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:41:21 smithi050 podman[152926]: 2023-10-26T06:41:21.983 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/324862352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:21.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/324862352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:22.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/324862352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:22.517 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:41:22 smithi050 bash[152926]: 8a8951df31940118c9e75d2725400fe2380382159053c71cf98a105d607a0109 2023-10-26T06:41:22.518 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mds[152967]: -- 172.21.15.50:0/3627560185 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b0f163f1e0 con 0x55b0f1616800 2023-10-26T06:41:22.518 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-a[152942]: starting mds.a at 2023-10-26T06:41:22.519 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:41:22 smithi050 systemd[1]: Started Ceph mds.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:22.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:22.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:22.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:22 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:23.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:23.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:23.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:22 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:23.077 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:23.078 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:23.078 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:23.078 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:23.078 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-26T06:41:23.079 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-26T06:41:23.079 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:22 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:23.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 -- 172.21.15.50:0/3379244286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 msgr2=0x7f99ac10c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 --2- 172.21.15.50:0/3379244286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac10c9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009990 tx=0x7f99a0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 -- 172.21.15.50:0/3379244286 shutdown_connections 2023-10-26T06:41:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 --2- 172.21.15.50:0/3379244286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac10cee0 0x7f99ac10f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 --2- 172.21.15.50:0/3379244286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99ac072c20 0x7f99ac073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 --2- 172.21.15.50:0/3379244286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac10c9a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 -- 172.21.15.50:0/3379244286 >> 172.21.15.50:0/3379244286 conn(0x7f99ac0fc170 msgr2=0x7f99ac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 -- 172.21.15.50:0/3379244286 shutdown_connections 2023-10-26T06:41:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.613+0000 7f99b0fff700 1 -- 172.21.15.50:0/3379244286 wait complete. 2023-10-26T06:41:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 Processor -- start 2023-10-26T06:41:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 -- start start 2023-10-26T06:41:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac072c20 0x7f99ac198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99ac10cee0 0x7f99ac19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac19dcf0 con 0x7f99ac073540 2023-10-26T06:41:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac19de60 con 0x7f99ac072c20 2023-10-26T06:41:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.614+0000 7f99b0fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac19e020 con 0x7f99ac10cee0 2023-10-26T06:41:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99aa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac072c20 0x7f99ac198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99aa59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac072c20 0x7f99ac198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51160/0 (socket says 172.21.15.50:51160) 2023-10-26T06:41:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99aa59c700 1 -- 172.21.15.50:0/4171920334 learned_addr learned my addr 172.21.15.50:0/4171920334 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99aad9d700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99ac10cee0 0x7f99ac19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 -- 172.21.15.50:0/4171920334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99ac10cee0 msgr2=0x7f99ac19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99ac10cee0 0x7f99ac19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 -- 172.21.15.50:0/4171920334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac072c20 msgr2=0x7f99ac198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac072c20 0x7f99ac198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 -- 172.21.15.50:0/4171920334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00095f0 con 0x7f99ac073540 2023-10-26T06:41:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.615+0000 7f99a9d9b700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac199360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99a00098e0 tx=0x7f99a0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.616+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a001d070 con 0x7f99ac073540 2023-10-26T06:41:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.616+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99a0022470 con 0x7f99ac073540 2023-10-26T06:41:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.616+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac19e2a0 con 0x7f99ac073540 2023-10-26T06:41:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.616+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0017650 con 0x7f99ac073540 2023-10-26T06:41:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.616+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac1a5b40 con 0x7f99ac073540 2023-10-26T06:41:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.617+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac1080f0 con 0x7f99ac073540 2023-10-26T06:41:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.619+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f99a00225e0 con 0x7f99ac073540 2023-10-26T06:41:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.620+0000 7f999b7fe700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99940a14d0 0x7f99940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.620+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f99a00ce4f0 con 0x7f99ac073540 2023-10-26T06:41:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.620+0000 7f99aa59c700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99940a14d0 0x7f99940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.621+0000 7f99aa59c700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99940a14d0 0x7f99940a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f999c009d20 tx=0x7f999c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:23.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.622+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99a0097f10 con 0x7f99ac073540 2023-10-26T06:41:23.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.881+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99ac19a0d0 con 0x7f99ac073540 2023-10-26T06:41:23.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.881+0000 7f999b7fe700 1 -- 172.21.15.50:0/4171920334 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9251 (secure 0 0 0) 0x7f99a009b530 con 0x7f99ac073540 2023-10-26T06:41:23.883 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:23.884 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24692,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24694,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-26T06:41:23.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99940a14d0 msgr2=0x7f99940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:23.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99940a14d0 0x7f99940a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f999c009d20 tx=0x7f999c009260 comp rx=0 tx=0).stop 2023-10-26T06:41:23.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 msgr2=0x7f99ac199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:23.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac199360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99a00098e0 tx=0x7f99a0005740 comp rx=0 tx=0).stop 2023-10-26T06:41:23.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 shutdown_connections 2023-10-26T06:41:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99940a14d0 0x7f99940a3990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99ac10cee0 0x7f99ac19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99ac072c20 0x7f99ac198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 --2- 172.21.15.50:0/4171920334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99ac073540 0x7f99ac199360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:23.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 >> 172.21.15.50:0/4171920334 conn(0x7f99ac0fc170 msgr2=0x7f99ac0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 shutdown_connections 2023-10-26T06:41:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:23.884+0000 7f99b0fff700 1 -- 172.21.15.50:0/4171920334 wait complete. 2023-10-26T06:41:23.888 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 12 2023-10-26T06:41:24.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:23 smithi050 ceph-mon[94997]: Deploying daemon mds.b on smithi125 2023-10-26T06:41:24.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:23 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.50:6840/2366491284,v1:172.21.15.50:6841/2366491284] up:boot 2023-10-26T06:41:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:23 smithi050 ceph-mon[94997]: fsmap 11 up:standby 2023-10-26T06:41:24.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:23 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-26T06:41:24.132 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:23 smithi125 ceph-mon[130643]: Deploying daemon mds.b on smithi125 2023-10-26T06:41:24.133 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:23 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.50:6840/2366491284,v1:172.21.15.50:6841/2366491284] up:boot 2023-10-26T06:41:24.133 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:23 smithi125 ceph-mon[130643]: fsmap 11 up:standby 2023-10-26T06:41:24.133 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:23 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-26T06:41:24.134 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:23 smithi125 systemd[1]: Starting Ceph mds.b for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:41:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:23 smithi153 ceph-mon[131657]: Deploying daemon mds.b on smithi125 2023-10-26T06:41:24.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:23 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.50:6840/2366491284,v1:172.21.15.50:6841/2366491284] up:boot 2023-10-26T06:41:24.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:23 smithi153 ceph-mon[131657]: fsmap 11 up:standby 2023-10-26T06:41:24.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:23 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-26T06:41:24.415 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:24 smithi125 podman[168156]: 2023-10-26T06:41:24.672 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mds[168196]: -- 172.21.15.125:0/3567255703 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c27508f1e0 con 0x55c275065000 2023-10-26T06:41:24.673 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: starting mds.b at 2023-10-26T06:41:24.673 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:24 smithi125 bash[168156]: f79d7cf2916d693423f274552cb5c03b657a1913b6d017e59c231b1f440f3037 2023-10-26T06:41:24.673 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:24 smithi125 systemd[1]: Started Ceph mds.b for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:41:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4171920334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:25.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:24 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:25.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4171920334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:25.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:24 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:25.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4171920334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:25.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:24 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:25.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:26.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:25 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:41:26.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:25 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] up:boot 2023-10-26T06:41:26.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:25 smithi050 ceph-mon[94997]: fsmap 12 up:standby 2023-10-26T06:41:26.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:25 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-26T06:41:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 -- 172.21.15.50:0/1315713866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb790101060 msgr2=0x7fb79010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1315713866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb790101060 0x7fb79010d570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b0a0 tx=0x7fb78800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 -- 172.21.15.50:0/1315713866 shutdown_connections 2023-10-26T06:41:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1315713866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb790101060 0x7fb79010d570 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1315713866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7901066b0 0x7fb790106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1315713866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901006a0 0x7fb790100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.123+0000 7fb7977ff700 1 -- 172.21.15.50:0/1315713866 >> 172.21.15.50:0/1315713866 conn(0x7fb7900fc170 msgr2=0x7fb7900fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.124+0000 7fb7977ff700 1 -- 172.21.15.50:0/1315713866 shutdown_connections 2023-10-26T06:41:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.124+0000 7fb7977ff700 1 -- 172.21.15.50:0/1315713866 wait complete. 2023-10-26T06:41:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.125+0000 7fb7977ff700 1 Processor -- start 2023-10-26T06:41:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.125+0000 7fb7977ff700 1 -- start start 2023-10-26T06:41:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb7977ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 0x7fb79019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb7977ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 0x7fb79019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb7977ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901066b0 0x7fb790198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb7977ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790199130 con 0x7fb7901066b0 2023-10-26T06:41:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb7977ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901992a0 con 0x7fb790101060 2023-10-26T06:41:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb7977ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790199460 con 0x7fb7901006a0 2023-10-26T06:41:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb79559b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 0x7fb79019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb794d9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 0x7fb79019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb79559b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 0x7fb79019e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37502/0 (socket says 172.21.15.50:37502) 2023-10-26T06:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb794d9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 0x7fb79019eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37830/0 (socket says 172.21.15.50:37830) 2023-10-26T06:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb79559b700 1 -- 172.21.15.50:0/1889350650 learned_addr learned my addr 172.21.15.50:0/1889350650 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.126+0000 7fb795d9c700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901066b0 0x7fb790198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb79559b700 1 -- 172.21.15.50:0/1889350650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 msgr2=0x7fb79019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb79559b700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 0x7fb79019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb79559b700 1 -- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901066b0 msgr2=0x7fb790198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb79559b700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901066b0 0x7fb790198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb79559b700 1 -- 172.21.15.50:0/1889350650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788009d00 con 0x7fb7901006a0 2023-10-26T06:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb794d9a700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 0x7fb79019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb79559b700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 0x7fb79019e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00e9a0 tx=0x7fb78c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c009790 con 0x7fb7901006a0 2023-10-26T06:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb790199740 con 0x7fb7901006a0 2023-10-26T06:41:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb78c010430 con 0x7fb7901006a0 2023-10-26T06:41:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c018680 con 0x7fb7901006a0 2023-10-26T06:41:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.127+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7901a5990 con 0x7fb7901006a0 2023-10-26T06:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.128+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb790101de0 con 0x7fb7901006a0 2023-10-26T06:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.130+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb78c0105a0 con 0x7fb7901006a0 2023-10-26T06:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.133+0000 7fb7867fc700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb77c0a14d0 0x7fb77c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.133+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb78c014070 con 0x7fb7901006a0 2023-10-26T06:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.133+0000 7fb794d9a700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb77c0a14d0 0x7fb77c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.134+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb78c0966e0 con 0x7fb7901006a0 2023-10-26T06:41:26.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.134+0000 7fb794d9a700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb77c0a14d0 0x7fb77c0a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb790199c90 tx=0x7fb780009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:26.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:25 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:41:26.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:25 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] up:boot 2023-10-26T06:41:26.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:25 smithi125 ceph-mon[130643]: fsmap 12 up:standby 2023-10-26T06:41:26.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:25 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-26T06:41:26.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:25 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:41:26.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:25 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] up:boot 2023-10-26T06:41:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:25 smithi153 ceph-mon[131657]: fsmap 12 up:standby 2023-10-26T06:41:26.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:25 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-26T06:41:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.399+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb790067530 con 0x7fb7901006a0 2023-10-26T06:41:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.401+0000 7fb7867fc700 1 -- 172.21.15.50:0/1889350650 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10046 (secure 0 0 0) 0x7fb78c099d00 con 0x7fb7901006a0 2023-10-26T06:41:26.402 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:26.402 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24682,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24692,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24694,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24709,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24740,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-26T06:41:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb77c0a14d0 msgr2=0x7fb77c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb77c0a14d0 0x7fb77c0a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb790199c90 tx=0x7fb780009260 comp rx=0 tx=0).stop 2023-10-26T06:41:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 msgr2=0x7fb79019e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 0x7fb79019e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00e9a0 tx=0x7fb78c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 shutdown_connections 2023-10-26T06:41:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb77c0a14d0 0x7fb77c0a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901066b0 0x7fb790198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7901006a0 0x7fb79019e9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 --2- 172.21.15.50:0/1889350650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb790101060 0x7fb79019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 >> 172.21.15.50:0/1889350650 conn(0x7fb7900fc170 msgr2=0x7fb790072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 shutdown_connections 2023-10-26T06:41:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.403+0000 7fb7977ff700 1 -- 172.21.15.50:0/1889350650 wait complete. 2023-10-26T06:41:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2023-10-26T06:41:26.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:41:26.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 -- 172.21.15.50:0/2874044789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb00734b0 msgr2=0x7f4fb0111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/2874044789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb00734b0 0x7f4fb0111170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 -- 172.21.15.50:0/2874044789 shutdown_connections 2023-10-26T06:41:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/2874044789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 0x7f4fb0113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/2874044789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb0072b90 0x7f4fb0072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/2874044789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb00734b0 0x7f4fb0111170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 -- 172.21.15.50:0/2874044789 >> 172.21.15.50:0/2874044789 conn(0x7f4fb00fc170 msgr2=0x7f4fb00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 -- 172.21.15.50:0/2874044789 shutdown_connections 2023-10-26T06:41:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.641+0000 7f4fb81ff700 1 -- 172.21.15.50:0/2874044789 wait complete. 2023-10-26T06:41:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.642+0000 7f4fb81ff700 1 Processor -- start 2023-10-26T06:41:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.642+0000 7f4fb81ff700 1 -- start start 2023-10-26T06:41:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.642+0000 7f4fb81ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb0072b90 0x7f4fb019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.642+0000 7f4fb81ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb00734b0 0x7f4fb019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.642+0000 7f4fb81ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 0x7f4fb01a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb81ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01a20c0 con 0x7f4fb01116b0 2023-10-26T06:41:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb81ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01a2230 con 0x7f4fb00734b0 2023-10-26T06:41:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb81ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01a23f0 con 0x7f4fb0072b90 2023-10-26T06:41:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb5f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb0072b90 0x7f4fb019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb679c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 0x7f4fb01a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb579a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb00734b0 0x7f4fb019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb5f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb0072b90 0x7f4fb019d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37508/0 (socket says 172.21.15.50:37508) 2023-10-26T06:41:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb5f9b700 1 -- 172.21.15.50:0/3710932117 learned_addr learned my addr 172.21.15.50:0/3710932117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb579a700 1 -- 172.21.15.50:0/3710932117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb0072b90 msgr2=0x7f4fb019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb579a700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb0072b90 0x7f4fb019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb579a700 1 -- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 msgr2=0x7f4fb01a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb579a700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 0x7f4fb01a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb579a700 1 -- 172.21.15.50:0/3710932117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009c40 con 0x7f4fb00734b0 2023-10-26T06:41:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.643+0000 7f4fb679c700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 0x7f4fb01a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.644+0000 7f4fb579a700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb00734b0 0x7f4fb019d6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00059d0 tx=0x7f4fa0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.644+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa001d070 con 0x7f4fb00734b0 2023-10-26T06:41:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.644+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa00095f0 con 0x7f4fb00734b0 2023-10-26T06:41:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.644+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa0022470 con 0x7f4fb00734b0 2023-10-26T06:41:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.644+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0017650 con 0x7f4fb00734b0 2023-10-26T06:41:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.644+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb01a9d30 con 0x7f4fb00734b0 2023-10-26T06:41:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.645+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb0103b90 con 0x7f4fb00734b0 2023-10-26T06:41:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.647+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f4fa00225e0 con 0x7f4fb00734b0 2023-10-26T06:41:26.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.648+0000 7f4fa6ffd700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4f9c0a14d0 0x7f4f9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:26.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.649+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f4fa00cdb50 con 0x7f4fb00734b0 2023-10-26T06:41:26.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.649+0000 7f4fb5f9b700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4f9c0a14d0 0x7f4f9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:26.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.649+0000 7f4fb5f9b700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4f9c0a14d0 0x7f4f9c0a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fac005950 tx=0x7f4fac00b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:26.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.653+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4fa0097570 con 0x7f4fb00734b0 2023-10-26T06:41:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.874+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fb0067560 con 0x7f4fb00734b0 2023-10-26T06:41:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.876+0000 7f4fa6ffd700 1 -- 172.21.15.50:0/3710932117 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18762 (secure 0 0 0) 0x7f4fa009ab90 con 0x7f4fb00734b0 2023-10-26T06:41:26.878 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:26.878 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:40:43.836331+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:41:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.878+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4f9c0a14d0 msgr2=0x7f4f9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.878+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4f9c0a14d0 0x7f4f9c0a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fac005950 tx=0x7f4fac00b500 comp rx=0 tx=0).stop 2023-10-26T06:41:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.878+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb00734b0 msgr2=0x7f4fb019d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.878+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb00734b0 0x7f4fb019d6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00059d0 tx=0x7f4fa0004730 comp rx=0 tx=0).stop 2023-10-26T06:41:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 shutdown_connections 2023-10-26T06:41:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4f9c0a14d0 0x7f4f9c0a3990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb01116b0 0x7f4fb01a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fb0072b90 0x7f4fb019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 --2- 172.21.15.50:0/3710932117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb00734b0 0x7f4fb019d6e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 >> 172.21.15.50:0/3710932117 conn(0x7f4fb00fc170 msgr2=0x7f4fb00fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 shutdown_connections 2023-10-26T06:41:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:26.879+0000 7f4fb81ff700 1 -- 172.21.15.50:0/3710932117 wait complete. 2023-10-26T06:41:26.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:41:26.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:41:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:26 smithi050 ceph-mon[94997]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:26 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1889350650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 -- 172.21.15.50:0/2074967649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1581010e0 msgr2=0x7fd15810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/2074967649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1581010e0 0x7fd15810d5f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd15000b0a0 tx=0x7fd15000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 -- 172.21.15.50:0/2074967649 shutdown_connections 2023-10-26T06:41:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/2074967649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1581010e0 0x7fd15810d5f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/2074967649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd158106730 0x7fd158106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/2074967649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd158100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 -- 172.21.15.50:0/2074967649 >> 172.21.15.50:0/2074967649 conn(0x7fd1580fc1b0 msgr2=0x7fd1580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 -- 172.21.15.50:0/2074967649 shutdown_connections 2023-10-26T06:41:27.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.116+0000 7fd15e7ff700 1 -- 172.21.15.50:0/2074967649 wait complete. 2023-10-26T06:41:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 Processor -- start 2023-10-26T06:41:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 -- start start 2023-10-26T06:41:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd15819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1581010e0 0x7fd15819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 0x7fd158198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158199140 con 0x7fd158106730 2023-10-26T06:41:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581992b0 con 0x7fd158100720 2023-10-26T06:41:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15e7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158199470 con 0x7fd1581010e0 2023-10-26T06:41:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd157fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd15819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15cd9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 0x7fd158198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd157fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd15819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37876/0 (socket says 172.21.15.50:37876) 2023-10-26T06:41:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd15cd9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 0x7fd158198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54132/0 (socket says 172.21.15.50:54132) 2023-10-26T06:41:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.118+0000 7fd157fff700 1 -- 172.21.15.50:0/3029803921 learned_addr learned my addr 172.21.15.50:0/3029803921 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:27.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd1577fe700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1581010e0 0x7fd15819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd157fff700 1 -- 172.21.15.50:0/3029803921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1581010e0 msgr2=0x7fd15819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd157fff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1581010e0 0x7fd15819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd157fff700 1 -- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 msgr2=0x7fd158198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd157fff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 0x7fd158198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd157fff700 1 -- 172.21.15.50:0/3029803921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150009d00 con 0x7fd158100720 2023-10-26T06:41:27.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd15cd9c700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 0x7fd158198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd157fff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd15819e9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14800e9a0 tx=0x7fd14800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148009790 con 0x7fd158100720 2023-10-26T06:41:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd148010430 con 0x7fd158100720 2023-10-26T06:41:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd158199750 con 0x7fd158100720 2023-10-26T06:41:27.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148018680 con 0x7fd158100720 2023-10-26T06:41:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.119+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1581a59a0 con 0x7fd158100720 2023-10-26T06:41:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.120+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd158101e60 con 0x7fd158100720 2023-10-26T06:41:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.122+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd1480105a0 con 0x7fd158100720 2023-10-26T06:41:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.124+0000 7fd1557fa700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd1400a14d0 0x7fd1400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.124+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd148014070 con 0x7fd158100720 2023-10-26T06:41:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.124+0000 7fd1577fe700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd1400a14d0 0x7fd1400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.124+0000 7fd1577fe700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd1400a14d0 0x7fd1400a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd158199ca0 tx=0x7fd14c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:27.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.126+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd148096550 con 0x7fd158100720 2023-10-26T06:41:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:26 smithi125 ceph-mon[130643]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:26 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1889350650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:26 smithi153 ceph-mon[131657]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:26 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1889350650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:27.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.356+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1581106a0 con 0x7fd158100720 2023-10-26T06:41:27.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.357+0000 7fd1557fa700 1 -- 172.21.15.50:0/3029803921 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd148099b70 con 0x7fd158100720 2023-10-26T06:41:27.359 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:41:27.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.359+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd1400a14d0 msgr2=0x7fd1400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.359+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd1400a14d0 0x7fd1400a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd158199ca0 tx=0x7fd14c009260 comp rx=0 tx=0).stop 2023-10-26T06:41:27.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.359+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 msgr2=0x7fd15819e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.359+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd15819e9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14800e9a0 tx=0x7fd14800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 shutdown_connections 2023-10-26T06:41:27.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd1400a14d0 0x7fd1400a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd158106730 0x7fd158198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd158100720 0x7fd15819e9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 --2- 172.21.15.50:0/3029803921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1581010e0 0x7fd15819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 >> 172.21.15.50:0/3029803921 conn(0x7fd1580fc1b0 msgr2=0x7fd15810be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:27.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 shutdown_connections 2023-10-26T06:41:27.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.360+0000 7fd15e7ff700 1 -- 172.21.15.50:0/3029803921 wait complete. 2023-10-26T06:41:27.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-26T06:41:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 -- 172.21.15.50:0/1295696008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc067fa0 msgr2=0x7f3afc10d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 --2- 172.21.15.50:0/1295696008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc067fa0 0x7f3afc10d530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b0a0 tx=0x7f3af400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 -- 172.21.15.50:0/1295696008 shutdown_connections 2023-10-26T06:41:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 --2- 172.21.15.50:0/1295696008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc067fa0 0x7f3afc10d530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 --2- 172.21.15.50:0/1295696008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc1066c0 0x7f3afc106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 --2- 172.21.15.50:0/1295696008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc106fe0 0x7f3afc067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 -- 172.21.15.50:0/1295696008 >> 172.21.15.50:0/1295696008 conn(0x7f3afc076400 msgr2=0x7f3afc076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 -- 172.21.15.50:0/1295696008 shutdown_connections 2023-10-26T06:41:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.599+0000 7f3b00fff700 1 -- 172.21.15.50:0/1295696008 wait complete. 2023-10-26T06:41:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.600+0000 7f3b00fff700 1 Processor -- start 2023-10-26T06:41:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.600+0000 7f3b00fff700 1 -- start start 2023-10-26T06:41:27.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3b00fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc067fa0 0x7f3afc198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3b00fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 0x7f3afc199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3b00fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc106fe0 0x7f3afc19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3b00fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc19de00 con 0x7f3afc106fe0 2023-10-26T06:41:27.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3b00fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc19df70 con 0x7f3afc1066c0 2023-10-26T06:41:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3b00fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc19e130 con 0x7f3afc067fa0 2023-10-26T06:41:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3af9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 0x7f3afc199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3afa59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc067fa0 0x7f3afc198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3af9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 0x7f3afc199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37892/0 (socket says 172.21.15.50:37892) 2023-10-26T06:41:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3af9d9b700 1 -- 172.21.15.50:0/649444369 learned_addr learned my addr 172.21.15.50:0/649444369 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.601+0000 7f3afad9d700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc106fe0 0x7f3afc19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afa59c700 1 -- 172.21.15.50:0/649444369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 msgr2=0x7f3afc199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afa59c700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 0x7f3afc199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afa59c700 1 -- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc106fe0 msgr2=0x7f3afc19d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afa59c700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc106fe0 0x7f3afc19d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afa59c700 1 -- 172.21.15.50:0/649444369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4009d00 con 0x7f3afc067fa0 2023-10-26T06:41:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3af9d9b700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 0x7f3afc199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afad9d700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc106fe0 0x7f3afc19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3afa59c700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc067fa0 0x7f3afc198ee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9f0 tx=0x7f3aec00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00c9c0 con 0x7f3afc067fa0 2023-10-26T06:41:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc19e410 con 0x7f3afc067fa0 2023-10-26T06:41:27.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3aec010430 con 0x7f3afc067fa0 2023-10-26T06:41:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.602+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec018680 con 0x7f3afc067fa0 2023-10-26T06:41:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.603+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc1a5c50 con 0x7f3afc067fa0 2023-10-26T06:41:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.603+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc101de0 con 0x7f3afc067fa0 2023-10-26T06:41:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.606+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3aec010860 con 0x7f3afc067fa0 2023-10-26T06:41:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.609+0000 7f3aeb7fe700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ae40a14d0 0x7f3ae40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.609+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3aec014070 con 0x7f3afc067fa0 2023-10-26T06:41:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.609+0000 7f3af9d9b700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ae40a14d0 0x7f3ae40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.609+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3aec0964a0 con 0x7f3afc067fa0 2023-10-26T06:41:27.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.610+0000 7f3af9d9b700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ae40a14d0 0x7f3ae40a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3afc19a430 tx=0x7f3af0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:27.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.858+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3afc067530 con 0x7f3afc067fa0 2023-10-26T06:41:27.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.859+0000 7f3aeb7fe700 1 -- 172.21.15.50:0/649444369 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3aec099ac0 con 0x7f3afc067fa0 2023-10-26T06:41:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:27.861 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-10-26T06:41:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:41:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-10-26T06:41:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-10-26T06:41:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:41:27.862 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-10-26T06:41:27.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ae40a14d0 msgr2=0x7f3ae40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ae40a14d0 0x7f3ae40a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3afc19a430 tx=0x7f3af0009260 comp rx=0 tx=0).stop 2023-10-26T06:41:27.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc067fa0 msgr2=0x7f3afc198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:27.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc067fa0 0x7f3afc198ee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9f0 tx=0x7f3aec00ed00 comp rx=0 tx=0).stop 2023-10-26T06:41:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 shutdown_connections 2023-10-26T06:41:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ae40a14d0 0x7f3ae40a3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3afc106fe0 0x7f3afc19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3afc067fa0 0x7f3afc198ee0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 --2- 172.21.15.50:0/649444369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3afc1066c0 0x7f3afc199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 >> 172.21.15.50:0/649444369 conn(0x7f3afc076400 msgr2=0x7f3afc10b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 shutdown_connections 2023-10-26T06:41:27.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:27.862+0000 7f3b00fff700 1 -- 172.21.15.50:0/649444369 wait complete. 2023-10-26T06:41:27.887 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-26T06:41:27.888 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-26T06:41:28.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:27 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3710932117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:28.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:27 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3029803921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:41:28.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:27 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.107+0000 7f57db3ff700 1 -- 172.21.15.50:0/1038070516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 msgr2=0x7f57d410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.107+0000 7f57db3ff700 1 --2- 172.21.15.50:0/1038070516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d410d5f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00b0a0 tx=0x7f57cc00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 -- 172.21.15.50:0/1038070516 shutdown_connections 2023-10-26T06:41:28.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 --2- 172.21.15.50:0/1038070516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d410d5f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 --2- 172.21.15.50:0/1038070516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d4106730 0x7f57d4106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 --2- 172.21.15.50:0/1038070516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 -- 172.21.15.50:0/1038070516 >> 172.21.15.50:0/1038070516 conn(0x7f57d40fc1b0 msgr2=0x7f57d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:28.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 -- 172.21.15.50:0/1038070516 shutdown_connections 2023-10-26T06:41:28.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.108+0000 7f57db3ff700 1 -- 172.21.15.50:0/1038070516 wait complete. 2023-10-26T06:41:28.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.109+0000 7f57db3ff700 1 Processor -- start 2023-10-26T06:41:28.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.109+0000 7f57db3ff700 1 -- start start 2023-10-26T06:41:28.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57db3ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:28.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57db3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:28.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57db3ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d4106730 0x7f57d4073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:28.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57db3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41a4f70 con 0x7f57d41010e0 2023-10-26T06:41:28.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57db3ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41a50e0 con 0x7f57d4106730 2023-10-26T06:41:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57db3ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41a52a0 con 0x7f57d4100720 2023-10-26T06:41:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57d899a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57d919b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57d899a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d4073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54166/0 (socket says 172.21.15.50:54166) 2023-10-26T06:41:28.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57d899a700 1 -- 172.21.15.50:0/412604101 learned_addr learned my addr 172.21.15.50:0/412604101 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:28.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57d919b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37572/0 (socket says 172.21.15.50:37572) 2023-10-26T06:41:28.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.110+0000 7f57d999c700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d4106730 0x7f57d4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:28.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d899a700 1 -- 172.21.15.50:0/412604101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 msgr2=0x7f57d4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d899a700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d899a700 1 -- 172.21.15.50:0/412604101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d4106730 msgr2=0x7f57d4073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:28.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d899a700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d4106730 0x7f57d4073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d899a700 1 -- 172.21.15.50:0/412604101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009d00 con 0x7f57d41010e0 2023-10-26T06:41:28.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d919b700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:28.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57d899a700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d4073030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f57c400e9a0 tx=0x7f57c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:28.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4009790 con 0x7f57d41010e0 2023-10-26T06:41:28.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57c4010430 con 0x7f57d41010e0 2023-10-26T06:41:28.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d41a5580 con 0x7f57d41010e0 2023-10-26T06:41:28.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.111+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4018680 con 0x7f57d41010e0 2023-10-26T06:41:28.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.112+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d41a5a60 con 0x7f57d41010e0 2023-10-26T06:41:28.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.113+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d4108d40 con 0x7f57d41010e0 2023-10-26T06:41:28.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.115+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f57c40105a0 con 0x7f57d41010e0 2023-10-26T06:41:28.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.116+0000 7f57ca7fc700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f57c00a14d0 0x7f57c00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:28.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.116+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f57c4014070 con 0x7f57d41010e0 2023-10-26T06:41:28.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.116+0000 7f57d919b700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f57c00a14d0 0x7f57c00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:28.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.117+0000 7f57d919b700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f57c00a14d0 0x7f57c00a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fd0 tx=0x7f57d0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:28.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.120+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57c4052100 con 0x7f57d41010e0 2023-10-26T06:41:28.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:27 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3710932117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:27 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3029803921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:41:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:27 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:27 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3710932117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:28.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:27 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3029803921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:41:28.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:27 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.347+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f57d4073fd0 con 0x7f57d41010e0 2023-10-26T06:41:28.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.920+0000 7f57ca7fc700 1 -- 172.21.15.50:0/412604101 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f57c409a000 con 0x7f57d41010e0 2023-10-26T06:41:28.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.923+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f57c00a14d0 msgr2=0x7f57c00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:28.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.923+0000 7f57db3ff700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f57c00a14d0 0x7f57c00a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fd0 tx=0x7f57d0009260 comp rx=0 tx=0).stop 2023-10-26T06:41:28.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.923+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 msgr2=0x7f57d4073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:28.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.923+0000 7f57db3ff700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d4073030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f57c400e9a0 tx=0x7f57c400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.924+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 shutdown_connections 2023-10-26T06:41:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.924+0000 7f57db3ff700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f57c00a14d0 0x7f57c00a3990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.924+0000 7f57db3ff700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d4106730 0x7f57d4073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.924+0000 7f57db3ff700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57d4100720 0x7f57d4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.924+0000 7f57db3ff700 1 --2- 172.21.15.50:0/412604101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57d41010e0 0x7f57d4073030 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.924+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 >> 172.21.15.50:0/412604101 conn(0x7f57d40fc1b0 msgr2=0x7f57d40fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:28.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.925+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 shutdown_connections 2023-10-26T06:41:28.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:28.925+0000 7f57db3ff700 1 -- 172.21.15.50:0/412604101 wait complete. 2023-10-26T06:41:28.931 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-10-26T06:41:28.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-26T06:41:29.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.165+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/4059027946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 msgr2=0x7fbd08073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:29.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.165+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/4059027946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 0x7fbd08073000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009990 tx=0x7fbcf8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/4059027946 shutdown_connections 2023-10-26T06:41:29.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/4059027946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 0x7fbd0810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/4059027946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 0x7fbd08073000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/4059027946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd0810ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/4059027946 >> 172.21.15.50:0/4059027946 conn(0x7fbd080fc200 msgr2=0x7fbd080fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/4059027946 shutdown_connections 2023-10-26T06:41:29.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.166+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/4059027946 wait complete. 2023-10-26T06:41:29.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:28 smithi125 ceph-mon[130643]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:29.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:28 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/649444369' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-26T06:41:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 Processor -- start 2023-10-26T06:41:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 -- start start 2023-10-26T06:41:29.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 0x7fbd08198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd08199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 0x7fbd0819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0819dd10 con 0x7fbd08073540 2023-10-26T06:41:29.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0819de80 con 0x7fbd08072c20 2023-10-26T06:41:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd0d7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0819e040 con 0x7fbd0810cf50 2023-10-26T06:41:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.167+0000 7fbd067fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd08199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 0x7fbd0819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd067fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd08199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54186/0 (socket says 172.21.15.50:54186) 2023-10-26T06:41:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd067fc700 1 -- 172.21.15.50:0/2514123664 learned_addr learned my addr 172.21.15.50:0/2514123664 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:29.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd06ffd700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 0x7fbd08198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 -- 172.21.15.50:0/2514123664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 msgr2=0x7fbd08198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 0x7fbd08198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 -- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 msgr2=0x7fbd08199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd08199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 -- 172.21.15.50:0/2514123664 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80095f0 con 0x7fbd0810cf50 2023-10-26T06:41:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd067fc700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd08199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbd077fe700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 0x7fbd0819d6d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000efc0 tx=0x7fbd0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.168+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00018070 con 0x7fbd0810cf50 2023-10-26T06:41:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.169+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0819e2c0 con 0x7fbd0810cf50 2023-10-26T06:41:29.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.169+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd0000f040 con 0x7fbd0810cf50 2023-10-26T06:41:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.169+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000cd40 con 0x7fbd0810cf50 2023-10-26T06:41:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.169+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd081a5b60 con 0x7fbd0810cf50 2023-10-26T06:41:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.170+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd08108160 con 0x7fbd0810cf50 2023-10-26T06:41:29.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.172+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbd00003a00 con 0x7fbd0810cf50 2023-10-26T06:41:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.173+0000 7fbceffff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcf00a1550 0x7fbcf00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.173+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7712+0+0 (secure 0 0 0) 0x7fbd000ccff0 con 0x7fbd0810cf50 2023-10-26T06:41:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.173+0000 7fbd06ffd700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcf00a1550 0x7fbcf00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:29.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.174+0000 7fbd06ffd700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcf00a1550 0x7fbcf00a3a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800b2e0 tx=0x7fbcf8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:29.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.175+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd00096900 con 0x7fbd0810cf50 2023-10-26T06:41:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:28 smithi153 ceph-mon[131657]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:29.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:28 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/649444369' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-26T06:41:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:28 smithi050 ceph-mon[94997]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:28 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/649444369' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-26T06:41:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.393+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbd080742d0 con 0x7fbd0810cf50 2023-10-26T06:41:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.946+0000 7fbceffff700 1 -- 172.21.15.50:0/2514123664 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbd00099f20 con 0x7fbd0810cf50 2023-10-26T06:41:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcf00a1550 msgr2=0x7fbcf00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcf00a1550 0x7fbcf00a3a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800b2e0 tx=0x7fbcf8005fd0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 msgr2=0x7fbd0819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 0x7fbd0819d6d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000efc0 tx=0x7fbd0000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 shutdown_connections 2023-10-26T06:41:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcf00a1550 0x7fbcf00a3a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd0810cf50 0x7fbd0819d6d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbd08072c20 0x7fbd08198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 --2- 172.21.15.50:0/2514123664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd08073540 0x7fbd08199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.953+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 >> 172.21.15.50:0/2514123664 conn(0x7fbd080fc200 msgr2=0x7fbd080fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.954+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 shutdown_connections 2023-10-26T06:41:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:29.954+0000 7fbd0d7ff700 1 -- 172.21.15.50:0/2514123664 wait complete. 2023-10-26T06:41:29.959 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-10-26T06:41:29.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-26T06:41:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 -- 172.21.15.50:0/384656855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 msgr2=0x7f0e6c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 --2- 172.21.15.50:0/384656855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 0x7f0e6c10d5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400b0a0 tx=0x7f0e6400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 -- 172.21.15.50:0/384656855 shutdown_connections 2023-10-26T06:41:30.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 --2- 172.21.15.50:0/384656855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 0x7f0e6c10d5f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 --2- 172.21.15.50:0/384656855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c106730 0x7f0e6c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 --2- 172.21.15.50:0/384656855 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c100720 0x7f0e6c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 -- 172.21.15.50:0/384656855 >> 172.21.15.50:0/384656855 conn(0x7f0e6c0fc1b0 msgr2=0x7f0e6c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:30.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 -- 172.21.15.50:0/384656855 shutdown_connections 2023-10-26T06:41:30.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.195+0000 7f0e72bff700 1 -- 172.21.15.50:0/384656855 wait complete. 2023-10-26T06:41:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.196+0000 7f0e72bff700 1 Processor -- start 2023-10-26T06:41:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.196+0000 7f0e72bff700 1 -- start start 2023-10-26T06:41:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e72bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 0x7f0e6c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e72bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 0x7f0e6c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e72bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c106730 0x7f0e6c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e72bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c19cb40 con 0x7f0e6c100720 2023-10-26T06:41:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e72bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c19ccb0 con 0x7f0e6c106730 2023-10-26T06:41:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e72bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c19ce70 con 0x7f0e6c1010e0 2023-10-26T06:41:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 0x7f0e6c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 0x7f0e6c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54216/0 (socket says 172.21.15.50:54216) 2023-10-26T06:41:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 -- 172.21.15.50:0/2889637972 learned_addr learned my addr 172.21.15.50:0/2889637972 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7119c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c106730 0x7f0e6c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e6bfff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 0x7f0e6c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 -- 172.21.15.50:0/2889637972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 msgr2=0x7f0e6c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 0x7f0e6c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 -- 172.21.15.50:0/2889637972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c106730 msgr2=0x7f0e6c19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c106730 0x7f0e6c19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7099b700 1 -- 172.21.15.50:0/2889637972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64009d00 con 0x7f0e6c100720 2023-10-26T06:41:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.197+0000 7f0e7119c700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c106730 0x7f0e6c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.198+0000 7f0e7099b700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 0x7f0e6c198d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000e9a0 tx=0x7f0e6000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.198+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60009790 con 0x7f0e6c100720 2023-10-26T06:41:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.198+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c19d150 con 0x7f0e6c100720 2023-10-26T06:41:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.198+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e60010430 con 0x7f0e6c100720 2023-10-26T06:41:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.198+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60018680 con 0x7f0e6c100720 2023-10-26T06:41:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.198+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c1a5ab0 con 0x7f0e6c100720 2023-10-26T06:41:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.199+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c101e60 con 0x7f0e6c100720 2023-10-26T06:41:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.201+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0e600105a0 con 0x7f0e6c100720 2023-10-26T06:41:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.202+0000 7f0e69ffb700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0e5c0a14d0 0x7f0e5c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.203+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8094+0+0 (secure 0 0 0) 0x7f0e60014070 con 0x7f0e6c100720 2023-10-26T06:41:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.203+0000 7f0e6bfff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0e5c0a14d0 0x7f0e5c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.203+0000 7f0e6bfff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0e5c0a14d0 0x7f0e5c0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c19a220 tx=0x7f0e58009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:30.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.205+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e600966e0 con 0x7f0e6c100720 2023-10-26T06:41:30.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:29 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/412604101' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-26T06:41:30.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:30.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:30.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:29 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/412604101' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-26T06:41:30.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:29 smithi153 ceph-mon[131657]: osdmap e81: 12 total, 12 up, 12 in 2023-10-26T06:41:30.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:29 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2514123664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-26T06:41:30.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:29 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/412604101' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-26T06:41:30.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:30.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:29 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/412604101' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-26T06:41:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:29 smithi050 ceph-mon[94997]: osdmap e81: 12 total, 12 up, 12 in 2023-10-26T06:41:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:29 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2514123664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-26T06:41:30.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:29 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/412604101' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-26T06:41:30.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:29 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/412604101' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-26T06:41:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:29 smithi125 ceph-mon[130643]: osdmap e81: 12 total, 12 up, 12 in 2023-10-26T06:41:30.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:29 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2514123664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-26T06:41:30.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.486+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0e6c110690 con 0x7f0e6c100720 2023-10-26T06:41:30.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.956+0000 7f0e69ffb700 1 -- 172.21.15.50:0/2889637972 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0e60099d00 con 0x7f0e6c100720 2023-10-26T06:41:30.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.964+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0e5c0a14d0 msgr2=0x7f0e5c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:30.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.964+0000 7f0e72bff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0e5c0a14d0 0x7f0e5c0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c19a220 tx=0x7f0e58009260 comp rx=0 tx=0).stop 2023-10-26T06:41:30.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.964+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 msgr2=0x7f0e6c198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:30.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.964+0000 7f0e72bff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 0x7f0e6c198d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000e9a0 tx=0x7f0e6000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.965+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 shutdown_connections 2023-10-26T06:41:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.965+0000 7f0e72bff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0e5c0a14d0 0x7f0e5c0a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.965+0000 7f0e72bff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e6c106730 0x7f0e6c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.965+0000 7f0e72bff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e6c100720 0x7f0e6c198d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.965+0000 7f0e72bff700 1 --2- 172.21.15.50:0/2889637972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e6c1010e0 0x7f0e6c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:30.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.965+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 >> 172.21.15.50:0/2889637972 conn(0x7f0e6c0fc1b0 msgr2=0x7f0e6c1059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.966+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 shutdown_connections 2023-10-26T06:41:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:30.967+0000 7f0e72bff700 1 -- 172.21.15.50:0/2889637972 wait complete. 2023-10-26T06:41:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2023-10-26T06:41:30.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:41:31.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3492799759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b41066b0 msgr2=0x7f36b4106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3492799759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b41066b0 0x7f36b4106a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009990 tx=0x7f36a8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3492799759 shutdown_connections 2023-10-26T06:41:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3492799759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b4101060 0x7f36b410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3492799759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b41066b0 0x7f36b4106a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3492799759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 0x7f36b4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3492799759 >> 172.21.15.50:0/3492799759 conn(0x7f36b40fc170 msgr2=0x7f36b40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3492799759 shutdown_connections 2023-10-26T06:41:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.210+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3492799759 wait complete. 2023-10-26T06:41:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.211+0000 7f36bb1ff700 1 Processor -- start 2023-10-26T06:41:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.211+0000 7f36bb1ff700 1 -- start start 2023-10-26T06:41:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36bb1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 0x7f36b419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36bb1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 0x7f36b419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36bb1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b41066b0 0x7f36b4196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36bb1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4196fa0 con 0x7f36b41066b0 2023-10-26T06:41:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36bb1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4197110 con 0x7f36b41006a0 2023-10-26T06:41:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36bb1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b41972d0 con 0x7f36b4101060 2023-10-26T06:41:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 0x7f36b419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b8f9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 0x7f36b419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 0x7f36b419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37634/0 (socket says 172.21.15.50:37634) 2023-10-26T06:41:31.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b8f9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 0x7f36b419c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37968/0 (socket says 172.21.15.50:37968) 2023-10-26T06:41:31.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 -- 172.21.15.50:0/3384178306 learned_addr learned my addr 172.21.15.50:0/3384178306 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:31.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b979c700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b41066b0 0x7f36b4196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 -- 172.21.15.50:0/3384178306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 msgr2=0x7f36b419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 0x7f36b419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 -- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b41066b0 msgr2=0x7f36b4196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b41066b0 0x7f36b4196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.212+0000 7f36b3fff700 1 -- 172.21.15.50:0/3384178306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80095f0 con 0x7f36b4101060 2023-10-26T06:41:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.213+0000 7f36b3fff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 0x7f36b419cd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e9a0 tx=0x7f36a000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.213+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0009790 con 0x7f36b4101060 2023-10-26T06:41:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.213+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36a0010430 con 0x7f36b4101060 2023-10-26T06:41:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.213+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0018680 con 0x7f36b4101060 2023-10-26T06:41:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.213+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b41975b0 con 0x7f36b4101060 2023-10-26T06:41:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.213+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b41a3800 con 0x7f36b4101060 2023-10-26T06:41:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.214+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b4108c30 con 0x7f36b4101060 2023-10-26T06:41:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.216+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f36a00105a0 con 0x7f36b4101060 2023-10-26T06:41:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.217+0000 7f36b1ffb700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36a40a1550 0x7f36a40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.218+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f36a0014070 con 0x7f36b4101060 2023-10-26T06:41:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.218+0000 7f36b8f9b700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36a40a1550 0x7f36a40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.218+0000 7f36b8f9b700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36a40a1550 0x7f36a40a3a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f36a800b2e0 tx=0x7f36a8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.219+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36a0096550 con 0x7f36b4101060 2023-10-26T06:41:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-26T06:41:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: pgmap v249: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:31.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:31.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:41:31.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-26T06:41:31.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: osdmap e82: 12 total, 12 up, 12 in 2023-10-26T06:41:31.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:31.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:41:31.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2889637972' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-26T06:41:31.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:30 smithi153 ceph-mon[131657]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-26T06:41:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-26T06:41:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: pgmap v249: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:41:31.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-26T06:41:31.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: osdmap e82: 12 total, 12 up, 12 in 2023-10-26T06:41:31.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:31.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:41:31.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2889637972' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-26T06:41:31.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:30 smithi050 ceph-mon[94997]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-26T06:41:31.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-26T06:41:31.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: pgmap v249: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-26T06:41:31.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:31.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:41:31.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-26T06:41:31.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: osdmap e82: 12 total, 12 up, 12 in 2023-10-26T06:41:31.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:31.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:41:31.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2889637972' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-26T06:41:31.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:30 smithi125 ceph-mon[130643]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-26T06:41:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.439+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36b4101de0 con 0x7f36b4101060 2023-10-26T06:41:31.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.441+0000 7f36b1ffb700 1 -- 172.21.15.50:0/3384178306 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22472 (secure 0 0 0) 0x7f36a0099b70 con 0x7f36b4101060 2023-10-26T06:41:31.443 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:31.443 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":83,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:41:30.488466+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:41:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36a40a1550 msgr2=0x7f36a40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36a40a1550 0x7f36a40a3a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f36a800b2e0 tx=0x7f36a8005fd0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 msgr2=0x7f36b419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 0x7f36b419cd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e9a0 tx=0x7f36a000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 shutdown_connections 2023-10-26T06:41:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36a40a1550 0x7f36a40a3a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36b41066b0 0x7f36b4196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36b41006a0 0x7f36b419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 --2- 172.21.15.50:0/3384178306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36b4101060 0x7f36b419cd50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 >> 172.21.15.50:0/3384178306 conn(0x7f36b40fc170 msgr2=0x7f36b40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 shutdown_connections 2023-10-26T06:41:31.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.443+0000 7f36bb1ff700 1 -- 172.21.15.50:0/3384178306 wait complete. 2023-10-26T06:41:31.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:41:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.679+0000 7f18ba7ff700 1 -- 172.21.15.50:0/798236216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b4072c20 msgr2=0x7f18b4073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.679+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/798236216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b4072c20 0x7f18b4073000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009990 tx=0x7f18a4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 -- 172.21.15.50:0/798236216 shutdown_connections 2023-10-26T06:41:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/798236216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b410cee0 0x7f18b410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/798236216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b4072c20 0x7f18b4073000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/798236216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4073540 0x7f18b410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 -- 172.21.15.50:0/798236216 >> 172.21.15.50:0/798236216 conn(0x7f18b40fc170 msgr2=0x7f18b40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 -- 172.21.15.50:0/798236216 shutdown_connections 2023-10-26T06:41:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.680+0000 7f18ba7ff700 1 -- 172.21.15.50:0/798236216 wait complete. 2023-10-26T06:41:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 Processor -- start 2023-10-26T06:41:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 -- start start 2023-10-26T06:41:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 0x7f18b4198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b4073540 0x7f18b41992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b410cee0 0x7f18b419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b419dcb0 con 0x7f18b410cee0 2023-10-26T06:41:31.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b419de20 con 0x7f18b4073540 2023-10-26T06:41:31.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.681+0000 7f18ba7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b419dfe0 con 0x7f18b4072c20 2023-10-26T06:41:31.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 0x7f18b4198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b8d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b410cee0 0x7f18b419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 0x7f18b4198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37656/0 (socket says 172.21.15.50:37656) 2023-10-26T06:41:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 -- 172.21.15.50:0/907996505 learned_addr learned my addr 172.21.15.50:0/907996505 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b37fe700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b4073540 0x7f18b41992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 -- 172.21.15.50:0/907996505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b4073540 msgr2=0x7f18b41992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b4073540 0x7f18b41992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 -- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b410cee0 msgr2=0x7f18b419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b410cee0 0x7f18b419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 -- 172.21.15.50:0/907996505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40095f0 con 0x7f18b4072c20 2023-10-26T06:41:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b8d9c700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b410cee0 0x7f18b419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:31.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.682+0000 7f18b3fff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 0x7f18b4198d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f18a4000c00 tx=0x7f18a4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:31.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.683+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a401d070 con 0x7f18b4072c20 2023-10-26T06:41:31.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.683+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18a4022470 con 0x7f18b4072c20 2023-10-26T06:41:31.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.683+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4017650 con 0x7f18b4072c20 2023-10-26T06:41:31.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.683+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b419e260 con 0x7f18b4072c20 2023-10-26T06:41:31.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.683+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b419e4e0 con 0x7f18b4072c20 2023-10-26T06:41:31.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.684+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b41080f0 con 0x7f18b4072c20 2023-10-26T06:41:31.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.686+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f18a40225e0 con 0x7f18b4072c20 2023-10-26T06:41:31.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.687+0000 7f18b17fa700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f189c0a1550 0x7f189c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:31.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.687+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f18a40cdea0 con 0x7f18b4072c20 2023-10-26T06:41:31.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.687+0000 7f18b37fe700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f189c0a1550 0x7f189c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:31.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.688+0000 7f18b37fe700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f189c0a1550 0x7f189c0a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18b419a2e0 tx=0x7f18a8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:31.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.691+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f18a4097670 con 0x7f18b4072c20 2023-10-26T06:41:31.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.921+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b40742d0 con 0x7f18b4072c20 2023-10-26T06:41:31.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.922+0000 7f18b17fa700 1 -- 172.21.15.50:0/907996505 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22472 (secure 0 0 0) 0x7f18a4027020 con 0x7f18b4072c20 2023-10-26T06:41:31.924 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:31.925 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":83,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:41:30.488466+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:41:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f189c0a1550 msgr2=0x7f189c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f189c0a1550 0x7f189c0a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18b419a2e0 tx=0x7f18a8009260 comp rx=0 tx=0).stop 2023-10-26T06:41:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 msgr2=0x7f18b4198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 0x7f18b4198d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f18a4000c00 tx=0x7f18a4005740 comp rx=0 tx=0).stop 2023-10-26T06:41:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 shutdown_connections 2023-10-26T06:41:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f189c0a1550 0x7f189c0a3a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18b410cee0 0x7f18b419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18b4072c20 0x7f18b4198d90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 --2- 172.21.15.50:0/907996505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b4073540 0x7f18b41992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 >> 172.21.15.50:0/907996505 conn(0x7f18b40fc170 msgr2=0x7f18b40fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 shutdown_connections 2023-10-26T06:41:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:31.925+0000 7f18ba7ff700 1 -- 172.21.15.50:0/907996505 wait complete. 2023-10-26T06:41:31.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-26T06:41:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 -- 172.21.15.50:0/3470541798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 msgr2=0x7f8378106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 --2- 172.21.15.50:0/3470541798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378106b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8374009990 tx=0x7f8374009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 -- 172.21.15.50:0/3470541798 shutdown_connections 2023-10-26T06:41:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 --2- 172.21.15.50:0/3470541798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83781010d0 0x7f837810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 --2- 172.21.15.50:0/3470541798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378106b00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 --2- 172.21.15.50:0/3470541798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8378100710 0x7f8378100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 -- 172.21.15.50:0/3470541798 >> 172.21.15.50:0/3470541798 conn(0x7f83780fc200 msgr2=0x7f83780fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 -- 172.21.15.50:0/3470541798 shutdown_connections 2023-10-26T06:41:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.169+0000 7f83805ff700 1 -- 172.21.15.50:0/3470541798 wait complete. 2023-10-26T06:41:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 Processor -- start 2023-10-26T06:41:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 -- start start 2023-10-26T06:41:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 0x7f837819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83781010d0 0x7f837819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378199200 con 0x7f83781010d0 2023-10-26T06:41:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378199370 con 0x7f8378100710 2023-10-26T06:41:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.170+0000 7f83805ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378199530 con 0x7f8378106720 2023-10-26T06:41:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 0x7f837819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837eb9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 0x7f837819ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38008/0 (socket says 172.21.15.50:38008) 2023-10-26T06:41:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 -- 172.21.15.50:0/3106761662 learned_addr learned my addr 172.21.15.50:0/3106761662 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837db9a700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83781010d0 0x7f837819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 -- 172.21.15.50:0/3106761662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 msgr2=0x7f8378198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 -- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83781010d0 msgr2=0x7f837819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83781010d0 0x7f837819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 -- 172.21.15.50:0/3106761662 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740095f0 con 0x7f8378100710 2023-10-26T06:41:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837eb9c700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.171+0000 7f837e39b700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 0x7f837819ea70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8374000c00 tx=0x7f8374005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.172+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837401d070 con 0x7f8378100710 2023-10-26T06:41:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.172+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8374022470 con 0x7f8378100710 2023-10-26T06:41:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.172+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83781997b0 con 0x7f8378100710 2023-10-26T06:41:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.172+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374017650 con 0x7f8378100710 2023-10-26T06:41:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.172+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83781a5a60 con 0x7f8378100710 2023-10-26T06:41:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.173+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8378101e50 con 0x7f8378100710 2023-10-26T06:41:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.175+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f83740225e0 con 0x7f8378100710 2023-10-26T06:41:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.176+0000 7f836f7fe700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83640a14d0 0x7f83640a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.176+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f83740ce170 con 0x7f8378100710 2023-10-26T06:41:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.176+0000 7f837db9a700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83640a14d0 0x7f83640a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:32.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.177+0000 7f837db9a700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83640a14d0 0x7f83640a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f837819a240 tx=0x7f8368009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.180+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8374097820 con 0x7f8378100710 2023-10-26T06:41:32.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-26T06:41:32.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: osdmap e83: 12 total, 12 up, 12 in 2023-10-26T06:41:32.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2889637972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-26T06:41:32.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-26T06:41:32.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-26T06:41:32.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3384178306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:32.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: pgmap v252: 97 pgs: 15 creating+peering, 21 active+clean, 61 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-26T06:41:32.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:31 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/907996505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:32.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-26T06:41:32.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: osdmap e83: 12 total, 12 up, 12 in 2023-10-26T06:41:32.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2889637972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-26T06:41:32.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-26T06:41:32.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-26T06:41:32.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3384178306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:32.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: pgmap v252: 97 pgs: 15 creating+peering, 21 active+clean, 61 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-26T06:41:32.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:31 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/907996505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:32.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-26T06:41:32.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: osdmap e83: 12 total, 12 up, 12 in 2023-10-26T06:41:32.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2889637972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-26T06:41:32.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-26T06:41:32.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-26T06:41:32.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3384178306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:32.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: pgmap v252: 97 pgs: 15 creating+peering, 21 active+clean, 61 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-26T06:41:32.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:31 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/907996505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:32.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.479+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8378199ff0 con 0x7f8378100710 2023-10-26T06:41:32.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.967+0000 7f836f7fe700 1 -- 172.21.15.50:0/3106761662 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f837409ae40 con 0x7f8378100710 2023-10-26T06:41:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83640a14d0 msgr2=0x7f83640a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83640a14d0 0x7f83640a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f837819a240 tx=0x7f8368009260 comp rx=0 tx=0).stop 2023-10-26T06:41:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 msgr2=0x7f837819ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 0x7f837819ea70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8374000c00 tx=0x7f8374005740 comp rx=0 tx=0).stop 2023-10-26T06:41:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 shutdown_connections 2023-10-26T06:41:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83640a14d0 0x7f83640a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8378106720 0x7f8378198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8378100710 0x7f837819ea70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 --2- 172.21.15.50:0/3106761662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83781010d0 0x7f837819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:32.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 >> 172.21.15.50:0/3106761662 conn(0x7f83780fc200 msgr2=0x7f837810be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:32.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 shutdown_connections 2023-10-26T06:41:32.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:32.970+0000 7f83805ff700 1 -- 172.21.15.50:0/3106761662 wait complete. 2023-10-26T06:41:32.992 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-26T06:41:32.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-26T06:41:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 -- 172.21.15.50:0/3307109454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c105170 msgr2=0x7f010c1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 --2- 172.21.15.50:0/3307109454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c105170 0x7f010c1055f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0100009990 tx=0x7f0100009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 -- 172.21.15.50:0/3307109454 shutdown_connections 2023-10-26T06:41:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 --2- 172.21.15.50:0/3307109454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f010c105b30 0x7f010c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 --2- 172.21.15.50:0/3307109454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c067d40 0x7f010c068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 --2- 172.21.15.50:0/3307109454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c105170 0x7f010c1055f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 -- 172.21.15.50:0/3307109454 >> 172.21.15.50:0/3307109454 conn(0x7f010c0767f0 msgr2=0x7f010c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 -- 172.21.15.50:0/3307109454 shutdown_connections 2023-10-26T06:41:33.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.206+0000 7f01115ff700 1 -- 172.21.15.50:0/3307109454 wait complete. 2023-10-26T06:41:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 Processor -- start 2023-10-26T06:41:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 -- start start 2023-10-26T06:41:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 0x7f010c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c105170 0x7f010c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f010c105b30 0x7f010c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c19dd10 con 0x7f010c105b30 2023-10-26T06:41:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c19de80 con 0x7f010c067d40 2023-10-26T06:41:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f01115ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c19e040 con 0x7f010c105170 2023-10-26T06:41:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f010affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 0x7f010c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f010affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 0x7f010c198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38024/0 (socket says 172.21.15.50:38024) 2023-10-26T06:41:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f010affd700 1 -- 172.21.15.50:0/4225941159 learned_addr learned my addr 172.21.15.50:0/4225941159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.208+0000 7f010a7fc700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c105170 0x7f010c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010b7fe700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f010c105b30 0x7f010c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010affd700 1 -- 172.21.15.50:0/4225941159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c105170 msgr2=0x7f010c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010affd700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c105170 0x7f010c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010affd700 1 -- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f010c105b30 msgr2=0x7f010c19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010affd700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f010c105b30 0x7f010c19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010affd700 1 -- 172.21.15.50:0/4225941159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01000095f0 con 0x7f010c067d40 2023-10-26T06:41:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010a7fc700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c105170 0x7f010c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f010affd700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 0x7f010c198df0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e9a0 tx=0x7f00fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc009790 con 0x7f010c067d40 2023-10-26T06:41:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00fc010430 con 0x7f010c067d40 2023-10-26T06:41:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc018680 con 0x7f010c067d40 2023-10-26T06:41:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.209+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c19e320 con 0x7f010c067d40 2023-10-26T06:41:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.210+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c1a5b60 con 0x7f010c067d40 2023-10-26T06:41:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.211+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c0fe930 con 0x7f010c067d40 2023-10-26T06:41:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.214+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f00fc0105a0 con 0x7f010c067d40 2023-10-26T06:41:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.215+0000 7f00f3fff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00f40a1550 0x7f00f40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.215+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f00fc014070 con 0x7f010c067d40 2023-10-26T06:41:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.215+0000 7f010a7fc700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00f40a1550 0x7f00f40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.216+0000 7f010a7fc700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00f40a1550 0x7f00f40a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f010c19a340 tx=0x7f010000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.219+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f00fc096510 con 0x7f010c067d40 2023-10-26T06:41:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: osdmap e84: 12 total, 12 up, 12 in 2023-10-26T06:41:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-26T06:41:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: Cluster is now healthy 2023-10-26T06:41:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] up:active 2023-10-26T06:41:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3106761662' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-26T06:41:33.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-26T06:41:33.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:32 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: osdmap e84: 12 total, 12 up, 12 in 2023-10-26T06:41:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-26T06:41:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: Cluster is now healthy 2023-10-26T06:41:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] up:active 2023-10-26T06:41:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3106761662' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-26T06:41:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-26T06:41:33.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:32 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:33.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: osdmap e84: 12 total, 12 up, 12 in 2023-10-26T06:41:33.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-26T06:41:33.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: Cluster is now healthy 2023-10-26T06:41:33.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] up:active 2023-10-26T06:41:33.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:33.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:33.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3106761662' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-26T06:41:33.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-26T06:41:33.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:32 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:33.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.490+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f010c19a0f0 con 0x7f010c067d40 2023-10-26T06:41:33.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.974+0000 7f00f3fff700 1 -- 172.21.15.50:0/4225941159 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f00fc099b30 con 0x7f010c067d40 2023-10-26T06:41:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00f40a1550 msgr2=0x7f00f40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00f40a1550 0x7f00f40a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f010c19a340 tx=0x7f010000b260 comp rx=0 tx=0).stop 2023-10-26T06:41:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 msgr2=0x7f010c198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:33.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 0x7f010c198df0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e9a0 tx=0x7f00fc00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 shutdown_connections 2023-10-26T06:41:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00f40a1550 0x7f00f40a3a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f010c105b30 0x7f010c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f010c067d40 0x7f010c198df0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 --2- 172.21.15.50:0/4225941159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f010c105170 0x7f010c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.977+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 >> 172.21.15.50:0/4225941159 conn(0x7f010c0767f0 msgr2=0x7f010c10bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.978+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 shutdown_connections 2023-10-26T06:41:33.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:33.978+0000 7f01115ff700 1 -- 172.21.15.50:0/4225941159 wait complete. 2023-10-26T06:41:34.002 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-26T06:41:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 -- 172.21.15.50:0/3813559113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910100720 msgr2=0x7fb910100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 --2- 172.21.15.50:0/3813559113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910100720 0x7fb910100ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb904009990 tx=0x7fb904009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 -- 172.21.15.50:0/3813559113 shutdown_connections 2023-10-26T06:41:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 --2- 172.21.15.50:0/3813559113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9101010e0 0x7fb91010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 --2- 172.21.15.50:0/3813559113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb910106730 0x7fb910106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 --2- 172.21.15.50:0/3813559113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910100720 0x7fb910100ba0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 -- 172.21.15.50:0/3813559113 >> 172.21.15.50:0/3813559113 conn(0x7fb9100fc1b0 msgr2=0x7fb9100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.210+0000 7fb9159ff700 1 -- 172.21.15.50:0/3813559113 shutdown_connections 2023-10-26T06:41:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.211+0000 7fb9159ff700 1 -- 172.21.15.50:0/3813559113 wait complete. 2023-10-26T06:41:34.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.211+0000 7fb9159ff700 1 Processor -- start 2023-10-26T06:41:34.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 -- start start 2023-10-26T06:41:34.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 0x7fb91019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 0x7fb91019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910106730 0x7fb910198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9101991f0 con 0x7fb9101010e0 2023-10-26T06:41:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910199360 con 0x7fb910100720 2023-10-26T06:41:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb9159ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910199520 con 0x7fb910106730 2023-10-26T06:41:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb90effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 0x7fb91019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb90e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 0x7fb91019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb90effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 0x7fb91019ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51850/0 (socket says 172.21.15.50:51850) 2023-10-26T06:41:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb90e7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 0x7fb91019efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41408/0 (socket says 172.21.15.50:41408) 2023-10-26T06:41:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb90effd700 1 -- 172.21.15.50:0/4244526305 learned_addr learned my addr 172.21.15.50:0/4244526305 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.212+0000 7fb90f7fe700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910106730 0x7fb910198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90e7fc700 1 -- 172.21.15.50:0/4244526305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910106730 msgr2=0x7fb910198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90e7fc700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910106730 0x7fb910198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90e7fc700 1 -- 172.21.15.50:0/4244526305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 msgr2=0x7fb91019ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:34.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90e7fc700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 0x7fb91019ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90e7fc700 1 -- 172.21.15.50:0/4244526305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040095f0 con 0x7fb9101010e0 2023-10-26T06:41:34.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90effd700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 0x7fb91019ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:34.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb90e7fc700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 0x7fb91019efa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb9040098e0 tx=0x7fb904005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:34.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90401d070 con 0x7fb9101010e0 2023-10-26T06:41:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb904022470 con 0x7fb9101010e0 2023-10-26T06:41:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9101997a0 con 0x7fb9101010e0 2023-10-26T06:41:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904017650 con 0x7fb9101010e0 2023-10-26T06:41:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.213+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9101a5a50 con 0x7fb9101010e0 2023-10-26T06:41:34.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.214+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb910101e60 con 0x7fb9101010e0 2023-10-26T06:41:34.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.218+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb9040225e0 con 0x7fb9101010e0 2023-10-26T06:41:34.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.219+0000 7fb9149fd700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8f80a14d0 0x7fb8f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:34.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.219+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb9040ce6c0 con 0x7fb9101010e0 2023-10-26T06:41:34.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.220+0000 7fb90effd700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8f80a14d0 0x7fb8f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:34.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.220+0000 7fb90effd700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8f80a14d0 0x7fb8f80a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb900011550 tx=0x7fb900009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:34.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.222+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb904097d70 con 0x7fb9101010e0 2023-10-26T06:41:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-26T06:41:34.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:34.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4225941159' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-26T06:41:34.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-26T06:41:34.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: pgmap v254: 97 pgs: 15 creating+peering, 63 active+clean, 19 unknown; 578 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 871 B/s wr, 6 op/s 2023-10-26T06:41:34.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:34.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:41:34.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:33 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-26T06:41:34.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:34.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4225941159' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-26T06:41:34.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-26T06:41:34.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: pgmap v254: 97 pgs: 15 creating+peering, 63 active+clean, 19 unknown; 578 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 871 B/s wr, 6 op/s 2023-10-26T06:41:34.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:34.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:41:34.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:33 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-26T06:41:34.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:34.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4225941159' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-26T06:41:34.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-10-26T06:41:34.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: pgmap v254: 97 pgs: 15 creating+peering, 63 active+clean, 19 unknown; 578 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 871 B/s wr, 6 op/s 2023-10-26T06:41:34.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:41:34.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:41:34.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:33 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:41:34.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.483+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fb910199fe0 con 0x7fb9101010e0 2023-10-26T06:41:34.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.979+0000 7fb9149fd700 1 -- 172.21.15.50:0/4244526305 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb90409b390 con 0x7fb9101010e0 2023-10-26T06:41:34.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8f80a14d0 msgr2=0x7fb8f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:34.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8f80a14d0 0x7fb8f80a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb900011550 tx=0x7fb900009260 comp rx=0 tx=0).stop 2023-10-26T06:41:34.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 msgr2=0x7fb91019efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:34.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 0x7fb91019efa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb9040098e0 tx=0x7fb904005740 comp rx=0 tx=0).stop 2023-10-26T06:41:34.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 shutdown_connections 2023-10-26T06:41:34.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8f80a14d0 0x7fb8f80a3990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb910106730 0x7fb910198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb910100720 0x7fb91019ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 --2- 172.21.15.50:0/4244526305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9101010e0 0x7fb91019efa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:34.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 >> 172.21.15.50:0/4244526305 conn(0x7fb9100fc1b0 msgr2=0x7fb9100fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:34.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 shutdown_connections 2023-10-26T06:41:34.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:34.982+0000 7fb9159ff700 1 -- 172.21.15.50:0/4244526305 wait complete. 2023-10-26T06:41:35.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-26T06:41:35.172 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: 2023-10-26T06:41:34.859+0000 7f9e64dfb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-26T06:41:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-26T06:41:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-10-26T06:41:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-26T06:41:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-26T06:41:35.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-26T06:41:35.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:34 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4244526305' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-26T06:41:35.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 -- 172.21.15.50:0/1072165639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c073540 msgr2=0x7ff12c10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 --2- 172.21.15.50:0/1072165639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c073540 0x7ff12c10ca20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff114009990 tx=0x7ff114009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 -- 172.21.15.50:0/1072165639 shutdown_connections 2023-10-26T06:41:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 --2- 172.21.15.50:0/1072165639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c10cf60 0x7ff12c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 --2- 172.21.15.50:0/1072165639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12c072c20 0x7ff12c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 --2- 172.21.15.50:0/1072165639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c073540 0x7ff12c10ca20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 -- 172.21.15.50:0/1072165639 >> 172.21.15.50:0/1072165639 conn(0x7ff12c0fc1b0 msgr2=0x7ff12c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 -- 172.21.15.50:0/1072165639 shutdown_connections 2023-10-26T06:41:35.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.218+0000 7ff131dff700 1 -- 172.21.15.50:0/1072165639 wait complete. 2023-10-26T06:41:35.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 Processor -- start 2023-10-26T06:41:35.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 -- start start 2023-10-26T06:41:35.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 0x7ff12c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:35.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c073540 0x7ff12c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:35.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12c10cf60 0x7ff12c19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:35.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c19ddc0 con 0x7ff12c072c20 2023-10-26T06:41:35.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c19df30 con 0x7ff12c10cf60 2023-10-26T06:41:35.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.219+0000 7ff131dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c19e0f0 con 0x7ff12c073540 2023-10-26T06:41:35.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 0x7ff12c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:35.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 0x7ff12c198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41426/0 (socket says 172.21.15.50:41426) 2023-10-26T06:41:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 -- 172.21.15.50:0/1596392063 learned_addr learned my addr 172.21.15.50:0/1596392063 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff123fff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c073540 0x7ff12c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12bfff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12c10cf60 0x7ff12c19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 -- 172.21.15.50:0/1596392063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c073540 msgr2=0x7ff12c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:35.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c073540 0x7ff12c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 -- 172.21.15.50:0/1596392063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12c10cf60 msgr2=0x7ff12c19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:35.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12c10cf60 0x7ff12c19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 -- 172.21.15.50:0/1596392063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140095f0 con 0x7ff12c072c20 2023-10-26T06:41:35.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.220+0000 7ff12b7fe700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 0x7ff12c198ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00e9a0 tx=0x7ff11c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:35.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.221+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c009790 con 0x7ff12c072c20 2023-10-26T06:41:35.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.221+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff11c010430 con 0x7ff12c072c20 2023-10-26T06:41:35.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.221+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c19e3d0 con 0x7ff12c072c20 2023-10-26T06:41:35.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.221+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c018680 con 0x7ff12c072c20 2023-10-26T06:41:35.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.221+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c1a5c10 con 0x7ff12c072c20 2023-10-26T06:41:35.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.222+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c108170 con 0x7ff12c072c20 2023-10-26T06:41:35.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.224+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff11c0105a0 con 0x7ff12c072c20 2023-10-26T06:41:35.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.225+0000 7ff1297fa700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1180a14d0 0x7ff1180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:35.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.225+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff11c014070 con 0x7ff12c072c20 2023-10-26T06:41:35.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.225+0000 7ff123fff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1180a14d0 0x7ff1180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:35.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.226+0000 7ff123fff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1180a14d0 0x7ff1180a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff12c19a3f0 tx=0x7ff114005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:35.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.229+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff11c096560 con 0x7ff12c072c20 2023-10-26T06:41:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-26T06:41:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-10-26T06:41:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-26T06:41:35.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:35.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-26T06:41:35.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-26T06:41:35.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:34 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4244526305' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-26T06:41:35.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-26T06:41:35.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-10-26T06:41:35.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-26T06:41:35.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-26T06:41:35.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-26T06:41:35.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-26T06:41:35.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:34 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4244526305' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-26T06:41:35.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.493+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7ff12c0742d0 con 0x7ff12c072c20 2023-10-26T06:41:35.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.990+0000 7ff1297fa700 1 -- 172.21.15.50:0/1596392063 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff11c099b80 con 0x7ff12c072c20 2023-10-26T06:41:35.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1180a14d0 msgr2=0x7ff1180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1180a14d0 0x7ff1180a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff12c19a3f0 tx=0x7ff114005fd0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 msgr2=0x7ff12c198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 0x7ff12c198ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00e9a0 tx=0x7ff11c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 shutdown_connections 2023-10-26T06:41:35.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff1180a14d0 0x7ff1180a3990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff12c10cf60 0x7ff12c19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff12c072c20 0x7ff12c198ea0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 --2- 172.21.15.50:0/1596392063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff12c073540 0x7ff12c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 >> 172.21.15.50:0/1596392063 conn(0x7ff12c0fc1b0 msgr2=0x7ff12c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:35.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 shutdown_connections 2023-10-26T06:41:35.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:35.993+0000 7ff131dff700 1 -- 172.21.15.50:0/1596392063 wait complete. 2023-10-26T06:41:36.015 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-26T06:41:36.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-26T06:41:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 -- 172.21.15.50:0/1480356450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac1010e0 msgr2=0x7f29ac10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 --2- 172.21.15.50:0/1480356450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac1010e0 0x7f29ac10d5f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29a400b0a0 tx=0x7f29a400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 -- 172.21.15.50:0/1480356450 shutdown_connections 2023-10-26T06:41:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 --2- 172.21.15.50:0/1480356450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac1010e0 0x7f29ac10d5f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 --2- 172.21.15.50:0/1480356450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29ac106730 0x7f29ac106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 --2- 172.21.15.50:0/1480356450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac100720 0x7f29ac100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 -- 172.21.15.50:0/1480356450 >> 172.21.15.50:0/1480356450 conn(0x7f29ac0fc1b0 msgr2=0x7f29ac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 -- 172.21.15.50:0/1480356450 shutdown_connections 2023-10-26T06:41:36.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.223+0000 7f29b23ff700 1 -- 172.21.15.50:0/1480356450 wait complete. 2023-10-26T06:41:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.224+0000 7f29b23ff700 1 Processor -- start 2023-10-26T06:41:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 -- start start 2023-10-26T06:41:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac100720 0x7f29ac19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29ac1010e0 0x7f29ac19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac106730 0x7f29ac198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac199190 con 0x7f29ac100720 2023-10-26T06:41:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac199300 con 0x7f29ac106730 2023-10-26T06:41:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b23ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac1994c0 con 0x7f29ac1010e0 2023-10-26T06:41:36.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac100720 0x7f29ac19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29b099c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac106730 0x7f29ac198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29ab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29ac1010e0 0x7f29ac19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac100720 0x7f29ac19e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41440/0 (socket says 172.21.15.50:41440) 2023-10-26T06:41:36.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.225+0000 7f29abfff700 1 -- 172.21.15.50:0/3934434134 learned_addr learned my addr 172.21.15.50:0/3934434134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b099c700 1 -- 172.21.15.50:0/3934434134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29ac1010e0 msgr2=0x7f29ac19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b099c700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29ac1010e0 0x7f29ac19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b099c700 1 -- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac100720 msgr2=0x7f29ac19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b099c700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac100720 0x7f29ac19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b099c700 1 -- 172.21.15.50:0/3934434134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a4009d00 con 0x7f29ac106730 2023-10-26T06:41:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b099c700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac106730 0x7f29ac198b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29a400b070 tx=0x7f29a40077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400e040 con 0x7f29ac106730 2023-10-26T06:41:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac199740 con 0x7f29ac106730 2023-10-26T06:41:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.226+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29a4004e60 con 0x7f29ac106730 2023-10-26T06:41:36.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.227+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4005040 con 0x7f29ac106730 2023-10-26T06:41:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.227+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac1a5a40 con 0x7f29ac106730 2023-10-26T06:41:36.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.227+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac101e60 con 0x7f29ac106730 2023-10-26T06:41:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4244526305' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-26T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:active 2023-10-26T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-26T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-26T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: Cluster is now healthy 2023-10-26T06:41:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-26T06:41:36.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-26T06:41:36.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-26T06:41:36.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1596392063' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-26T06:41:36.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:35 smithi153 ceph-mon[131657]: pgmap v255: 97 pgs: 11 creating+peering, 86 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 6 op/s 2023-10-26T06:41:36.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.230+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f29a401d470 con 0x7f29ac106730 2023-10-26T06:41:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.231+0000 7f29a97fa700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f29940a14d0 0x7f29940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.231+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f29a40ce900 con 0x7f29ac106730 2023-10-26T06:41:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.231+0000 7f29abfff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f29940a14d0 0x7f29940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.232+0000 7f29abfff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f29940a14d0 0x7f29940a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f299c009ca0 tx=0x7f299c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:36.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.233+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f29a4097fb0 con 0x7f29ac106730 2023-10-26T06:41:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4244526305' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-26T06:41:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:active 2023-10-26T06:41:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-26T06:41:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-26T06:41:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: Cluster is now healthy 2023-10-26T06:41:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-26T06:41:36.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-26T06:41:36.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-26T06:41:36.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1596392063' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-26T06:41:36.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:35 smithi050 ceph-mon[94997]: pgmap v255: 97 pgs: 11 creating+peering, 86 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 6 op/s 2023-10-26T06:41:36.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4244526305' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-26T06:41:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:active 2023-10-26T06:41:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-26T06:41:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-26T06:41:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: Cluster is now healthy 2023-10-26T06:41:36.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-26T06:41:36.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-26T06:41:36.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-26T06:41:36.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1596392063' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-26T06:41:36.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:35 smithi125 ceph-mon[130643]: pgmap v255: 97 pgs: 11 creating+peering, 86 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 6 op/s 2023-10-26T06:41:36.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.479+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f29ac110690 con 0x7f29940a14d0 2023-10-26T06:41:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.524+0000 7f29a97fa700 1 -- 172.21.15.50:0/3934434134 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f29ac110690 con 0x7f29940a14d0 2023-10-26T06:41:36.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f29940a14d0 msgr2=0x7f29940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f29940a14d0 0x7f29940a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f299c009ca0 tx=0x7f299c009260 comp rx=0 tx=0).stop 2023-10-26T06:41:36.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac106730 msgr2=0x7f29ac198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac106730 0x7f29ac198b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29a400b070 tx=0x7f29a40077f0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 shutdown_connections 2023-10-26T06:41:36.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f29940a14d0 0x7f29940a3990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29ac106730 0x7f29ac198b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac100720 0x7f29ac19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 --2- 172.21.15.50:0/3934434134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29ac1010e0 0x7f29ac19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 >> 172.21.15.50:0/3934434134 conn(0x7f29ac0fc1b0 msgr2=0x7f29ac0fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:36.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 shutdown_connections 2023-10-26T06:41:36.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.527+0000 7f29b23ff700 1 -- 172.21.15.50:0/3934434134 wait complete. 2023-10-26T06:41:36.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-26T06:41:36.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.753+0000 7f62f85ff700 1 -- 172.21.15.50:0/2963298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 msgr2=0x7f62f0106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.753+0000 7f62f85ff700 1 --2- 172.21.15.50:0/2963298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0106b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009990 tx=0x7f62ec009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.753+0000 7f62f85ff700 1 -- 172.21.15.50:0/2963298984 shutdown_connections 2023-10-26T06:41:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.753+0000 7f62f85ff700 1 --2- 172.21.15.50:0/2963298984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f01010e0 0x7f62f010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.754+0000 7f62f85ff700 1 --2- 172.21.15.50:0/2963298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0106b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.754+0000 7f62f85ff700 1 --2- 172.21.15.50:0/2963298984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62f0100720 0x7f62f0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.754+0000 7f62f85ff700 1 -- 172.21.15.50:0/2963298984 >> 172.21.15.50:0/2963298984 conn(0x7f62f00fc1b0 msgr2=0x7f62f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.754+0000 7f62f85ff700 1 -- 172.21.15.50:0/2963298984 shutdown_connections 2023-10-26T06:41:36.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.754+0000 7f62f85ff700 1 -- 172.21.15.50:0/2963298984 wait complete. 2023-10-26T06:41:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 Processor -- start 2023-10-26T06:41:36.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 -- start start 2023-10-26T06:41:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62f0100720 0x7f62f0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f01010e0 0x7f62f0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01a4f30 con 0x7f62f0106730 2023-10-26T06:41:36.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01a50a0 con 0x7f62f0100720 2023-10-26T06:41:36.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.755+0000 7f62f85ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01a5260 con 0x7f62f01010e0 2023-10-26T06:41:36.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f639b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62f0100720 0x7f62f0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41472/0 (socket says 172.21.15.50:41472) 2023-10-26T06:41:36.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 -- 172.21.15.50:0/20361132 learned_addr learned my addr 172.21.15.50:0/20361132 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f5b9a700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f01010e0 0x7f62f0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 -- 172.21.15.50:0/20361132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f01010e0 msgr2=0x7f62f0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f01010e0 0x7f62f0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 -- 172.21.15.50:0/20361132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62f0100720 msgr2=0x7f62f0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62f0100720 0x7f62f0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 -- 172.21.15.50:0/20361132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec0095f0 con 0x7f62f0106730 2023-10-26T06:41:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62f6b9c700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0073570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f62e800ef30 tx=0x7f62e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8018070 con 0x7f62f0106730 2023-10-26T06:41:36.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62e800f040 con 0x7f62f0106730 2023-10-26T06:41:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.756+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800cd00 con 0x7f62f0106730 2023-10-26T06:41:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.757+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f01a54e0 con 0x7f62f0106730 2023-10-26T06:41:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.757+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f01a59a0 con 0x7f62f0106730 2023-10-26T06:41:36.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.758+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0108d20 con 0x7f62f0106730 2023-10-26T06:41:36.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.760+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f62e8003a00 con 0x7f62f0106730 2023-10-26T06:41:36.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.761+0000 7f62e77fe700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f62dc0a1550 0x7f62dc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:36.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.761+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f62e80cd1e0 con 0x7f62f0106730 2023-10-26T06:41:36.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.761+0000 7f62f639b700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f62dc0a1550 0x7f62dc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:36.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.762+0000 7f62f639b700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f62dc0a1550 0x7f62dc0a3a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f62ec006010 tx=0x7f62ec00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:36.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:36.763+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62e8096890 con 0x7f62f0106730 2023-10-26T06:41:36.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:41:36.486+0000 7fabb8723700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:41:36.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:41:36.486+0000 7fabb8723700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:41:36.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:41:36.486+0000 7fabb8723700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:41:36.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:41:36.486+0000 7fabb8723700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:41:36.768 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:41:36.486+0000 7fabb8723700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:41:37.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.011+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f62f0074040 con 0x7f62dc0a1550 2023-10-26T06:41:37.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.016+0000 7f62e77fe700 1 -- 172.21.15.50:0/20361132 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f62f0074040 con 0x7f62dc0a1550 2023-10-26T06:41:37.017 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/_nogroup/sv_0/f95e8fa8-9455-432b-b77d-5ad44315c068 2023-10-26T06:41:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f62dc0a1550 msgr2=0x7f62dc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f62dc0a1550 0x7f62dc0a3a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f62ec006010 tx=0x7f62ec00b260 comp rx=0 tx=0).stop 2023-10-26T06:41:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 msgr2=0x7f62f0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0073570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f62e800ef30 tx=0x7f62e800c3a0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 shutdown_connections 2023-10-26T06:41:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f62dc0a1550 0x7f62dc0a3a10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62f0106730 0x7f62f0073570 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62f0100720 0x7f62f0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 --2- 172.21.15.50:0/20361132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62f01010e0 0x7f62f0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 >> 172.21.15.50:0/20361132 conn(0x7f62f00fc1b0 msgr2=0x7f62f00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 shutdown_connections 2023-10-26T06:41:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.018+0000 7f62f85ff700 1 -- 172.21.15.50:0/20361132 wait complete. 2023-10-26T06:41:37.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-26T06:41:37.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 -- 172.21.15.50:0/2882781461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 msgr2=0x7fc6c010d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/2882781461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c010d540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b0d0 tx=0x7fc6b800b3e0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 -- 172.21.15.50:0/2882781461 shutdown_connections 2023-10-26T06:41:37.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/2882781461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c010d540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/2882781461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0067d40 0x7fc6c0068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/2882781461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0105170 0x7fc6c01055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 -- 172.21.15.50:0/2882781461 >> 172.21.15.50:0/2882781461 conn(0x7fc6c00767f0 msgr2=0x7fc6c0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:37.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 -- 172.21.15.50:0/2882781461 shutdown_connections 2023-10-26T06:41:37.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.246+0000 7fc6c87ff700 1 -- 172.21.15.50:0/2882781461 wait complete. 2023-10-26T06:41:37.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.247+0000 7fc6c87ff700 1 Processor -- start 2023-10-26T06:41:37.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.247+0000 7fc6c87ff700 1 -- start start 2023-10-26T06:41:37.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c87ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0067d40 0x7fc6c00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c87ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0105170 0x7fc6c00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c87ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c0100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c87ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01a50a0 con 0x7fc6c0105b30 2023-10-26T06:41:37.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c87ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01a5210 con 0x7fc6c0067d40 2023-10-26T06:41:37.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c87ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01a53d0 con 0x7fc6c0105170 2023-10-26T06:41:37.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c0100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c0100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41490/0 (socket says 172.21.15.50:41490) 2023-10-26T06:41:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c5d9a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0105170 0x7fc6c00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 -- 172.21.15.50:0/104106760 learned_addr learned my addr 172.21.15.50:0/104106760 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c659b700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0067d40 0x7fc6c00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 -- 172.21.15.50:0/104106760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0105170 msgr2=0x7fc6c00ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0105170 0x7fc6c00ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 -- 172.21.15.50:0/104106760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0067d40 msgr2=0x7fc6c00ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0067d40 0x7fc6c00ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c6d9c700 1 -- 172.21.15.50:0/104106760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8009d00 con 0x7fc6c0105b30 2023-10-26T06:41:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c659b700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0067d40 0x7fc6c00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:41:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.248+0000 7fc6c5d9a700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0105170 0x7fc6c00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:37.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.249+0000 7fc6c6d9c700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c0100130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800bcd0 tx=0x7fc6b800bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:37.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.249+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800e040 con 0x7fc6c0105b30 2023-10-26T06:41:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.249+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b8005070 con 0x7fc6c0105b30 2023-10-26T06:41:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.249+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b801b6a0 con 0x7fc6c0105b30 2023-10-26T06:41:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.249+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c01a5650 con 0x7fc6c0105b30 2023-10-26T06:41:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.249+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c01a5a20 con 0x7fc6c0105b30 2023-10-26T06:41:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.250+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c0108c20 con 0x7fc6c0105b30 2023-10-26T06:41:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.252+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc6b8003a00 con 0x7fc6c0105b30 2023-10-26T06:41:37.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.253+0000 7fc6b77fe700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc6ac0a14d0 0x7fc6ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.253+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc6b80cd790 con 0x7fc6c0105b30 2023-10-26T06:41:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.254+0000 7fc6c659b700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc6ac0a14d0 0x7fc6ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.254+0000 7fc6c659b700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc6ac0a14d0 0x7fc6ac0a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009cb0 tx=0x7fc6bc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:37.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.257+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6b8096e40 con 0x7fc6c0105b30 2023-10-26T06:41:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1596392063' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-26T06:41:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] up:active 2023-10-26T06:41:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-26T06:41:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:41:37.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:36 smithi050 ceph-mon[94997]: from='client.24824 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:37.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:36 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1596392063' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-26T06:41:37.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:36 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] up:active 2023-10-26T06:41:37.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:36 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-26T06:41:37.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:36 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:41:37.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:36 smithi125 ceph-mon[130643]: from='client.24824 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:37.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:36 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1596392063' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-26T06:41:37.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:36 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] up:active 2023-10-26T06:41:37.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:36 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-26T06:41:37.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:36 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:41:37.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:36 smithi153 ceph-mon[131657]: from='client.24824 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.506+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c0100c00 con 0x7fc6ac0a14d0 2023-10-26T06:41:37.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.532+0000 7fc6b77fe700 1 -- 172.21.15.50:0/104106760 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc6c0100c00 con 0x7fc6ac0a14d0 2023-10-26T06:41:37.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc6ac0a14d0 msgr2=0x7fc6ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc6ac0a14d0 0x7fc6ac0a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009cb0 tx=0x7fc6bc009260 comp rx=0 tx=0).stop 2023-10-26T06:41:37.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 msgr2=0x7fc6c0100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c0100130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800bcd0 tx=0x7fc6b800bd00 comp rx=0 tx=0).stop 2023-10-26T06:41:37.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 shutdown_connections 2023-10-26T06:41:37.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc6ac0a14d0 0x7fc6ac0a3990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6c0105b30 0x7fc6c0100130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6c0067d40 0x7fc6c00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.534+0000 7fc6c87ff700 1 --2- 172.21.15.50:0/104106760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6c0105170 0x7fc6c00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.535+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 >> 172.21.15.50:0/104106760 conn(0x7fc6c00767f0 msgr2=0x7fc6c00fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:37.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.535+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 shutdown_connections 2023-10-26T06:41:37.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.535+0000 7fc6c87ff700 1 -- 172.21.15.50:0/104106760 wait complete. 2023-10-26T06:41:37.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-26T06:41:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 -- 172.21.15.50:0/2135517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 msgr2=0x7f9390106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 --2- 172.21.15.50:0/2135517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390106b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f938c009990 tx=0x7f938c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 -- 172.21.15.50:0/2135517881 shutdown_connections 2023-10-26T06:41:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 --2- 172.21.15.50:0/2135517881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93901010e0 0x7f939010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 --2- 172.21.15.50:0/2135517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390106b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 --2- 172.21.15.50:0/2135517881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 0x7f9390100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.762+0000 7f93977ff700 1 -- 172.21.15.50:0/2135517881 >> 172.21.15.50:0/2135517881 conn(0x7f93900fc1b0 msgr2=0x7f93900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:37.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.763+0000 7f93977ff700 1 -- 172.21.15.50:0/2135517881 shutdown_connections 2023-10-26T06:41:37.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.763+0000 7f93977ff700 1 -- 172.21.15.50:0/2135517881 wait complete. 2023-10-26T06:41:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 Processor -- start 2023-10-26T06:41:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 -- start start 2023-10-26T06:41:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 0x7f9390072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93901010e0 0x7f9390073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93901a4f30 con 0x7f9390106730 2023-10-26T06:41:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93901a50a0 con 0x7f9390100720 2023-10-26T06:41:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f93977ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93901a5260 con 0x7f93901010e0 2023-10-26T06:41:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.764+0000 7f9395d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41514/0 (socket says 172.21.15.50:41514) 2023-10-26T06:41:37.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 -- 172.21.15.50:0/4108460439 learned_addr learned my addr 172.21.15.50:0/4108460439 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:37.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f939559b700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 0x7f9390072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9394d9a700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93901010e0 0x7f9390073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 -- 172.21.15.50:0/4108460439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93901010e0 msgr2=0x7f9390073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93901010e0 0x7f9390073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 -- 172.21.15.50:0/4108460439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 msgr2=0x7f9390072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 0x7f9390072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 -- 172.21.15.50:0/4108460439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0095f0 con 0x7f9390106730 2023-10-26T06:41:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f939559b700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 0x7f9390072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f9395d9c700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390073570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f938800ef30 tx=0x7f938800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388018070 con 0x7f9390106730 2023-10-26T06:41:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f938800f040 con 0x7f9390106730 2023-10-26T06:41:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93901a54e0 con 0x7f9390106730 2023-10-26T06:41:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.765+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800cd00 con 0x7f9390106730 2023-10-26T06:41:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.766+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93901a59f0 con 0x7f9390106730 2023-10-26T06:41:37.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.766+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390108d20 con 0x7f9390106730 2023-10-26T06:41:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.769+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9388003a00 con 0x7f9390106730 2023-10-26T06:41:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.770+0000 7f93867fc700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f937c0a1550 0x7f937c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.770+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f93880cd180 con 0x7f9390106730 2023-10-26T06:41:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.770+0000 7f939559b700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f937c0a1550 0x7f937c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.771+0000 7f939559b700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f937c0a1550 0x7f937c0a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f938c006010 tx=0x7f938c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:37.773+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9388096890 con 0x7f9390106730 2023-10-26T06:41:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.011+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f9388003cb0 con 0x7f9390106730 2023-10-26T06:41:38.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.026+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9390073fd0 con 0x7f937c0a1550 2023-10-26T06:41:38.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.030+0000 7f93867fc700 1 -- 172.21.15.50:0/4108460439 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f9390073fd0 con 0x7f937c0a1550 2023-10-26T06:41:38.032 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a 2023-10-26T06:41:38.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f937c0a1550 msgr2=0x7f937c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f937c0a1550 0x7f937c0a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f938c006010 tx=0x7f938c00b260 comp rx=0 tx=0).stop 2023-10-26T06:41:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 msgr2=0x7f9390073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390073570 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f938800ef30 tx=0x7f938800c3a0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 shutdown_connections 2023-10-26T06:41:38.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f937c0a1550 0x7f937c0a3a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9390106730 0x7f9390073570 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9390100720 0x7f9390072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 --2- 172.21.15.50:0/4108460439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93901010e0 0x7f9390073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 >> 172.21.15.50:0/4108460439 conn(0x7f93900fc1b0 msgr2=0x7f93900fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:38.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 shutdown_connections 2023-10-26T06:41:38.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.033+0000 7f93977ff700 1 -- 172.21.15.50:0/4108460439 wait complete. 2023-10-26T06:41:38.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:41:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 -- 172.21.15.50:0/2504180880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 msgr2=0x7fa094106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/2504180880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 0x7fa094106a90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa088009990 tx=0x7fa088009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 -- 172.21.15.50:0/2504180880 shutdown_connections 2023-10-26T06:41:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/2504180880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 0x7fa09410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/2504180880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 0x7fa094106a90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/2504180880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 -- 172.21.15.50:0/2504180880 >> 172.21.15.50:0/2504180880 conn(0x7fa0940fc170 msgr2=0x7fa0940fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 -- 172.21.15.50:0/2504180880 shutdown_connections 2023-10-26T06:41:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.257+0000 7fa09b1ff700 1 -- 172.21.15.50:0/2504180880 wait complete. 2023-10-26T06:41:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.258+0000 7fa09b1ff700 1 Processor -- start 2023-10-26T06:41:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.258+0000 7fa09b1ff700 1 -- start start 2023-10-26T06:41:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09b1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09b1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 0x7fa094199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09b1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 0x7fa09419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09b1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09419cb30 con 0x7fa0941006a0 2023-10-26T06:41:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09b1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09419cca0 con 0x7fa094101060 2023-10-26T06:41:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09b1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09419ce60 con 0x7fa0941066b0 2023-10-26T06:41:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41536/0 (socket says 172.21.15.50:41536) 2023-10-26T06:41:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 -- 172.21.15.50:0/190196894 learned_addr learned my addr 172.21.15.50:0/190196894 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa09979c700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 0x7fa09419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa093fff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 0x7fa094199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 -- 172.21.15.50:0/190196894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 msgr2=0x7fa09419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 0x7fa09419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 -- 172.21.15.50:0/190196894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 msgr2=0x7fa094199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 0x7fa094199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa098f9b700 1 -- 172.21.15.50:0/190196894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880095f0 con 0x7fa0941006a0 2023-10-26T06:41:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.259+0000 7fa093fff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 0x7fa094199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:41:38.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.260+0000 7fa098f9b700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094198d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa088005910 tx=0x7fa088004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.260+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08801d070 con 0x7fa0941006a0 2023-10-26T06:41:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.260+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa088022470 con 0x7fa0941006a0 2023-10-26T06:41:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.260+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088017650 con 0x7fa0941006a0 2023-10-26T06:41:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.260+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09419d0e0 con 0x7fa0941006a0 2023-10-26T06:41:38.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.260+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0941a5aa0 con 0x7fa0941006a0 2023-10-26T06:41:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.261+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa094101de0 con 0x7fa0941006a0 2023-10-26T06:41:38.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.263+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fa0880225e0 con 0x7fa0941006a0 2023-10-26T06:41:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.264+0000 7fa091ffb700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa0840a15e0 0x7fa0840a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.265+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa0880ce170 con 0x7fa0941006a0 2023-10-26T06:41:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.265+0000 7fa093fff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa0840a15e0 0x7fa0840a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.265+0000 7fa093fff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa0840a15e0 0x7fa0840a3aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa09419a210 tx=0x7fa080009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:38.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:37 smithi050 ceph-mon[94997]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:38.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:37 smithi050 ceph-mon[94997]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:38.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:37 smithi050 ceph-mon[94997]: pgmap v256: 97 pgs: 97 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 133 B/s rd, 3.4 KiB/s wr, 11 op/s 2023-10-26T06:41:38.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.269+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa088097720 con 0x7fa0941006a0 2023-10-26T06:41:38.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:38 smithi125 ceph-mon[130643]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:38.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:38 smithi125 ceph-mon[130643]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:38.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:38 smithi125 ceph-mon[130643]: pgmap v256: 97 pgs: 97 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 133 B/s rd, 3.4 KiB/s wr, 11 op/s 2023-10-26T06:41:38.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:38 smithi153 ceph-mon[131657]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:38.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:38 smithi153 ceph-mon[131657]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:38.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:38 smithi153 ceph-mon[131657]: pgmap v256: 97 pgs: 97 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 133 B/s rd, 3.4 KiB/s wr, 11 op/s 2023-10-26T06:41:38.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.525+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0940674e0 con 0x7fa0941006a0 2023-10-26T06:41:38.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.526+0000 7fa091ffb700 1 -- 172.21.15.50:0/190196894 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7fa08809ad40 con 0x7fa0941006a0 2023-10-26T06:41:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:38.738 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:41:38.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa0840a15e0 msgr2=0x7fa0840a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa0840a15e0 0x7fa0840a3aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa09419a210 tx=0x7fa080009260 comp rx=0 tx=0).stop 2023-10-26T06:41:38.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 msgr2=0x7fa094198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094198d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa088005910 tx=0x7fa088004730 comp rx=0 tx=0).stop 2023-10-26T06:41:38.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 shutdown_connections 2023-10-26T06:41:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa0840a15e0 0x7fa0840a3aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0941066b0 0x7fa09419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0941006a0 0x7fa094198d00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 --2- 172.21.15.50:0/190196894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa094101060 0x7fa094199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 >> 172.21.15.50:0/190196894 conn(0x7fa0940fc170 msgr2=0x7fa09410bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:38.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.528+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 shutdown_connections 2023-10-26T06:41:38.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.529+0000 7fa09b1ff700 1 -- 172.21.15.50:0/190196894 wait complete. 2023-10-26T06:41:38.743 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:41:38.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:41:38.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.950+0000 7f66d97ff700 1 -- 172.21.15.50:0/525979750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d41066c0 msgr2=0x7f66d4106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.950+0000 7f66d97ff700 1 --2- 172.21.15.50:0/525979750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d41066c0 0x7f66d4106aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009990 tx=0x7f66c4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 -- 172.21.15.50:0/525979750 shutdown_connections 2023-10-26T06:41:38.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 --2- 172.21.15.50:0/525979750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66d4067fa0 0x7f66d410d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 --2- 172.21.15.50:0/525979750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d41066c0 0x7f66d4106aa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 --2- 172.21.15.50:0/525979750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d4106fe0 0x7f66d4067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 -- 172.21.15.50:0/525979750 >> 172.21.15.50:0/525979750 conn(0x7f66d4076400 msgr2=0x7f66d4076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:38.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 -- 172.21.15.50:0/525979750 shutdown_connections 2023-10-26T06:41:38.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.951+0000 7f66d97ff700 1 -- 172.21.15.50:0/525979750 wait complete. 2023-10-26T06:41:38.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.952+0000 7f66d97ff700 1 Processor -- start 2023-10-26T06:41:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.952+0000 7f66d97ff700 1 -- start start 2023-10-26T06:41:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d97ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 0x7f66d419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d97ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d41066c0 0x7f66d419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d97ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66d4106fe0 0x7f66d4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d97ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4199350 con 0x7f66d4106fe0 2023-10-26T06:41:38.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d97ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41994c0 con 0x7f66d4067fa0 2023-10-26T06:41:38.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d97ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4199680 con 0x7f66d41066c0 2023-10-26T06:41:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 0x7f66d419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 0x7f66d419eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51964/0 (socket says 172.21.15.50:51964) 2023-10-26T06:41:38.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 -- 172.21.15.50:0/162334208 learned_addr learned my addr 172.21.15.50:0/162334208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d37fe700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66d4106fe0 0x7f66d4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d27fc700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d41066c0 0x7f66d419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 -- 172.21.15.50:0/162334208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d41066c0 msgr2=0x7f66d419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d41066c0 0x7f66d419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 -- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66d4106fe0 msgr2=0x7f66d4198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66d4106fe0 0x7f66d4198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.953+0000 7f66d2ffd700 1 -- 172.21.15.50:0/162334208 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40095f0 con 0x7f66d4067fa0 2023-10-26T06:41:38.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.954+0000 7f66d2ffd700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 0x7f66d419eae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66c4005740 tx=0x7f66c4005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.954+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c401d070 con 0x7f66d4067fa0 2023-10-26T06:41:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.954+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d4199900 con 0x7f66d4067fa0 2023-10-26T06:41:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.954+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c4022470 con 0x7f66d4067fa0 2023-10-26T06:41:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.954+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4017650 con 0x7f66d4067fa0 2023-10-26T06:41:38.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.954+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d41a5a60 con 0x7f66d4067fa0 2023-10-26T06:41:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.956+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d4101de0 con 0x7f66d4067fa0 2023-10-26T06:41:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.958+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f66c40225e0 con 0x7f66d4067fa0 2023-10-26T06:41:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.959+0000 7f66bbfff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f66bc0a15e0 0x7f66bc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.960+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f66c40cdfe0 con 0x7f66d4067fa0 2023-10-26T06:41:38.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.960+0000 7f66d27fc700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f66bc0a15e0 0x7f66bc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:38.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.961+0000 7f66d27fc700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f66bc0a15e0 0x7f66bc0a3aa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66d419a2f0 tx=0x7f66c8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:38.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:38.964+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f66c405d100 con 0x7f66d4067fa0 2023-10-26T06:41:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.180+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66d4067530 con 0x7f66d4067fa0 2023-10-26T06:41:39.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.182+0000 7f66bbfff700 1 -- 172.21.15.50:0/162334208 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22459 (secure 0 0 0) 0x7f66c4095e60 con 0x7f66d4067fa0 2023-10-26T06:41:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:39.184 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:41:31.938631+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:41:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f66bc0a15e0 msgr2=0x7f66bc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f66bc0a15e0 0x7f66bc0a3aa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f66d419a2f0 tx=0x7f66c8009260 comp rx=0 tx=0).stop 2023-10-26T06:41:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 msgr2=0x7f66d419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 0x7f66d419eae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66c4005740 tx=0x7f66c4005770 comp rx=0 tx=0).stop 2023-10-26T06:41:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 shutdown_connections 2023-10-26T06:41:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f66bc0a15e0 0x7f66bc0a3aa0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66d4106fe0 0x7f66d4198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66d4067fa0 0x7f66d419eae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 --2- 172.21.15.50:0/162334208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d41066c0 0x7f66d419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.184+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 >> 172.21.15.50:0/162334208 conn(0x7f66d4076400 msgr2=0x7f66d410b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.185+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 shutdown_connections 2023-10-26T06:41:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.185+0000 7f66d97ff700 1 -- 172.21.15.50:0/162334208 wait complete. 2023-10-26T06:41:39.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:39 smithi050 ceph-mon[94997]: mgrmap e21: x(active, since 6m), standbys: z, y 2023-10-26T06:41:39.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:39 smithi050 ceph-mon[94997]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:39.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:39 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/190196894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:39.207 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-26T06:41:39.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-26T06:41:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 -- 172.21.15.50:0/812799197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 msgr2=0x7f06d0100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 --2- 172.21.15.50:0/812799197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d0100b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06c40098f0 tx=0x7f06c4009c00 comp rx=0 tx=0).stop 2023-10-26T06:41:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 -- 172.21.15.50:0/812799197 shutdown_connections 2023-10-26T06:41:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 --2- 172.21.15.50:0/812799197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d0101060 0x7f06d010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 --2- 172.21.15.50:0/812799197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06d01066b0 0x7f06d0106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 --2- 172.21.15.50:0/812799197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d0100b20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.411+0000 7f06d65ff700 1 -- 172.21.15.50:0/812799197 >> 172.21.15.50:0/812799197 conn(0x7f06d00fc170 msgr2=0x7f06d00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.412+0000 7f06d65ff700 1 -- 172.21.15.50:0/812799197 shutdown_connections 2023-10-26T06:41:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.412+0000 7f06d65ff700 1 -- 172.21.15.50:0/812799197 wait complete. 2023-10-26T06:41:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.412+0000 7f06d65ff700 1 Processor -- start 2023-10-26T06:41:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 -- start start 2023-10-26T06:41:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d019ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06d0101060 0x7f06d019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d01066b0 0x7f06d0198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0199230 con 0x7f06d01006a0 2023-10-26T06:41:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d01993a0 con 0x7f06d0101060 2023-10-26T06:41:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d65ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0199560 con 0x7f06d01066b0 2023-10-26T06:41:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06cffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d019ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06cffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d019ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41576/0 (socket says 172.21.15.50:41576) 2023-10-26T06:41:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06cffff700 1 -- 172.21.15.50:0/3426132686 learned_addr learned my addr 172.21.15.50:0/3426132686 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06cf7fe700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06d0101060 0x7f06d019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.413+0000 7f06d4b9c700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d01066b0 0x7f06d0198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cffff700 1 -- 172.21.15.50:0/3426132686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d01066b0 msgr2=0x7f06d0198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cffff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d01066b0 0x7f06d0198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cffff700 1 -- 172.21.15.50:0/3426132686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06d0101060 msgr2=0x7f06d019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cffff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06d0101060 0x7f06d019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cffff700 1 -- 172.21.15.50:0/3426132686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4009520 con 0x7f06d01006a0 2023-10-26T06:41:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cffff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d019ea50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e9c0 tx=0x7f06c000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0004a30 con 0x7f06d01006a0 2023-10-26T06:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c000cc80 con 0x7f06d01006a0 2023-10-26T06:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d0199840 con 0x7f06d01006a0 2023-10-26T06:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00054e0 con 0x7f06d01006a0 2023-10-26T06:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.414+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d01a5a40 con 0x7f06d01006a0 2023-10-26T06:41:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.415+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d0101de0 con 0x7f06d01006a0 2023-10-26T06:41:39.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:39 smithi125 ceph-mon[130643]: mgrmap e21: x(active, since 6m), standbys: z, y 2023-10-26T06:41:39.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:39 smithi125 ceph-mon[130643]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:39.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:39 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/190196894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.417+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f06c0004b90 con 0x7f06d01006a0 2023-10-26T06:41:39.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.419+0000 7f06cd7fa700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f06b80a1560 0x7f06b80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.419+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f06c0014070 con 0x7f06d01006a0 2023-10-26T06:41:39.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.419+0000 7f06cf7fe700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f06b80a1560 0x7f06b80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.420+0000 7f06cf7fe700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f06b80a1560 0x7f06b80a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06c40098c0 tx=0x7f06c4019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:39.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.424+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f06c0096440 con 0x7f06d01006a0 2023-10-26T06:41:39.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:39 smithi153 ceph-mon[131657]: mgrmap e21: x(active, since 6m), standbys: z, y 2023-10-26T06:41:39.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:39 smithi153 ceph-mon[131657]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:41:39.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:39 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/190196894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:41:39.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.633+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06d0110670 con 0x7f06b80a1560 2023-10-26T06:41:39.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.646+0000 7f06cd7fa700 1 -- 172.21.15.50:0/3426132686 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335633 (secure 0 0 0) 0x7f06d0110670 con 0x7f06b80a1560 2023-10-26T06:41:39.652 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f06b80a1560 msgr2=0x7f06b80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f06b80a1560 0x7f06b80a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06c40098c0 tx=0x7f06c4019040 comp rx=0 tx=0).stop 2023-10-26T06:41:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 msgr2=0x7f06d019ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d019ea50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e9c0 tx=0x7f06c000ecd0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 shutdown_connections 2023-10-26T06:41:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f06b80a1560 0x7f06b80a3a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d01066b0 0x7f06d0198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d01006a0 0x7f06d019ea50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 --2- 172.21.15.50:0/3426132686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06d0101060 0x7f06d019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 >> 172.21.15.50:0/3426132686 conn(0x7f06d00fc170 msgr2=0x7f06d00fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 shutdown_connections 2023-10-26T06:41:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.650+0000 7f06d65ff700 1 -- 172.21.15.50:0/3426132686 wait complete. 2023-10-26T06:41:39.657 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:41:39.671 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2023-10-26T06:41:39.622957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630899,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":162,"num_read_kb":155,"num_write":319,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259,"ondisk_log_size":259,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336840,"kb_used_data":12628,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604984,"statfs":{"total":1151940427776,"available":1151595503616,"internally_reserved":0,"allocated":12931072,"data_stored":7174047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40531,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":26,"num_read_kb":36,"num_write":138,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.690690"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640504+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:41:33.640504+0000","last_peered":"2023-10-26T06:41:33.640504+0000","last_clean":"2023-10-26T06:41:33.640504+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:41:33.640504+0000","last_undegraded":"2023-10-26T06:41:33.640504+0000","last_fullsized":"2023-10-26T06:41:33.640504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640890+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:41:33.640890+0000","last_peered":"2023-10-26T06:41:33.640890+0000","last_clean":"2023-10-26T06:41:33.640890+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:41:33.640890+0000","last_undegraded":"2023-10-26T06:41:33.640890+0000","last_fullsized":"2023-10-26T06:41:33.640890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640897+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:41:33.640897+0000","last_peered":"2023-10-26T06:41:33.640897+0000","last_clean":"2023-10-26T06:41:33.640897+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:41:33.640897+0000","last_undegraded":"2023-10-26T06:41:33.640897+0000","last_fullsized":"2023-10-26T06:41:33.640897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640010+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:41:33.640010+0000","last_peered":"2023-10-26T06:41:33.640010+0000","last_clean":"2023-10-26T06:41:33.640010+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:41:33.640010+0000","last_undegraded":"2023-10-26T06:41:33.640010+0000","last_fullsized":"2023-10-26T06:41:33.640010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432795+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:41:33.432795+0000","last_peered":"2023-10-26T06:41:33.432795+0000","last_clean":"2023-10-26T06:41:33.432795+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:41:33.432795+0000","last_undegraded":"2023-10-26T06:41:33.432795+0000","last_fullsized":"2023-10-26T06:41:33.432795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640353+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:41:33.640353+0000","last_peered":"2023-10-26T06:41:33.640353+0000","last_clean":"2023-10-26T06:41:33.640353+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:41:33.640353+0000","last_undegraded":"2023-10-26T06:41:33.640353+0000","last_fullsized":"2023-10-26T06:41:33.640353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551931+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:41:32.551931+0000","last_peered":"2023-10-26T06:41:32.551931+0000","last_clean":"2023-10-26T06:41:32.551931+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:41:32.551931+0000","last_undegraded":"2023-10-26T06:41:32.551931+0000","last_fullsized":"2023-10-26T06:41:32.551931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942062+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:41:31.942062+0000","last_peered":"2023-10-26T06:41:31.942062+0000","last_clean":"2023-10-26T06:41:31.942062+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:41:31.942062+0000","last_undegraded":"2023-10-26T06:41:31.942062+0000","last_fullsized":"2023-10-26T06:41:31.942062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942643+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:41:31.942643+0000","last_peered":"2023-10-26T06:41:31.942643+0000","last_clean":"2023-10-26T06:41:31.942643+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:41:31.942643+0000","last_undegraded":"2023-10-26T06:41:31.942643+0000","last_fullsized":"2023-10-26T06:41:31.942643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639839+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:41:33.639839+0000","last_peered":"2023-10-26T06:41:33.639839+0000","last_clean":"2023-10-26T06:41:33.639839+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:41:33.639839+0000","last_undegraded":"2023-10-26T06:41:33.639839+0000","last_fullsized":"2023-10-26T06:41:33.639839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552219+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:41:32.552219+0000","last_peered":"2023-10-26T06:41:32.552219+0000","last_clean":"2023-10-26T06:41:32.552219+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:41:32.552219+0000","last_undegraded":"2023-10-26T06:41:32.552219+0000","last_fullsized":"2023-10-26T06:41:32.552219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639937+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:41:33.639937+0000","last_peered":"2023-10-26T06:41:33.639937+0000","last_clean":"2023-10-26T06:41:33.639937+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:41:33.639937+0000","last_undegraded":"2023-10-26T06:41:33.639937+0000","last_fullsized":"2023-10-26T06:41:33.639937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640417+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:41:33.640417+0000","last_peered":"2023-10-26T06:41:33.640417+0000","last_clean":"2023-10-26T06:41:33.640417+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:41:33.640417+0000","last_undegraded":"2023-10-26T06:41:33.640417+0000","last_fullsized":"2023-10-26T06:41:33.640417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640107+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:41:33.640107+0000","last_peered":"2023-10-26T06:41:33.640107+0000","last_clean":"2023-10-26T06:41:33.640107+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:41:33.640107+0000","last_undegraded":"2023-10-26T06:41:33.640107+0000","last_fullsized":"2023-10-26T06:41:33.640107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640318+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:41:33.640318+0000","last_peered":"2023-10-26T06:41:33.640318+0000","last_clean":"2023-10-26T06:41:33.640318+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:41:33.640318+0000","last_undegraded":"2023-10-26T06:41:33.640318+0000","last_fullsized":"2023-10-26T06:41:33.640318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942255+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:41:31.942255+0000","last_peered":"2023-10-26T06:41:31.942255+0000","last_clean":"2023-10-26T06:41:31.942255+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:41:31.942255+0000","last_undegraded":"2023-10-26T06:41:31.942255+0000","last_fullsized":"2023-10-26T06:41:31.942255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640510+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:41:33.640510+0000","last_peered":"2023-10-26T06:41:33.640510+0000","last_clean":"2023-10-26T06:41:33.640510+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:41:33.640510+0000","last_undegraded":"2023-10-26T06:41:33.640510+0000","last_fullsized":"2023-10-26T06:41:33.640510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640274+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:41:33.640274+0000","last_peered":"2023-10-26T06:41:33.640274+0000","last_clean":"2023-10-26T06:41:33.640274+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:41:33.640274+0000","last_undegraded":"2023-10-26T06:41:33.640274+0000","last_fullsized":"2023-10-26T06:41:33.640274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946785+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:41:31.946785+0000","last_peered":"2023-10-26T06:41:31.946785+0000","last_clean":"2023-10-26T06:41:31.946785+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:41:31.946785+0000","last_undegraded":"2023-10-26T06:41:31.946785+0000","last_fullsized":"2023-10-26T06:41:31.946785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996640+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:41:34.996640+0000","last_peered":"2023-10-26T06:41:34.996640+0000","last_clean":"2023-10-26T06:41:34.996640+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:41:34.996640+0000","last_undegraded":"2023-10-26T06:41:34.996640+0000","last_fullsized":"2023-10-26T06:41:34.996640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942852+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:41:31.942852+0000","last_peered":"2023-10-26T06:41:31.942852+0000","last_clean":"2023-10-26T06:41:31.942852+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:41:31.942852+0000","last_undegraded":"2023-10-26T06:41:31.942852+0000","last_fullsized":"2023-10-26T06:41:31.942852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.020694+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:41:32.020694+0000","last_peered":"2023-10-26T06:41:32.020694+0000","last_clean":"2023-10-26T06:41:32.020694+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:41:32.020694+0000","last_undegraded":"2023-10-26T06:41:32.020694+0000","last_fullsized":"2023-10-26T06:41:32.020694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641194+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:41:33.641194+0000","last_peered":"2023-10-26T06:41:33.641194+0000","last_clean":"2023-10-26T06:41:33.641194+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:41:33.641194+0000","last_undegraded":"2023-10-26T06:41:33.641194+0000","last_fullsized":"2023-10-26T06:41:33.641194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994464+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:41:34.994464+0000","last_peered":"2023-10-26T06:41:34.994464+0000","last_clean":"2023-10-26T06:41:34.994464+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:41:34.994464+0000","last_undegraded":"2023-10-26T06:41:34.994464+0000","last_fullsized":"2023-10-26T06:41:34.994464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942419+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:41:31.942419+0000","last_peered":"2023-10-26T06:41:31.942419+0000","last_clean":"2023-10-26T06:41:31.942419+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:41:31.942419+0000","last_undegraded":"2023-10-26T06:41:31.942419+0000","last_fullsized":"2023-10-26T06:41:31.942419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.208523+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:41:33.208523+0000","last_peered":"2023-10-26T06:41:33.208523+0000","last_clean":"2023-10-26T06:41:33.208523+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:41:33.208523+0000","last_undegraded":"2023-10-26T06:41:33.208523+0000","last_fullsized":"2023-10-26T06:41:33.208523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640086+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:41:33.640086+0000","last_peered":"2023-10-26T06:41:33.640086+0000","last_clean":"2023-10-26T06:41:33.640086+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:41:33.640086+0000","last_undegraded":"2023-10-26T06:41:33.640086+0000","last_fullsized":"2023-10-26T06:41:33.640086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992870+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:41:33.992870+0000","last_peered":"2023-10-26T06:41:33.992870+0000","last_clean":"2023-10-26T06:41:33.992870+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:41:33.992870+0000","last_undegraded":"2023-10-26T06:41:33.992870+0000","last_fullsized":"2023-10-26T06:41:33.992870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432740+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:41:33.432740+0000","last_peered":"2023-10-26T06:41:33.432740+0000","last_clean":"2023-10-26T06:41:33.432740+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:41:33.432740+0000","last_undegraded":"2023-10-26T06:41:33.432740+0000","last_fullsized":"2023-10-26T06:41:33.432740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996516+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:41:34.996516+0000","last_peered":"2023-10-26T06:41:34.996516+0000","last_clean":"2023-10-26T06:41:34.996516+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:41:34.996516+0000","last_undegraded":"2023-10-26T06:41:34.996516+0000","last_fullsized":"2023-10-26T06:41:34.996516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639975+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:41:33.639975+0000","last_peered":"2023-10-26T06:41:33.639975+0000","last_clean":"2023-10-26T06:41:33.639975+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:41:33.639975+0000","last_undegraded":"2023-10-26T06:41:33.639975+0000","last_fullsized":"2023-10-26T06:41:33.639975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.997042+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:41:34.997042+0000","last_peered":"2023-10-26T06:41:34.997042+0000","last_clean":"2023-10-26T06:41:34.997042+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:41:34.997042+0000","last_undegraded":"2023-10-26T06:41:34.997042+0000","last_fullsized":"2023-10-26T06:41:34.997042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942182+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:41:31.942182+0000","last_peered":"2023-10-26T06:41:31.942182+0000","last_clean":"2023-10-26T06:41:31.942182+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:41:31.942182+0000","last_undegraded":"2023-10-26T06:41:31.942182+0000","last_fullsized":"2023-10-26T06:41:31.942182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640596+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:41:33.640596+0000","last_peered":"2023-10-26T06:41:33.640596+0000","last_clean":"2023-10-26T06:41:33.640596+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:41:33.640596+0000","last_undegraded":"2023-10-26T06:41:33.640596+0000","last_fullsized":"2023-10-26T06:41:33.640596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639814+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:41:33.639814+0000","last_peered":"2023-10-26T06:41:33.639814+0000","last_clean":"2023-10-26T06:41:33.639814+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:41:33.639814+0000","last_undegraded":"2023-10-26T06:41:33.639814+0000","last_fullsized":"2023-10-26T06:41:33.639814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.003583+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:41:36.003583+0000","last_peered":"2023-10-26T06:41:36.003583+0000","last_clean":"2023-10-26T06:41:36.003583+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:41:36.003583+0000","last_undegraded":"2023-10-26T06:41:36.003583+0000","last_fullsized":"2023-10-26T06:41:36.003583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942571+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:41:31.942571+0000","last_peered":"2023-10-26T06:41:31.942571+0000","last_clean":"2023-10-26T06:41:31.942571+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:41:31.942571+0000","last_undegraded":"2023-10-26T06:41:31.942571+0000","last_fullsized":"2023-10-26T06:41:31.942571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991018+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:41:33.991018+0000","last_peered":"2023-10-26T06:41:33.991018+0000","last_clean":"2023-10-26T06:41:33.991018+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:41:33.991018+0000","last_undegraded":"2023-10-26T06:41:33.991018+0000","last_fullsized":"2023-10-26T06:41:33.991018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641143+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:41:33.641143+0000","last_peered":"2023-10-26T06:41:33.641143+0000","last_clean":"2023-10-26T06:41:33.641143+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:41:33.641143+0000","last_undegraded":"2023-10-26T06:41:33.641143+0000","last_fullsized":"2023-10-26T06:41:33.641143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640255+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:41:33.640255+0000","last_peered":"2023-10-26T06:41:33.640255+0000","last_clean":"2023-10-26T06:41:33.640255+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:41:33.640255+0000","last_undegraded":"2023-10-26T06:41:33.640255+0000","last_fullsized":"2023-10-26T06:41:33.640255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942519+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:41:31.942519+0000","last_peered":"2023-10-26T06:41:31.942519+0000","last_clean":"2023-10-26T06:41:31.942519+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:41:31.942519+0000","last_undegraded":"2023-10-26T06:41:31.942519+0000","last_fullsized":"2023-10-26T06:41:31.942519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'18","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:37.525230+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:41:37.525230+0000","last_peered":"2023-10-26T06:41:37.525230+0000","last_clean":"2023-10-26T06:41:37.525230+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:41:37.525230+0000","last_undegraded":"2023-10-26T06:41:37.525230+0000","last_fullsized":"2023-10-26T06:41:37.525230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36285,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":21,"num_write":19,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.433005+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:41:33.433005+0000","last_peered":"2023-10-26T06:41:33.433005+0000","last_clean":"2023-10-26T06:41:33.433005+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:41:33.433005+0000","last_undegraded":"2023-10-26T06:41:33.433005+0000","last_fullsized":"2023-10-26T06:41:33.433005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.995515+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:41:34.995515+0000","last_peered":"2023-10-26T06:41:34.995515+0000","last_clean":"2023-10-26T06:41:34.995515+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:41:34.995515+0000","last_undegraded":"2023-10-26T06:41:34.995515+0000","last_fullsized":"2023-10-26T06:41:34.995515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640487+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:41:33.640487+0000","last_peered":"2023-10-26T06:41:33.640487+0000","last_clean":"2023-10-26T06:41:33.640487+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:41:33.640487+0000","last_undegraded":"2023-10-26T06:41:33.640487+0000","last_fullsized":"2023-10-26T06:41:33.640487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992241+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:41:33.992241+0000","last_peered":"2023-10-26T06:41:33.992241+0000","last_clean":"2023-10-26T06:41:33.992241+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:41:33.992241+0000","last_undegraded":"2023-10-26T06:41:33.992241+0000","last_fullsized":"2023-10-26T06:41:33.992241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552190+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:41:32.552190+0000","last_peered":"2023-10-26T06:41:32.552190+0000","last_clean":"2023-10-26T06:41:32.552190+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:41:32.552190+0000","last_undegraded":"2023-10-26T06:41:32.552190+0000","last_fullsized":"2023-10-26T06:41:32.552190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:38.012225+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:41:38.012225+0000","last_peered":"2023-10-26T06:41:38.012225+0000","last_clean":"2023-10-26T06:41:38.012225+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:41:38.012225+0000","last_undegraded":"2023-10-26T06:41:38.012225+0000","last_fullsized":"2023-10-26T06:41:38.012225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551861+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:41:32.551861+0000","last_peered":"2023-10-26T06:41:32.551861+0000","last_clean":"2023-10-26T06:41:32.551861+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:41:32.551861+0000","last_undegraded":"2023-10-26T06:41:32.551861+0000","last_fullsized":"2023-10-26T06:41:32.551861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996700+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:41:34.996700+0000","last_peered":"2023-10-26T06:41:34.996700+0000","last_clean":"2023-10-26T06:41:34.996700+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:41:34.996700+0000","last_undegraded":"2023-10-26T06:41:34.996700+0000","last_fullsized":"2023-10-26T06:41:34.996700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639977+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:41:33.639977+0000","last_peered":"2023-10-26T06:41:33.639977+0000","last_clean":"2023-10-26T06:41:33.639977+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:41:33.639977+0000","last_undegraded":"2023-10-26T06:41:33.639977+0000","last_fullsized":"2023-10-26T06:41:33.639977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.005443+0000","last_change":"2023-10-26T06:41:29.962764+0000","last_active":"2023-10-26T06:41:36.005443+0000","last_peered":"2023-10-26T06:41:36.005443+0000","last_clean":"2023-10-26T06:41:36.005443+0000","last_became_active":"2023-10-26T06:41:29.962245+0000","last_became_peered":"2023-10-26T06:41:29.962245+0000","last_unstale":"2023-10-26T06:41:36.005443+0000","last_undegraded":"2023-10-26T06:41:36.005443+0000","last_fullsized":"2023-10-26T06:41:36.005443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:33:21.800233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640386+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:41:33.640386+0000","last_peered":"2023-10-26T06:41:33.640386+0000","last_clean":"2023-10-26T06:41:33.640386+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:41:33.640386+0000","last_undegraded":"2023-10-26T06:41:33.640386+0000","last_fullsized":"2023-10-26T06:41:33.640386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.942650+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:41:30.942650+0000","last_peered":"2023-10-26T06:41:30.942650+0000","last_clean":"2023-10-26T06:41:30.942650+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:41:30.942650+0000","last_undegraded":"2023-10-26T06:41:30.942650+0000","last_fullsized":"2023-10-26T06:41:30.942650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640019+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:41:33.640019+0000","last_peered":"2023-10-26T06:41:33.640019+0000","last_clean":"2023-10-26T06:41:33.640019+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:41:33.640019+0000","last_undegraded":"2023-10-26T06:41:33.640019+0000","last_fullsized":"2023-10-26T06:41:33.640019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675117+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:41:33.675117+0000","last_peered":"2023-10-26T06:41:33.675117+0000","last_clean":"2023-10-26T06:41:33.675117+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:41:33.675117+0000","last_undegraded":"2023-10-26T06:41:33.675117+0000","last_fullsized":"2023-10-26T06:41:33.675117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639719+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:41:33.639719+0000","last_peered":"2023-10-26T06:41:33.639719+0000","last_clean":"2023-10-26T06:41:33.639719+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:41:33.639719+0000","last_undegraded":"2023-10-26T06:41:33.639719+0000","last_fullsized":"2023-10-26T06:41:33.639719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640746+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:41:33.640746+0000","last_peered":"2023-10-26T06:41:33.640746+0000","last_clean":"2023-10-26T06:41:33.640746+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:41:33.640746+0000","last_undegraded":"2023-10-26T06:41:33.640746+0000","last_fullsized":"2023-10-26T06:41:33.640746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.997901+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:41:34.997901+0000","last_peered":"2023-10-26T06:41:34.997901+0000","last_clean":"2023-10-26T06:41:34.997901+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:41:34.997901+0000","last_undegraded":"2023-10-26T06:41:34.997901+0000","last_fullsized":"2023-10-26T06:41:34.997901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942453+0000","last_change":"2023-10-26T06:41:30.946148+0000","last_active":"2023-10-26T06:41:31.942453+0000","last_peered":"2023-10-26T06:41:31.942453+0000","last_clean":"2023-10-26T06:41:31.942453+0000","last_became_active":"2023-10-26T06:41:30.945835+0000","last_became_peered":"2023-10-26T06:41:30.945835+0000","last_unstale":"2023-10-26T06:41:31.942453+0000","last_undegraded":"2023-10-26T06:41:31.942453+0000","last_fullsized":"2023-10-26T06:41:31.942453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:29:50.330144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.002428+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:41:36.002428+0000","last_peered":"2023-10-26T06:41:36.002428+0000","last_clean":"2023-10-26T06:41:36.002428+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:41:36.002428+0000","last_undegraded":"2023-10-26T06:41:36.002428+0000","last_fullsized":"2023-10-26T06:41:36.002428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.939903+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:41:30.939903+0000","last_peered":"2023-10-26T06:41:30.939903+0000","last_clean":"2023-10-26T06:41:30.939903+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:41:30.939903+0000","last_undegraded":"2023-10-26T06:41:30.939903+0000","last_fullsized":"2023-10-26T06:41:30.939903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639481+0000","last_change":"2023-10-26T06:41:30.954040+0000","last_active":"2023-10-26T06:41:33.639481+0000","last_peered":"2023-10-26T06:41:33.639481+0000","last_clean":"2023-10-26T06:41:33.639481+0000","last_became_active":"2023-10-26T06:41:30.953367+0000","last_became_peered":"2023-10-26T06:41:30.953367+0000","last_unstale":"2023-10-26T06:41:33.639481+0000","last_undegraded":"2023-10-26T06:41:33.639481+0000","last_fullsized":"2023-10-26T06:41:33.639481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:17:37.442177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994555+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:41:34.994555+0000","last_peered":"2023-10-26T06:41:34.994555+0000","last_clean":"2023-10-26T06:41:34.994555+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:41:34.994555+0000","last_undegraded":"2023-10-26T06:41:34.994555+0000","last_fullsized":"2023-10-26T06:41:34.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991384+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:41:33.991384+0000","last_peered":"2023-10-26T06:41:33.991384+0000","last_clean":"2023-10-26T06:41:33.991384+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:41:33.991384+0000","last_undegraded":"2023-10-26T06:41:33.991384+0000","last_fullsized":"2023-10-26T06:41:33.991384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640145+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:41:33.640145+0000","last_peered":"2023-10-26T06:41:33.640145+0000","last_clean":"2023-10-26T06:41:33.640145+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:41:33.640145+0000","last_undegraded":"2023-10-26T06:41:33.640145+0000","last_fullsized":"2023-10-26T06:41:33.640145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996709+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:41:34.996709+0000","last_peered":"2023-10-26T06:41:34.996709+0000","last_clean":"2023-10-26T06:41:34.996709+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:41:34.996709+0000","last_undegraded":"2023-10-26T06:41:34.996709+0000","last_fullsized":"2023-10-26T06:41:34.996709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942707+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:41:31.942707+0000","last_peered":"2023-10-26T06:41:31.942707+0000","last_clean":"2023-10-26T06:41:31.942707+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:41:31.942707+0000","last_undegraded":"2023-10-26T06:41:31.942707+0000","last_fullsized":"2023-10-26T06:41:31.942707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991181+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:41:33.991181+0000","last_peered":"2023-10-26T06:41:33.991181+0000","last_clean":"2023-10-26T06:41:33.991181+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:41:33.991181+0000","last_undegraded":"2023-10-26T06:41:33.991181+0000","last_fullsized":"2023-10-26T06:41:33.991181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641086+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:41:33.641086+0000","last_peered":"2023-10-26T06:41:33.641086+0000","last_clean":"2023-10-26T06:41:33.641086+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:41:33.641086+0000","last_undegraded":"2023-10-26T06:41:33.641086+0000","last_fullsized":"2023-10-26T06:41:33.641086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991058+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:41:33.991058+0000","last_peered":"2023-10-26T06:41:33.991058+0000","last_clean":"2023-10-26T06:41:33.991058+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:41:33.991058+0000","last_undegraded":"2023-10-26T06:41:33.991058+0000","last_fullsized":"2023-10-26T06:41:33.991058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432711+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:41:33.432711+0000","last_peered":"2023-10-26T06:41:33.432711+0000","last_clean":"2023-10-26T06:41:33.432711+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:41:33.432711+0000","last_undegraded":"2023-10-26T06:41:33.432711+0000","last_fullsized":"2023-10-26T06:41:33.432711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991075+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:41:33.991075+0000","last_peered":"2023-10-26T06:41:33.991075+0000","last_clean":"2023-10-26T06:41:33.991075+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:41:33.991075+0000","last_undegraded":"2023-10-26T06:41:33.991075+0000","last_fullsized":"2023-10-26T06:41:33.991075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639521+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:41:33.639521+0000","last_peered":"2023-10-26T06:41:33.639521+0000","last_clean":"2023-10-26T06:41:33.639521+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:41:33.639521+0000","last_undegraded":"2023-10-26T06:41:33.639521+0000","last_fullsized":"2023-10-26T06:41:33.639521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946651+0000","last_change":"2023-10-26T06:41:29.957155+0000","last_active":"2023-10-26T06:41:31.946651+0000","last_peered":"2023-10-26T06:41:31.946651+0000","last_clean":"2023-10-26T06:41:31.946651+0000","last_became_active":"2023-10-26T06:41:29.956740+0000","last_became_peered":"2023-10-26T06:41:29.956740+0000","last_unstale":"2023-10-26T06:41:31.946651+0000","last_undegraded":"2023-10-26T06:41:31.946651+0000","last_fullsized":"2023-10-26T06:41:31.946651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:14:27.826402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942335+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:41:31.942335+0000","last_peered":"2023-10-26T06:41:31.942335+0000","last_clean":"2023-10-26T06:41:31.942335+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:41:31.942335+0000","last_undegraded":"2023-10-26T06:41:31.942335+0000","last_fullsized":"2023-10-26T06:41:31.942335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991813+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:41:33.991813+0000","last_peered":"2023-10-26T06:41:33.991813+0000","last_clean":"2023-10-26T06:41:33.991813+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:41:33.991813+0000","last_undegraded":"2023-10-26T06:41:33.991813+0000","last_fullsized":"2023-10-26T06:41:33.991813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552153+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:41:32.552153+0000","last_peered":"2023-10-26T06:41:32.552153+0000","last_clean":"2023-10-26T06:41:32.552153+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:41:32.552153+0000","last_undegraded":"2023-10-26T06:41:32.552153+0000","last_fullsized":"2023-10-26T06:41:32.552153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994673+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:41:34.994673+0000","last_peered":"2023-10-26T06:41:34.994673+0000","last_clean":"2023-10-26T06:41:34.994673+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:41:34.994673+0000","last_undegraded":"2023-10-26T06:41:34.994673+0000","last_fullsized":"2023-10-26T06:41:34.994673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552239+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:41:32.552239+0000","last_peered":"2023-10-26T06:41:32.552239+0000","last_clean":"2023-10-26T06:41:32.552239+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:41:32.552239+0000","last_undegraded":"2023-10-26T06:41:32.552239+0000","last_fullsized":"2023-10-26T06:41:32.552239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.972588+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:41:30.972588+0000","last_peered":"2023-10-26T06:41:30.972588+0000","last_clean":"2023-10-26T06:41:30.972588+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:41:30.972588+0000","last_undegraded":"2023-10-26T06:41:30.972588+0000","last_fullsized":"2023-10-26T06:41:30.972588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675149+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:41:33.675149+0000","last_peered":"2023-10-26T06:41:33.675149+0000","last_clean":"2023-10-26T06:41:33.675149+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:41:33.675149+0000","last_undegraded":"2023-10-26T06:41:33.675149+0000","last_fullsized":"2023-10-26T06:41:33.675149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.054027+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:41:31.054027+0000","last_peered":"2023-10-26T06:41:31.054027+0000","last_clean":"2023-10-26T06:41:31.054027+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:41:31.054027+0000","last_undegraded":"2023-10-26T06:41:31.054027+0000","last_fullsized":"2023-10-26T06:41:31.054027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552218+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:41:32.552218+0000","last_peered":"2023-10-26T06:41:32.552218+0000","last_clean":"2023-10-26T06:41:32.552218+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:41:32.552218+0000","last_undegraded":"2023-10-26T06:41:32.552218+0000","last_fullsized":"2023-10-26T06:41:32.552218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639593+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:41:33.639593+0000","last_peered":"2023-10-26T06:41:33.639593+0000","last_clean":"2023-10-26T06:41:33.639593+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:41:33.639593+0000","last_undegraded":"2023-10-26T06:41:33.639593+0000","last_fullsized":"2023-10-26T06:41:33.639593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946627+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:41:31.946627+0000","last_peered":"2023-10-26T06:41:31.946627+0000","last_clean":"2023-10-26T06:41:31.946627+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:41:31.946627+0000","last_undegraded":"2023-10-26T06:41:31.946627+0000","last_fullsized":"2023-10-26T06:41:31.946627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946633+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:41:31.946633+0000","last_peered":"2023-10-26T06:41:31.946633+0000","last_clean":"2023-10-26T06:41:31.946633+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:41:31.946633+0000","last_undegraded":"2023-10-26T06:41:31.946633+0000","last_fullsized":"2023-10-26T06:41:31.946633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640660+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:41:33.640660+0000","last_peered":"2023-10-26T06:41:33.640660+0000","last_clean":"2023-10-26T06:41:33.640660+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:41:33.640660+0000","last_undegraded":"2023-10-26T06:41:33.640660+0000","last_fullsized":"2023-10-26T06:41:33.640660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640677+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:41:33.640677+0000","last_peered":"2023-10-26T06:41:33.640677+0000","last_clean":"2023-10-26T06:41:33.640677+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:41:33.640677+0000","last_undegraded":"2023-10-26T06:41:33.640677+0000","last_fullsized":"2023-10-26T06:41:33.640677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639806+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:41:33.639806+0000","last_peered":"2023-10-26T06:41:33.639806+0000","last_clean":"2023-10-26T06:41:33.639806+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:41:33.639806+0000","last_undegraded":"2023-10-26T06:41:33.639806+0000","last_fullsized":"2023-10-26T06:41:33.639806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946954+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:41:31.946954+0000","last_peered":"2023-10-26T06:41:31.946954+0000","last_clean":"2023-10-26T06:41:31.946954+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:41:31.946954+0000","last_undegraded":"2023-10-26T06:41:31.946954+0000","last_fullsized":"2023-10-26T06:41:31.946954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942673+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:41:31.942673+0000","last_peered":"2023-10-26T06:41:31.942673+0000","last_clean":"2023-10-26T06:41:31.942673+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:41:31.942673+0000","last_undegraded":"2023-10-26T06:41:31.942673+0000","last_fullsized":"2023-10-26T06:41:31.942673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640616+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:41:33.640616+0000","last_peered":"2023-10-26T06:41:33.640616+0000","last_clean":"2023-10-26T06:41:33.640616+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:41:33.640616+0000","last_undegraded":"2023-10-26T06:41:33.640616+0000","last_fullsized":"2023-10-26T06:41:33.640616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942404+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:41:31.942404+0000","last_peered":"2023-10-26T06:41:31.942404+0000","last_clean":"2023-10-26T06:41:31.942404+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:41:31.942404+0000","last_undegraded":"2023-10-26T06:41:31.942404+0000","last_fullsized":"2023-10-26T06:41:31.942404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942522+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:41:31.942522+0000","last_peered":"2023-10-26T06:41:31.942522+0000","last_clean":"2023-10-26T06:41:31.942522+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:41:31.942522+0000","last_undegraded":"2023-10-26T06:41:31.942522+0000","last_fullsized":"2023-10-26T06:41:31.942522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640293+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:41:33.640293+0000","last_peered":"2023-10-26T06:41:33.640293+0000","last_clean":"2023-10-26T06:41:33.640293+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:41:33.640293+0000","last_undegraded":"2023-10-26T06:41:33.640293+0000","last_fullsized":"2023-10-26T06:41:33.640293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639807+0000","last_change":"2023-10-26T06:41:30.948857+0000","last_active":"2023-10-26T06:41:33.639807+0000","last_peered":"2023-10-26T06:41:33.639807+0000","last_clean":"2023-10-26T06:41:33.639807+0000","last_became_active":"2023-10-26T06:41:30.948505+0000","last_became_peered":"2023-10-26T06:41:30.948505+0000","last_unstale":"2023-10-26T06:41:33.639807+0000","last_undegraded":"2023-10-26T06:41:33.639807+0000","last_fullsized":"2023-10-26T06:41:33.639807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:11:47.908249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40285,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":26,"num_read_kb":36,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":91364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416398,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":445170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1055693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.438}]},{"osd":5,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61199999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.87},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.78400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":445406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.79800000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.755}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":445326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82499999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.751}]},{"osd":2,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.497},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3759999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.91900000000000004,"15min":0.94399999999999995},"min":{"1min":0.61499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.075,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1}]},{"osd":10,"last update":"Thu Oct 26 06:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.96199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299423,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1037261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41399999999999998},"min":{"1min":0.29799999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.39800000000000002},"min":{"1min":0.28000000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.62},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.46800000000000003},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.751}]},{"osd":6,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.70299999999999996},"min":{"1min":0.55800000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.71599999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86099999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":6,"up_from":47,"seq":201863462947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":444678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.41499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.45300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.51600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":1.026,"15min":1.026},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.754,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.127,"15min":1.127},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.012,"5min":1.038,"15min":1.038},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76800000000000002,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0209999999999999,"5min":1.133,"15min":1.133},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Oct 26 06:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.748},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69699999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.78300000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":480873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.501,"15min":0.49299999999999999},"min":{"1min":0.377,"5min":0.309,"15min":0.309},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.497}]},{"osd":4,"last update":"Thu Oct 26 06:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.442}]},{"osd":5,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.625}]},{"osd":7,"last update":"Thu Oct 26 06:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71199999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79700000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76100000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":446066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.47799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.65200000000000002,"15min":0.59899999999999998},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.67100000000000004,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.873}]},{"osd":3,"last update":"Thu Oct 26 06:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.63500000000000001,"15min":0.60999999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.67700000000000005,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Oct 26 06:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.441,"15min":0.441},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.61099999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.70799999999999996,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.99099999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.0269999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.105},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.98099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378679,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":446856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.51300000000000001},"min":{"1min":0.435,"5min":0.254,"15min":0.254},"max":{"1min":0.84199999999999997,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.378,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.149,"5min":2.371,"15min":2.371},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86599999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77300000000000002,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66400000000000003,"15min":0.70699999999999996},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.181,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85099999999999998,"5min":2.282,"15min":2.282},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63100000000000001,"15min":0.64800000000000002},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81100000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":1.044},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.55300000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85899999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.093},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.2450000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":3,"up_from":26,"seq":111669149746,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":444995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.35099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.751,"5min":1.069,"15min":1.069},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.46100000000000002,"15min":0.433},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.374,"15min":0.374},"max":{"1min":0.92900000000000005,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.61799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.69399999999999995,"15min":0.64700000000000002},"min":{"1min":0.60099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.68899999999999995,"15min":0.66000000000000003},"min":{"1min":0.56100000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.73499999999999999,"15min":0.68899999999999995},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.67800000000000005,"15min":0.64800000000000002},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.628},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.44,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.66800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.71999999999999997,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.64100000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:41:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.59899999999999998}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.82499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":4,"up_from":34,"seq":146028888110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":445622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.38100000000000001,"15min":0.35599999999999998},"min":{"1min":0.32100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39100000000000001,"15min":0.372},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.877,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55900000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.84099999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.745}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1523712,"data_stored":1036101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":5.819,"15min":5.819},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.751,"5min":5.835,"15min":5.835},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.872}]},{"osd":6,"last update":"Thu Oct 26 06:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.38600000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84299999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85499999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.83499999999999996}]},{"osd":8,"last update":"Thu Oct 26 06:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.96299999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.79800000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.02},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.90600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:41:39.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-26T06:41:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 -- 172.21.15.50:0/1536044904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1066b0 msgr2=0x7f2e2c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 --2- 172.21.15.50:0/1536044904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1066b0 0x7f2e2c106a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009990 tx=0x7f2e28009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 -- 172.21.15.50:0/1536044904 shutdown_connections 2023-10-26T06:41:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 --2- 172.21.15.50:0/1536044904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e2c101060 0x7f2e2c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 --2- 172.21.15.50:0/1536044904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1066b0 0x7f2e2c106a90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 --2- 172.21.15.50:0/1536044904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c1006a0 0x7f2e2c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 -- 172.21.15.50:0/1536044904 >> 172.21.15.50:0/1536044904 conn(0x7f2e2c0fc170 msgr2=0x7f2e2c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:39.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 -- 172.21.15.50:0/1536044904 shutdown_connections 2023-10-26T06:41:39.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.915+0000 7f2e347ff700 1 -- 172.21.15.50:0/1536044904 wait complete. 2023-10-26T06:41:39.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.916+0000 7f2e347ff700 1 Processor -- start 2023-10-26T06:41:39.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.916+0000 7f2e347ff700 1 -- start start 2023-10-26T06:41:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e347ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1006a0 0x7f2e2c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e347ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 0x7f2e2c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e347ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e2c1066b0 0x7f2e2c1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e347ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c196f20 con 0x7f2e2c101060 2023-10-26T06:41:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e347ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c197090 con 0x7f2e2c1066b0 2023-10-26T06:41:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e347ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c197250 con 0x7f2e2c1006a0 2023-10-26T06:41:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 0x7f2e2c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e32d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e2c1066b0 0x7f2e2c1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 0x7f2e2c19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41596/0 (socket says 172.21.15.50:41596) 2023-10-26T06:41:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e3259b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1006a0 0x7f2e2c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 -- 172.21.15.50:0/127403663 learned_addr learned my addr 172.21.15.50:0/127403663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 -- 172.21.15.50:0/127403663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1006a0 msgr2=0x7f2e2c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1006a0 0x7f2e2c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 -- 172.21.15.50:0/127403663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e2c1066b0 msgr2=0x7f2e2c1968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e2c1066b0 0x7f2e2c1968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.917+0000 7f2e31d9a700 1 -- 172.21.15.50:0/127403663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280095f0 con 0x7f2e2c101060 2023-10-26T06:41:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.918+0000 7f2e31d9a700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 0x7f2e2c19ccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00e9a0 tx=0x7f2e1c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.918+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c009790 con 0x7f2e2c101060 2023-10-26T06:41:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.918+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c197530 con 0x7f2e2c101060 2023-10-26T06:41:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.918+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e1c010430 con 0x7f2e2c101060 2023-10-26T06:41:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.918+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c018680 con 0x7f2e2c101060 2023-10-26T06:41:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.918+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c1a3780 con 0x7f2e2c101060 2023-10-26T06:41:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.919+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c108c30 con 0x7f2e2c101060 2023-10-26T06:41:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.921+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f2e1c0105a0 con 0x7f2e2c101060 2023-10-26T06:41:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.922+0000 7f2e237fe700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2e180a1560 0x7f2e180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:39.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.923+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f2e1c014070 con 0x7f2e2c101060 2023-10-26T06:41:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.923+0000 7f2e3259b700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2e180a1560 0x7f2e180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.923+0000 7f2e3259b700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2e180a1560 0x7f2e180a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b2e0 tx=0x7f2e28005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:39.926+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2e1c052100 con 0x7f2e2c101060 2023-10-26T06:41:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.134+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e2c197d80 con 0x7f2e180a1560 2023-10-26T06:41:40.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.145+0000 7f2e237fe700 1 -- 172.21.15.50:0/127403663 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335633 (secure 0 0 0) 0x7f2e2c197d80 con 0x7f2e180a1560 2023-10-26T06:41:40.150 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2e180a1560 msgr2=0x7f2e180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2e180a1560 0x7f2e180a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b2e0 tx=0x7f2e28005960 comp rx=0 tx=0).stop 2023-10-26T06:41:40.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 msgr2=0x7f2e2c19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 0x7f2e2c19ccd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00e9a0 tx=0x7f2e1c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 shutdown_connections 2023-10-26T06:41:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2e180a1560 0x7f2e180a3a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e2c1066b0 0x7f2e2c1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e2c1006a0 0x7f2e2c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:40.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 --2- 172.21.15.50:0/127403663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e2c101060 0x7f2e2c19ccd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:40.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 >> 172.21.15.50:0/127403663 conn(0x7f2e2c0fc170 msgr2=0x7f2e2c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:40.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.149+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 shutdown_connections 2023-10-26T06:41:40.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:40.150+0000 7f2e347ff700 1 -- 172.21.15.50:0/127403663 wait complete. 2023-10-26T06:41:40.155 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:41:40.170 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2023-10-26T06:41:39.622957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630899,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":162,"num_read_kb":155,"num_write":319,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259,"ondisk_log_size":259,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336840,"kb_used_data":12628,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604984,"statfs":{"total":1151940427776,"available":1151595503616,"internally_reserved":0,"allocated":12931072,"data_stored":7174047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40531,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":26,"num_read_kb":36,"num_write":138,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.690690"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640504+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:41:33.640504+0000","last_peered":"2023-10-26T06:41:33.640504+0000","last_clean":"2023-10-26T06:41:33.640504+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:41:33.640504+0000","last_undegraded":"2023-10-26T06:41:33.640504+0000","last_fullsized":"2023-10-26T06:41:33.640504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640890+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:41:33.640890+0000","last_peered":"2023-10-26T06:41:33.640890+0000","last_clean":"2023-10-26T06:41:33.640890+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:41:33.640890+0000","last_undegraded":"2023-10-26T06:41:33.640890+0000","last_fullsized":"2023-10-26T06:41:33.640890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640897+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:41:33.640897+0000","last_peered":"2023-10-26T06:41:33.640897+0000","last_clean":"2023-10-26T06:41:33.640897+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:41:33.640897+0000","last_undegraded":"2023-10-26T06:41:33.640897+0000","last_fullsized":"2023-10-26T06:41:33.640897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640010+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:41:33.640010+0000","last_peered":"2023-10-26T06:41:33.640010+0000","last_clean":"2023-10-26T06:41:33.640010+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:41:33.640010+0000","last_undegraded":"2023-10-26T06:41:33.640010+0000","last_fullsized":"2023-10-26T06:41:33.640010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432795+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:41:33.432795+0000","last_peered":"2023-10-26T06:41:33.432795+0000","last_clean":"2023-10-26T06:41:33.432795+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:41:33.432795+0000","last_undegraded":"2023-10-26T06:41:33.432795+0000","last_fullsized":"2023-10-26T06:41:33.432795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640353+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:41:33.640353+0000","last_peered":"2023-10-26T06:41:33.640353+0000","last_clean":"2023-10-26T06:41:33.640353+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:41:33.640353+0000","last_undegraded":"2023-10-26T06:41:33.640353+0000","last_fullsized":"2023-10-26T06:41:33.640353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551931+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:41:32.551931+0000","last_peered":"2023-10-26T06:41:32.551931+0000","last_clean":"2023-10-26T06:41:32.551931+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:41:32.551931+0000","last_undegraded":"2023-10-26T06:41:32.551931+0000","last_fullsized":"2023-10-26T06:41:32.551931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942062+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:41:31.942062+0000","last_peered":"2023-10-26T06:41:31.942062+0000","last_clean":"2023-10-26T06:41:31.942062+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:41:31.942062+0000","last_undegraded":"2023-10-26T06:41:31.942062+0000","last_fullsized":"2023-10-26T06:41:31.942062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942643+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:41:31.942643+0000","last_peered":"2023-10-26T06:41:31.942643+0000","last_clean":"2023-10-26T06:41:31.942643+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:41:31.942643+0000","last_undegraded":"2023-10-26T06:41:31.942643+0000","last_fullsized":"2023-10-26T06:41:31.942643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639839+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:41:33.639839+0000","last_peered":"2023-10-26T06:41:33.639839+0000","last_clean":"2023-10-26T06:41:33.639839+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:41:33.639839+0000","last_undegraded":"2023-10-26T06:41:33.639839+0000","last_fullsized":"2023-10-26T06:41:33.639839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552219+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:41:32.552219+0000","last_peered":"2023-10-26T06:41:32.552219+0000","last_clean":"2023-10-26T06:41:32.552219+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:41:32.552219+0000","last_undegraded":"2023-10-26T06:41:32.552219+0000","last_fullsized":"2023-10-26T06:41:32.552219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639937+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:41:33.639937+0000","last_peered":"2023-10-26T06:41:33.639937+0000","last_clean":"2023-10-26T06:41:33.639937+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:41:33.639937+0000","last_undegraded":"2023-10-26T06:41:33.639937+0000","last_fullsized":"2023-10-26T06:41:33.639937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640417+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:41:33.640417+0000","last_peered":"2023-10-26T06:41:33.640417+0000","last_clean":"2023-10-26T06:41:33.640417+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:41:33.640417+0000","last_undegraded":"2023-10-26T06:41:33.640417+0000","last_fullsized":"2023-10-26T06:41:33.640417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640107+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:41:33.640107+0000","last_peered":"2023-10-26T06:41:33.640107+0000","last_clean":"2023-10-26T06:41:33.640107+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:41:33.640107+0000","last_undegraded":"2023-10-26T06:41:33.640107+0000","last_fullsized":"2023-10-26T06:41:33.640107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640318+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:41:33.640318+0000","last_peered":"2023-10-26T06:41:33.640318+0000","last_clean":"2023-10-26T06:41:33.640318+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:41:33.640318+0000","last_undegraded":"2023-10-26T06:41:33.640318+0000","last_fullsized":"2023-10-26T06:41:33.640318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942255+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:41:31.942255+0000","last_peered":"2023-10-26T06:41:31.942255+0000","last_clean":"2023-10-26T06:41:31.942255+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:41:31.942255+0000","last_undegraded":"2023-10-26T06:41:31.942255+0000","last_fullsized":"2023-10-26T06:41:31.942255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640510+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:41:33.640510+0000","last_peered":"2023-10-26T06:41:33.640510+0000","last_clean":"2023-10-26T06:41:33.640510+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:41:33.640510+0000","last_undegraded":"2023-10-26T06:41:33.640510+0000","last_fullsized":"2023-10-26T06:41:33.640510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640274+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:41:33.640274+0000","last_peered":"2023-10-26T06:41:33.640274+0000","last_clean":"2023-10-26T06:41:33.640274+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:41:33.640274+0000","last_undegraded":"2023-10-26T06:41:33.640274+0000","last_fullsized":"2023-10-26T06:41:33.640274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946785+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:41:31.946785+0000","last_peered":"2023-10-26T06:41:31.946785+0000","last_clean":"2023-10-26T06:41:31.946785+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:41:31.946785+0000","last_undegraded":"2023-10-26T06:41:31.946785+0000","last_fullsized":"2023-10-26T06:41:31.946785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996640+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:41:34.996640+0000","last_peered":"2023-10-26T06:41:34.996640+0000","last_clean":"2023-10-26T06:41:34.996640+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:41:34.996640+0000","last_undegraded":"2023-10-26T06:41:34.996640+0000","last_fullsized":"2023-10-26T06:41:34.996640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942852+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:41:31.942852+0000","last_peered":"2023-10-26T06:41:31.942852+0000","last_clean":"2023-10-26T06:41:31.942852+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:41:31.942852+0000","last_undegraded":"2023-10-26T06:41:31.942852+0000","last_fullsized":"2023-10-26T06:41:31.942852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.020694+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:41:32.020694+0000","last_peered":"2023-10-26T06:41:32.020694+0000","last_clean":"2023-10-26T06:41:32.020694+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:41:32.020694+0000","last_undegraded":"2023-10-26T06:41:32.020694+0000","last_fullsized":"2023-10-26T06:41:32.020694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641194+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:41:33.641194+0000","last_peered":"2023-10-26T06:41:33.641194+0000","last_clean":"2023-10-26T06:41:33.641194+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:41:33.641194+0000","last_undegraded":"2023-10-26T06:41:33.641194+0000","last_fullsized":"2023-10-26T06:41:33.641194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994464+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:41:34.994464+0000","last_peered":"2023-10-26T06:41:34.994464+0000","last_clean":"2023-10-26T06:41:34.994464+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:41:34.994464+0000","last_undegraded":"2023-10-26T06:41:34.994464+0000","last_fullsized":"2023-10-26T06:41:34.994464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942419+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:41:31.942419+0000","last_peered":"2023-10-26T06:41:31.942419+0000","last_clean":"2023-10-26T06:41:31.942419+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:41:31.942419+0000","last_undegraded":"2023-10-26T06:41:31.942419+0000","last_fullsized":"2023-10-26T06:41:31.942419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.208523+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:41:33.208523+0000","last_peered":"2023-10-26T06:41:33.208523+0000","last_clean":"2023-10-26T06:41:33.208523+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:41:33.208523+0000","last_undegraded":"2023-10-26T06:41:33.208523+0000","last_fullsized":"2023-10-26T06:41:33.208523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640086+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:41:33.640086+0000","last_peered":"2023-10-26T06:41:33.640086+0000","last_clean":"2023-10-26T06:41:33.640086+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:41:33.640086+0000","last_undegraded":"2023-10-26T06:41:33.640086+0000","last_fullsized":"2023-10-26T06:41:33.640086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992870+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:41:33.992870+0000","last_peered":"2023-10-26T06:41:33.992870+0000","last_clean":"2023-10-26T06:41:33.992870+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:41:33.992870+0000","last_undegraded":"2023-10-26T06:41:33.992870+0000","last_fullsized":"2023-10-26T06:41:33.992870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432740+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:41:33.432740+0000","last_peered":"2023-10-26T06:41:33.432740+0000","last_clean":"2023-10-26T06:41:33.432740+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:41:33.432740+0000","last_undegraded":"2023-10-26T06:41:33.432740+0000","last_fullsized":"2023-10-26T06:41:33.432740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996516+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:41:34.996516+0000","last_peered":"2023-10-26T06:41:34.996516+0000","last_clean":"2023-10-26T06:41:34.996516+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:41:34.996516+0000","last_undegraded":"2023-10-26T06:41:34.996516+0000","last_fullsized":"2023-10-26T06:41:34.996516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639975+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:41:33.639975+0000","last_peered":"2023-10-26T06:41:33.639975+0000","last_clean":"2023-10-26T06:41:33.639975+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:41:33.639975+0000","last_undegraded":"2023-10-26T06:41:33.639975+0000","last_fullsized":"2023-10-26T06:41:33.639975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.997042+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:41:34.997042+0000","last_peered":"2023-10-26T06:41:34.997042+0000","last_clean":"2023-10-26T06:41:34.997042+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:41:34.997042+0000","last_undegraded":"2023-10-26T06:41:34.997042+0000","last_fullsized":"2023-10-26T06:41:34.997042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942182+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:41:31.942182+0000","last_peered":"2023-10-26T06:41:31.942182+0000","last_clean":"2023-10-26T06:41:31.942182+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:41:31.942182+0000","last_undegraded":"2023-10-26T06:41:31.942182+0000","last_fullsized":"2023-10-26T06:41:31.942182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640596+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:41:33.640596+0000","last_peered":"2023-10-26T06:41:33.640596+0000","last_clean":"2023-10-26T06:41:33.640596+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:41:33.640596+0000","last_undegraded":"2023-10-26T06:41:33.640596+0000","last_fullsized":"2023-10-26T06:41:33.640596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639814+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:41:33.639814+0000","last_peered":"2023-10-26T06:41:33.639814+0000","last_clean":"2023-10-26T06:41:33.639814+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:41:33.639814+0000","last_undegraded":"2023-10-26T06:41:33.639814+0000","last_fullsized":"2023-10-26T06:41:33.639814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.003583+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:41:36.003583+0000","last_peered":"2023-10-26T06:41:36.003583+0000","last_clean":"2023-10-26T06:41:36.003583+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:41:36.003583+0000","last_undegraded":"2023-10-26T06:41:36.003583+0000","last_fullsized":"2023-10-26T06:41:36.003583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942571+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:41:31.942571+0000","last_peered":"2023-10-26T06:41:31.942571+0000","last_clean":"2023-10-26T06:41:31.942571+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:41:31.942571+0000","last_undegraded":"2023-10-26T06:41:31.942571+0000","last_fullsized":"2023-10-26T06:41:31.942571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991018+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:41:33.991018+0000","last_peered":"2023-10-26T06:41:33.991018+0000","last_clean":"2023-10-26T06:41:33.991018+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:41:33.991018+0000","last_undegraded":"2023-10-26T06:41:33.991018+0000","last_fullsized":"2023-10-26T06:41:33.991018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641143+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:41:33.641143+0000","last_peered":"2023-10-26T06:41:33.641143+0000","last_clean":"2023-10-26T06:41:33.641143+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:41:33.641143+0000","last_undegraded":"2023-10-26T06:41:33.641143+0000","last_fullsized":"2023-10-26T06:41:33.641143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640255+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:41:33.640255+0000","last_peered":"2023-10-26T06:41:33.640255+0000","last_clean":"2023-10-26T06:41:33.640255+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:41:33.640255+0000","last_undegraded":"2023-10-26T06:41:33.640255+0000","last_fullsized":"2023-10-26T06:41:33.640255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942519+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:41:31.942519+0000","last_peered":"2023-10-26T06:41:31.942519+0000","last_clean":"2023-10-26T06:41:31.942519+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:41:31.942519+0000","last_undegraded":"2023-10-26T06:41:31.942519+0000","last_fullsized":"2023-10-26T06:41:31.942519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'18","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:37.525230+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:41:37.525230+0000","last_peered":"2023-10-26T06:41:37.525230+0000","last_clean":"2023-10-26T06:41:37.525230+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:41:37.525230+0000","last_undegraded":"2023-10-26T06:41:37.525230+0000","last_fullsized":"2023-10-26T06:41:37.525230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36285,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":21,"num_write":19,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.433005+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:41:33.433005+0000","last_peered":"2023-10-26T06:41:33.433005+0000","last_clean":"2023-10-26T06:41:33.433005+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:41:33.433005+0000","last_undegraded":"2023-10-26T06:41:33.433005+0000","last_fullsized":"2023-10-26T06:41:33.433005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.995515+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:41:34.995515+0000","last_peered":"2023-10-26T06:41:34.995515+0000","last_clean":"2023-10-26T06:41:34.995515+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:41:34.995515+0000","last_undegraded":"2023-10-26T06:41:34.995515+0000","last_fullsized":"2023-10-26T06:41:34.995515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640487+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:41:33.640487+0000","last_peered":"2023-10-26T06:41:33.640487+0000","last_clean":"2023-10-26T06:41:33.640487+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:41:33.640487+0000","last_undegraded":"2023-10-26T06:41:33.640487+0000","last_fullsized":"2023-10-26T06:41:33.640487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992241+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:41:33.992241+0000","last_peered":"2023-10-26T06:41:33.992241+0000","last_clean":"2023-10-26T06:41:33.992241+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:41:33.992241+0000","last_undegraded":"2023-10-26T06:41:33.992241+0000","last_fullsized":"2023-10-26T06:41:33.992241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552190+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:41:32.552190+0000","last_peered":"2023-10-26T06:41:32.552190+0000","last_clean":"2023-10-26T06:41:32.552190+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:41:32.552190+0000","last_undegraded":"2023-10-26T06:41:32.552190+0000","last_fullsized":"2023-10-26T06:41:32.552190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:38.012225+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:41:38.012225+0000","last_peered":"2023-10-26T06:41:38.012225+0000","last_clean":"2023-10-26T06:41:38.012225+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:41:38.012225+0000","last_undegraded":"2023-10-26T06:41:38.012225+0000","last_fullsized":"2023-10-26T06:41:38.012225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551861+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:41:32.551861+0000","last_peered":"2023-10-26T06:41:32.551861+0000","last_clean":"2023-10-26T06:41:32.551861+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:41:32.551861+0000","last_undegraded":"2023-10-26T06:41:32.551861+0000","last_fullsized":"2023-10-26T06:41:32.551861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996700+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:41:34.996700+0000","last_peered":"2023-10-26T06:41:34.996700+0000","last_clean":"2023-10-26T06:41:34.996700+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:41:34.996700+0000","last_undegraded":"2023-10-26T06:41:34.996700+0000","last_fullsized":"2023-10-26T06:41:34.996700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639977+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:41:33.639977+0000","last_peered":"2023-10-26T06:41:33.639977+0000","last_clean":"2023-10-26T06:41:33.639977+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:41:33.639977+0000","last_undegraded":"2023-10-26T06:41:33.639977+0000","last_fullsized":"2023-10-26T06:41:33.639977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.005443+0000","last_change":"2023-10-26T06:41:29.962764+0000","last_active":"2023-10-26T06:41:36.005443+0000","last_peered":"2023-10-26T06:41:36.005443+0000","last_clean":"2023-10-26T06:41:36.005443+0000","last_became_active":"2023-10-26T06:41:29.962245+0000","last_became_peered":"2023-10-26T06:41:29.962245+0000","last_unstale":"2023-10-26T06:41:36.005443+0000","last_undegraded":"2023-10-26T06:41:36.005443+0000","last_fullsized":"2023-10-26T06:41:36.005443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:33:21.800233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640386+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:41:33.640386+0000","last_peered":"2023-10-26T06:41:33.640386+0000","last_clean":"2023-10-26T06:41:33.640386+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:41:33.640386+0000","last_undegraded":"2023-10-26T06:41:33.640386+0000","last_fullsized":"2023-10-26T06:41:33.640386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.942650+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:41:30.942650+0000","last_peered":"2023-10-26T06:41:30.942650+0000","last_clean":"2023-10-26T06:41:30.942650+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:41:30.942650+0000","last_undegraded":"2023-10-26T06:41:30.942650+0000","last_fullsized":"2023-10-26T06:41:30.942650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640019+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:41:33.640019+0000","last_peered":"2023-10-26T06:41:33.640019+0000","last_clean":"2023-10-26T06:41:33.640019+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:41:33.640019+0000","last_undegraded":"2023-10-26T06:41:33.640019+0000","last_fullsized":"2023-10-26T06:41:33.640019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675117+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:41:33.675117+0000","last_peered":"2023-10-26T06:41:33.675117+0000","last_clean":"2023-10-26T06:41:33.675117+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:41:33.675117+0000","last_undegraded":"2023-10-26T06:41:33.675117+0000","last_fullsized":"2023-10-26T06:41:33.675117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639719+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:41:33.639719+0000","last_peered":"2023-10-26T06:41:33.639719+0000","last_clean":"2023-10-26T06:41:33.639719+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:41:33.639719+0000","last_undegraded":"2023-10-26T06:41:33.639719+0000","last_fullsized":"2023-10-26T06:41:33.639719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640746+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:41:33.640746+0000","last_peered":"2023-10-26T06:41:33.640746+0000","last_clean":"2023-10-26T06:41:33.640746+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:41:33.640746+0000","last_undegraded":"2023-10-26T06:41:33.640746+0000","last_fullsized":"2023-10-26T06:41:33.640746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.997901+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:41:34.997901+0000","last_peered":"2023-10-26T06:41:34.997901+0000","last_clean":"2023-10-26T06:41:34.997901+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:41:34.997901+0000","last_undegraded":"2023-10-26T06:41:34.997901+0000","last_fullsized":"2023-10-26T06:41:34.997901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942453+0000","last_change":"2023-10-26T06:41:30.946148+0000","last_active":"2023-10-26T06:41:31.942453+0000","last_peered":"2023-10-26T06:41:31.942453+0000","last_clean":"2023-10-26T06:41:31.942453+0000","last_became_active":"2023-10-26T06:41:30.945835+0000","last_became_peered":"2023-10-26T06:41:30.945835+0000","last_unstale":"2023-10-26T06:41:31.942453+0000","last_undegraded":"2023-10-26T06:41:31.942453+0000","last_fullsized":"2023-10-26T06:41:31.942453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:29:50.330144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.002428+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:41:36.002428+0000","last_peered":"2023-10-26T06:41:36.002428+0000","last_clean":"2023-10-26T06:41:36.002428+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:41:36.002428+0000","last_undegraded":"2023-10-26T06:41:36.002428+0000","last_fullsized":"2023-10-26T06:41:36.002428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.939903+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:41:30.939903+0000","last_peered":"2023-10-26T06:41:30.939903+0000","last_clean":"2023-10-26T06:41:30.939903+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:41:30.939903+0000","last_undegraded":"2023-10-26T06:41:30.939903+0000","last_fullsized":"2023-10-26T06:41:30.939903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639481+0000","last_change":"2023-10-26T06:41:30.954040+0000","last_active":"2023-10-26T06:41:33.639481+0000","last_peered":"2023-10-26T06:41:33.639481+0000","last_clean":"2023-10-26T06:41:33.639481+0000","last_became_active":"2023-10-26T06:41:30.953367+0000","last_became_peered":"2023-10-26T06:41:30.953367+0000","last_unstale":"2023-10-26T06:41:33.639481+0000","last_undegraded":"2023-10-26T06:41:33.639481+0000","last_fullsized":"2023-10-26T06:41:33.639481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:17:37.442177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994555+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:41:34.994555+0000","last_peered":"2023-10-26T06:41:34.994555+0000","last_clean":"2023-10-26T06:41:34.994555+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:41:34.994555+0000","last_undegraded":"2023-10-26T06:41:34.994555+0000","last_fullsized":"2023-10-26T06:41:34.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991384+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:41:33.991384+0000","last_peered":"2023-10-26T06:41:33.991384+0000","last_clean":"2023-10-26T06:41:33.991384+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:41:33.991384+0000","last_undegraded":"2023-10-26T06:41:33.991384+0000","last_fullsized":"2023-10-26T06:41:33.991384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640145+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:41:33.640145+0000","last_peered":"2023-10-26T06:41:33.640145+0000","last_clean":"2023-10-26T06:41:33.640145+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:41:33.640145+0000","last_undegraded":"2023-10-26T06:41:33.640145+0000","last_fullsized":"2023-10-26T06:41:33.640145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996709+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:41:34.996709+0000","last_peered":"2023-10-26T06:41:34.996709+0000","last_clean":"2023-10-26T06:41:34.996709+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:41:34.996709+0000","last_undegraded":"2023-10-26T06:41:34.996709+0000","last_fullsized":"2023-10-26T06:41:34.996709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942707+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:41:31.942707+0000","last_peered":"2023-10-26T06:41:31.942707+0000","last_clean":"2023-10-26T06:41:31.942707+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:41:31.942707+0000","last_undegraded":"2023-10-26T06:41:31.942707+0000","last_fullsized":"2023-10-26T06:41:31.942707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991181+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:41:33.991181+0000","last_peered":"2023-10-26T06:41:33.991181+0000","last_clean":"2023-10-26T06:41:33.991181+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:41:33.991181+0000","last_undegraded":"2023-10-26T06:41:33.991181+0000","last_fullsized":"2023-10-26T06:41:33.991181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641086+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:41:33.641086+0000","last_peered":"2023-10-26T06:41:33.641086+0000","last_clean":"2023-10-26T06:41:33.641086+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:41:33.641086+0000","last_undegraded":"2023-10-26T06:41:33.641086+0000","last_fullsized":"2023-10-26T06:41:33.641086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991058+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:41:33.991058+0000","last_peered":"2023-10-26T06:41:33.991058+0000","last_clean":"2023-10-26T06:41:33.991058+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:41:33.991058+0000","last_undegraded":"2023-10-26T06:41:33.991058+0000","last_fullsized":"2023-10-26T06:41:33.991058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432711+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:41:33.432711+0000","last_peered":"2023-10-26T06:41:33.432711+0000","last_clean":"2023-10-26T06:41:33.432711+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:41:33.432711+0000","last_undegraded":"2023-10-26T06:41:33.432711+0000","last_fullsized":"2023-10-26T06:41:33.432711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991075+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:41:33.991075+0000","last_peered":"2023-10-26T06:41:33.991075+0000","last_clean":"2023-10-26T06:41:33.991075+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:41:33.991075+0000","last_undegraded":"2023-10-26T06:41:33.991075+0000","last_fullsized":"2023-10-26T06:41:33.991075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639521+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:41:33.639521+0000","last_peered":"2023-10-26T06:41:33.639521+0000","last_clean":"2023-10-26T06:41:33.639521+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:41:33.639521+0000","last_undegraded":"2023-10-26T06:41:33.639521+0000","last_fullsized":"2023-10-26T06:41:33.639521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946651+0000","last_change":"2023-10-26T06:41:29.957155+0000","last_active":"2023-10-26T06:41:31.946651+0000","last_peered":"2023-10-26T06:41:31.946651+0000","last_clean":"2023-10-26T06:41:31.946651+0000","last_became_active":"2023-10-26T06:41:29.956740+0000","last_became_peered":"2023-10-26T06:41:29.956740+0000","last_unstale":"2023-10-26T06:41:31.946651+0000","last_undegraded":"2023-10-26T06:41:31.946651+0000","last_fullsized":"2023-10-26T06:41:31.946651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:14:27.826402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942335+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:41:31.942335+0000","last_peered":"2023-10-26T06:41:31.942335+0000","last_clean":"2023-10-26T06:41:31.942335+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:41:31.942335+0000","last_undegraded":"2023-10-26T06:41:31.942335+0000","last_fullsized":"2023-10-26T06:41:31.942335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991813+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:41:33.991813+0000","last_peered":"2023-10-26T06:41:33.991813+0000","last_clean":"2023-10-26T06:41:33.991813+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:41:33.991813+0000","last_undegraded":"2023-10-26T06:41:33.991813+0000","last_fullsized":"2023-10-26T06:41:33.991813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552153+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:41:32.552153+0000","last_peered":"2023-10-26T06:41:32.552153+0000","last_clean":"2023-10-26T06:41:32.552153+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:41:32.552153+0000","last_undegraded":"2023-10-26T06:41:32.552153+0000","last_fullsized":"2023-10-26T06:41:32.552153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994673+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:41:34.994673+0000","last_peered":"2023-10-26T06:41:34.994673+0000","last_clean":"2023-10-26T06:41:34.994673+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:41:34.994673+0000","last_undegraded":"2023-10-26T06:41:34.994673+0000","last_fullsized":"2023-10-26T06:41:34.994673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552239+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:41:32.552239+0000","last_peered":"2023-10-26T06:41:32.552239+0000","last_clean":"2023-10-26T06:41:32.552239+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:41:32.552239+0000","last_undegraded":"2023-10-26T06:41:32.552239+0000","last_fullsized":"2023-10-26T06:41:32.552239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.972588+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:41:30.972588+0000","last_peered":"2023-10-26T06:41:30.972588+0000","last_clean":"2023-10-26T06:41:30.972588+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:41:30.972588+0000","last_undegraded":"2023-10-26T06:41:30.972588+0000","last_fullsized":"2023-10-26T06:41:30.972588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675149+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:41:33.675149+0000","last_peered":"2023-10-26T06:41:33.675149+0000","last_clean":"2023-10-26T06:41:33.675149+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:41:33.675149+0000","last_undegraded":"2023-10-26T06:41:33.675149+0000","last_fullsized":"2023-10-26T06:41:33.675149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.054027+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:41:31.054027+0000","last_peered":"2023-10-26T06:41:31.054027+0000","last_clean":"2023-10-26T06:41:31.054027+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:41:31.054027+0000","last_undegraded":"2023-10-26T06:41:31.054027+0000","last_fullsized":"2023-10-26T06:41:31.054027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552218+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:41:32.552218+0000","last_peered":"2023-10-26T06:41:32.552218+0000","last_clean":"2023-10-26T06:41:32.552218+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:41:32.552218+0000","last_undegraded":"2023-10-26T06:41:32.552218+0000","last_fullsized":"2023-10-26T06:41:32.552218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639593+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:41:33.639593+0000","last_peered":"2023-10-26T06:41:33.639593+0000","last_clean":"2023-10-26T06:41:33.639593+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:41:33.639593+0000","last_undegraded":"2023-10-26T06:41:33.639593+0000","last_fullsized":"2023-10-26T06:41:33.639593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946627+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:41:31.946627+0000","last_peered":"2023-10-26T06:41:31.946627+0000","last_clean":"2023-10-26T06:41:31.946627+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:41:31.946627+0000","last_undegraded":"2023-10-26T06:41:31.946627+0000","last_fullsized":"2023-10-26T06:41:31.946627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946633+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:41:31.946633+0000","last_peered":"2023-10-26T06:41:31.946633+0000","last_clean":"2023-10-26T06:41:31.946633+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:41:31.946633+0000","last_undegraded":"2023-10-26T06:41:31.946633+0000","last_fullsized":"2023-10-26T06:41:31.946633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640660+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:41:33.640660+0000","last_peered":"2023-10-26T06:41:33.640660+0000","last_clean":"2023-10-26T06:41:33.640660+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:41:33.640660+0000","last_undegraded":"2023-10-26T06:41:33.640660+0000","last_fullsized":"2023-10-26T06:41:33.640660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640677+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:41:33.640677+0000","last_peered":"2023-10-26T06:41:33.640677+0000","last_clean":"2023-10-26T06:41:33.640677+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:41:33.640677+0000","last_undegraded":"2023-10-26T06:41:33.640677+0000","last_fullsized":"2023-10-26T06:41:33.640677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639806+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:41:33.639806+0000","last_peered":"2023-10-26T06:41:33.639806+0000","last_clean":"2023-10-26T06:41:33.639806+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:41:33.639806+0000","last_undegraded":"2023-10-26T06:41:33.639806+0000","last_fullsized":"2023-10-26T06:41:33.639806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946954+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:41:31.946954+0000","last_peered":"2023-10-26T06:41:31.946954+0000","last_clean":"2023-10-26T06:41:31.946954+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:41:31.946954+0000","last_undegraded":"2023-10-26T06:41:31.946954+0000","last_fullsized":"2023-10-26T06:41:31.946954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942673+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:41:31.942673+0000","last_peered":"2023-10-26T06:41:31.942673+0000","last_clean":"2023-10-26T06:41:31.942673+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:41:31.942673+0000","last_undegraded":"2023-10-26T06:41:31.942673+0000","last_fullsized":"2023-10-26T06:41:31.942673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640616+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:41:33.640616+0000","last_peered":"2023-10-26T06:41:33.640616+0000","last_clean":"2023-10-26T06:41:33.640616+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:41:33.640616+0000","last_undegraded":"2023-10-26T06:41:33.640616+0000","last_fullsized":"2023-10-26T06:41:33.640616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942404+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:41:31.942404+0000","last_peered":"2023-10-26T06:41:31.942404+0000","last_clean":"2023-10-26T06:41:31.942404+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:41:31.942404+0000","last_undegraded":"2023-10-26T06:41:31.942404+0000","last_fullsized":"2023-10-26T06:41:31.942404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942522+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:41:31.942522+0000","last_peered":"2023-10-26T06:41:31.942522+0000","last_clean":"2023-10-26T06:41:31.942522+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:41:31.942522+0000","last_undegraded":"2023-10-26T06:41:31.942522+0000","last_fullsized":"2023-10-26T06:41:31.942522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640293+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:41:33.640293+0000","last_peered":"2023-10-26T06:41:33.640293+0000","last_clean":"2023-10-26T06:41:33.640293+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:41:33.640293+0000","last_undegraded":"2023-10-26T06:41:33.640293+0000","last_fullsized":"2023-10-26T06:41:33.640293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639807+0000","last_change":"2023-10-26T06:41:30.948857+0000","last_active":"2023-10-26T06:41:33.639807+0000","last_peered":"2023-10-26T06:41:33.639807+0000","last_clean":"2023-10-26T06:41:33.639807+0000","last_became_active":"2023-10-26T06:41:30.948505+0000","last_became_peered":"2023-10-26T06:41:30.948505+0000","last_unstale":"2023-10-26T06:41:33.639807+0000","last_undegraded":"2023-10-26T06:41:33.639807+0000","last_fullsized":"2023-10-26T06:41:33.639807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:11:47.908249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40285,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":26,"num_read_kb":36,"num_write":136,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":91364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416398,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":445170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645329,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1055693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.438}]},{"osd":5,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61199999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.87},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.78400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":445406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.90800000000000003}]},{"osd":8,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.79800000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.755}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":445326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82499999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.751}]},{"osd":2,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.497},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3759999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.91900000000000004,"15min":0.94399999999999995},"min":{"1min":0.61499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.075,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1}]},{"osd":10,"last update":"Thu Oct 26 06:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.96199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299423,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1037261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41399999999999998},"min":{"1min":0.29799999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.39800000000000002},"min":{"1min":0.28000000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.41899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.42499999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.62},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.46800000000000003},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.59999999999999998,"15min":0.58799999999999997},"min":{"1min":0.45800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.751}]},{"osd":6,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71399999999999997,"15min":0.70299999999999996},"min":{"1min":0.55800000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51700000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.71599999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86099999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":6,"up_from":47,"seq":201863462947,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":444678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.41499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.45300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.499,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.51600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":1.026,"15min":1.026},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.754,"15min":0.748},"min":{"1min":0.61699999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.127,"15min":1.127},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.012,"5min":1.038,"15min":1.038},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76800000000000002,"15min":0.75900000000000001},"min":{"1min":0.626,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0209999999999999,"5min":1.133,"15min":1.133},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66900000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:40:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Oct 26 06:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.748},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69699999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.78300000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":480873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.501,"15min":0.49299999999999999},"min":{"1min":0.377,"5min":0.309,"15min":0.309},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.497}]},{"osd":4,"last update":"Thu Oct 26 06:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.371,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.442}]},{"osd":5,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.625}]},{"osd":7,"last update":"Thu Oct 26 06:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.51500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71199999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79700000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.76100000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":446066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.47799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.61299999999999999,"15min":0.56499999999999995},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.65200000000000002,"15min":0.59899999999999998},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.67100000000000004,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.873}]},{"osd":3,"last update":"Thu Oct 26 06:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.63500000000000001,"15min":0.60999999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.67700000000000005,"15min":0.63100000000000001},"min":{"1min":0.49399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Oct 26 06:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.441,"15min":0.441},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.61099999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.70799999999999996,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.77000000000000002,"15min":0.76000000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.99099999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.0269999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.105},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.98099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378679,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":446856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.51300000000000001},"min":{"1min":0.435,"5min":0.254,"15min":0.254},"max":{"1min":0.84199999999999997,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.622},"min":{"1min":0.378,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.149,"5min":2.371,"15min":2.371},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86599999999999999,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77300000000000002,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.66400000000000003,"15min":0.70699999999999996},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.181,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85099999999999998,"5min":2.282,"15min":2.282},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63100000000000001,"15min":0.64800000000000002},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81100000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":1.044},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.55300000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85899999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":1.093},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.2450000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":3,"up_from":26,"seq":111669149746,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":444995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.35099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.751,"5min":1.069,"15min":1.069},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.46100000000000002,"15min":0.433},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.374,"15min":0.374},"max":{"1min":0.92900000000000005,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.61799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66000000000000003,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.69399999999999995,"15min":0.64700000000000002},"min":{"1min":0.60099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.68899999999999995,"15min":0.66000000000000003},"min":{"1min":0.56100000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.73499999999999999,"15min":0.68899999999999995},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.67800000000000005,"15min":0.64800000000000002},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.628},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.64600000000000002,"15min":0.623},"min":{"1min":0.44,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.66800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.71999999999999997,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.64100000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:41:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.59899999999999998}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.82499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":4,"up_from":34,"seq":146028888110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":445622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.38100000000000001,"15min":0.35599999999999998},"min":{"1min":0.32100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39100000000000001,"15min":0.372},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.877,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.47799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55900000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.84099999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.745}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1523712,"data_stored":1036101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":5.819,"15min":5.819},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.751,"5min":5.835,"15min":5.835},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.872}]},{"osd":6,"last update":"Thu Oct 26 06:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.38600000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84299999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85499999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.83499999999999996}]},{"osd":8,"last update":"Thu Oct 26 06:40:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.96299999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.79800000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.02},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.90600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:41:40.177 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-26T06:41:40.178 INFO:tasks.cephadm:Setting up client nodes... 2023-10-26T06:41:40.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-26T06:41:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:40 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/162334208' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:40 smithi050 ceph-mon[94997]: pgmap v257: 97 pgs: 97 active+clean; 616 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8.7 KiB/s wr, 18 op/s 2023-10-26T06:41:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:40 smithi050 ceph-mon[94997]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:41:40.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:40 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/162334208' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:40.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:40 smithi125 ceph-mon[130643]: pgmap v257: 97 pgs: 97 active+clean; 616 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8.7 KiB/s wr, 18 op/s 2023-10-26T06:41:40.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:40 smithi125 ceph-mon[130643]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:41:40.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:40 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/162334208' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:40 smithi153 ceph-mon[131657]: pgmap v257: 97 pgs: 97 active+clean; 616 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8.7 KiB/s wr, 18 op/s 2023-10-26T06:41:40.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:40 smithi153 ceph-mon[131657]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:41:40.949 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:41 smithi050 ceph-mon[94997]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:41:41.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:41 smithi125 ceph-mon[130643]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:41:41.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:41 smithi153 ceph-mon[131657]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:41:42.208 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:42 smithi050 ceph-mon[94997]: pgmap v258: 97 pgs: 97 active+clean; 616 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2023-10-26T06:41:42.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:42 smithi125 ceph-mon[130643]: pgmap v258: 97 pgs: 97 active+clean; 616 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2023-10-26T06:41:42.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.468+0000 7fc7e9d56700 1 -- 172.21.15.50:0/1318742468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 msgr2=0x7fc7e410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.468+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/1318742468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e410d610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b0a0 tx=0x7fc7dc00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 -- 172.21.15.50:0/1318742468 shutdown_connections 2023-10-26T06:41:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/1318742468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e410d610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/1318742468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7e4105680 0x7fc7e4105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/1318742468 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7e41008a0 0x7fc7e4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 -- 172.21.15.50:0/1318742468 >> 172.21.15.50:0/1318742468 conn(0x7fc7e4077950 msgr2=0x7fc7e4077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 -- 172.21.15.50:0/1318742468 shutdown_connections 2023-10-26T06:41:42.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.469+0000 7fc7e9d56700 1 -- 172.21.15.50:0/1318742468 wait complete. 2023-10-26T06:41:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 Processor -- start 2023-10-26T06:41:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 -- start start 2023-10-26T06:41:42.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7e41008a0 0x7fc7e4196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e4197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7e4105680 0x7fc7e419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e419ab40 con 0x7fc7e4101260 2023-10-26T06:41:42.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e419acb0 con 0x7fc7e4105680 2023-10-26T06:41:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e9d56700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e419ae70 con 0x7fc7e41008a0 2023-10-26T06:41:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e4197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e4197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41620/0 (socket says 172.21.15.50:41620) 2023-10-26T06:41:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.470+0000 7fc7e2ffd700 1 -- 172.21.15.50:0/2343620775 learned_addr learned my addr 172.21.15.50:0/2343620775 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e37fe700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7e41008a0 0x7fc7e4196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e3fff700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7e4105680 0x7fc7e419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e2ffd700 1 -- 172.21.15.50:0/2343620775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7e41008a0 msgr2=0x7fc7e4196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e2ffd700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7e41008a0 0x7fc7e4196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e2ffd700 1 -- 172.21.15.50:0/2343620775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7e4105680 msgr2=0x7fc7e419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:42.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e2ffd700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7e4105680 0x7fc7e419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e2ffd700 1 -- 172.21.15.50:0/2343620775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009d00 con 0x7fc7e4101260 2023-10-26T06:41:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e2ffd700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e4197240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800e9a0 tx=0x7fc7d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8009790 con 0x7fc7e4101260 2023-10-26T06:41:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d8010430 con 0x7fc7e4101260 2023-10-26T06:41:42.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8018680 con 0x7fc7e4101260 2023-10-26T06:41:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.471+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e419b150 con 0x7fc7e4101260 2023-10-26T06:41:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.472+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e41a3aa0 con 0x7fc7e4101260 2023-10-26T06:41:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.473+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4108cf0 con 0x7fc7e4101260 2023-10-26T06:41:42.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.474+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc7d80105a0 con 0x7fc7e4101260 2023-10-26T06:41:42.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.476+0000 7fc7e0ff9700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc7cc0a15e0 0x7fc7cc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:42.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.476+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc7d8014070 con 0x7fc7e4101260 2023-10-26T06:41:42.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.476+0000 7fc7e37fe700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc7cc0a15e0 0x7fc7cc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:42.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.477+0000 7fc7e37fe700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc7cc0a15e0 0x7fc7cc0a3aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009be0 tx=0x7fc7d4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:42.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.480+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc7d8096540 con 0x7fc7e4101260 2023-10-26T06:41:42.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:42 smithi153 ceph-mon[131657]: pgmap v258: 97 pgs: 97 active+clean; 616 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2023-10-26T06:41:42.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.774+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc7e4197fd0 con 0x7fc7e4101260 2023-10-26T06:41:42.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.776+0000 7fc7e0ff9700 1 -- 172.21.15.50:0/2343620775 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc7d8099b60 con 0x7fc7e4101260 2023-10-26T06:41:42.778 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-10-26T06:41:42.778 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAmCjploN9ALhAA9f8WQh+/9w/Hhv9SZ0eXlw== 2023-10-26T06:41:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc7cc0a15e0 msgr2=0x7fc7cc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc7cc0a15e0 0x7fc7cc0a3aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009be0 tx=0x7fc7d4009260 comp rx=0 tx=0).stop 2023-10-26T06:41:42.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 msgr2=0x7fc7e4197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e4197240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800e9a0 tx=0x7fc7d800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 shutdown_connections 2023-10-26T06:41:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc7cc0a15e0 0x7fc7cc0a3aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7e4105680 0x7fc7e419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7e41008a0 0x7fc7e4196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 --2- 172.21.15.50:0/2343620775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7e4101260 0x7fc7e4197240 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:42.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 >> 172.21.15.50:0/2343620775 conn(0x7fc7e4077950 msgr2=0x7fc7e40fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 shutdown_connections 2023-10-26T06:41:42.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:42.780+0000 7fc7e9d56700 1 -- 172.21.15.50:0/2343620775 wait complete. 2023-10-26T06:41:43.211 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:43 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2343620775' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-26T06:41:43.212 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:43 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2343620775' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-26T06:41:43.239 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:41:43.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-26T06:41:43.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-26T06:41:43.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-26T06:41:43.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:43 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2343620775' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-26T06:41:43.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:43 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2343620775' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-26T06:41:43.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:43 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2343620775' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-26T06:41:43.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:43 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2343620775' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-26T06:41:44.129 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:44 smithi125 ceph-mon[130643]: pgmap v259: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2023-10-26T06:41:44.427 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:44 smithi050 ceph-mon[94997]: pgmap v259: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2023-10-26T06:41:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:44 smithi153 ceph-mon[131657]: pgmap v259: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.1 KiB/s wr, 16 op/s 2023-10-26T06:41:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.644+0000 7f2fcba3c700 1 -- 172.21.15.50:0/665944290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 msgr2=0x7f2fc410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.644+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/665944290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc410d650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00b0a0 tx=0x7f2fbc00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 -- 172.21.15.50:0/665944290 shutdown_connections 2023-10-26T06:41:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/665944290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc410d650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/665944290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 0x7f2fc4105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/665944290 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fc41008a0 0x7f2fc4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 -- 172.21.15.50:0/665944290 >> 172.21.15.50:0/665944290 conn(0x7f2fc40779e0 msgr2=0x7f2fc4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 -- 172.21.15.50:0/665944290 shutdown_connections 2023-10-26T06:41:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.645+0000 7f2fcba3c700 1 -- 172.21.15.50:0/665944290 wait complete. 2023-10-26T06:41:45.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.646+0000 7f2fcba3c700 1 Processor -- start 2023-10-26T06:41:45.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.646+0000 7f2fcba3c700 1 -- start start 2023-10-26T06:41:45.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fcba3c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fc41008a0 0x7f2fc4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:45.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fcba3c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:45.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fcba3c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 0x7f2fc4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:45.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fcba3c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41a5090 con 0x7f2fc4101260 2023-10-26T06:41:45.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fcba3c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41a5200 con 0x7f2fc41008a0 2023-10-26T06:41:45.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fcba3c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41a53c0 con 0x7f2fc41057c0 2023-10-26T06:41:45.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:45.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc4073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38962/0 (socket says 172.21.15.50:38962) 2023-10-26T06:41:45.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 -- 172.21.15.50:0/2787824629 learned_addr learned my addr 172.21.15.50:0/2787824629 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:45.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc9fd9700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 0x7f2fc4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:45.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc97d8700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fc41008a0 0x7f2fc4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:45.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 -- 172.21.15.50:0/2787824629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 msgr2=0x7f2fc4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:45.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 0x7f2fc4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 -- 172.21.15.50:0/2787824629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fc41008a0 msgr2=0x7f2fc4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:45.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fc41008a0 0x7f2fc4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc8fd7700 1 -- 172.21.15.50:0/2787824629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009d00 con 0x7f2fc4101260 2023-10-26T06:41:45.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.647+0000 7f2fc9fd9700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 0x7f2fc4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:41:45.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.648+0000 7f2fc8fd7700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc4073030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400e9a0 tx=0x7f2fb400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:45.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.648+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4009790 con 0x7f2fc4101260 2023-10-26T06:41:45.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.648+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fb4010430 con 0x7f2fc4101260 2023-10-26T06:41:45.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.648+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4018680 con 0x7f2fc4101260 2023-10-26T06:41:45.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.648+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc41a56a0 con 0x7f2fc4101260 2023-10-26T06:41:45.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.648+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc41a5ba0 con 0x7f2fc4101260 2023-10-26T06:41:45.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.649+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4108da0 con 0x7f2fc4101260 2023-10-26T06:41:45.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.651+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f2fb40105a0 con 0x7f2fc4101260 2023-10-26T06:41:45.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.652+0000 7f2fba7fc700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2fb00a15e0 0x7f2fb00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:45.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.653+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f2fb4014070 con 0x7f2fc4101260 2023-10-26T06:41:45.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.653+0000 7f2fc97d8700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2fb00a15e0 0x7f2fb00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:45.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.653+0000 7f2fc97d8700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2fb00a15e0 0x7f2fb00a3aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4101930 tx=0x7f2fc0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:45.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.655+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2fb4096780 con 0x7f2fc4101260 2023-10-26T06:41:45.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.869+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f2fc4101f30 con 0x7f2fc4101260 2023-10-26T06:41:45.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.869+0000 7f2fba7fc700 1 -- 172.21.15.50:0/2787824629 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7f2fb4026070 con 0x7f2fc4101260 2023-10-26T06:41:45.871 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.871+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2fb00a15e0 msgr2=0x7f2fb00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:45.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.871+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2fb00a15e0 0x7f2fb00a3aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4101930 tx=0x7f2fc0009260 comp rx=0 tx=0).stop 2023-10-26T06:41:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.871+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 msgr2=0x7f2fc4073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.871+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc4073030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400e9a0 tx=0x7f2fb400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 shutdown_connections 2023-10-26T06:41:45.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2fb00a15e0 0x7f2fb00a3aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fc41057c0 0x7f2fc4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fc41008a0 0x7f2fc4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 --2- 172.21.15.50:0/2787824629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fc4101260 0x7f2fc4073030 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 >> 172.21.15.50:0/2787824629 conn(0x7f2fc40779e0 msgr2=0x7f2fc40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:45.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 shutdown_connections 2023-10-26T06:41:45.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:45.872+0000 7f2fcba3c700 1 -- 172.21.15.50:0/2787824629 wait complete. 2023-10-26T06:41:46.415 INFO:teuthology.orchestra.run.smithi050.stdout:[{"version":46,"timestamp":"2023-10-26T06:41:24.585923+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-26T06:41:46.416 INFO:tasks.ceph_manager:config epoch is 46 2023-10-26T06:41:46.416 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-26T06:41:46.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-26T06:41:46.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-26T06:41:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:46 smithi153 ceph-mon[131657]: pgmap v260: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 KiB/s wr, 14 op/s 2023-10-26T06:41:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:46 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2787824629' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-26T06:41:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:46 smithi050 ceph-mon[94997]: pgmap v260: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 KiB/s wr, 14 op/s 2023-10-26T06:41:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:46 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2787824629' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-26T06:41:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:46 smithi125 ceph-mon[130643]: pgmap v260: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 KiB/s wr, 14 op/s 2023-10-26T06:41:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:46 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2787824629' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-26T06:41:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 -- 172.21.15.50:0/2612758286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581057c0 msgr2=0x7f9f58105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2612758286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581057c0 0x7f9f58105ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009990 tx=0x7f9f54009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 -- 172.21.15.50:0/2612758286 shutdown_connections 2023-10-26T06:41:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2612758286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f58101260 0x7f9f5810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2612758286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581057c0 0x7f9f58105ba0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2612758286 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f581008a0 0x7f9f58100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 -- 172.21.15.50:0/2612758286 >> 172.21.15.50:0/2612758286 conn(0x7f9f580779e0 msgr2=0x7f9f58077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 -- 172.21.15.50:0/2612758286 shutdown_connections 2023-10-26T06:41:48.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.691+0000 7f9f601ca700 1 -- 172.21.15.50:0/2612758286 wait complete. 2023-10-26T06:41:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.692+0000 7f9f601ca700 1 Processor -- start 2023-10-26T06:41:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.692+0000 7f9f601ca700 1 -- start start 2023-10-26T06:41:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f601ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 0x7f9f5819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f601ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f58101260 0x7f9f5819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f601ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f581057c0 0x7f9f58196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f601ca700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f581970e0 con 0x7f9f581008a0 2023-10-26T06:41:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f601ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58197250 con 0x7f9f581057c0 2023-10-26T06:41:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f601ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58197410 con 0x7f9f58101260 2023-10-26T06:41:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 0x7f9f5819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 0x7f9f5819c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38974/0 (socket says 172.21.15.50:38974) 2023-10-26T06:41:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 -- 172.21.15.50:0/2575078202 learned_addr learned my addr 172.21.15.50:0/2575078202 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5e767700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f581057c0 0x7f9f58196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5d765700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f58101260 0x7f9f5819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 -- 172.21.15.50:0/2575078202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f58101260 msgr2=0x7f9f5819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f58101260 0x7f9f5819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 -- 172.21.15.50:0/2575078202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f581057c0 msgr2=0x7f9f58196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f581057c0 0x7f9f58196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.693+0000 7f9f5df66700 1 -- 172.21.15.50:0/2575078202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f540095f0 con 0x7f9f581008a0 2023-10-26T06:41:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.694+0000 7f9f5df66700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 0x7f9f5819c940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000c00 tx=0x7f9f54005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:48.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.694+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5401d070 con 0x7f9f581008a0 2023-10-26T06:41:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.694+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f54022470 con 0x7f9f581008a0 2023-10-26T06:41:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.694+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54017650 con 0x7f9f581008a0 2023-10-26T06:41:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.694+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f58197690 con 0x7f9f581008a0 2023-10-26T06:41:48.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.694+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f581a3930 con 0x7f9f581008a0 2023-10-26T06:41:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.695+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f58108d80 con 0x7f9f581008a0 2023-10-26T06:41:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.697+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f9f5400fad0 con 0x7f9f581008a0 2023-10-26T06:41:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.698+0000 7f9f4effd700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f440a1560 0x7f9f440a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.699+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f9f540ce990 con 0x7f9f581008a0 2023-10-26T06:41:48.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.699+0000 7f9f5d765700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f440a1560 0x7f9f440a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.699+0000 7f9f5d765700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f440a1560 0x7f9f440a3a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f58197c40 tx=0x7f9f48009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:48.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.701+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f54097ee0 con 0x7f9f581008a0 2023-10-26T06:41:48.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:48 smithi050 ceph-mon[94997]: pgmap v261: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2023-10-26T06:41:48.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.971+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9f58101f30 con 0x7f9f581008a0 2023-10-26T06:41:48.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.976+0000 7f9f4effd700 1 -- 172.21.15.50:0/2575078202 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+260422 (secure 0 0 0) 0x7f9f54027090 con 0x7f9f581008a0 2023-10-26T06:41:48.980 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:48.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:48 smithi153 ceph-mon[131657]: pgmap v261: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2023-10-26T06:41:48.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f440a1560 msgr2=0x7f9f440a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:48.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f440a1560 0x7f9f440a3a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f58197c40 tx=0x7f9f48009260 comp rx=0 tx=0).stop 2023-10-26T06:41:48.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 msgr2=0x7f9f5819c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:48.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 0x7f9f5819c940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000c00 tx=0x7f9f54005740 comp rx=0 tx=0).stop 2023-10-26T06:41:48.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 shutdown_connections 2023-10-26T06:41:48.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f440a1560 0x7f9f440a3a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f581057c0 0x7f9f58196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f581008a0 0x7f9f5819c940 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 --2- 172.21.15.50:0/2575078202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f58101260 0x7f9f5819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:48.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 >> 172.21.15.50:0/2575078202 conn(0x7f9f580779e0 msgr2=0x7f9f580fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:48.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 shutdown_connections 2023-10-26T06:41:48.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:48.981+0000 7f9f601ca700 1 -- 172.21.15.50:0/2575078202 wait complete. 2023-10-26T06:41:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:48 smithi125 ceph-mon[130643]: pgmap v261: 97 pgs: 97 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2023-10-26T06:41:49.453 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":21,"active_gid":14214,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3705474252},{"type":"v1","addr":"172.21.15.50:6801","nonce":3705474252}]},"active_addr":"172.21.15.50:6801/3705474252","active_change":"2023-10-26T06:35:29.546101+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24160,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24182,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.50:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3997259714}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2388389662}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1960216599}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":290566375}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":667095419}]}]} 2023-10-26T06:41:49.459 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-26T06:41:49.460 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-26T06:41:49.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd dump --format=json 2023-10-26T06:41:49.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:49 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2575078202' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-26T06:41:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:49 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2575078202' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-26T06:41:50.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:49 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2575078202' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-26T06:41:50.209 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:50.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:50 smithi050 ceph-mon[94997]: pgmap v262: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2023-10-26T06:41:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:50 smithi153 ceph-mon[131657]: pgmap v262: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2023-10-26T06:41:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:50 smithi125 ceph-mon[130643]: pgmap v262: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2023-10-26T06:41:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 -- 172.21.15.50:0/1843076804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 msgr2=0x7f8674105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 --2- 172.21.15.50:0/1843076804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 0x7f8674105ba0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8668009990 tx=0x7f8668009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 -- 172.21.15.50:0/1843076804 shutdown_connections 2023-10-26T06:41:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 --2- 172.21.15.50:0/1843076804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8674101260 0x7f867410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 --2- 172.21.15.50:0/1843076804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 0x7f8674105ba0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 --2- 172.21.15.50:0/1843076804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86741008a0 0x7f8674100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 -- 172.21.15.50:0/1843076804 >> 172.21.15.50:0/1843076804 conn(0x7f86740779e0 msgr2=0x7f8674077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 -- 172.21.15.50:0/1843076804 shutdown_connections 2023-10-26T06:41:51.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.658+0000 7f867ad7e700 1 -- 172.21.15.50:0/1843076804 wait complete. 2023-10-26T06:41:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.659+0000 7f867ad7e700 1 Processor -- start 2023-10-26T06:41:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.659+0000 7f867ad7e700 1 -- start start 2023-10-26T06:41:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867ad7e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86741008a0 0x7f8674198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867ad7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 0x7f8674199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:51.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867ad7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 0x7f867419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867ad7e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867419dd50 con 0x7f86741057c0 2023-10-26T06:41:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867ad7e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867419dec0 con 0x7f8674101260 2023-10-26T06:41:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867ad7e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867419e080 con 0x7f86741008a0 2023-10-26T06:41:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 0x7f8674199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:51.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f867931b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 0x7f867419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 0x7f8674199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:55210/0 (socket says 172.21.15.50:55210) 2023-10-26T06:41:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 -- 172.21.15.50:0/3780771418 learned_addr learned my addr 172.21.15.50:0/3780771418 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8678b1a700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86741008a0 0x7f8674198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 -- 172.21.15.50:0/3780771418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86741008a0 msgr2=0x7f8674198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86741008a0 0x7f8674198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 -- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 msgr2=0x7f867419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 0x7f867419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.660+0000 7f8673fff700 1 -- 172.21.15.50:0/3780771418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680095f0 con 0x7f8674101260 2023-10-26T06:41:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.661+0000 7f8673fff700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 0x7f8674199390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f866000e9a0 tx=0x7f866000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.661+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660009790 con 0x7f8674101260 2023-10-26T06:41:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.661+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867419e360 con 0x7f8674101260 2023-10-26T06:41:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.661+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8660010430 con 0x7f8674101260 2023-10-26T06:41:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.661+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660018680 con 0x7f8674101260 2023-10-26T06:41:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.661+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86741a5bc0 con 0x7f8674101260 2023-10-26T06:41:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.662+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8674101f30 con 0x7f8674101260 2023-10-26T06:41:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.664+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f86600105a0 con 0x7f8674101260 2023-10-26T06:41:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.665+0000 7f8671ffb700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86640a1560 0x7f86640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.666+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f8660014070 con 0x7f8674101260 2023-10-26T06:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.666+0000 7f8678b1a700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86640a1560 0x7f86640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.666+0000 7f8678b1a700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86640a1560 0x7f86640a3a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f866800b2e0 tx=0x7f8668005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.668+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8660096790 con 0x7f8674101260 2023-10-26T06:41:51.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.883+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f867404e4c0 con 0x7f8674101260 2023-10-26T06:41:51.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.885+0000 7f8671ffb700 1 -- 172.21.15.50:0/3780771418 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22459 (secure 0 0 0) 0x7f8660026090 con 0x7f8674101260 2023-10-26T06:41:51.887 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:51.887 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:41:31.938631+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86640a1560 msgr2=0x7f86640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86640a1560 0x7f86640a3a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f866800b2e0 tx=0x7f8668005fd0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 msgr2=0x7f8674199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 0x7f8674199390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f866000e9a0 tx=0x7f866000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 shutdown_connections 2023-10-26T06:41:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86640a1560 0x7f86640a3a20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86741057c0 0x7f867419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86741008a0 0x7f8674198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 --2- 172.21.15.50:0/3780771418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8674101260 0x7f8674199390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:51.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 >> 172.21.15.50:0/3780771418 conn(0x7f86740779e0 msgr2=0x7f86740fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:51.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 shutdown_connections 2023-10-26T06:41:51.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:51.887+0000 7f867ad7e700 1 -- 172.21.15.50:0/3780771418 wait complete. 2023-10-26T06:41:52.494 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-26T06:41:52.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd dump --format=json 2023-10-26T06:41:52.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:52 smithi050 ceph-mon[94997]: pgmap v263: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-10-26T06:41:52.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:52 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3780771418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:52 smithi153 ceph-mon[131657]: pgmap v263: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-10-26T06:41:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:52 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3780771418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:52 smithi125 ceph-mon[130643]: pgmap v263: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-10-26T06:41:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:52 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3780771418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:53.241 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:53.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:53 smithi050 ceph-mon[94997]: pgmap v264: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-10-26T06:41:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:53 smithi125 ceph-mon[130643]: pgmap v264: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-10-26T06:41:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:53 smithi153 ceph-mon[131657]: pgmap v264: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-10-26T06:41:54.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 -- 172.21.15.50:0/3947293820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001008a0 msgr2=0x7f7f00100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:54.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3947293820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001008a0 0x7f7f00100d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009990 tx=0x7f7ef4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:41:54.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 -- 172.21.15.50:0/3947293820 shutdown_connections 2023-10-26T06:41:54.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3947293820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f00101260 0x7f7f0010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:54.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3947293820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001057c0 0x7f7f00105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:54.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3947293820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001008a0 0x7f7f00100d20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:54.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.782+0000 7f7f0615f700 1 -- 172.21.15.50:0/3947293820 >> 172.21.15.50:0/3947293820 conn(0x7f7f000779e0 msgr2=0x7f7f00077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:54.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.783+0000 7f7f0615f700 1 -- 172.21.15.50:0/3947293820 shutdown_connections 2023-10-26T06:41:54.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.783+0000 7f7f0615f700 1 -- 172.21.15.50:0/3947293820 wait complete. 2023-10-26T06:41:54.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 Processor -- start 2023-10-26T06:41:54.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 -- start start 2023-10-26T06:41:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 0x7f7f00072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f00101260 0x7f7f00073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001057c0 0x7f7f00073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:54.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001a4f80 con 0x7f7f001008a0 2023-10-26T06:41:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001a50f0 con 0x7f7f001057c0 2023-10-26T06:41:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7f0615f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f001a52b0 con 0x7f7f00101260 2023-10-26T06:41:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7eff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 0x7f7f00072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.784+0000 7f7efeffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f00101260 0x7f7f00073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:54.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 0x7f7f00072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52366/0 (socket says 172.21.15.50:52366) 2023-10-26T06:41:54.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 -- 172.21.15.50:0/3371288072 learned_addr learned my addr 172.21.15.50:0/3371288072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:41:54.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7efffff700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001057c0 0x7f7f00073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:54.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 -- 172.21.15.50:0/3371288072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f00101260 msgr2=0x7f7f00073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:54.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f00101260 0x7f7f00073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:54.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 -- 172.21.15.50:0/3371288072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001057c0 msgr2=0x7f7f00073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001057c0 0x7f7f00073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 -- 172.21.15.50:0/3371288072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0009520 con 0x7f7f001008a0 2023-10-26T06:41:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7eff7fe700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 0x7f7f00072af0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000ea50 tx=0x7f7ef000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000cbd0 con 0x7f7f001008a0 2023-10-26T06:41:54.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ef000cd30 con 0x7f7f001008a0 2023-10-26T06:41:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.785+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0018680 con 0x7f7f001008a0 2023-10-26T06:41:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.786+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef40095f0 con 0x7f7f001008a0 2023-10-26T06:41:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.786+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f001a5880 con 0x7f7f001008a0 2023-10-26T06:41:54.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.787+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f00108da0 con 0x7f7f001008a0 2023-10-26T06:41:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.789+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f7ef0010430 con 0x7f7f001008a0 2023-10-26T06:41:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.790+0000 7f7efcff9700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7ee80a1560 0x7f7ee80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:41:54.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.790+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f7ef0014070 con 0x7f7f001008a0 2023-10-26T06:41:54.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.790+0000 7f7efeffd700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7ee80a1560 0x7f7ee80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:41:54.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.791+0000 7f7efeffd700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7ee80a1560 0x7f7ee80a3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098e0 tx=0x7f7ef4005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:41:54.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:54.793+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ef0096e50 con 0x7f7f001008a0 2023-10-26T06:41:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.010+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f00073f80 con 0x7f7f001008a0 2023-10-26T06:41:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.011+0000 7f7efcff9700 1 -- 172.21.15.50:0/3371288072 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22459 (secure 0 0 0) 0x7f7ef009a470 con 0x7f7f001008a0 2023-10-26T06:41:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:41:55.014 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":84,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:41:31.938631+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:41:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7ee80a1560 msgr2=0x7f7ee80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7ee80a1560 0x7f7ee80a3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098e0 tx=0x7f7ef4005960 comp rx=0 tx=0).stop 2023-10-26T06:41:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 msgr2=0x7f7f00072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:41:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 0x7f7f00072af0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000ea50 tx=0x7f7ef000ed60 comp rx=0 tx=0).stop 2023-10-26T06:41:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 shutdown_connections 2023-10-26T06:41:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7ee80a1560 0x7f7ee80a3a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f001057c0 0x7f7f00073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f001008a0 0x7f7f00072af0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 --2- 172.21.15.50:0/3371288072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f00101260 0x7f7f00073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:41:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 >> 172.21.15.50:0/3371288072 conn(0x7f7f000779e0 msgr2=0x7f7f000fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:41:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 shutdown_connections 2023-10-26T06:41:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:41:55.014+0000 7f7f0615f700 1 -- 172.21.15.50:0/3371288072 wait complete. 2023-10-26T06:41:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:55 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3371288072' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:55.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:55 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3371288072' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:55 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3371288072' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:41:55.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-26T06:41:55.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-26T06:41:55.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-26T06:41:55.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-26T06:41:55.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-26T06:41:55.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-26T06:41:55.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-26T06:41:55.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-26T06:41:55.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-26T06:41:55.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-26T06:41:55.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-26T06:41:55.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-26T06:41:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:56 smithi125 ceph-mon[130643]: pgmap v265: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-10-26T06:41:56.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:56 smithi153 ceph-mon[131657]: pgmap v265: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-10-26T06:41:56.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:56 smithi050 ceph-mon[94997]: pgmap v265: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-10-26T06:41:57.404 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:57.523 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:57.618 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:57.620 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:57.623 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:57.734 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.121 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.726 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:41:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:41:58 smithi153 ceph-mon[131657]: pgmap v266: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-10-26T06:41:58.999 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:41:58 smithi050 ceph-mon[94997]: pgmap v266: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-10-26T06:41:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:41:58 smithi125 ceph-mon[130643]: pgmap v266: 97 pgs: 97 active+clean; 633 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-10-26T06:42:00.974 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:00 smithi050 ceph-mon[94997]: pgmap v267: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-10-26T06:42:00.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:00 smithi153 ceph-mon[131657]: pgmap v267: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-10-26T06:42:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:00 smithi125 ceph-mon[130643]: pgmap v267: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-10-26T06:42:02.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 -- 172.21.15.50:0/2421040161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 msgr2=0x7f1c7c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 --2- 172.21.15.50:0/2421040161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c10d650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400b0a0 tx=0x7f1c7400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 -- 172.21.15.50:0/2421040161 shutdown_connections 2023-10-26T06:42:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 --2- 172.21.15.50:0/2421040161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c10d650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 --2- 172.21.15.50:0/2421040161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7c1057c0 0x7f1c7c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 --2- 172.21.15.50:0/2421040161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c1008a0 0x7f1c7c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 -- 172.21.15.50:0/2421040161 >> 172.21.15.50:0/2421040161 conn(0x7f1c7c0779e0 msgr2=0x7f1c7c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 -- 172.21.15.50:0/2421040161 shutdown_connections 2023-10-26T06:42:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.185+0000 7f1c837ce700 1 -- 172.21.15.50:0/2421040161 wait complete. 2023-10-26T06:42:02.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.186+0000 7f1c837ce700 1 Processor -- start 2023-10-26T06:42:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.186+0000 7f1c837ce700 1 -- start start 2023-10-26T06:42:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.186+0000 7f1c837ce700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c1008a0 0x7f1c7c19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.186+0000 7f1c837ce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c837ce700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7c1057c0 0x7f1c7c196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:02.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c837ce700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c197330 con 0x7f1c7c101260 2023-10-26T06:42:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c837ce700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1974a0 con 0x7f1c7c1057c0 2023-10-26T06:42:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c837ce700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c197660 con 0x7f1c7c1008a0 2023-10-26T06:42:02.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c80d69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c8156a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c1008a0 0x7f1c7c19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c80d69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c19d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52382/0 (socket says 172.21.15.50:52382) 2023-10-26T06:42:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c80d69700 1 -- 172.21.15.50:0/689440205 learned_addr learned my addr 172.21.15.50:0/689440205 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c81d6b700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7c1057c0 0x7f1c7c196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:02.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c81d6b700 1 -- 172.21.15.50:0/689440205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c1008a0 msgr2=0x7f1c7c19cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c81d6b700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c1008a0 0x7f1c7c19cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c81d6b700 1 -- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 msgr2=0x7f1c7c19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c81d6b700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c81d6b700 1 -- 172.21.15.50:0/689440205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009d00 con 0x7f1c7c1057c0 2023-10-26T06:42:02.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c8156a700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c1008a0 0x7f1c7c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.187+0000 7f1c80d69700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c7c101260 0x7f1c7c19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.188+0000 7f1c81d6b700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7c1057c0 0x7f1c7c196b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400b070 tx=0x7f1c740077d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.188+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400e040 con 0x7f1c7c1057c0 2023-10-26T06:42:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.188+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c1978e0 con 0x7f1c7c1057c0 2023-10-26T06:42:02.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.188+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c7401d470 con 0x7f1c7c1057c0 2023-10-26T06:42:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.188+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740052a0 con 0x7f1c7c1057c0 2023-10-26T06:42:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.188+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c1a3a50 con 0x7f1c7c1057c0 2023-10-26T06:42:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.189+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c7c110a40 con 0x7f1c7c1057c0 2023-10-26T06:42:02.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.191+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f1c7401d5e0 con 0x7f1c7c1057c0 2023-10-26T06:42:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c727fc700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1c680a1560 0x7f1c680a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f1c740ce420 con 0x7f1c7c1057c0 2023-10-26T06:42:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c8156a700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1c680a1560 0x7f1c680a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c727fc700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] conn(0x7f1c680aaed0 0x7f1c680ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:02.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 --> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c680ad9a0 con 0x7f1c680aaed0 2023-10-26T06:42:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c740ce790 con 0x7f1c7c1057c0 2023-10-26T06:42:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c80d69700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] conn(0x7f1c680aaed0 0x7f1c680ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.193+0000 7f1c8156a700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1c680a1560 0x7f1c680a3a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c101930 tx=0x7f1c78009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.194+0000 7f1c80d69700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] conn(0x7f1c680aaed0 0x7f1c680ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:02.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.195+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== osd.4 v2:172.21.15.125:6808/1302238589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1c680ad9a0 con 0x7f1c680aaed0 2023-10-26T06:42:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.212+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 --> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c7c101f30 con 0x7f1c680aaed0 2023-10-26T06:42:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.212+0000 7f1c727fc700 1 -- 172.21.15.50:0/689440205 <== osd.4 v2:172.21.15.125:6808/1302238589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1c7c101f30 con 0x7f1c680aaed0 2023-10-26T06:42:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] conn(0x7f1c680aaed0 msgr2=0x7f1c680ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] conn(0x7f1c680aaed0 0x7f1c680ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1c680a1560 msgr2=0x7f1c680a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:02.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1c680a1560 0x7f1c680a3a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c101930 tx=0x7f1c78009260 comp rx=0 tx=0).stop 2023-10-26T06:42:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7c1057c0 msgr2=0x7f1c7c196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 --2- 172.21.15.50:0/689440205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7c1057c0 0x7f1c7c196b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400b070 tx=0x7f1c740077d0 comp rx=0 tx=0).stop 2023-10-26T06:42:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c81d6b700 1 -- 172.21.15.50:0/689440205 reap_dead start 2023-10-26T06:42:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 shutdown_connections 2023-10-26T06:42:02.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 >> 172.21.15.50:0/689440205 conn(0x7f1c7c0779e0 msgr2=0x7f1c7c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 shutdown_connections 2023-10-26T06:42:02.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:02.213+0000 7f1c837ce700 1 -- 172.21.15.50:0/689440205 wait complete. 2023-10-26T06:42:02.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:02 smithi153 ceph-mon[131657]: pgmap v268: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:02 smithi050 ceph-mon[94997]: pgmap v268: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:02 smithi125 ceph-mon[130643]: pgmap v268: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:03.997 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:03 smithi050 ceph-mon[94997]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:03 smithi125 ceph-mon[130643]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:04.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:03 smithi153 ceph-mon[131657]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 -- 172.21.15.50:0/2006534067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01008a0 msgr2=0x7fcdf0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:04.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/2006534067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01008a0 0x7fcdf0100d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009990 tx=0x7fcde4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 -- 172.21.15.50:0/2006534067 shutdown_connections 2023-10-26T06:42:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/2006534067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf0101260 0x7fcdf010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/2006534067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf01057c0 0x7fcdf0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/2006534067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01008a0 0x7fcdf0100d20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:04.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 -- 172.21.15.50:0/2006534067 >> 172.21.15.50:0/2006534067 conn(0x7fcdf00779e0 msgr2=0x7fcdf0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:04.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 -- 172.21.15.50:0/2006534067 shutdown_connections 2023-10-26T06:42:04.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.986+0000 7fcdf4b92700 1 -- 172.21.15.50:0/2006534067 wait complete. 2023-10-26T06:42:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.987+0000 7fcdf4b92700 1 Processor -- start 2023-10-26T06:42:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.987+0000 7fcdf4b92700 1 -- start start 2023-10-26T06:42:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdf4b92700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf01008a0 0x7fcdf0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdf4b92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf0101260 0x7fcdf0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdf4b92700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01057c0 0x7fcdf0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdf4b92700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf01a4f90 con 0x7fcdf01057c0 2023-10-26T06:42:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdf4b92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf01a5100 con 0x7fcdf0101260 2023-10-26T06:42:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdf4b92700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf01a52c0 con 0x7fcdf01008a0 2023-10-26T06:42:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdeed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01057c0 0x7fcdf0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf0101260 0x7fcdf0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf0101260 0x7fcdf0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:35154/0 (socket says 172.21.15.50:35154) 2023-10-26T06:42:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 -- 172.21.15.50:0/1363205798 learned_addr learned my addr 172.21.15.50:0/1363205798 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdee59c700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf01008a0 0x7fcdf0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 -- 172.21.15.50:0/1363205798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf01008a0 msgr2=0x7fcdf0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcdf01008a0 0x7fcdf0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 -- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01057c0 msgr2=0x7fcdf0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01057c0 0x7fcdf0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:04.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdedd9b700 1 -- 172.21.15.50:0/1363205798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40095f0 con 0x7fcdf0101260 2023-10-26T06:42:04.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.988+0000 7fcdeed9d700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdf01057c0 0x7fcdf0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:04.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.989+0000 7fcdedd9b700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf0101260 0x7fcdf0073030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcde4000c00 tx=0x7fcde4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:04.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.989+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde401d070 con 0x7fcdf0101260 2023-10-26T06:42:04.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.989+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf01a5540 con 0x7fcdf0101260 2023-10-26T06:42:04.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.989+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcde4022470 con 0x7fcdf0101260 2023-10-26T06:42:04.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.989+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4017650 con 0x7fcdf0101260 2023-10-26T06:42:04.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.989+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf01a5950 con 0x7fcdf0101260 2023-10-26T06:42:04.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.990+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdf0110a60 con 0x7fcdf0101260 2023-10-26T06:42:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.992+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fcde40225e0 con 0x7fcdf0101260 2023-10-26T06:42:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcddf7fe700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdd80a1560 0x7fcdd80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fcde40ceba0 con 0x7fcdf0101260 2023-10-26T06:42:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcdee59c700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdd80a1560 0x7fcdd80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcddf7fe700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] conn(0x7fcdd80aaed0 0x7fcdd80ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 --> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdd80ad9a0 con 0x7fcdd80aaed0 2023-10-26T06:42:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcde40cef10 con 0x7fcdf0101260 2023-10-26T06:42:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.994+0000 7fcdeed9d700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] conn(0x7fcdd80aaed0 0x7fcdd80ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.995+0000 7fcdee59c700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdd80a1560 0x7fcdd80a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0101930 tx=0x7fcde0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.995+0000 7fcdeed9d700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] conn(0x7fcdd80aaed0 0x7fcdd80ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:04.996+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== osd.0 v2:172.21.15.50:6802/4270342949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fcdd80ad9a0 con 0x7fcdd80aaed0 2023-10-26T06:42:05.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.013+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 --> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdf0060e70 con 0x7fcdd80aaed0 2023-10-26T06:42:05.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.013+0000 7fcddf7fe700 1 -- 172.21.15.50:0/1363205798 <== osd.0 v2:172.21.15.50:6802/4270342949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdf0060e70 con 0x7fcdd80aaed0 2023-10-26T06:42:05.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] conn(0x7fcdd80aaed0 msgr2=0x7fcdd80ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] conn(0x7fcdd80aaed0 0x7fcdd80ad2f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdd80a1560 msgr2=0x7fcdd80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdd80a1560 0x7fcdd80a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0101930 tx=0x7fcde0009260 comp rx=0 tx=0).stop 2023-10-26T06:42:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf0101260 msgr2=0x7fcdf0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 --2- 172.21.15.50:0/1363205798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdf0101260 0x7fcdf0073030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcde4000c00 tx=0x7fcde4005740 comp rx=0 tx=0).stop 2023-10-26T06:42:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdeed9d700 1 -- 172.21.15.50:0/1363205798 reap_dead start 2023-10-26T06:42:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 shutdown_connections 2023-10-26T06:42:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 >> 172.21.15.50:0/1363205798 conn(0x7fcdf00779e0 msgr2=0x7fcdf00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:05.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 shutdown_connections 2023-10-26T06:42:05.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.014+0000 7fcdf4b92700 1 -- 172.21.15.50:0/1363205798 wait complete. 2023-10-26T06:42:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 -- 172.21.15.50:0/2045230981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41057c0 msgr2=0x7fc1a4105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/2045230981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41057c0 0x7fc1a4105ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009990 tx=0x7fc1a0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 -- 172.21.15.50:0/2045230981 shutdown_connections 2023-10-26T06:42:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/2045230981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1a4101260 0x7fc1a410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/2045230981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41057c0 0x7fc1a4105ba0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/2045230981 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1a41008a0 0x7fc1a4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.205+0000 7fc1abc4e700 1 -- 172.21.15.50:0/2045230981 >> 172.21.15.50:0/2045230981 conn(0x7fc1a40779e0 msgr2=0x7fc1a4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.206+0000 7fc1abc4e700 1 -- 172.21.15.50:0/2045230981 shutdown_connections 2023-10-26T06:42:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.206+0000 7fc1abc4e700 1 -- 172.21.15.50:0/2045230981 wait complete. 2023-10-26T06:42:05.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 Processor -- start 2023-10-26T06:42:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 -- start start 2023-10-26T06:42:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41008a0 0x7fc1a4198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1a4101260 0x7fc1a41993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1a41057c0 0x7fc1a419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a419dda0 con 0x7fc1a41008a0 2023-10-26T06:42:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a419df10 con 0x7fc1a41057c0 2023-10-26T06:42:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.207+0000 7fc1abc4e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a419e0d0 con 0x7fc1a4101260 2023-10-26T06:42:05.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a99ea700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41008a0 0x7fc1a4198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1aa1eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1a41057c0 0x7fc1a419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a99ea700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41008a0 0x7fc1a4198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50648/0 (socket says 172.21.15.50:50648) 2023-10-26T06:42:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a99ea700 1 -- 172.21.15.50:0/3974043561 learned_addr learned my addr 172.21.15.50:0/3974043561 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1a4101260 0x7fc1a41993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 -- 172.21.15.50:0/3974043561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1a41057c0 msgr2=0x7fc1a419d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1a41057c0 0x7fc1a419d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 -- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41008a0 msgr2=0x7fc1a4198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41008a0 0x7fc1a4198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 -- 172.21.15.50:0/3974043561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00095f0 con 0x7fc1a4101260 2023-10-26T06:42:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a99ea700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a41008a0 0x7fc1a4198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.208+0000 7fc1a91e9700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1a4101260 0x7fc1a41993e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc19400d950 tx=0x7fc19400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.209+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19400f890 con 0x7fc1a4101260 2023-10-26T06:42:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.209+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a419e3b0 con 0x7fc1a4101260 2023-10-26T06:42:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.209+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc194010460 con 0x7fc1a4101260 2023-10-26T06:42:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.209+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19400e610 con 0x7fc1a4101260 2023-10-26T06:42:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.209+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a41a5c10 con 0x7fc1a4101260 2023-10-26T06:42:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.210+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1a41109e0 con 0x7fc1a4101260 2023-10-26T06:42:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.212+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc1940108d0 con 0x7fc1a4101260 2023-10-26T06:42:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.213+0000 7fc19affd700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc1900a1560 0x7fc1900a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.214+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc1940cd0f0 con 0x7fc1a4101260 2023-10-26T06:42:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.214+0000 7fc1a99ea700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc1900a1560 0x7fc1900a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.214+0000 7fc19affd700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] conn(0x7fc1900aaed0 0x7fc1900ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.214+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 --> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1900ad9a0 con 0x7fc1900aaed0 2023-10-26T06:42:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.214+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1940cd460 con 0x7fc1a4101260 2023-10-26T06:42:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.214+0000 7fc1aa1eb700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] conn(0x7fc1900aaed0 0x7fc1900ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.215+0000 7fc1a99ea700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc1900a1560 0x7fc1900a3a20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000b2e0 tx=0x7fc1a0005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.215+0000 7fc1aa1eb700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] conn(0x7fc1900aaed0 0x7fc1900ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.216+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== osd.6 v2:172.21.15.50:6818/3555167697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc1900ad9a0 con 0x7fc1900aaed0 2023-10-26T06:42:05.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.234+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 --> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1a410c360 con 0x7fc1900aaed0 2023-10-26T06:42:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.234+0000 7fc19affd700 1 -- 172.21.15.50:0/3974043561 <== osd.6 v2:172.21.15.50:6818/3555167697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc1a410c360 con 0x7fc1900aaed0 2023-10-26T06:42:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] conn(0x7fc1900aaed0 msgr2=0x7fc1900ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] conn(0x7fc1900aaed0 0x7fc1900ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc1900a1560 msgr2=0x7fc1900a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc1900a1560 0x7fc1900a3a20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000b2e0 tx=0x7fc1a0005fd0 comp rx=0 tx=0).stop 2023-10-26T06:42:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1a4101260 msgr2=0x7fc1a41993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 --2- 172.21.15.50:0/3974043561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1a4101260 0x7fc1a41993e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc19400d950 tx=0x7fc19400dc60 comp rx=0 tx=0).stop 2023-10-26T06:42:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1aa1eb700 1 -- 172.21.15.50:0/3974043561 reap_dead start 2023-10-26T06:42:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 shutdown_connections 2023-10-26T06:42:05.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 >> 172.21.15.50:0/3974043561 conn(0x7fc1a40779e0 msgr2=0x7fc1a410ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 shutdown_connections 2023-10-26T06:42:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:05.235+0000 7fc1abc4e700 1 -- 172.21.15.50:0/3974043561 wait complete. 2023-10-26T06:42:05.430 INFO:teuthology.orchestra.run.smithi050.stdout:146028888115 2023-10-26T06:42:05.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-26T06:42:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 -- 172.21.15.50:0/2163133256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c101290 msgr2=0x7f587c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 --2- 172.21.15.50:0/2163133256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c101290 0x7f587c10d630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5874009f90 tx=0x7f587400b330 comp rx=0 tx=0).stop 2023-10-26T06:42:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 -- 172.21.15.50:0/2163133256 shutdown_connections 2023-10-26T06:42:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 --2- 172.21.15.50:0/2163133256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c101290 0x7f587c10d630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 --2- 172.21.15.50:0/2163133256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f587c1067d0 0x7f587c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 --2- 172.21.15.50:0/2163133256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f587c1008d0 0x7f587c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 -- 172.21.15.50:0/2163133256 >> 172.21.15.50:0/2163133256 conn(0x7f587c0778d0 msgr2=0x7f587c077ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.038+0000 7f5882146700 1 -- 172.21.15.50:0/2163133256 shutdown_connections 2023-10-26T06:42:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.039+0000 7f5882146700 1 -- 172.21.15.50:0/2163133256 wait complete. 2023-10-26T06:42:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 Processor -- start 2023-10-26T06:42:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 -- start start 2023-10-26T06:42:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c1008d0 0x7f587c198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f587c101290 0x7f587c199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f587c1067d0 0x7f587c19d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c19def0 con 0x7f587c101290 2023-10-26T06:42:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c19e060 con 0x7f587c1008d0 2023-10-26T06:42:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.040+0000 7f5882146700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c19e220 con 0x7f587c1067d0 2023-10-26T06:42:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c1008d0 0x7f587c198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c1008d0 0x7f587c198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:35176/0 (socket says 172.21.15.50:35176) 2023-10-26T06:42:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f587c101290 0x7f587c199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 -- 172.21.15.50:0/1906914266 learned_addr learned my addr 172.21.15.50:0/1906914266 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587bfff700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f587c1067d0 0x7f587c19d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 -- 172.21.15.50:0/1906914266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f587c1067d0 msgr2=0x7f587c19d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f587c1067d0 0x7f587c19d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 -- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f587c101290 msgr2=0x7f587c199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f587c101290 0x7f587c199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 -- 172.21.15.50:0/1906914266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009c40 con 0x7f587c1008d0 2023-10-26T06:42:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587bfff700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f587c1067d0 0x7f587c19d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:06.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.041+0000 7f587b7fe700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c1008d0 0x7f587c198ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f586c00e9a0 tx=0x7f586c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.042+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c009790 con 0x7f587c1008d0 2023-10-26T06:42:06.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.042+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c19e500 con 0x7f587c1008d0 2023-10-26T06:42:06.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.042+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f586c00ce80 con 0x7f587c1008d0 2023-10-26T06:42:06.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.042+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c018680 con 0x7f587c1008d0 2023-10-26T06:42:06.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.042+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c1a5d60 con 0x7f587c1008d0 2023-10-26T06:42:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.043+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f587c1109d0 con 0x7f587c1008d0 2023-10-26T06:42:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.046+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f586c00c9c0 con 0x7f587c1008d0 2023-10-26T06:42:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.048+0000 7f5878ff9700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f58640a1560 0x7f58640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.048+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f586c014070 con 0x7f587c1008d0 2023-10-26T06:42:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.048+0000 7f587affd700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f58640a1560 0x7f58640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.048+0000 7f5878ff9700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] conn(0x7f58640aaed0 0x7f58640ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.048+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 --> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58640ad9a0 con 0x7f58640aaed0 2023-10-26T06:42:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.048+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f586c0cf500 con 0x7f587c1008d0 2023-10-26T06:42:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.049+0000 7f587bfff700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] conn(0x7f58640aaed0 0x7f58640ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.049+0000 7f587affd700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f58640a1560 0x7f58640a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f587c19a550 tx=0x7f5870009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.049+0000 7f587bfff700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] conn(0x7f58640aaed0 0x7f58640ad2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.050+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== osd.1 v2:172.21.15.125:6800/2294493733 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f58640ad9a0 con 0x7f58640aaed0 2023-10-26T06:42:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.069+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 --> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f587c101f00 con 0x7f58640aaed0 2023-10-26T06:42:06.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5878ff9700 1 -- 172.21.15.50:0/1906914266 <== osd.1 v2:172.21.15.125:6800/2294493733 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f587c101f00 con 0x7f58640aaed0 2023-10-26T06:42:06.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] conn(0x7f58640aaed0 msgr2=0x7f58640ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5882146700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] conn(0x7f58640aaed0 0x7f58640ad2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f58640a1560 msgr2=0x7f58640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5882146700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f58640a1560 0x7f58640a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f587c19a550 tx=0x7f5870009310 comp rx=0 tx=0).stop 2023-10-26T06:42:06.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c1008d0 msgr2=0x7f587c198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.070+0000 7f5882146700 1 --2- 172.21.15.50:0/1906914266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f587c1008d0 0x7f587c198ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f586c00e9a0 tx=0x7f586c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.071+0000 7f587bfff700 1 -- 172.21.15.50:0/1906914266 reap_dead start 2023-10-26T06:42:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.071+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 shutdown_connections 2023-10-26T06:42:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.071+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 >> 172.21.15.50:0/1906914266 conn(0x7f587c0778d0 msgr2=0x7f587c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.071+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 shutdown_connections 2023-10-26T06:42:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.071+0000 7f5882146700 1 -- 172.21.15.50:0/1906914266 wait complete. 2023-10-26T06:42:06.076 INFO:teuthology.orchestra.run.smithi050.stdout:38654705732 2023-10-26T06:42:06.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-26T06:42:06.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 -- 172.21.15.50:0/711529220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 msgr2=0x7fc2440685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 --2- 172.21.15.50:0/711529220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc2440685f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc238009990 tx=0x7fc238009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 -- 172.21.15.50:0/711529220 shutdown_connections 2023-10-26T06:42:06.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 --2- 172.21.15.50:0/711529220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc244068b30 0x7fc24410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 --2- 172.21.15.50:0/711529220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2441067a0 0x7fc244106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 --2- 172.21.15.50:0/711529220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc2440685f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 -- 172.21.15.50:0/711529220 >> 172.21.15.50:0/711529220 conn(0x7fc244075790 msgr2=0x7fc244075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 -- 172.21.15.50:0/711529220 shutdown_connections 2023-10-26T06:42:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.292+0000 7fc24a29c700 1 -- 172.21.15.50:0/711529220 wait complete. 2023-10-26T06:42:06.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.293+0000 7fc24a29c700 1 Processor -- start 2023-10-26T06:42:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 -- start start 2023-10-26T06:42:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc24419d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244068b30 0x7fc24419de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2441067a0 0x7fc2441993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244199b20 con 0x7fc244068b30 2023-10-26T06:42:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244199c90 con 0x7fc2441067a0 2023-10-26T06:42:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc24a29c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244199e50 con 0x7fc244068190 2023-10-26T06:42:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc243fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc24419d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc243fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc24419d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:39890/0 (socket says 172.21.15.50:39890) 2023-10-26T06:42:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.294+0000 7fc243fff700 1 -- 172.21.15.50:0/4189324349 learned_addr learned my addr 172.21.15.50:0/4189324349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc2437fe700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244068b30 0x7fc24419de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc248839700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2441067a0 0x7fc2441993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc243fff700 1 -- 172.21.15.50:0/4189324349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2441067a0 msgr2=0x7fc2441993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc243fff700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2441067a0 0x7fc2441993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc243fff700 1 -- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244068b30 msgr2=0x7fc24419de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc243fff700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244068b30 0x7fc24419de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc243fff700 1 -- 172.21.15.50:0/4189324349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380095f0 con 0x7fc244068190 2023-10-26T06:42:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc248839700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2441067a0 0x7fc2441993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:42:06.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc2437fe700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc244068b30 0x7fc24419de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:42:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.295+0000 7fc243fff700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc24419d8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc23400e9a0 tx=0x7fc23400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.296+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234009790 con 0x7fc244068190 2023-10-26T06:42:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.296+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc23400cbd0 con 0x7fc244068190 2023-10-26T06:42:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.296+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234018680 con 0x7fc244068190 2023-10-26T06:42:06.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.296+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24419a130 con 0x7fc244068190 2023-10-26T06:42:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.297+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24410b6f0 con 0x7fc244068190 2023-10-26T06:42:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.298+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2441109c0 con 0x7fc244068190 2023-10-26T06:42:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.302+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc23400cd40 con 0x7fc244068190 2023-10-26T06:42:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.304+0000 7fc2417fa700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc22c0a15e0 0x7fc22c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.304+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc234014070 con 0x7fc244068190 2023-10-26T06:42:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.305+0000 7fc2417fa700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] conn(0x7fc22c0aaf50 0x7fc22c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.305+0000 7fc2437fe700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc22c0a15e0 0x7fc22c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.305+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 --> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc22c0ada20 con 0x7fc22c0aaf50 2023-10-26T06:42:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.305+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2340cf5d0 con 0x7fc244068190 2023-10-26T06:42:06.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.306+0000 7fc248839700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] conn(0x7fc22c0aaf50 0x7fc22c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.306+0000 7fc2437fe700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc22c0a15e0 0x7fc22c0a3aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc238006010 tx=0x7fc23800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.306+0000 7fc248839700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] conn(0x7fc22c0aaf50 0x7fc22c0ad370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.308+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== osd.5 v2:172.21.15.153:6808/2001551915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc22c0ada20 con 0x7fc22c0aaf50 2023-10-26T06:42:06.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.334+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 --> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc244101ee0 con 0x7fc22c0aaf50 2023-10-26T06:42:06.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc2417fa700 1 -- 172.21.15.50:0/4189324349 <== osd.5 v2:172.21.15.153:6808/2001551915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc244101ee0 con 0x7fc22c0aaf50 2023-10-26T06:42:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] conn(0x7fc22c0aaf50 msgr2=0x7fc22c0ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc24a29c700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] conn(0x7fc22c0aaf50 0x7fc22c0ad370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc22c0a15e0 msgr2=0x7fc22c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc24a29c700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc22c0a15e0 0x7fc22c0a3aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc238006010 tx=0x7fc23800b260 comp rx=0 tx=0).stop 2023-10-26T06:42:06.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 msgr2=0x7fc24419d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc24a29c700 1 --2- 172.21.15.50:0/4189324349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc244068190 0x7fc24419d8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc23400e9a0 tx=0x7fc23400ed60 comp rx=0 tx=0).stop 2023-10-26T06:42:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.335+0000 7fc248839700 1 -- 172.21.15.50:0/4189324349 reap_dead start 2023-10-26T06:42:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.336+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 shutdown_connections 2023-10-26T06:42:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.336+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 >> 172.21.15.50:0/4189324349 conn(0x7fc244075790 msgr2=0x7fc2441045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.336+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 shutdown_connections 2023-10-26T06:42:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.336+0000 7fc24a29c700 1 -- 172.21.15.50:0/4189324349 wait complete. 2023-10-26T06:42:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 -- 172.21.15.50:0/41392647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf0101260 msgr2=0x7f4bf010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/41392647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf0101260 0x7f4bf010d650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4be800b0a0 tx=0x7f4be800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 -- 172.21.15.50:0/41392647 shutdown_connections 2023-10-26T06:42:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/41392647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf0101260 0x7f4bf010d650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/41392647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bf01057c0 0x7f4bf0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/41392647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf01008a0 0x7f4bf0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 -- 172.21.15.50:0/41392647 >> 172.21.15.50:0/41392647 conn(0x7f4bf00779e0 msgr2=0x7f4bf0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 -- 172.21.15.50:0/41392647 shutdown_connections 2023-10-26T06:42:06.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.854+0000 7f4bf5b59700 1 -- 172.21.15.50:0/41392647 wait complete. 2023-10-26T06:42:06.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.856+0000 7f4bf5b59700 1 Processor -- start 2023-10-26T06:42:06.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.856+0000 7f4bf5b59700 1 -- start start 2023-10-26T06:42:06.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 -- 172.21.15.50:0/2239357866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc108110 msgr2=0x7fd2dc113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 --2- 172.21.15.50:0/2239357866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc108110 0x7fd2dc113400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009990 tx=0x7fd2d0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 -- 172.21.15.50:0/2239357866 shutdown_connections 2023-10-26T06:42:06.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 --2- 172.21.15.50:0/2239357866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 0x7fd2dc115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 --2- 172.21.15.50:0/2239357866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc1077f0 0x7fd2dc107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 --2- 172.21.15.50:0/2239357866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc108110 0x7fd2dc113400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 -- 172.21.15.50:0/2239357866 >> 172.21.15.50:0/2239357866 conn(0x7fd2dc06b8c0 msgr2=0x7fd2dc06bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 -- 172.21.15.50:0/2239357866 shutdown_connections 2023-10-26T06:42:06.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.236+0000 7fd2e2643700 1 -- 172.21.15.50:0/2239357866 wait complete. 2023-10-26T06:42:06.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 Processor -- start 2023-10-26T06:42:06.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 -- start start 2023-10-26T06:42:06.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc1077f0 0x7fd2dc109260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc108110 0x7fd2dc1097a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 0x7fd2dc109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1ad890 con 0x7fd2dc108110 2023-10-26T06:42:06.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1ada00 con 0x7fd2dc1077f0 2023-10-26T06:42:06.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.238+0000 7fd2e2643700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1adbc0 con 0x7fd2dc113940 2023-10-26T06:42:06.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2dbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc1077f0 0x7fd2dc109260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 0x7fd2dc109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 0x7fd2dc109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:39880/0 (socket says 172.21.15.50:39880) 2023-10-26T06:42:06.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 -- 172.21.15.50:0/3397525463 learned_addr learned my addr 172.21.15.50:0/3397525463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:06.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2db7fe700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc108110 0x7fd2dc1097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 -- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc1077f0 msgr2=0x7fd2dc109260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2dc1077f0 0x7fd2dc109260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 -- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc108110 msgr2=0x7fd2dc1097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2dc108110 0x7fd2dc1097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.239+0000 7fd2e0be0700 1 -- 172.21.15.50:0/3397525463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00095f0 con 0x7fd2dc113940 2023-10-26T06:42:06.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.240+0000 7fd2e0be0700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 0x7fd2dc109ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e940 tx=0x7fd2cc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.240+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0097b0 con 0x7fd2dc113940 2023-10-26T06:42:06.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.240+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2cc005020 con 0x7fd2dc113940 2023-10-26T06:42:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.240+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc00cc40 con 0x7fd2dc113940 2023-10-26T06:42:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.240+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc1adea0 con 0x7fd2dc113940 2023-10-26T06:42:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.240+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc1ae2c0 con 0x7fd2dc113940 2023-10-26T06:42:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.242+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2dc119220 con 0x7fd2dc113940 2023-10-26T06:42:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.245+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fd2cc005400 con 0x7fd2dc113940 2023-10-26T06:42:06.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.249+0000 7fd2d97fa700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd2c40a15e0 0x7fd2c40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.250+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fd2cc014070 con 0x7fd2dc113940 2023-10-26T06:42:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.250+0000 7fd2d97fa700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] conn(0x7fd2c40aaf50 0x7fd2c40ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.250+0000 7fd2dbfff700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd2c40a15e0 0x7fd2c40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.251+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 --> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2c40ada20 con 0x7fd2c40aaf50 2023-10-26T06:42:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.251+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2cc0cd630 con 0x7fd2dc113940 2023-10-26T06:42:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.252+0000 7fd2dbfff700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd2c40a15e0 0x7fd2c40a3aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009550 tx=0x7fd2d40091f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.252+0000 7fd2db7fe700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] conn(0x7fd2c40aaf50 0x7fd2c40ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.254+0000 7fd2db7fe700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] conn(0x7fd2c40aaf50 0x7fd2c40ad370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.255+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== osd.10 v2:172.21.15.125:6824/4125267059 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd2c40ada20 con 0x7fd2c40aaf50 2023-10-26T06:42:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.282+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 --> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2dc1191e0 con 0x7fd2c40aaf50 2023-10-26T06:42:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.283+0000 7fd2d97fa700 1 -- 172.21.15.50:0/3397525463 <== osd.10 v2:172.21.15.125:6824/4125267059 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd2dc1191e0 con 0x7fd2c40aaf50 2023-10-26T06:42:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] conn(0x7fd2c40aaf50 msgr2=0x7fd2c40ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] conn(0x7fd2c40aaf50 0x7fd2c40ad370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd2c40a15e0 msgr2=0x7fd2c40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd2c40a15e0 0x7fd2c40a3aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009550 tx=0x7fd2d40091f0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 msgr2=0x7fd2dc109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 --2- 172.21.15.50:0/3397525463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2dc113940 0x7fd2dc109ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e940 tx=0x7fd2cc00ec50 comp rx=0 tx=0).stop 2023-10-26T06:42:06.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e0be0700 1 -- 172.21.15.50:0/3397525463 reap_dead start 2023-10-26T06:42:06.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 shutdown_connections 2023-10-26T06:42:06.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 >> 172.21.15.50:0/3397525463 conn(0x7fd2dc06b8c0 msgr2=0x7fd2dc0709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 shutdown_connections 2023-10-26T06:42:06.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.284+0000 7fd2e2643700 1 -- 172.21.15.50:0/3397525463 wait complete. 2023-10-26T06:42:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bf5b59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bf01008a0 0x7f4bf0198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bf5b59700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf0101260 0x7f4bf0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bf5b59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf01057c0 0x7f4bf019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bf5b59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf019ddf0 con 0x7f4bf01057c0 2023-10-26T06:42:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bf5b59700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf019df60 con 0x7f4bf01008a0 2023-10-26T06:42:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bf5b59700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf019e120 con 0x7f4bf0101260 2023-10-26T06:42:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bf01008a0 0x7f4bf0198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bf01008a0 0x7f4bf0198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:35250/0 (socket says 172.21.15.50:35250) 2023-10-26T06:42:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4beffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf01057c0 0x7f4bf019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4bef7fe700 1 -- 172.21.15.50:0/2717410845 learned_addr learned my addr 172.21.15.50:0/2717410845 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.857+0000 7f4beeffd700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf0101260 0x7f4bf0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4beffff700 1 -- 172.21.15.50:0/2717410845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf0101260 msgr2=0x7f4bf0199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4beffff700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf0101260 0x7f4bf0199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4beffff700 1 -- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bf01008a0 msgr2=0x7f4bf0198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4beffff700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bf01008a0 0x7f4bf0198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4beffff700 1 -- 172.21.15.50:0/2717410845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8009d00 con 0x7f4bf01057c0 2023-10-26T06:42:06.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4beffff700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf01057c0 0x7f4bf019d7e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4be800b0a0 tx=0x7f4be8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be800e040 con 0x7f4bf01057c0 2023-10-26T06:42:06.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf019e3a0 con 0x7f4bf01057c0 2023-10-26T06:42:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4be801d470 con 0x7f4bf01057c0 2023-10-26T06:42:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.858+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8005260 con 0x7f4bf01057c0 2023-10-26T06:42:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.859+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf01a5c60 con 0x7f4bf01057c0 2023-10-26T06:42:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.860+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bf01109f0 con 0x7f4bf01057c0 2023-10-26T06:42:06.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.862+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4be801d5e0 con 0x7f4bf01057c0 2023-10-26T06:42:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.863+0000 7f4becff9700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4bd80a1560 0x7f4bd80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.863+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4be80ce770 con 0x7f4bf01057c0 2023-10-26T06:42:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.864+0000 7f4bef7fe700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4bd80a1560 0x7f4bd80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.864+0000 7f4becff9700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] conn(0x7f4bd80aaed0 0x7f4bd80ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.864+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 --> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bd80ad9a0 con 0x7f4bd80aaed0 2023-10-26T06:42:06.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.864+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4be80ceae0 con 0x7f4bf01057c0 2023-10-26T06:42:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.864+0000 7f4bef7fe700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4bd80a1560 0x7f4bd80a3a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4be0005950 tx=0x7f4be0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.864+0000 7f4beeffd700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] conn(0x7f4bd80aaed0 0x7f4bd80ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.865+0000 7f4beeffd700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] conn(0x7f4bd80aaed0 0x7f4bd80ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:06.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.866+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== osd.7 v2:172.21.15.125:6816/3807250109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4bd80ad9a0 con 0x7f4bd80aaed0 2023-10-26T06:42:06.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.883+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 --> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bf0101f30 con 0x7f4bd80aaed0 2023-10-26T06:42:06.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.883+0000 7f4becff9700 1 -- 172.21.15.50:0/2717410845 <== osd.7 v2:172.21.15.125:6816/3807250109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4bf0101f30 con 0x7f4bd80aaed0 2023-10-26T06:42:06.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] conn(0x7f4bd80aaed0 msgr2=0x7f4bd80ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] conn(0x7f4bd80aaed0 0x7f4bd80ad2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:06.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4bd80a1560 msgr2=0x7f4bd80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4bd80a1560 0x7f4bd80a3a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4be0005950 tx=0x7f4be0009260 comp rx=0 tx=0).stop 2023-10-26T06:42:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf01057c0 msgr2=0x7f4bf019d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 --2- 172.21.15.50:0/2717410845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bf01057c0 0x7f4bf019d7e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4be800b0a0 tx=0x7f4be8007870 comp rx=0 tx=0).stop 2023-10-26T06:42:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4beffff700 1 -- 172.21.15.50:0/2717410845 reap_dead start 2023-10-26T06:42:06.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 shutdown_connections 2023-10-26T06:42:06.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.884+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 >> 172.21.15.50:0/2717410845 conn(0x7f4bf00779e0 msgr2=0x7f4bf010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:06.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.885+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 shutdown_connections 2023-10-26T06:42:06.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:06.885+0000 7f4bf5b59700 1 -- 172.21.15.50:0/2717410845 wait complete. 2023-10-26T06:42:06.907 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:06 smithi050 ceph-mon[94997]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:06.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:06 smithi153 ceph-mon[131657]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:06 smithi125 ceph-mon[130643]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:42:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 -- 172.21.15.50:0/1095370305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e8073340 msgr2=0x7fa9e810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/1095370305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e8073340 0x7fa9e810cd10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0098f0 tx=0x7fa9dc009c00 comp rx=0 tx=0).stop 2023-10-26T06:42:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 -- 172.21.15.50:0/1095370305 shutdown_connections 2023-10-26T06:42:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/1095370305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e810d250 0x7fa9e810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/1095370305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e8072a20 0x7fa9e8072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/1095370305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e8073340 0x7fa9e810cd10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 -- 172.21.15.50:0/1095370305 >> 172.21.15.50:0/1095370305 conn(0x7fa9e80779e0 msgr2=0x7fa9e8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:07.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 -- 172.21.15.50:0/1095370305 shutdown_connections 2023-10-26T06:42:07.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.823+0000 7fa9edcfc700 1 -- 172.21.15.50:0/1095370305 wait complete. 2023-10-26T06:42:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.824+0000 7fa9edcfc700 1 Processor -- start 2023-10-26T06:42:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 -- start start 2023-10-26T06:42:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e8072a20 0x7fa9e8198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e8073340 0x7fa9e8199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e810d250 0x7fa9e819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e819ded0 con 0x7fa9e8073340 2023-10-26T06:42:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e819e040 con 0x7fa9e810d250 2023-10-26T06:42:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9edcfc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e819e200 con 0x7fa9e8072a20 2023-10-26T06:42:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e8072a20 0x7fa9e8198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9e6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e8073340 0x7fa9e8199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9e77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e8072a20 0x7fa9e8198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:39958/0 (socket says 172.21.15.50:39958) 2023-10-26T06:42:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9e77fe700 1 -- 172.21.15.50:0/3551771111 learned_addr learned my addr 172.21.15.50:0/3551771111 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.825+0000 7fa9e7fff700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e810d250 0x7fa9e819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e77fe700 1 -- 172.21.15.50:0/3551771111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e810d250 msgr2=0x7fa9e819d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e77fe700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9e810d250 0x7fa9e819d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e77fe700 1 -- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e8073340 msgr2=0x7fa9e8199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e77fe700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e8073340 0x7fa9e8199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e77fe700 1 -- 172.21.15.50:0/3551771111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80095f0 con 0x7fa9e8072a20 2023-10-26T06:42:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e6ffd700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e8073340 0x7fa9e8199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:07.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e77fe700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e8072a20 0x7fa9e8198fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800ec10 tx=0x7fa9d800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800cc90 con 0x7fa9e8072a20 2023-10-26T06:42:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc009520 con 0x7fa9e8072a20 2023-10-26T06:42:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9d80044e0 con 0x7fa9e8072a20 2023-10-26T06:42:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8010430 con 0x7fa9e8072a20 2023-10-26T06:42:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.826+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e81a5b70 con 0x7fa9e8072a20 2023-10-26T06:42:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.827+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9e8112ca0 con 0x7fa9e8072a20 2023-10-26T06:42:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.829+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fa9d8003f70 con 0x7fa9e8072a20 2023-10-26T06:42:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.831+0000 7fa9e4ff9700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9d00a1560 0x7fa9d00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.831+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa9d8014070 con 0x7fa9e8072a20 2023-10-26T06:42:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.831+0000 7fa9e6ffd700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9d00a1560 0x7fa9d00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.831+0000 7fa9e4ff9700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] conn(0x7fa9d00aaed0 0x7fa9d00ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.831+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 --> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9d00ad9a0 con 0x7fa9d00aaed0 2023-10-26T06:42:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.831+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9d80cd930 con 0x7fa9e8072a20 2023-10-26T06:42:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.832+0000 7fa9e7fff700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] conn(0x7fa9d00aaed0 0x7fa9d00ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.832+0000 7fa9e6ffd700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9d00a1560 0x7fa9d00a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009fd0 tx=0x7fa9dc019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.832+0000 7fa9e7fff700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] conn(0x7fa9d00aaed0 0x7fa9d00ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:07.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.833+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== osd.8 v2:172.21.15.153:6816/3815055379 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa9d00ad9a0 con 0x7fa9d00aaed0 2023-10-26T06:42:07.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.852+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 --> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9e80740b0 con 0x7fa9d00aaed0 2023-10-26T06:42:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.852+0000 7fa9e4ff9700 1 -- 172.21.15.50:0/3551771111 <== osd.8 v2:172.21.15.153:6816/3815055379 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa9e80740b0 con 0x7fa9d00aaed0 2023-10-26T06:42:07.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] conn(0x7fa9d00aaed0 msgr2=0x7fa9d00ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] conn(0x7fa9d00aaed0 0x7fa9d00ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9d00a1560 msgr2=0x7fa9d00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9d00a1560 0x7fa9d00a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009fd0 tx=0x7fa9dc019040 comp rx=0 tx=0).stop 2023-10-26T06:42:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e8072a20 msgr2=0x7fa9e8198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 --2- 172.21.15.50:0/3551771111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e8072a20 0x7fa9e8198fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800ec10 tx=0x7fa9d800ef20 comp rx=0 tx=0).stop 2023-10-26T06:42:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9e7fff700 1 -- 172.21.15.50:0/3551771111 reap_dead start 2023-10-26T06:42:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 shutdown_connections 2023-10-26T06:42:07.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.853+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 >> 172.21.15.50:0/3551771111 conn(0x7fa9e80779e0 msgr2=0x7fa9e80feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:07.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.854+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 shutdown_connections 2023-10-26T06:42:07.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.854+0000 7fa9edcfc700 1 -- 172.21.15.50:0/3551771111 wait complete. 2023-10-26T06:42:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 -- 172.21.15.50:0/3697130086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 msgr2=0x7f7c280733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/3697130086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c280733e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009990 tx=0x7f7c1c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 -- 172.21.15.50:0/3697130086 shutdown_connections 2023-10-26T06:42:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/3697130086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c28111570 0x7f7c281139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/3697130086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c28074770 0x7f7c28072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/3697130086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c280733e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 -- 172.21.15.50:0/3697130086 >> 172.21.15.50:0/3697130086 conn(0x7f7c280779e0 msgr2=0x7f7c28077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.694+0000 7f7c2cb59700 1 -- 172.21.15.50:0/3697130086 shutdown_connections 2023-10-26T06:42:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.695+0000 7f7c2cb59700 1 -- 172.21.15.50:0/3697130086 wait complete. 2023-10-26T06:42:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 Processor -- start 2023-10-26T06:42:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 -- start start 2023-10-26T06:42:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c2819d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c28074770 0x7f7c2819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c28111570 0x7f7c281a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281a2180 con 0x7f7c28072f60 2023-10-26T06:42:07.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281a22f0 con 0x7f7c28111570 2023-10-26T06:42:07.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2cb59700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281a24b0 con 0x7f7c28074770 2023-10-26T06:42:07.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c2819d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c2819d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50732/0 (socket says 172.21.15.50:50732) 2023-10-26T06:42:07.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c2659c700 1 -- 172.21.15.50:0/682406449 learned_addr learned my addr 172.21.15.50:0/682406449 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:07.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.696+0000 7f7c25d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c28074770 0x7f7c2819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c26d9d700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c28111570 0x7f7c281a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c2659c700 1 -- 172.21.15.50:0/682406449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c28074770 msgr2=0x7f7c2819d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c2659c700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c28074770 0x7f7c2819d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c2659c700 1 -- 172.21.15.50:0/682406449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c28111570 msgr2=0x7f7c281a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c2659c700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c28111570 0x7f7c281a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c2659c700 1 -- 172.21.15.50:0/682406449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0095f0 con 0x7f7c28072f60 2023-10-26T06:42:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c25d9b700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c28074770 0x7f7c2819d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c2659c700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c2819d2d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e9a0 tx=0x7f7c1800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.697+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18009790 con 0x7f7c28072f60 2023-10-26T06:42:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.698+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c281a2790 con 0x7f7c28072f60 2023-10-26T06:42:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.698+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c18010430 con 0x7f7c28072f60 2023-10-26T06:42:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.698+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18018680 con 0x7f7c28072f60 2023-10-26T06:42:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.698+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c281a9ff0 con 0x7f7c28072f60 2023-10-26T06:42:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.699+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c280740b0 con 0x7f7c28072f60 2023-10-26T06:42:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.701+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f7c180105a0 con 0x7f7c28072f60 2023-10-26T06:42:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.703+0000 7f7c177fe700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7c100a15e0 0x7f7c100a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.703+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f7c18014070 con 0x7f7c28072f60 2023-10-26T06:42:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.704+0000 7f7c25d9b700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7c100a15e0 0x7f7c100a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.704+0000 7f7c177fe700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] conn(0x7f7c100aaf50 0x7f7c100ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.704+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 --> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c100ada20 con 0x7f7c100aaf50 2023-10-26T06:42:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.704+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c180cd660 con 0x7f7c28072f60 2023-10-26T06:42:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.704+0000 7f7c26d9d700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] conn(0x7f7c100aaf50 0x7f7c100ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.704+0000 7f7c25d9b700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7c100a15e0 0x7f7c100a3aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00b2e0 tx=0x7f7c1c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:07.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.705+0000 7f7c26d9d700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] conn(0x7f7c100aaf50 0x7f7c100ad370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:07.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.705+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== osd.3 v2:172.21.15.50:6810/2387269481 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7c100ada20 con 0x7f7c100aaf50 2023-10-26T06:42:07.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.723+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 --> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c28117080 con 0x7f7c100aaf50 2023-10-26T06:42:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.723+0000 7f7c177fe700 1 -- 172.21.15.50:0/682406449 <== osd.3 v2:172.21.15.50:6810/2387269481 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7c28117080 con 0x7f7c100aaf50 2023-10-26T06:42:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] conn(0x7f7c100aaf50 msgr2=0x7f7c100ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] conn(0x7f7c100aaf50 0x7f7c100ad370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7c100a15e0 msgr2=0x7f7c100a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7c100a15e0 0x7f7c100a3aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00b2e0 tx=0x7f7c1c005960 comp rx=0 tx=0).stop 2023-10-26T06:42:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 msgr2=0x7f7c2819d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 --2- 172.21.15.50:0/682406449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c28072f60 0x7f7c2819d2d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e9a0 tx=0x7f7c1800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c26d9d700 1 -- 172.21.15.50:0/682406449 reap_dead start 2023-10-26T06:42:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 shutdown_connections 2023-10-26T06:42:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 >> 172.21.15.50:0/682406449 conn(0x7f7c280779e0 msgr2=0x7f7c281101e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 shutdown_connections 2023-10-26T06:42:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.724+0000 7f7c2cb59700 1 -- 172.21.15.50:0/682406449 wait complete. 2023-10-26T06:42:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 -- 172.21.15.50:0/4010970033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 msgr2=0x7f7e7410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 --2- 172.21.15.50:0/4010970033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 0x7f7e7410f640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009f90 tx=0x7f7e6c00b330 comp rx=0 tx=0).stop 2023-10-26T06:42:08.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 -- 172.21.15.50:0/4010970033 shutdown_connections 2023-10-26T06:42:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 --2- 172.21.15.50:0/4010970033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 0x7f7e7410f640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 --2- 172.21.15.50:0/4010970033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e74072a20 0x7f7e74072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 --2- 172.21.15.50:0/4010970033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74073340 0x7f7e7410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 -- 172.21.15.50:0/4010970033 >> 172.21.15.50:0/4010970033 conn(0x7f7e740779e0 msgr2=0x7f7e74077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 -- 172.21.15.50:0/4010970033 shutdown_connections 2023-10-26T06:42:08.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.038+0000 7f7e7b414700 1 -- 172.21.15.50:0/4010970033 wait complete. 2023-10-26T06:42:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.039+0000 7f7e7b414700 1 Processor -- start 2023-10-26T06:42:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.040+0000 7f7e7b414700 1 -- start start 2023-10-26T06:42:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.040+0000 7f7e7b414700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74072a20 0x7f7e74199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.040+0000 7f7e7b414700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e74073340 0x7f7e741995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.040+0000 7f7e7b414700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 0x7f7e7419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.040+0000 7f7e7b414700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7419df60 con 0x7f7e74072a20 2023-10-26T06:42:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e7b414700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7419e0d0 con 0x7f7e7410d250 2023-10-26T06:42:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e7b414700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7419e290 con 0x7f7e74073340 2023-10-26T06:42:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74072a20 0x7f7e74199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74072a20 0x7f7e74199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50786/0 (socket says 172.21.15.50:50786) 2023-10-26T06:42:08.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 -- 172.21.15.50:0/3935848105 learned_addr learned my addr 172.21.15.50:0/3935848105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e789af700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e74073340 0x7f7e741995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e799b1700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 0x7f7e7419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 -- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e74073340 msgr2=0x7f7e741995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e74073340 0x7f7e741995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 -- 172.21.15.50:0/3935848105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 msgr2=0x7f7e7419d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e7410d250 0x7f7e7419d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 -- 172.21.15.50:0/3935848105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c009c40 con 0x7f7e74072a20 2023-10-26T06:42:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.041+0000 7f7e791b0700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74072a20 0x7f7e74199060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000e9a0 tx=0x7f7e7000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:08.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.042+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70009790 con 0x7f7e74072a20 2023-10-26T06:42:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.042+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7419e570 con 0x7f7e74072a20 2023-10-26T06:42:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.042+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e7000ce80 con 0x7f7e74072a20 2023-10-26T06:42:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.042+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70018680 con 0x7f7e74072a20 2023-10-26T06:42:08.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.042+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e741a5dd0 con 0x7f7e74072a20 2023-10-26T06:42:08.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.043+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e74112d10 con 0x7f7e74072a20 2023-10-26T06:42:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.045+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f7e70010430 con 0x7f7e74072a20 2023-10-26T06:42:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.046+0000 7f7e6a7fc700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e600a1560 0x7f7e600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.046+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f7e70014070 con 0x7f7e74072a20 2023-10-26T06:42:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.046+0000 7f7e789af700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e600a1560 0x7f7e600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.046+0000 7f7e6a7fc700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] conn(0x7f7e600aaed0 0x7f7e600ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.046+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 --> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e600ad9a0 con 0x7f7e600aaed0 2023-10-26T06:42:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.046+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e700cd8b0 con 0x7f7e74072a20 2023-10-26T06:42:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.047+0000 7f7e799b1700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] conn(0x7f7e600aaed0 0x7f7e600ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.047+0000 7f7e789af700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e600a1560 0x7f7e600a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e7419a5c0 tx=0x7f7e64009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:08.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.048+0000 7f7e799b1700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] conn(0x7f7e600aaed0 0x7f7e600ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:08.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.049+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== osd.11 v2:172.21.15.153:6824/356376297 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7e600ad9a0 con 0x7f7e600aaed0 2023-10-26T06:42:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.066+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 --> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e740740b0 con 0x7f7e600aaed0 2023-10-26T06:42:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e6a7fc700 1 -- 172.21.15.50:0/3935848105 <== osd.11 v2:172.21.15.153:6824/356376297 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7e740740b0 con 0x7f7e600aaed0 2023-10-26T06:42:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] conn(0x7f7e600aaed0 msgr2=0x7f7e600ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] conn(0x7f7e600aaed0 0x7f7e600ad2f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e600a1560 msgr2=0x7f7e600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e600a1560 0x7f7e600a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e7419a5c0 tx=0x7f7e64009310 comp rx=0 tx=0).stop 2023-10-26T06:42:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74072a20 msgr2=0x7f7e74199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 --2- 172.21.15.50:0/3935848105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e74072a20 0x7f7e74199060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000e9a0 tx=0x7f7e7000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e799b1700 1 -- 172.21.15.50:0/3935848105 reap_dead start 2023-10-26T06:42:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 shutdown_connections 2023-10-26T06:42:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.067+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 >> 172.21.15.50:0/3935848105 conn(0x7f7e740779e0 msgr2=0x7f7e740fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.068+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 shutdown_connections 2023-10-26T06:42:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.068+0000 7f7e7b414700 1 -- 172.21.15.50:0/3935848105 wait complete. 2023-10-26T06:42:08.318 INFO:teuthology.orchestra.run.smithi050.stdout:60129542209 2023-10-26T06:42:08.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-26T06:42:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 -- 172.21.15.50:0/3507528369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de8069740 msgr2=0x7f9de810cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/3507528369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de8069740 0x7f9de810cdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009990 tx=0x7f9ddc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 -- 172.21.15.50:0/3507528369 shutdown_connections 2023-10-26T06:42:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/3507528369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de810d300 0x7f9de810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/3507528369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9de8068e20 0x7f9de8069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/3507528369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de8069740 0x7f9de810cdc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 -- 172.21.15.50:0/3507528369 >> 172.21.15.50:0/3507528369 conn(0x7f9de80757d0 msgr2=0x7f9de8075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 -- 172.21.15.50:0/3507528369 shutdown_connections 2023-10-26T06:42:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.977+0000 7f9ded6cf700 1 -- 172.21.15.50:0/3507528369 wait complete. 2023-10-26T06:42:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.978+0000 7f9ded6cf700 1 Processor -- start 2023-10-26T06:42:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.978+0000 7f9ded6cf700 1 -- start start 2023-10-26T06:42:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.978+0000 7f9ded6cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de8068e20 0x7f9de8198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.978+0000 7f9ded6cf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9de8069740 0x7f9de8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9ded6cf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de810d300 0x7f9de819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9ded6cf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de819dd50 con 0x7f9de810d300 2023-10-26T06:42:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9ded6cf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de819dec0 con 0x7f9de8068e20 2023-10-26T06:42:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9ded6cf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de819e080 con 0x7f9de8069740 2023-10-26T06:42:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de8068e20 0x7f9de8198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de8068e20 0x7f9de8198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:35284/0 (socket says 172.21.15.50:35284) 2023-10-26T06:42:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 -- 172.21.15.50:0/2265178318 learned_addr learned my addr 172.21.15.50:0/2265178318 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de67fc700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9de8069740 0x7f9de8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de77fe700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de810d300 0x7f9de819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 -- 172.21.15.50:0/2265178318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9de8069740 msgr2=0x7f9de8199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9de8069740 0x7f9de8199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 -- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de810d300 msgr2=0x7f9de819d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9de810d300 0x7f9de819d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.979+0000 7f9de6ffd700 1 -- 172.21.15.50:0/2265178318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0095f0 con 0x7f9de8068e20 2023-10-26T06:42:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.980+0000 7f9de6ffd700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de8068e20 0x7f9de8198e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800d980 tx=0x7f9dd800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.980+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8004220 con 0x7f9de8068e20 2023-10-26T06:42:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.980+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de819e360 con 0x7f9de8068e20 2023-10-26T06:42:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.980+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de81a5bc0 con 0x7f9de8068e20 2023-10-26T06:42:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.980+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd8007640 con 0x7f9de8068e20 2023-10-26T06:42:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.980+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8005610 con 0x7f9de8068e20 2023-10-26T06:42:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.981+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9dd4000fc0 con 0x7f9de8068e20 2023-10-26T06:42:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.983+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f9dd8044780 con 0x7f9de8068e20 2023-10-26T06:42:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.984+0000 7f9dcffff700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9dd00a15e0 0x7f9dd00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.985+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f9dd80ccdb0 con 0x7f9de8068e20 2023-10-26T06:42:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.985+0000 7f9dcffff700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] conn(0x7f9dd00aaf50 0x7f9dd00ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.985+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 --> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9dd00ada20 con 0x7f9dd00aaf50 2023-10-26T06:42:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.985+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dd80cd120 con 0x7f9de8068e20 2023-10-26T06:42:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.985+0000 7f9de67fc700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9dd00a15e0 0x7f9dd00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.985+0000 7f9de77fe700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] conn(0x7f9dd00aaf50 0x7f9dd00ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.986+0000 7f9de67fc700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9dd00a15e0 0x7f9dd00a3aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9de819a3b0 tx=0x7f9ddc005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.986+0000 7f9de77fe700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] conn(0x7f9dd00aaf50 0x7f9dd00ad370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:07.987+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== osd.9 v2:172.21.15.50:6826/2403450797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9dd00ada20 con 0x7f9dd00aaf50 2023-10-26T06:42:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.005+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 --> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9dd4002d40 con 0x7f9dd00aaf50 2023-10-26T06:42:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9dcffff700 1 -- 172.21.15.50:0/2265178318 <== osd.9 v2:172.21.15.50:6826/2403450797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9dd4002d40 con 0x7f9dd00aaf50 2023-10-26T06:42:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] conn(0x7f9dd00aaf50 msgr2=0x7f9dd00ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] conn(0x7f9dd00aaf50 0x7f9dd00ad370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9dd00a15e0 msgr2=0x7f9dd00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9dd00a15e0 0x7f9dd00a3aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9de819a3b0 tx=0x7f9ddc005fd0 comp rx=0 tx=0).stop 2023-10-26T06:42:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de8068e20 msgr2=0x7f9de8198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.006+0000 7f9ded6cf700 1 --2- 172.21.15.50:0/2265178318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9de8068e20 0x7f9de8198e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800d980 tx=0x7f9dd800dc90 comp rx=0 tx=0).stop 2023-10-26T06:42:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.007+0000 7f9de77fe700 1 -- 172.21.15.50:0/2265178318 reap_dead start 2023-10-26T06:42:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.007+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 shutdown_connections 2023-10-26T06:42:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.007+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 >> 172.21.15.50:0/2265178318 conn(0x7f9de80757d0 msgr2=0x7f9de810e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.007+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 shutdown_connections 2023-10-26T06:42:08.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:08.007+0000 7f9ded6cf700 1 -- 172.21.15.50:0/2265178318 wait complete. 2023-10-26T06:42:08.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:08 smithi153 ceph-mon[131657]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-10-26T06:42:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:08 smithi050 ceph-mon[94997]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-10-26T06:42:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:08 smithi125 ceph-mon[130643]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-10-26T06:42:09.489 INFO:teuthology.orchestra.run.smithi050.stdout:339302416404 2023-10-26T06:42:09.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-26T06:42:09.491 INFO:teuthology.orchestra.run.smithi050.stdout:201863462953 2023-10-26T06:42:09.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-26T06:42:09.766 INFO:teuthology.orchestra.run.smithi050.stdout:253403070496 2023-10-26T06:42:09.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-26T06:42:10.083 INFO:teuthology.orchestra.run.smithi050.stdout:309237645335 2023-10-26T06:42:10.083 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-26T06:42:10.145 INFO:teuthology.orchestra.run.smithi050.stdout:167503724591 2023-10-26T06:42:10.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-26T06:42:10.358 INFO:teuthology.orchestra.run.smithi050.stdout:223338299429 2023-10-26T06:42:10.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-26T06:42:10.479 INFO:teuthology.orchestra.run.smithi050.stdout:287762808860 2023-10-26T06:42:10.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-26T06:42:10.839 INFO:teuthology.orchestra.run.smithi050.stdout:111669149753 2023-10-26T06:42:10.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-26T06:42:10.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:10 smithi153 ceph-mon[131657]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-10-26T06:42:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 -- 172.21.15.50:0/3385277458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c072a20 msgr2=0x7f799c072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/3385277458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c072a20 0x7f799c072e00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f798c009990 tx=0x7f798c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 -- 172.21.15.50:0/3385277458 shutdown_connections 2023-10-26T06:42:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/3385277458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c10d250 0x7f799c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/3385277458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c072a20 0x7f799c072e00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/3385277458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c073340 0x7f799c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 -- 172.21.15.50:0/3385277458 >> 172.21.15.50:0/3385277458 conn(0x7f799c0779e0 msgr2=0x7f799c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 -- 172.21.15.50:0/3385277458 shutdown_connections 2023-10-26T06:42:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.993+0000 7f79a0ef1700 1 -- 172.21.15.50:0/3385277458 wait complete. 2023-10-26T06:42:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.994+0000 7f79a0ef1700 1 Processor -- start 2023-10-26T06:42:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.994+0000 7f79a0ef1700 1 -- start start 2023-10-26T06:42:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f79a0ef1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c072a20 0x7f799c198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f79a0ef1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c073340 0x7f799c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f79a0ef1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c10d250 0x7f799c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f79a0ef1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c19ddb0 con 0x7f799c073340 2023-10-26T06:42:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f79a0ef1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c19df20 con 0x7f799c10d250 2023-10-26T06:42:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f79a0ef1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c19e0e0 con 0x7f799c072a20 2023-10-26T06:42:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f7999d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c073340 0x7f799c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:11.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f7999d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c073340 0x7f799c199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50808/0 (socket says 172.21.15.50:50808) 2023-10-26T06:42:11.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f7999d9b700 1 -- 172.21.15.50:0/80730861 learned_addr learned my addr 172.21.15.50:0/80730861 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:11.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f799ad9d700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c10d250 0x7f799c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:11.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.995+0000 7f799a59c700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c072a20 0x7f799c198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:11.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f799ad9d700 1 -- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c072a20 msgr2=0x7f799c198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:11.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f799ad9d700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f799c072a20 0x7f799c198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:11.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f799ad9d700 1 -- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c073340 msgr2=0x7f799c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:11.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f799ad9d700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c073340 0x7f799c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:11.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f799ad9d700 1 -- 172.21.15.50:0/80730861 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0095f0 con 0x7f799c10d250 2023-10-26T06:42:11.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f7999d9b700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c073340 0x7f799c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:11.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f799ad9d700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c10d250 0x7f799c19d7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7994007ee0 tx=0x7f799400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:11.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994004db0 con 0x7f799c10d250 2023-10-26T06:42:11.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c19e3c0 con 0x7f799c10d250 2023-10-26T06:42:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f799400f040 con 0x7f799c10d250 2023-10-26T06:42:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994005850 con 0x7f799c10d250 2023-10-26T06:42:11.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.996+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c1a5c20 con 0x7f799c10d250 2023-10-26T06:42:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.997+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f799c112cf0 con 0x7f799c10d250 2023-10-26T06:42:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:10.999+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f799400db20 con 0x7f799c10d250 2023-10-26T06:42:11.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.001+0000 7f798b7fe700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79840a1560 0x7f79840a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.001+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f79940cd220 con 0x7f799c10d250 2023-10-26T06:42:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.001+0000 7f799a59c700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79840a1560 0x7f79840a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.001+0000 7f798b7fe700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] conn(0x7f79840aaed0 0x7f79840ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.001+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 --> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79840ad9a0 con 0x7f79840aaed0 2023-10-26T06:42:11.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.001+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79940cd590 con 0x7f799c10d250 2023-10-26T06:42:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.002+0000 7f7999d9b700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] conn(0x7f79840aaed0 0x7f79840ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.002+0000 7f799a59c700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79840a1560 0x7f79840a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f798c006010 tx=0x7f798c00b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.002+0000 7f7999d9b700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] conn(0x7f79840aaed0 0x7f79840ad2f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:11.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.003+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== osd.2 v2:172.21.15.153:6800/3455493796 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f79840ad9a0 con 0x7f79840aaed0 2023-10-26T06:42:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:10 smithi050 ceph-mon[94997]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-10-26T06:42:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.022+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 --> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f799c0740b0 con 0x7f79840aaed0 2023-10-26T06:42:11.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.023+0000 7f798b7fe700 1 -- 172.21.15.50:0/80730861 <== osd.2 v2:172.21.15.153:6800/3455493796 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f799c0740b0 con 0x7f79840aaed0 2023-10-26T06:42:11.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] conn(0x7f79840aaed0 msgr2=0x7f79840ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] conn(0x7f79840aaed0 0x7f79840ad2f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79840a1560 msgr2=0x7f79840a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79840a1560 0x7f79840a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f798c006010 tx=0x7f798c00b540 comp rx=0 tx=0).stop 2023-10-26T06:42:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c10d250 msgr2=0x7f799c19d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 --2- 172.21.15.50:0/80730861 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f799c10d250 0x7f799c19d7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7994007ee0 tx=0x7f799400d3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f799ad9d700 1 -- 172.21.15.50:0/80730861 reap_dead start 2023-10-26T06:42:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 shutdown_connections 2023-10-26T06:42:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 >> 172.21.15.50:0/80730861 conn(0x7f799c0779e0 msgr2=0x7f799c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:11.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 shutdown_connections 2023-10-26T06:42:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:11.024+0000 7f79a0ef1700 1 -- 172.21.15.50:0/80730861 wait complete. 2023-10-26T06:42:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:10 smithi125 ceph-mon[130643]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-10-26T06:42:11.966 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.033 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.053 INFO:teuthology.orchestra.run.smithi050.stdout:81604378687 2023-10-26T06:42:12.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-26T06:42:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.477 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.685 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.686 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:12 smithi050 ceph-mon[94997]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:12.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:12 smithi153 ceph-mon[131657]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:13.005 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:12 smithi125 ceph-mon[130643]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:14.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:13 smithi050 ceph-mon[94997]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2023-10-26T06:42:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:13 smithi125 ceph-mon[130643]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2023-10-26T06:42:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:13 smithi153 ceph-mon[131657]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2023-10-26T06:42:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:15.303 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:16.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 -- 172.21.15.50:0/1390492943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8628101200 msgr2=0x7f862810d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:16.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1390492943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8628101200 0x7f862810d630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f862000b0a0 tx=0x7f862000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 -- 172.21.15.50:0/1390492943 shutdown_connections 2023-10-26T06:42:16.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1390492943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8628101200 0x7f862810d630 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1390492943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86281056a0 0x7f8628105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1390492943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628100840 0x7f8628100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 -- 172.21.15.50:0/1390492943 >> 172.21.15.50:0/1390492943 conn(0x7f8628077950 msgr2=0x7f8628077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:16.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 -- 172.21.15.50:0/1390492943 shutdown_connections 2023-10-26T06:42:16.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.159+0000 7f862f6f0700 1 -- 172.21.15.50:0/1390492943 wait complete. 2023-10-26T06:42:16.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.160+0000 7f862f6f0700 1 Processor -- start 2023-10-26T06:42:16.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.160+0000 7f862f6f0700 1 -- start start 2023-10-26T06:42:16.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862f6f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628100840 0x7f8628072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:16.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862f6f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628101200 0x7f8628073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:16.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862f6f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86281056a0 0x7f8628073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:16.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862f6f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86281a5100 con 0x7f86281056a0 2023-10-26T06:42:16.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862f6f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86281a5270 con 0x7f8628101200 2023-10-26T06:42:16.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862f6f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86281a5430 con 0x7f8628100840 2023-10-26T06:42:16.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862cc8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628101200 0x7f8628073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:16.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862dc8d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86281056a0 0x7f8628073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:16.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862cc8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628101200 0x7f8628073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:58194/0 (socket says 172.21.15.50:58194) 2023-10-26T06:42:16.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862cc8b700 1 -- 172.21.15.50:0/1755981090 learned_addr learned my addr 172.21.15.50:0/1755981090 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:16.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862d48c700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628100840 0x7f8628072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:16.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862dc8d700 1 -- 172.21.15.50:0/1755981090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628100840 msgr2=0x7f8628072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:16.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862dc8d700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628100840 0x7f8628072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862dc8d700 1 -- 172.21.15.50:0/1755981090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628101200 msgr2=0x7f8628073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:16.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862dc8d700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628101200 0x7f8628073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.161+0000 7f862dc8d700 1 -- 172.21.15.50:0/1755981090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009d00 con 0x7f86281056a0 2023-10-26T06:42:16.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.162+0000 7f862dc8d700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86281056a0 0x7f8628073570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f862000b070 tx=0x7f8620007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:16.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.162+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862000e040 con 0x7f86281056a0 2023-10-26T06:42:16.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.162+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f862001d470 con 0x7f86281056a0 2023-10-26T06:42:16.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.162+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86281a56b0 con 0x7f86281056a0 2023-10-26T06:42:16.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.162+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200052a0 con 0x7f86281056a0 2023-10-26T06:42:16.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.162+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86281a5b60 con 0x7f86281056a0 2023-10-26T06:42:16.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.163+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8628108d10 con 0x7f86281056a0 2023-10-26T06:42:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.165+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f862001d5e0 con 0x7f86281056a0 2023-10-26T06:42:16.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.167+0000 7f861e7fc700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86140a1560 0x7f86140a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:16.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.168+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f86200ce320 con 0x7f86281056a0 2023-10-26T06:42:16.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.168+0000 7f862d48c700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86140a1560 0x7f86140a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:16.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.168+0000 7f862d48c700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86140a1560 0x7f86140a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8624009be0 tx=0x7f8624009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:16.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.172+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8620097870 con 0x7f86281056a0 2023-10-26T06:42:16.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.390+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8628101ec0 con 0x7f86281056a0 2023-10-26T06:42:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.390+0000 7f861e7fc700 1 -- 172.21.15.50:0/1755981090 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f862009ae90 con 0x7f86281056a0 2023-10-26T06:42:16.392 INFO:teuthology.orchestra.run.smithi050.stdout:60129542211 2023-10-26T06:42:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86140a1560 msgr2=0x7f86140a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86140a1560 0x7f86140a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8624009be0 tx=0x7f8624009260 comp rx=0 tx=0).stop 2023-10-26T06:42:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86281056a0 msgr2=0x7f8628073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86281056a0 0x7f8628073570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f862000b070 tx=0x7f8620007930 comp rx=0 tx=0).stop 2023-10-26T06:42:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 shutdown_connections 2023-10-26T06:42:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86140a1560 0x7f86140a3a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86281056a0 0x7f8628073570 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628100840 0x7f8628072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 --2- 172.21.15.50:0/1755981090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8628101200 0x7f8628073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.392+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 >> 172.21.15.50:0/1755981090 conn(0x7f8628077950 msgr2=0x7f86280fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.393+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 shutdown_connections 2023-10-26T06:42:16.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:16.393+0000 7f862f6f0700 1 -- 172.21.15.50:0/1755981090 wait complete. 2023-10-26T06:42:16.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:16 smithi153 ceph-mon[131657]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:16 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1755981090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-26T06:42:17.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:16 smithi050 ceph-mon[94997]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:17.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:16 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1755981090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-26T06:42:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:16 smithi125 ceph-mon[130643]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:16 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1755981090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-26T06:42:17.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 -- 172.21.15.50:0/2748216535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 msgr2=0x7fadc8106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 --2- 172.21.15.50:0/2748216535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 0x7fadc8106b80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009990 tx=0x7fadb8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 -- 172.21.15.50:0/2748216535 shutdown_connections 2023-10-26T06:42:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 --2- 172.21.15.50:0/2748216535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 --2- 172.21.15.50:0/2748216535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 0x7fadc8106b80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 --2- 172.21.15.50:0/2748216535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 0x7fadc80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 -- 172.21.15.50:0/2748216535 >> 172.21.15.50:0/2748216535 conn(0x7fadc8075790 msgr2=0x7fadc8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:17.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 -- 172.21.15.50:0/2748216535 shutdown_connections 2023-10-26T06:42:17.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.519+0000 7fadcd519700 1 -- 172.21.15.50:0/2748216535 wait complete. 2023-10-26T06:42:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 Processor -- start 2023-10-26T06:42:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 -- start start 2023-10-26T06:42:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 0x7fadc8198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 0x7fadc819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc819dd00 con 0x7fadc8068b30 2023-10-26T06:42:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc819de70 con 0x7fadc8068190 2023-10-26T06:42:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.521+0000 7fadcd519700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc819e030 con 0x7fadc81067a0 2023-10-26T06:42:17.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 0x7fadc8198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc8199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38804/0 (socket says 172.21.15.50:38804) 2023-10-26T06:42:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 0x7fadc8198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:58212/0 (socket says 172.21.15.50:58212) 2023-10-26T06:42:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 -- 172.21.15.50:0/265379263 learned_addr learned my addr 172.21.15.50:0/265379263 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc77fe700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 0x7fadc819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 -- 172.21.15.50:0/265379263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 msgr2=0x7fadc819d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 0x7fadc819d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 -- 172.21.15.50:0/265379263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 msgr2=0x7fadc8198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 0x7fadc8198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 -- 172.21.15.50:0/265379263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80095f0 con 0x7fadc8068b30 2023-10-26T06:42:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.522+0000 7fadc67fc700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc8199340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00d980 tx=0x7fadbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.523+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc004220 con 0x7fadc8068b30 2023-10-26T06:42:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.523+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadbc007640 con 0x7fadc8068b30 2023-10-26T06:42:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.523+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc819e310 con 0x7fadc8068b30 2023-10-26T06:42:17.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.523+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc005690 con 0x7fadc8068b30 2023-10-26T06:42:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.523+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc81a5b70 con 0x7fadc8068b30 2023-10-26T06:42:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.524+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc80fed60 con 0x7fadc8068b30 2023-10-26T06:42:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.526+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fadbc004750 con 0x7fadc8068b30 2023-10-26T06:42:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.527+0000 7fadaffff700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fadb00a15e0 0x7fadb00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.528+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fadbc0ccc60 con 0x7fadc8068b30 2023-10-26T06:42:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.528+0000 7fadc6ffd700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fadb00a15e0 0x7fadb00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.528+0000 7fadc6ffd700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fadb00a15e0 0x7fadb00a3aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadb800b2e0 tx=0x7fadb8005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.532+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadbc096120 con 0x7fadc8068b30 2023-10-26T06:42:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.774+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fadc8101ee0 con 0x7fadc8068b30 2023-10-26T06:42:17.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.775+0000 7fadaffff700 1 -- 172.21.15.50:0/265379263 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadbc016020 con 0x7fadc8068b30 2023-10-26T06:42:17.776 INFO:teuthology.orchestra.run.smithi050.stdout:201863462956 2023-10-26T06:42:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fadb00a15e0 msgr2=0x7fadb00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fadb00a15e0 0x7fadb00a3aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadb800b2e0 tx=0x7fadb8005960 comp rx=0 tx=0).stop 2023-10-26T06:42:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 msgr2=0x7fadc8199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc8199340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00d980 tx=0x7fadbc00dc90 comp rx=0 tx=0).stop 2023-10-26T06:42:17.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 shutdown_connections 2023-10-26T06:42:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fadb00a15e0 0x7fadb00a3aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fadc81067a0 0x7fadc819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc8068190 0x7fadc8198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 --2- 172.21.15.50:0/265379263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadc8068b30 0x7fadc8199340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 >> 172.21.15.50:0/265379263 conn(0x7fadc8075790 msgr2=0x7fadc810bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 shutdown_connections 2023-10-26T06:42:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:17.777+0000 7fadcd519700 1 -- 172.21.15.50:0/265379263 wait complete. 2023-10-26T06:42:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.226+0000 7f4c2b57f700 1 -- 172.21.15.50:0/1538894000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 msgr2=0x7f4c24102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.226+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/1538894000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 0x7f4c24102c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009990 tx=0x7f4c14009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 -- 172.21.15.50:0/1538894000 shutdown_connections 2023-10-26T06:42:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/1538894000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2410f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/1538894000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/1538894000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 0x7f4c24102c80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 -- 172.21.15.50:0/1538894000 >> 172.21.15.50:0/1538894000 conn(0x7f4c240fe2f0 msgr2=0x7f4c24100710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 -- 172.21.15.50:0/1538894000 shutdown_connections 2023-10-26T06:42:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.227+0000 7f4c2b57f700 1 -- 172.21.15.50:0/1538894000 wait complete. 2023-10-26T06:42:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.228+0000 7f4c2b57f700 1 Processor -- start 2023-10-26T06:42:18.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.228+0000 7f4c2b57f700 1 -- start start 2023-10-26T06:42:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.228+0000 7f4c2b57f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 0x7f4c2419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2b57f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2b57f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2b57f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24199140 con 0x7f4c24108800 2023-10-26T06:42:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2b57f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c241992b0 con 0x7f4c241031c0 2023-10-26T06:42:18.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2b57f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24199470 con 0x7f4c24102800 2023-10-26T06:42:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c29d7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38820/0 (socket says 172.21.15.50:38820) 2023-10-26T06:42:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c29d7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:58234/0 (socket says 172.21.15.50:58234) 2023-10-26T06:42:18.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 -- 172.21.15.50:0/2968563123 learned_addr learned my addr 172.21.15.50:0/2968563123 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2a57d700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 0x7f4c2419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 -- 172.21.15.50:0/2968563123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 msgr2=0x7f4c2419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 0x7f4c2419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 -- 172.21.15.50:0/2968563123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 msgr2=0x7f4c2419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:18.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c2ad7e700 1 -- 172.21.15.50:0/2968563123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140095f0 con 0x7f4c24108800 2023-10-26T06:42:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.229+0000 7f4c29d7c700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.230+0000 7f4c2ad7e700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24198ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00ef30 tx=0x7f4c1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.230+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c018070 con 0x7f4c24108800 2023-10-26T06:42:18.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.230+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c1c00f040 con 0x7f4c24108800 2023-10-26T06:42:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.230+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c241996f0 con 0x7f4c24108800 2023-10-26T06:42:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.230+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00cd00 con 0x7f4c24108800 2023-10-26T06:42:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.230+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c241a5940 con 0x7f4c24108800 2023-10-26T06:42:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.231+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2410ae20 con 0x7f4c24108800 2023-10-26T06:42:18.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.233+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f4c1c003a00 con 0x7f4c24108800 2023-10-26T06:42:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.235+0000 7f4c1b7fe700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4c100a15e0 0x7f4c100a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.235+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f4c1c0cc9f0 con 0x7f4c24108800 2023-10-26T06:42:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.235+0000 7f4c2a57d700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4c100a15e0 0x7f4c100a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.235+0000 7f4c2a57d700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4c100a15e0 0x7f4c100a3aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009be0 tx=0x7f4c20009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:18.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.239+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c1c095fa0 con 0x7f4c24108800 2023-10-26T06:42:18.445 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542209 got 60129542211 for osd.1 2023-10-26T06:42:18.445 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.475+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c24103f40 con 0x7f4c24108800 2023-10-26T06:42:18.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.476+0000 7f4c1b7fe700 1 -- 172.21.15.50:0/2968563123 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c1c0995c0 con 0x7f4c24108800 2023-10-26T06:42:18.478 INFO:teuthology.orchestra.run.smithi050.stdout:38654705734 2023-10-26T06:42:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4c100a15e0 msgr2=0x7f4c100a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4c100a15e0 0x7f4c100a3aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009be0 tx=0x7f4c20009260 comp rx=0 tx=0).stop 2023-10-26T06:42:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 msgr2=0x7f4c24198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:18.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24198ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00ef30 tx=0x7f4c1c00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 shutdown_connections 2023-10-26T06:42:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f4c100a15e0 0x7f4c100a3aa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c24108800 0x7f4c24198ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c24102800 0x7f4c2419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 --2- 172.21.15.50:0/2968563123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c241031c0 0x7f4c2419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 >> 172.21.15.50:0/2968563123 conn(0x7f4c240fe2f0 msgr2=0x7f4c240feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.479+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 shutdown_connections 2023-10-26T06:42:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.480+0000 7f4c2b57f700 1 -- 172.21.15.50:0/2968563123 wait complete. 2023-10-26T06:42:18.900 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:18.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:18 smithi153 ceph-mon[131657]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:18.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:18 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/265379263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-26T06:42:18.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:18 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2968563123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-26T06:42:18.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:18 smithi050 ceph-mon[94997]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:18.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:18 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/265379263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-26T06:42:18.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:18 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2968563123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-26T06:42:19.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 -- 172.21.15.50:0/1820082597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8072a20 msgr2=0x7facd8072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 --2- 172.21.15.50:0/1820082597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8072a20 0x7facd8072e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7facc8009990 tx=0x7facc8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 -- 172.21.15.50:0/1820082597 shutdown_connections 2023-10-26T06:42:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 --2- 172.21.15.50:0/1820082597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 0x7facd810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 --2- 172.21.15.50:0/1820082597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8072a20 0x7facd8072e00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 --2- 172.21.15.50:0/1820082597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facd8073340 0x7facd810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 -- 172.21.15.50:0/1820082597 >> 172.21.15.50:0/1820082597 conn(0x7facd80779e0 msgr2=0x7facd8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 -- 172.21.15.50:0/1820082597 shutdown_connections 2023-10-26T06:42:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.649+0000 7facdd141700 1 -- 172.21.15.50:0/1820082597 wait complete. 2023-10-26T06:42:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.651+0000 7facdd141700 1 Processor -- start 2023-10-26T06:42:19.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 -- start start 2023-10-26T06:42:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facd8072a20 0x7facd8198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 0x7facd8199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 0x7facd819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd819dde0 con 0x7facd8073340 2023-10-26T06:42:19.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd819df50 con 0x7facd810d250 2023-10-26T06:42:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facdd141700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd819e110 con 0x7facd8072a20 2023-10-26T06:42:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facd659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 0x7facd8199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facd659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 0x7facd8199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38838/0 (socket says 172.21.15.50:38838) 2023-10-26T06:42:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facd659c700 1 -- 172.21.15.50:0/3375209919 learned_addr learned my addr 172.21.15.50:0/3375209919 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facd759e700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 0x7facd819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.652+0000 7facd6d9d700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facd8072a20 0x7facd8198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd659c700 1 -- 172.21.15.50:0/3375209919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facd8072a20 msgr2=0x7facd8198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd659c700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facd8072a20 0x7facd8198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd659c700 1 -- 172.21.15.50:0/3375209919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 msgr2=0x7facd819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd659c700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 0x7facd819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd659c700 1 -- 172.21.15.50:0/3375209919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80095f0 con 0x7facd8073340 2023-10-26T06:42:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd759e700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 0x7facd819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facd659c700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 0x7facd8199420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e9a0 tx=0x7faccc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc009790 con 0x7facd8073340 2023-10-26T06:42:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faccc010430 con 0x7facd8073340 2023-10-26T06:42:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd819e3f0 con 0x7facd8073340 2023-10-26T06:42:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.653+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc018680 con 0x7facd8073340 2023-10-26T06:42:19.154 INFO:teuthology.orchestra.run.smithi050.stdout:309237645337 2023-10-26T06:42:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.654+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd81a5c50 con 0x7facd8073340 2023-10-26T06:42:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.655+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd8108460 con 0x7facd8073340 2023-10-26T06:42:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.657+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7faccc0105a0 con 0x7facd8073340 2023-10-26T06:42:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.658+0000 7facbffff700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facc00a15e0 0x7facc00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.658+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7faccc014070 con 0x7facd8073340 2023-10-26T06:42:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.659+0000 7facd6d9d700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facc00a15e0 0x7facc00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.659+0000 7facd6d9d700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facc00a15e0 0x7facc00a3aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7facc800b2e0 tx=0x7facc8005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.663+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faccc096540 con 0x7facd8073340 2023-10-26T06:42:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.891+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7facd80740b0 con 0x7facd8073340 2023-10-26T06:42:19.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.891+0000 7facbffff700 1 -- 172.21.15.50:0/3375209919 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7faccc099b60 con 0x7facd8073340 2023-10-26T06:42:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facc00a15e0 msgr2=0x7facc00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facc00a15e0 0x7facc00a3aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7facc800b2e0 tx=0x7facc8005fd0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 msgr2=0x7facd8199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 0x7facd8199420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e9a0 tx=0x7faccc00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 shutdown_connections 2023-10-26T06:42:19.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facc00a15e0 0x7facc00a3aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7facd810d250 0x7facd819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facd8072a20 0x7facd8198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 --2- 172.21.15.50:0/3375209919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facd8073340 0x7facd8199420 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 >> 172.21.15.50:0/3375209919 conn(0x7facd80779e0 msgr2=0x7facd80fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 shutdown_connections 2023-10-26T06:42:19.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:18.894+0000 7facdd141700 1 -- 172.21.15.50:0/3375209919 wait complete. 2023-10-26T06:42:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:18 smithi125 ceph-mon[130643]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-10-26T06:42:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:18 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/265379263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-26T06:42:19.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:18 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2968563123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-26T06:42:19.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 -- 172.21.15.50:0/1073870037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 msgr2=0x7f7260105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 --2- 172.21.15.50:0/1073870037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260105ba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f725c009990 tx=0x7f725c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 -- 172.21.15.50:0/1073870037 shutdown_connections 2023-10-26T06:42:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 --2- 172.21.15.50:0/1073870037 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7260101260 0x7f726010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 --2- 172.21.15.50:0/1073870037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260105ba0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 --2- 172.21.15.50:0/1073870037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72601008a0 0x7f7260100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 -- 172.21.15.50:0/1073870037 >> 172.21.15.50:0/1073870037 conn(0x7f72600779e0 msgr2=0x7f7260077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 -- 172.21.15.50:0/1073870037 shutdown_connections 2023-10-26T06:42:19.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.618+0000 7f7267d99700 1 -- 172.21.15.50:0/1073870037 wait complete. 2023-10-26T06:42:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.619+0000 7f7267d99700 1 Processor -- start 2023-10-26T06:42:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.619+0000 7f7267d99700 1 -- start start 2023-10-26T06:42:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7267d99700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72601008a0 0x7f7260072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7267d99700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7260101260 0x7f7260073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7267d99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7267d99700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601a5030 con 0x7f72601057c0 2023-10-26T06:42:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7267d99700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601a51a0 con 0x7f7260101260 2023-10-26T06:42:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7267d99700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601a5360 con 0x7f72601008a0 2023-10-26T06:42:19.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38882/0 (socket says 172.21.15.50:38882) 2023-10-26T06:42:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 -- 172.21.15.50:0/2485258806 learned_addr learned my addr 172.21.15.50:0/2485258806 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7265334700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7260101260 0x7f7260073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7265b35700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72601008a0 0x7f7260072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 -- 172.21.15.50:0/2485258806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72601008a0 msgr2=0x7f7260072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72601008a0 0x7f7260072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 -- 172.21.15.50:0/2485258806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7260101260 msgr2=0x7f7260073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7260101260 0x7f7260073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.620+0000 7f7266336700 1 -- 172.21.15.50:0/2485258806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7258009c40 con 0x7f72601057c0 2023-10-26T06:42:19.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.621+0000 7f7266336700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260073570 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f725800c0f0 tx=0x7f725800c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:19.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.621+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258003a00 con 0x7f72601057c0 2023-10-26T06:42:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.621+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f725800e030 con 0x7f72601057c0 2023-10-26T06:42:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.621+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c0095f0 con 0x7f72601057c0 2023-10-26T06:42:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.621+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258004650 con 0x7f72601057c0 2023-10-26T06:42:19.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.621+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72601a5960 con 0x7f72601057c0 2023-10-26T06:42:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.622+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260108d80 con 0x7f72601057c0 2023-10-26T06:42:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.624+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f7258003cf0 con 0x7f72601057c0 2023-10-26T06:42:19.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.625+0000 7f7256ffd700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f724c0a1560 0x7f724c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:19.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.626+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f72580ccce0 con 0x7f72601057c0 2023-10-26T06:42:19.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.626+0000 7f7265b35700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f724c0a1560 0x7f724c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:19.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.626+0000 7f7265b35700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f724c0a1560 0x7f724c0a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f725c00b2e0 tx=0x7f725c005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:19.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.629+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7258096290 con 0x7f72601057c0 2023-10-26T06:42:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.844+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f7260101f30 con 0x7f72601057c0 2023-10-26T06:42:19.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.844+0000 7f7256ffd700 1 -- 172.21.15.50:0/2485258806 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72580998b0 con 0x7f72601057c0 2023-10-26T06:42:19.846 INFO:teuthology.orchestra.run.smithi050.stdout:253403070499 2023-10-26T06:42:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.846+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f724c0a1560 msgr2=0x7f724c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.846+0000 7f7267d99700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f724c0a1560 0x7f724c0a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f725c00b2e0 tx=0x7f725c005fd0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.846+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 msgr2=0x7f7260073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.846+0000 7f7267d99700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260073570 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f725800c0f0 tx=0x7f725800c400 comp rx=0 tx=0).stop 2023-10-26T06:42:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 shutdown_connections 2023-10-26T06:42:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f724c0a1560 0x7f724c0a3a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72601057c0 0x7f7260073570 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72601008a0 0x7f7260072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 --2- 172.21.15.50:0/2485258806 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7260101260 0x7f7260073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 >> 172.21.15.50:0/2485258806 conn(0x7f72600779e0 msgr2=0x7f72600fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 shutdown_connections 2023-10-26T06:42:19.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.847+0000 7f7267d99700 1 -- 172.21.15.50:0/2485258806 wait complete. 2023-10-26T06:42:19.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:19 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3375209919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-26T06:42:19.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:19 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3109848442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-26T06:42:19.983 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462956 for osd.6 2023-10-26T06:42:19.983 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:19.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:19 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3375209919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-26T06:42:19.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:19 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3109848442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-26T06:42:19.997 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705732 got 38654705734 for osd.0 2023-10-26T06:42:19.997 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 -- 172.21.15.50:0/3585330121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 msgr2=0x7fb82c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 --2- 172.21.15.50:0/3585330121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c0685f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb820009990 tx=0x7fb820009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 -- 172.21.15.50:0/3585330121 shutdown_connections 2023-10-26T06:42:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 --2- 172.21.15.50:0/3585330121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c068b30 0x7fb82c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 --2- 172.21.15.50:0/3585330121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb82c1067a0 0x7fb82c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 --2- 172.21.15.50:0/3585330121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c0685f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 -- 172.21.15.50:0/3585330121 >> 172.21.15.50:0/3585330121 conn(0x7fb82c075790 msgr2=0x7fb82c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 -- 172.21.15.50:0/3585330121 shutdown_connections 2023-10-26T06:42:20.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.178+0000 7fb83266a700 1 -- 172.21.15.50:0/3585330121 wait complete. 2023-10-26T06:42:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.180+0000 7fb83266a700 1 Processor -- start 2023-10-26T06:42:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.180+0000 7fb83266a700 1 -- start start 2023-10-26T06:42:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb83266a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb83266a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb82c068b30 0x7fb82c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb83266a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 0x7fb82c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb83266a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c19dd10 con 0x7fb82c1067a0 2023-10-26T06:42:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb83266a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c19de80 con 0x7fb82c068190 2023-10-26T06:42:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb83266a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c19e040 con 0x7fb82c068b30 2023-10-26T06:42:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb830c07700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 0x7fb82c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb830c07700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 0x7fb82c19d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38856/0 (socket says 172.21.15.50:38856) 2023-10-26T06:42:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb830c07700 1 -- 172.21.15.50:0/3109848442 learned_addr learned my addr 172.21.15.50:0/3109848442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb82b7fe700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb82c068b30 0x7fb82c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb82bfff700 1 -- 172.21.15.50:0/3109848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb82c068b30 msgr2=0x7fb82c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.181+0000 7fb82bfff700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb82c068b30 0x7fb82c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb82bfff700 1 -- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 msgr2=0x7fb82c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb82bfff700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 0x7fb82c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb82bfff700 1 -- 172.21.15.50:0/3109848442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200095f0 con 0x7fb82c068190 2023-10-26T06:42:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb830c07700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 0x7fb82c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb82bfff700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c198e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00e9f0 tx=0x7fb81c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:20.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00c9c0 con 0x7fb82c068190 2023-10-26T06:42:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb81c010430 con 0x7fb82c068190 2023-10-26T06:42:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c19e320 con 0x7fb82c068190 2023-10-26T06:42:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c018680 con 0x7fb82c068190 2023-10-26T06:42:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.182+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c1a5b80 con 0x7fb82c068190 2023-10-26T06:42:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.184+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c0fed60 con 0x7fb82c068190 2023-10-26T06:42:20.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.186+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fb81c010860 con 0x7fb82c068190 2023-10-26T06:42:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.187+0000 7fb8297fa700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8140a15e0 0x7fb8140a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.187+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb81c014070 con 0x7fb82c068190 2023-10-26T06:42:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.187+0000 7fb82b7fe700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8140a15e0 0x7fb8140a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.188+0000 7fb82b7fe700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8140a15e0 0x7fb8140a3aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8200098e0 tx=0x7fb820005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:20.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.191+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb81c052100 con 0x7fb82c068190 2023-10-26T06:42:20.171 INFO:teuthology.orchestra.run.smithi050.stdout:146028888118 2023-10-26T06:42:20.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.413+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb82c19a120 con 0x7fb82c068190 2023-10-26T06:42:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.414+0000 7fb8297fa700 1 -- 172.21.15.50:0/3109848442 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb81c096410 con 0x7fb82c068190 2023-10-26T06:42:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8140a15e0 msgr2=0x7fb8140a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8140a15e0 0x7fb8140a3aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8200098e0 tx=0x7fb820005960 comp rx=0 tx=0).stop 2023-10-26T06:42:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 msgr2=0x7fb82c198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c198e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00e9f0 tx=0x7fb81c00ed00 comp rx=0 tx=0).stop 2023-10-26T06:42:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 shutdown_connections 2023-10-26T06:42:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb8140a15e0 0x7fb8140a3aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82c1067a0 0x7fb82c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb82c068190 0x7fb82c198e10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 --2- 172.21.15.50:0/3109848442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb82c068b30 0x7fb82c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 >> 172.21.15.50:0/3109848442 conn(0x7fb82c075790 msgr2=0x7fb82c10bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 shutdown_connections 2023-10-26T06:42:20.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:19.416+0000 7fb83266a700 1 -- 172.21.15.50:0/3109848442 wait complete. 2023-10-26T06:42:20.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:19 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3375209919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-26T06:42:20.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:19 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3109848442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-26T06:42:20.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.741+0000 7ff95b04d700 1 -- 172.21.15.50:0/394624964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 msgr2=0x7ff954105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.741+0000 7ff95b04d700 1 --2- 172.21.15.50:0/394624964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff954105ba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff948009990 tx=0x7ff948009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.743+0000 7ff95b04d700 1 -- 172.21.15.50:0/394624964 shutdown_connections 2023-10-26T06:42:20.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.743+0000 7ff95b04d700 1 --2- 172.21.15.50:0/394624964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff954101260 0x7ff95410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.743+0000 7ff95b04d700 1 --2- 172.21.15.50:0/394624964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff954105ba0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.743+0000 7ff95b04d700 1 --2- 172.21.15.50:0/394624964 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9541008a0 0x7ff954100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.743+0000 7ff95b04d700 1 -- 172.21.15.50:0/394624964 >> 172.21.15.50:0/394624964 conn(0x7ff9540779e0 msgr2=0x7ff954077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.744+0000 7ff95b04d700 1 -- 172.21.15.50:0/394624964 shutdown_connections 2023-10-26T06:42:20.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.744+0000 7ff95b04d700 1 -- 172.21.15.50:0/394624964 wait complete. 2023-10-26T06:42:20.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.745+0000 7ff95b04d700 1 Processor -- start 2023-10-26T06:42:20.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.746+0000 7ff95b04d700 1 -- start start 2023-10-26T06:42:20.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff95b04d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9541008a0 0x7ff9541a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff95b04d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff954101260 0x7ff9541a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff95b04d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff95410c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff95b04d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95410ce30 con 0x7ff9541008a0 2023-10-26T06:42:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff95b04d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95410cfa0 con 0x7ff954101260 2023-10-26T06:42:20.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff95b04d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95410d160 con 0x7ff9541057c0 2023-10-26T06:42:20.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff9595ea700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff95410c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff958de9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9541008a0 0x7ff9541a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff9595ea700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff95410c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:56650/0 (socket says 172.21.15.50:56650) 2023-10-26T06:42:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff9595ea700 1 -- 172.21.15.50:0/3298087050 learned_addr learned my addr 172.21.15.50:0/3298087050 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:20.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.747+0000 7ff953fff700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff954101260 0x7ff9541a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff9595ea700 1 -- 172.21.15.50:0/3298087050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff954101260 msgr2=0x7ff9541a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff9595ea700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff954101260 0x7ff9541a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff9595ea700 1 -- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9541008a0 msgr2=0x7ff9541a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff9595ea700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9541008a0 0x7ff9541a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff9595ea700 1 -- 172.21.15.50:0/3298087050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009c40 con 0x7ff9541057c0 2023-10-26T06:42:20.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff958de9700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9541008a0 0x7ff9541a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:42:20.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff9595ea700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff95410c700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c0f0 tx=0x7ff94c00c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:20.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00cb60 con 0x7ff9541057c0 2023-10-26T06:42:20.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff94c00e030 con 0x7ff9541057c0 2023-10-26T06:42:20.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.748+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9480095f0 con 0x7ff9541057c0 2023-10-26T06:42:20.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.749+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c004810 con 0x7ff9541057c0 2023-10-26T06:42:20.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.749+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9541a9fb0 con 0x7ff9541057c0 2023-10-26T06:42:20.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.751+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954101f30 con 0x7ff9541057c0 2023-10-26T06:42:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.752+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7ff94c003a00 con 0x7ff9541057c0 2023-10-26T06:42:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.754+0000 7ff951ffb700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9440a15e0 0x7ff9440a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.754+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff94c0cce70 con 0x7ff9541057c0 2023-10-26T06:42:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.754+0000 7ff958de9700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9440a15e0 0x7ff9440a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:20.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.755+0000 7ff958de9700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9440a15e0 0x7ff9440a3aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b2e0 tx=0x7ff948005c00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:20.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.758+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff94c0963c0 con 0x7ff9541057c0 2023-10-26T06:42:20.953 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:20 smithi050 ceph-mon[94997]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-10-26T06:42:20.953 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:20 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2485258806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-26T06:42:20.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.981+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff95419e5c0 con 0x7ff9541057c0 2023-10-26T06:42:20.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.981+0000 7ff951ffb700 1 -- 172.21.15.50:0/3298087050 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff94c0999e0 con 0x7ff9541057c0 2023-10-26T06:42:20.984 INFO:teuthology.orchestra.run.smithi050.stdout:223338299432 2023-10-26T06:42:20.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:20 smithi153 ceph-mon[131657]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-10-26T06:42:20.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:20 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2485258806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-26T06:42:20.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9440a15e0 msgr2=0x7ff9440a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9440a15e0 0x7ff9440a3aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b2e0 tx=0x7ff948005c00 comp rx=0 tx=0).stop 2023-10-26T06:42:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 msgr2=0x7ff95410c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff95410c700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c0f0 tx=0x7ff94c00c4b0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 shutdown_connections 2023-10-26T06:42:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9440a15e0 0x7ff9440a3aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9541057c0 0x7ff95410c700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9541008a0 0x7ff9541a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 --2- 172.21.15.50:0/3298087050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff954101260 0x7ff9541a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:20.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 >> 172.21.15.50:0/3298087050 conn(0x7ff9540779e0 msgr2=0x7ff9540fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:20.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 shutdown_connections 2023-10-26T06:42:20.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:20.985+0000 7ff95b04d700 1 -- 172.21.15.50:0/3298087050 wait complete. 2023-10-26T06:42:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:20 smithi125 ceph-mon[130643]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-10-26T06:42:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:20 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2485258806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-26T06:42:21.474 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070496 got 253403070499 for osd.8 2023-10-26T06:42:21.475 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:21.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3298087050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-26T06:42:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3298087050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-26T06:42:22.049 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888115 got 146028888118 for osd.4 2023-10-26T06:42:22.049 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:22.136 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299429 got 223338299432 for osd.7 2023-10-26T06:42:22.136 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:22.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3298087050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-26T06:42:22.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 -- 172.21.15.50:0/2784304706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6601057c0 msgr2=0x7fc660105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 --2- 172.21.15.50:0/2784304706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6601057c0 0x7fc660105ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009990 tx=0x7fc65c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 -- 172.21.15.50:0/2784304706 shutdown_connections 2023-10-26T06:42:22.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 --2- 172.21.15.50:0/2784304706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc660101260 0x7fc66010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 --2- 172.21.15.50:0/2784304706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6601057c0 0x7fc660105ba0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 --2- 172.21.15.50:0/2784304706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6601008a0 0x7fc660100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 -- 172.21.15.50:0/2784304706 >> 172.21.15.50:0/2784304706 conn(0x7fc6600779e0 msgr2=0x7fc660077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:22.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 -- 172.21.15.50:0/2784304706 shutdown_connections 2023-10-26T06:42:22.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.331+0000 7fc668035700 1 -- 172.21.15.50:0/2784304706 wait complete. 2023-10-26T06:42:22.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.332+0000 7fc668035700 1 Processor -- start 2023-10-26T06:42:22.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.332+0000 7fc668035700 1 -- start start 2023-10-26T06:42:22.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc668035700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6601008a0 0x7fc660198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc668035700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 0x7fc660199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc6655d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 0x7fc660199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc6655d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 0x7fc660199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38918/0 (socket says 172.21.15.50:38918) 2023-10-26T06:42:22.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc665dd1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6601008a0 0x7fc660198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc665dd1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6601008a0 0x7fc660198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:58300/0 (socket says 172.21.15.50:58300) 2023-10-26T06:42:22.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc668035700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6601057c0 0x7fc66019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc6655d0700 1 -- 172.21.15.50:0/2479524822 learned_addr learned my addr 172.21.15.50:0/2479524822 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:22.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66019dcf0 con 0x7fc660101260 2023-10-26T06:42:22.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66019de60 con 0x7fc6601008a0 2023-10-26T06:42:22.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.333+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66019e020 con 0x7fc6601057c0 2023-10-26T06:42:22.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6665d2700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6601057c0 0x7fc66019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6655d0700 1 -- 172.21.15.50:0/2479524822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6601057c0 msgr2=0x7fc66019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6655d0700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6601057c0 0x7fc66019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6655d0700 1 -- 172.21.15.50:0/2479524822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6601008a0 msgr2=0x7fc660198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6655d0700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6601008a0 0x7fc660198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6655d0700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658009c40 con 0x7fc660101260 2023-10-26T06:42:22.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc6655d0700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 0x7fc660199420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc65000e9a0 tx=0x7fc65000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:22.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650009790 con 0x7fc660101260 2023-10-26T06:42:22.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c0095f0 con 0x7fc660101260 2023-10-26T06:42:22.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc65000cbd0 con 0x7fc660101260 2023-10-26T06:42:22.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650018680 con 0x7fc660101260 2023-10-26T06:42:22.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.334+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6601a5990 con 0x7fc660101260 2023-10-26T06:42:22.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.336+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660101f30 con 0x7fc660101260 2023-10-26T06:42:22.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.337+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc65000cd40 con 0x7fc660101260 2023-10-26T06:42:22.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.339+0000 7fc656ffd700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc64c0a15e0 0x7fc64c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.339+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc650014070 con 0x7fc660101260 2023-10-26T06:42:22.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.339+0000 7fc665dd1700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc64c0a15e0 0x7fc64c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.340+0000 7fc665dd1700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc64c0a15e0 0x7fc64c0a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00b2e0 tx=0x7fc65c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:22.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.343+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc650052100 con 0x7fc660101260 2023-10-26T06:42:22.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 -- 172.21.15.50:0/2466625090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4105670 msgr2=0x7f59e4105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 --2- 172.21.15.50:0/2466625090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4105670 0x7f59e4105a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59e00099c0 tx=0x7f59e0009cd0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 -- 172.21.15.50:0/2466625090 shutdown_connections 2023-10-26T06:42:22.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 --2- 172.21.15.50:0/2466625090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4069410 0x7f59e410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 --2- 172.21.15.50:0/2466625090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4105670 0x7f59e4105a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 --2- 172.21.15.50:0/2466625090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e4068a50 0x7f59e4068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 -- 172.21.15.50:0/2466625090 >> 172.21.15.50:0/2466625090 conn(0x7f59e40766c0 msgr2=0x7f59e4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:22.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 -- 172.21.15.50:0/2466625090 shutdown_connections 2023-10-26T06:42:22.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.345+0000 7f59ec53e700 1 -- 172.21.15.50:0/2466625090 wait complete. 2023-10-26T06:42:22.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.346+0000 7f59ec53e700 1 Processor -- start 2023-10-26T06:42:22.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.346+0000 7f59ec53e700 1 -- start start 2023-10-26T06:42:22.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.346+0000 7f59ec53e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4068a50 0x7f59e40ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ec53e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 0x7f59e40ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ec53e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e4105670 0x7f59e4100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ec53e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e41a4fb0 con 0x7f59e4069410 2023-10-26T06:42:22.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ec53e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e41a5120 con 0x7f59e4068a50 2023-10-26T06:42:22.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ec53e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e41a52e0 con 0x7f59e4105670 2023-10-26T06:42:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 0x7f59e40ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ea2da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4068a50 0x7f59e40ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 0x7f59e40ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38936/0 (socket says 172.21.15.50:38936) 2023-10-26T06:42:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 -- 172.21.15.50:0/1185720837 learned_addr learned my addr 172.21.15.50:0/1185720837 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:22.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59eaadb700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e4105670 0x7f59e4100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 -- 172.21.15.50:0/1185720837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e4105670 msgr2=0x7f59e4100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e4105670 0x7f59e4100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 -- 172.21.15.50:0/1185720837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4068a50 msgr2=0x7f59e40ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4068a50 0x7f59e40ff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59e9ad9700 1 -- 172.21.15.50:0/1185720837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00095f0 con 0x7f59e4069410 2023-10-26T06:42:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.347+0000 7f59ea2da700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4068a50 0x7f59e40ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.348+0000 7f59e9ad9700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 0x7f59e40ffcf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f59d400d980 tx=0x7f59d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.348+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4004220 con 0x7f59e4069410 2023-10-26T06:42:22.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.348+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59d4007640 con 0x7f59e4069410 2023-10-26T06:42:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.348+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4005610 con 0x7f59e4069410 2023-10-26T06:42:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.348+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e41a55c0 con 0x7f59e4069410 2023-10-26T06:42:22.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.348+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e41a5a70 con 0x7f59e4069410 2023-10-26T06:42:22.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.349+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e4108d30 con 0x7f59e4069410 2023-10-26T06:42:22.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.352+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f59d4004750 con 0x7f59e4069410 2023-10-26T06:42:22.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.354+0000 7f59db7fe700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59d00a15e0 0x7f59d00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:22.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.354+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f59d40cd1f0 con 0x7f59e4069410 2023-10-26T06:42:22.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.354+0000 7f59ea2da700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59d00a15e0 0x7f59d00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:22.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.355+0000 7f59ea2da700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59d00a15e0 0x7f59d00a3aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009990 tx=0x7f59e0005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:22.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.357+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f59d40966b0 con 0x7f59e4069410 2023-10-26T06:42:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.566+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc66019a1a0 con 0x7fc660101260 2023-10-26T06:42:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.567+0000 7fc656ffd700 1 -- 172.21.15.50:0/2479524822 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6500965f0 con 0x7fc660101260 2023-10-26T06:42:22.569 INFO:teuthology.orchestra.run.smithi050.stdout:167503724594 2023-10-26T06:42:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.569+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc64c0a15e0 msgr2=0x7fc64c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.569+0000 7fc668035700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc64c0a15e0 0x7fc64c0a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00b2e0 tx=0x7fc65c005960 comp rx=0 tx=0).stop 2023-10-26T06:42:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.569+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 msgr2=0x7fc660199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.569+0000 7fc668035700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 0x7fc660199420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc65000e9a0 tx=0x7fc65000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 shutdown_connections 2023-10-26T06:42:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc64c0a15e0 0x7fc64c0a3aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6601057c0 0x7fc66019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6601008a0 0x7fc660198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 --2- 172.21.15.50:0/2479524822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660101260 0x7fc660199420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 >> 172.21.15.50:0/2479524822 conn(0x7fc6600779e0 msgr2=0x7fc6600fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 shutdown_connections 2023-10-26T06:42:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.570+0000 7fc668035700 1 -- 172.21.15.50:0/2479524822 wait complete. 2023-10-26T06:42:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.573+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f59e4101ee0 con 0x7f59e4069410 2023-10-26T06:42:22.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.573+0000 7f59db7fe700 1 -- 172.21.15.50:0/1185720837 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f59d40cc020 con 0x7f59e4069410 2023-10-26T06:42:22.575 INFO:teuthology.orchestra.run.smithi050.stdout:339302416407 2023-10-26T06:42:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59d00a15e0 msgr2=0x7f59d00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59d00a15e0 0x7f59d00a3aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009990 tx=0x7f59e0005fd0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 msgr2=0x7f59e40ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 0x7f59e40ffcf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f59d400d980 tx=0x7f59d400dc90 comp rx=0 tx=0).stop 2023-10-26T06:42:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 shutdown_connections 2023-10-26T06:42:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59d00a15e0 0x7f59d00a3aa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59e4105670 0x7f59e4100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59e4068a50 0x7f59e40ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 --2- 172.21.15.50:0/1185720837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4069410 0x7f59e40ffcf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 >> 172.21.15.50:0/1185720837 conn(0x7f59e40766c0 msgr2=0x7f59e40fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 shutdown_connections 2023-10-26T06:42:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:22.576+0000 7f59ec53e700 1 -- 172.21.15.50:0/1185720837 wait complete. 2023-10-26T06:42:22.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:22 smithi050 ceph-mon[94997]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-26T06:42:22.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2479524822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-26T06:42:22.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1185720837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-26T06:42:22.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:22 smithi153 ceph-mon[131657]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-26T06:42:22.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:22 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2479524822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-26T06:42:22.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:22 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1185720837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-26T06:42:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:22 smithi125 ceph-mon[130643]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-10-26T06:42:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:22 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2479524822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-26T06:42:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:22 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1185720837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-26T06:42:23.195 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645335 got 309237645337 for osd.10 2023-10-26T06:42:23.195 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:23.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 -- 172.21.15.50:0/1912581186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 msgr2=0x7f1568072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 --2- 172.21.15.50:0/1912581186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568072e00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1564009990 tx=0x7f1564009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 -- 172.21.15.50:0/1912581186 shutdown_connections 2023-10-26T06:42:23.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 --2- 172.21.15.50:0/1912581186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f156810d250 0x7f156810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 --2- 172.21.15.50:0/1912581186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568072e00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 --2- 172.21.15.50:0/1912581186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 0x7f156810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 -- 172.21.15.50:0/1912581186 >> 172.21.15.50:0/1912581186 conn(0x7f15680779e0 msgr2=0x7f1568077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:23.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 -- 172.21.15.50:0/1912581186 shutdown_connections 2023-10-26T06:42:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.380+0000 7f156f703700 1 -- 172.21.15.50:0/1912581186 wait complete. 2023-10-26T06:42:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.381+0000 7f156f703700 1 Processor -- start 2023-10-26T06:42:23.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 -- start start 2023-10-26T06:42:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 0x7f1568199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f156810d250 0x7f156819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156819ddb0 con 0x7f1568072a20 2023-10-26T06:42:23.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156819df20 con 0x7f1568073340 2023-10-26T06:42:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156f703700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156819e0e0 con 0x7f156810d250 2023-10-26T06:42:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156d49f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156d49f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38952/0 (socket says 172.21.15.50:38952) 2023-10-26T06:42:23.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156d49f700 1 -- 172.21.15.50:0/2013499872 learned_addr learned my addr 172.21.15.50:0/2013499872 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156dca0700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f156810d250 0x7f156819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.382+0000 7f156cc9e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 0x7f1568199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156d49f700 1 -- 172.21.15.50:0/2013499872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f156810d250 msgr2=0x7f156819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156d49f700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f156810d250 0x7f156819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156d49f700 1 -- 172.21.15.50:0/2013499872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 msgr2=0x7f1568199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156d49f700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 0x7f1568199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156d49f700 1 -- 172.21.15.50:0/2013499872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640095f0 con 0x7f1568072a20 2023-10-26T06:42:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156cc9e700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 0x7f1568199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:23.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f156d49f700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568198f00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1564005910 tx=0x7f1564004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.383+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156401d070 con 0x7f1568072a20 2023-10-26T06:42:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.384+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156819e360 con 0x7f1568072a20 2023-10-26T06:42:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.384+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1564022470 con 0x7f1568072a20 2023-10-26T06:42:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.384+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564017650 con 0x7f1568072a20 2023-10-26T06:42:23.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.384+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15681a5c20 con 0x7f1568072a20 2023-10-26T06:42:23.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.385+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1568108460 con 0x7f1568072a20 2023-10-26T06:42:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.387+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f15640225e0 con 0x7f1568072a20 2023-10-26T06:42:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.388+0000 7f155e7fc700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15540a1560 0x7f15540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.388+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f15640ce250 con 0x7f1568072a20 2023-10-26T06:42:23.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.388+0000 7f156cc9e700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15540a1560 0x7f15540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.389+0000 7f156cc9e700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15540a1560 0x7f15540a3a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f156819a410 tx=0x7f1558009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:23.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.393+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15640977a0 con 0x7f1568072a20 2023-10-26T06:42:23.423 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416404 got 339302416407 for osd.11 2023-10-26T06:42:23.424 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:23.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 -- 172.21.15.50:0/504394390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c18068e20 msgr2=0x7f5c18069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/504394390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c18068e20 0x7f5c18069280 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009990 tx=0x7f5c0c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 -- 172.21.15.50:0/504394390 shutdown_connections 2023-10-26T06:42:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/504394390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c180697c0 0x7f5c1810d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/504394390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c181067d0 0x7f5c18106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/504394390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c18068e20 0x7f5c18069280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 -- 172.21.15.50:0/504394390 >> 172.21.15.50:0/504394390 conn(0x7f5c180757d0 msgr2=0x7f5c18075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 -- 172.21.15.50:0/504394390 shutdown_connections 2023-10-26T06:42:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.557+0000 7f5c1db7e700 1 -- 172.21.15.50:0/504394390 wait complete. 2023-10-26T06:42:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.558+0000 7f5c1db7e700 1 Processor -- start 2023-10-26T06:42:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.558+0000 7f5c1db7e700 1 -- start start 2023-10-26T06:42:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c1db7e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c18068e20 0x7f5c180ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c1db7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c180697c0 0x7f5c180ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c1db7e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c181067d0 0x7f5c181002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c1db7e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181a4fa0 con 0x7f5c180697c0 2023-10-26T06:42:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c1db7e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181a5110 con 0x7f5c181067d0 2023-10-26T06:42:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c1db7e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181a52d0 con 0x7f5c18068e20 2023-10-26T06:42:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c16ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c180697c0 0x7f5c180ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c177fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c18068e20 0x7f5c180ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c16ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c180697c0 0x7f5c180ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38968/0 (socket says 172.21.15.50:38968) 2023-10-26T06:42:23.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c16ffd700 1 -- 172.21.15.50:0/1699283712 learned_addr learned my addr 172.21.15.50:0/1699283712 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.559+0000 7f5c17fff700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c181067d0 0x7f5c181002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.560+0000 7f5c177fe700 1 -- 172.21.15.50:0/1699283712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c181067d0 msgr2=0x7f5c181002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.560+0000 7f5c177fe700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c181067d0 0x7f5c181002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.560+0000 7f5c177fe700 1 -- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c180697c0 msgr2=0x7f5c180ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.560+0000 7f5c177fe700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c180697c0 0x7f5c180ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.560+0000 7f5c177fe700 1 -- 172.21.15.50:0/1699283712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0095f0 con 0x7f5c18068e20 2023-10-26T06:42:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.563+0000 7f5c177fe700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c18068e20 0x7f5c180ff820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800e9f0 tx=0x7f5c0800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.563+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800c9c0 con 0x7f5c18068e20 2023-10-26T06:42:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.563+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c181a55b0 con 0x7f5c18068e20 2023-10-26T06:42:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.563+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c08010430 con 0x7f5c18068e20 2023-10-26T06:42:23.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.563+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08018680 con 0x7f5c18068e20 2023-10-26T06:42:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.563+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c181a5ab0 con 0x7f5c18068e20 2023-10-26T06:42:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.565+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c18108d10 con 0x7f5c18068e20 2023-10-26T06:42:23.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.567+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f5c08010860 con 0x7f5c18068e20 2023-10-26T06:42:23.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.568+0000 7f5c14ff9700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5c000a1560 0x7f5c000a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.568+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f5c08014070 con 0x7f5c18068e20 2023-10-26T06:42:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.568+0000 7f5c16ffd700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5c000a1560 0x7f5c000a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:23.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.569+0000 7f5c16ffd700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5c000a1560 0x7f5c000a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00b6f0 tx=0x7f5c0c005bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:23.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.584+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c08096490 con 0x7f5c18068e20 2023-10-26T06:42:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.623+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f156819a1c0 con 0x7f1568072a20 2023-10-26T06:42:23.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.623+0000 7f155e7fc700 1 -- 172.21.15.50:0/2013499872 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f156409adc0 con 0x7f1568072a20 2023-10-26T06:42:23.625 INFO:teuthology.orchestra.run.smithi050.stdout:287762808863 2023-10-26T06:42:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15540a1560 msgr2=0x7f15540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15540a1560 0x7f15540a3a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f156819a410 tx=0x7f1558009260 comp rx=0 tx=0).stop 2023-10-26T06:42:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 msgr2=0x7f1568198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568198f00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1564005910 tx=0x7f1564004730 comp rx=0 tx=0).stop 2023-10-26T06:42:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 shutdown_connections 2023-10-26T06:42:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15540a1560 0x7f15540a3a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f156810d250 0x7f156819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1568072a20 0x7f1568198f00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 --2- 172.21.15.50:0/2013499872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1568073340 0x7f1568199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 >> 172.21.15.50:0/2013499872 conn(0x7f15680779e0 msgr2=0x7f15680fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:23.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 shutdown_connections 2023-10-26T06:42:23.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.627+0000 7f156f703700 1 -- 172.21.15.50:0/2013499872 wait complete. 2023-10-26T06:42:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.825+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c1804e4c0 con 0x7f5c18068e20 2023-10-26T06:42:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.826+0000 7f5c14ff9700 1 -- 172.21.15.50:0/1699283712 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c08099ab0 con 0x7f5c18068e20 2023-10-26T06:42:23.828 INFO:teuthology.orchestra.run.smithi050.stdout:111669149755 2023-10-26T06:42:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5c000a1560 msgr2=0x7f5c000a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5c000a1560 0x7f5c000a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00b6f0 tx=0x7f5c0c005bc0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c18068e20 msgr2=0x7f5c180ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c18068e20 0x7f5c180ff820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800e9f0 tx=0x7f5c0800ed00 comp rx=0 tx=0).stop 2023-10-26T06:42:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 shutdown_connections 2023-10-26T06:42:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5c000a1560 0x7f5c000a3a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c181067d0 0x7f5c181002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c18068e20 0x7f5c180ff820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 --2- 172.21.15.50:0/1699283712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c180697c0 0x7f5c180ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.828+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 >> 172.21.15.50:0/1699283712 conn(0x7f5c180757d0 msgr2=0x7f5c180fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.829+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 shutdown_connections 2023-10-26T06:42:23.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:23.829+0000 7f5c1db7e700 1 -- 172.21.15.50:0/1699283712 wait complete. 2023-10-26T06:42:24.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:23 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2013499872' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-26T06:42:24.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:23 smithi050 ceph-mon[94997]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:24.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:23 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1699283712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-26T06:42:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:23 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2013499872' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-26T06:42:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:23 smithi125 ceph-mon[130643]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:23 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1699283712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-26T06:42:24.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724591 got 167503724594 for osd.5 2023-10-26T06:42:24.204 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:23 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2013499872' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-26T06:42:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:23 smithi153 ceph-mon[131657]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:24.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:23 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1699283712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-26T06:42:24.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808860 got 287762808863 for osd.9 2023-10-26T06:42:24.560 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:24.970 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149753 got 111669149755 for osd.3 2023-10-26T06:42:24.971 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:25.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 -- 172.21.15.50:0/2812117677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17241057c0 msgr2=0x7f1724105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 --2- 172.21.15.50:0/2812117677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17241057c0 0x7f1724105ba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1714009990 tx=0x7f1714009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 -- 172.21.15.50:0/2812117677 shutdown_connections 2023-10-26T06:42:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 --2- 172.21.15.50:0/2812117677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1724101260 0x7f172410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 --2- 172.21.15.50:0/2812117677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17241057c0 0x7f1724105ba0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 --2- 172.21.15.50:0/2812117677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 -- 172.21.15.50:0/2812117677 >> 172.21.15.50:0/2812117677 conn(0x7f17240779e0 msgr2=0x7f1724077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 -- 172.21.15.50:0/2812117677 shutdown_connections 2023-10-26T06:42:25.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.304+0000 7f1729412700 1 -- 172.21.15.50:0/2812117677 wait complete. 2023-10-26T06:42:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.305+0000 7f1729412700 1 Processor -- start 2023-10-26T06:42:25.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.305+0000 7f1729412700 1 -- start start 2023-10-26T06:42:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1729412700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1729412700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1724101260 0x7f1724199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1729412700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241057c0 0x7f172419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1729412700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172419de00 con 0x7f1724101260 2023-10-26T06:42:25.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1729412700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172419df70 con 0x7f17241057c0 2023-10-26T06:42:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1729412700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172419e130 con 0x7f17241008a0 2023-10-26T06:42:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1722ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1722ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:45968/0 (socket says 172.21.15.50:45968) 2023-10-26T06:42:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f1722ffd700 1 -- 172.21.15.50:0/2390401453 learned_addr learned my addr 172.21.15.50:0/2390401453 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:25.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.306+0000 7f17227fc700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1724101260 0x7f1724199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f17237fe700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241057c0 0x7f172419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1722ffd700 1 -- 172.21.15.50:0/2390401453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241057c0 msgr2=0x7f172419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1722ffd700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241057c0 0x7f172419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1722ffd700 1 -- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1724101260 msgr2=0x7f1724199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:25.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1722ffd700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1724101260 0x7f1724199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1722ffd700 1 -- 172.21.15.50:0/2390401453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140095f0 con 0x7f17241008a0 2023-10-26T06:42:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f17237fe700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241057c0 0x7f172419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:42:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f17227fc700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1724101260 0x7f1724199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1722ffd700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724198f00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f1714005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:25.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171401d070 con 0x7f17241008a0 2023-10-26T06:42:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172419e3b0 con 0x7f17241008a0 2023-10-26T06:42:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1714022470 con 0x7f17241008a0 2023-10-26T06:42:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.307+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714017650 con 0x7f17241008a0 2023-10-26T06:42:25.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.308+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241a5c70 con 0x7f17241008a0 2023-10-26T06:42:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.309+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1724101f30 con 0x7f17241008a0 2023-10-26T06:42:25.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.311+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f171400fad0 con 0x7f17241008a0 2023-10-26T06:42:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.312+0000 7f170bfff700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f170c0a1560 0x7f170c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.312+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f17140ce9d0 con 0x7f17241008a0 2023-10-26T06:42:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.312+0000 7f17227fc700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f170c0a1560 0x7f170c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:25.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.313+0000 7f17227fc700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f170c0a1560 0x7f170c0a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f172419a460 tx=0x7f17180073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:25.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.314+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1714097f20 con 0x7f17241008a0 2023-10-26T06:42:25.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.527+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f172404e4c0 con 0x7f17241008a0 2023-10-26T06:42:25.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.527+0000 7f170bfff700 1 -- 172.21.15.50:0/2390401453 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f171409b540 con 0x7f17241008a0 2023-10-26T06:42:25.529 INFO:teuthology.orchestra.run.smithi050.stdout:81604378689 2023-10-26T06:42:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f170c0a1560 msgr2=0x7f170c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f170c0a1560 0x7f170c0a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f172419a460 tx=0x7f17180073d0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 msgr2=0x7f1724198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:25.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724198f00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f1714005740 comp rx=0 tx=0).stop 2023-10-26T06:42:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 shutdown_connections 2023-10-26T06:42:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f170c0a1560 0x7f170c0a3a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17241057c0 0x7f172419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17241008a0 0x7f1724198f00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 --2- 172.21.15.50:0/2390401453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1724101260 0x7f1724199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 >> 172.21.15.50:0/2390401453 conn(0x7f17240779e0 msgr2=0x7f172410ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 shutdown_connections 2023-10-26T06:42:25.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:25.530+0000 7f1729412700 1 -- 172.21.15.50:0/2390401453 wait complete. 2023-10-26T06:42:25.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:25 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2390401453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-26T06:42:25.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:25 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2390401453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-26T06:42:26.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:25 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2390401453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-26T06:42:26.084 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378687 got 81604378689 for osd.2 2023-10-26T06:42:26.085 DEBUG:teuthology.parallel:result is None 2023-10-26T06:42:26.085 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-26T06:42:26.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph pg dump --format=json 2023-10-26T06:42:26.833 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:26.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:26 smithi125 ceph-mon[130643]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:26.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:26 smithi153 ceph-mon[131657]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:26 smithi050 ceph-mon[94997]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 -- 172.21.15.50:0/2675841417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201008a0 msgr2=0x7fe220100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 --2- 172.21.15.50:0/2675841417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201008a0 0x7fe220100d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe214009990 tx=0x7fe214009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 -- 172.21.15.50:0/2675841417 shutdown_connections 2023-10-26T06:42:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 --2- 172.21.15.50:0/2675841417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe220101260 0x7fe22010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 --2- 172.21.15.50:0/2675841417 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2201057c0 0x7fe220105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 --2- 172.21.15.50:0/2675841417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201008a0 0x7fe220100d20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 -- 172.21.15.50:0/2675841417 >> 172.21.15.50:0/2675841417 conn(0x7fe2200779e0 msgr2=0x7fe220077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 -- 172.21.15.50:0/2675841417 shutdown_connections 2023-10-26T06:42:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.345+0000 7fe225beb700 1 -- 172.21.15.50:0/2675841417 wait complete. 2023-10-26T06:42:28.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.346+0000 7fe225beb700 1 Processor -- start 2023-10-26T06:42:28.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.346+0000 7fe225beb700 1 -- start start 2023-10-26T06:42:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe225beb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2201008a0 0x7fe220072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe225beb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 0x7fe220073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe225beb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201057c0 0x7fe220073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe225beb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2201a4f90 con 0x7fe2201057c0 2023-10-26T06:42:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe225beb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2201a5100 con 0x7fe220101260 2023-10-26T06:42:28.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe225beb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2201a52c0 con 0x7fe2201008a0 2023-10-26T06:42:28.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe21effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 0x7fe220073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:28.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe21f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2201008a0 0x7fe220072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:28.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe21effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 0x7fe220073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:46330/0 (socket says 172.21.15.50:46330) 2023-10-26T06:42:28.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe21effd700 1 -- 172.21.15.50:0/2126560044 learned_addr learned my addr 172.21.15.50:0/2126560044 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.347+0000 7fe21ffff700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201057c0 0x7fe220073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21f7fe700 1 -- 172.21.15.50:0/2126560044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 msgr2=0x7fe220073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21f7fe700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 0x7fe220073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21f7fe700 1 -- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201057c0 msgr2=0x7fe220073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21f7fe700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201057c0 0x7fe220073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21f7fe700 1 -- 172.21.15.50:0/2126560044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140095f0 con 0x7fe2201008a0 2023-10-26T06:42:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21effd700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 0x7fe220073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21ffff700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201057c0 0x7fe220073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21f7fe700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2201008a0 0x7fe220072af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe21000e9c0 tx=0x7fe21000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210004220 con 0x7fe2201008a0 2023-10-26T06:42:28.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2201a55a0 con 0x7fe2201008a0 2023-10-26T06:42:28.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe210004380 con 0x7fe2201008a0 2023-10-26T06:42:28.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210003be0 con 0x7fe2201008a0 2023-10-26T06:42:28.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.348+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2201a5aa0 con 0x7fe2201008a0 2023-10-26T06:42:28.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.349+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220108da0 con 0x7fe2201008a0 2023-10-26T06:42:28.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.352+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fe210003d40 con 0x7fe2201008a0 2023-10-26T06:42:28.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.353+0000 7fe21cff9700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2080a1560 0x7fe2080a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:28.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.353+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fe210014070 con 0x7fe2201008a0 2023-10-26T06:42:28.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.353+0000 7fe21effd700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2080a1560 0x7fe2080a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:28.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.354+0000 7fe21effd700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2080a1560 0x7fe2080a3a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2200741d0 tx=0x7fe21400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:28.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.355+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe210096790 con 0x7fe2201008a0 2023-10-26T06:42:28.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.559+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe220073f80 con 0x7fe2080a1560 2023-10-26T06:42:28.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.571+0000 7fe21cff9700 1 -- 172.21.15.50:0/2126560044 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340675 (secure 0 0 0) 0x7fe220073f80 con 0x7fe2080a1560 2023-10-26T06:42:28.579 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2080a1560 msgr2=0x7fe2080a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:28.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2080a1560 0x7fe2080a3a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2200741d0 tx=0x7fe21400b260 comp rx=0 tx=0).stop 2023-10-26T06:42:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2201008a0 msgr2=0x7fe220072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2201008a0 0x7fe220072af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe21000e9c0 tx=0x7fe21000ecd0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 shutdown_connections 2023-10-26T06:42:28.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe2080a1560 0x7fe2080a3a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2201057c0 0x7fe220073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2201008a0 0x7fe220072af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 --2- 172.21.15.50:0/2126560044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe220101260 0x7fe220073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.576+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 >> 172.21.15.50:0/2126560044 conn(0x7fe2200779e0 msgr2=0x7fe2200fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:28.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.577+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 shutdown_connections 2023-10-26T06:42:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:28.577+0000 7fe225beb700 1 -- 172.21.15.50:0/2126560044 wait complete. 2023-10-26T06:42:28.584 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:42:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:28 smithi153 ceph-mon[131657]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:29.013 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:28 smithi050 ceph-mon[94997]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:29.016 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-10-26T06:42:27.635989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":453,"num_read_kb":343,"num_write":332,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336972,"kb_used_data":12772,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604852,"statfs":{"total":1151940427776,"available":1151595368448,"internally_reserved":0,"allocated":13078528,"data_stored":7295716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640504+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:41:33.640504+0000","last_peered":"2023-10-26T06:41:33.640504+0000","last_clean":"2023-10-26T06:41:33.640504+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:41:33.640504+0000","last_undegraded":"2023-10-26T06:41:33.640504+0000","last_fullsized":"2023-10-26T06:41:33.640504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640890+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:41:33.640890+0000","last_peered":"2023-10-26T06:41:33.640890+0000","last_clean":"2023-10-26T06:41:33.640890+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:41:33.640890+0000","last_undegraded":"2023-10-26T06:41:33.640890+0000","last_fullsized":"2023-10-26T06:41:33.640890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640897+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:41:33.640897+0000","last_peered":"2023-10-26T06:41:33.640897+0000","last_clean":"2023-10-26T06:41:33.640897+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:41:33.640897+0000","last_undegraded":"2023-10-26T06:41:33.640897+0000","last_fullsized":"2023-10-26T06:41:33.640897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640010+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:41:33.640010+0000","last_peered":"2023-10-26T06:41:33.640010+0000","last_clean":"2023-10-26T06:41:33.640010+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:41:33.640010+0000","last_undegraded":"2023-10-26T06:41:33.640010+0000","last_fullsized":"2023-10-26T06:41:33.640010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432795+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:41:33.432795+0000","last_peered":"2023-10-26T06:41:33.432795+0000","last_clean":"2023-10-26T06:41:33.432795+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:41:33.432795+0000","last_undegraded":"2023-10-26T06:41:33.432795+0000","last_fullsized":"2023-10-26T06:41:33.432795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640353+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:41:33.640353+0000","last_peered":"2023-10-26T06:41:33.640353+0000","last_clean":"2023-10-26T06:41:33.640353+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:41:33.640353+0000","last_undegraded":"2023-10-26T06:41:33.640353+0000","last_fullsized":"2023-10-26T06:41:33.640353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551931+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:41:32.551931+0000","last_peered":"2023-10-26T06:41:32.551931+0000","last_clean":"2023-10-26T06:41:32.551931+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:41:32.551931+0000","last_undegraded":"2023-10-26T06:41:32.551931+0000","last_fullsized":"2023-10-26T06:41:32.551931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942062+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:41:31.942062+0000","last_peered":"2023-10-26T06:41:31.942062+0000","last_clean":"2023-10-26T06:41:31.942062+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:41:31.942062+0000","last_undegraded":"2023-10-26T06:41:31.942062+0000","last_fullsized":"2023-10-26T06:41:31.942062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942643+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:41:31.942643+0000","last_peered":"2023-10-26T06:41:31.942643+0000","last_clean":"2023-10-26T06:41:31.942643+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:41:31.942643+0000","last_undegraded":"2023-10-26T06:41:31.942643+0000","last_fullsized":"2023-10-26T06:41:31.942643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639839+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:41:33.639839+0000","last_peered":"2023-10-26T06:41:33.639839+0000","last_clean":"2023-10-26T06:41:33.639839+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:41:33.639839+0000","last_undegraded":"2023-10-26T06:41:33.639839+0000","last_fullsized":"2023-10-26T06:41:33.639839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552219+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:41:32.552219+0000","last_peered":"2023-10-26T06:41:32.552219+0000","last_clean":"2023-10-26T06:41:32.552219+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:41:32.552219+0000","last_undegraded":"2023-10-26T06:41:32.552219+0000","last_fullsized":"2023-10-26T06:41:32.552219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639937+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:41:33.639937+0000","last_peered":"2023-10-26T06:41:33.639937+0000","last_clean":"2023-10-26T06:41:33.639937+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:41:33.639937+0000","last_undegraded":"2023-10-26T06:41:33.639937+0000","last_fullsized":"2023-10-26T06:41:33.639937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640417+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:41:33.640417+0000","last_peered":"2023-10-26T06:41:33.640417+0000","last_clean":"2023-10-26T06:41:33.640417+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:41:33.640417+0000","last_undegraded":"2023-10-26T06:41:33.640417+0000","last_fullsized":"2023-10-26T06:41:33.640417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640107+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:41:33.640107+0000","last_peered":"2023-10-26T06:41:33.640107+0000","last_clean":"2023-10-26T06:41:33.640107+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:41:33.640107+0000","last_undegraded":"2023-10-26T06:41:33.640107+0000","last_fullsized":"2023-10-26T06:41:33.640107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640318+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:41:33.640318+0000","last_peered":"2023-10-26T06:41:33.640318+0000","last_clean":"2023-10-26T06:41:33.640318+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:41:33.640318+0000","last_undegraded":"2023-10-26T06:41:33.640318+0000","last_fullsized":"2023-10-26T06:41:33.640318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942255+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:41:31.942255+0000","last_peered":"2023-10-26T06:41:31.942255+0000","last_clean":"2023-10-26T06:41:31.942255+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:41:31.942255+0000","last_undegraded":"2023-10-26T06:41:31.942255+0000","last_fullsized":"2023-10-26T06:41:31.942255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640510+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:41:33.640510+0000","last_peered":"2023-10-26T06:41:33.640510+0000","last_clean":"2023-10-26T06:41:33.640510+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:41:33.640510+0000","last_undegraded":"2023-10-26T06:41:33.640510+0000","last_fullsized":"2023-10-26T06:41:33.640510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640274+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:41:33.640274+0000","last_peered":"2023-10-26T06:41:33.640274+0000","last_clean":"2023-10-26T06:41:33.640274+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:41:33.640274+0000","last_undegraded":"2023-10-26T06:41:33.640274+0000","last_fullsized":"2023-10-26T06:41:33.640274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946785+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:41:31.946785+0000","last_peered":"2023-10-26T06:41:31.946785+0000","last_clean":"2023-10-26T06:41:31.946785+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:41:31.946785+0000","last_undegraded":"2023-10-26T06:41:31.946785+0000","last_fullsized":"2023-10-26T06:41:31.946785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996695+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:41:34.996695+0000","last_peered":"2023-10-26T06:41:34.996695+0000","last_clean":"2023-10-26T06:41:34.996695+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:41:34.996695+0000","last_undegraded":"2023-10-26T06:41:34.996695+0000","last_fullsized":"2023-10-26T06:41:34.996695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942852+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:41:31.942852+0000","last_peered":"2023-10-26T06:41:31.942852+0000","last_clean":"2023-10-26T06:41:31.942852+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:41:31.942852+0000","last_undegraded":"2023-10-26T06:41:31.942852+0000","last_fullsized":"2023-10-26T06:41:31.942852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.020694+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:41:32.020694+0000","last_peered":"2023-10-26T06:41:32.020694+0000","last_clean":"2023-10-26T06:41:32.020694+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:41:32.020694+0000","last_undegraded":"2023-10-26T06:41:32.020694+0000","last_fullsized":"2023-10-26T06:41:32.020694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641194+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:41:33.641194+0000","last_peered":"2023-10-26T06:41:33.641194+0000","last_clean":"2023-10-26T06:41:33.641194+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:41:33.641194+0000","last_undegraded":"2023-10-26T06:41:33.641194+0000","last_fullsized":"2023-10-26T06:41:33.641194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994464+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:41:34.994464+0000","last_peered":"2023-10-26T06:41:34.994464+0000","last_clean":"2023-10-26T06:41:34.994464+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:41:34.994464+0000","last_undegraded":"2023-10-26T06:41:34.994464+0000","last_fullsized":"2023-10-26T06:41:34.994464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942419+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:41:31.942419+0000","last_peered":"2023-10-26T06:41:31.942419+0000","last_clean":"2023-10-26T06:41:31.942419+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:41:31.942419+0000","last_undegraded":"2023-10-26T06:41:31.942419+0000","last_fullsized":"2023-10-26T06:41:31.942419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.208523+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:41:33.208523+0000","last_peered":"2023-10-26T06:41:33.208523+0000","last_clean":"2023-10-26T06:41:33.208523+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:41:33.208523+0000","last_undegraded":"2023-10-26T06:41:33.208523+0000","last_fullsized":"2023-10-26T06:41:33.208523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640086+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:41:33.640086+0000","last_peered":"2023-10-26T06:41:33.640086+0000","last_clean":"2023-10-26T06:41:33.640086+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:41:33.640086+0000","last_undegraded":"2023-10-26T06:41:33.640086+0000","last_fullsized":"2023-10-26T06:41:33.640086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":70,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:24.076813+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:42:24.076813+0000","last_peered":"2023-10-26T06:42:24.076813+0000","last_clean":"2023-10-26T06:42:24.076813+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:42:24.076813+0000","last_undegraded":"2023-10-26T06:42:24.076813+0000","last_fullsized":"2023-10-26T06:42:24.076813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432740+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:41:33.432740+0000","last_peered":"2023-10-26T06:41:33.432740+0000","last_clean":"2023-10-26T06:41:33.432740+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:41:33.432740+0000","last_undegraded":"2023-10-26T06:41:33.432740+0000","last_fullsized":"2023-10-26T06:41:33.432740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996516+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:41:34.996516+0000","last_peered":"2023-10-26T06:41:34.996516+0000","last_clean":"2023-10-26T06:41:34.996516+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:41:34.996516+0000","last_undegraded":"2023-10-26T06:41:34.996516+0000","last_fullsized":"2023-10-26T06:41:34.996516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639975+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:41:33.639975+0000","last_peered":"2023-10-26T06:41:33.639975+0000","last_clean":"2023-10-26T06:41:33.639975+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:41:33.639975+0000","last_undegraded":"2023-10-26T06:41:33.639975+0000","last_fullsized":"2023-10-26T06:41:33.639975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.997042+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:41:34.997042+0000","last_peered":"2023-10-26T06:41:34.997042+0000","last_clean":"2023-10-26T06:41:34.997042+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:41:34.997042+0000","last_undegraded":"2023-10-26T06:41:34.997042+0000","last_fullsized":"2023-10-26T06:41:34.997042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942182+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:41:31.942182+0000","last_peered":"2023-10-26T06:41:31.942182+0000","last_clean":"2023-10-26T06:41:31.942182+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:41:31.942182+0000","last_undegraded":"2023-10-26T06:41:31.942182+0000","last_fullsized":"2023-10-26T06:41:31.942182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640596+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:41:33.640596+0000","last_peered":"2023-10-26T06:41:33.640596+0000","last_clean":"2023-10-26T06:41:33.640596+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:41:33.640596+0000","last_undegraded":"2023-10-26T06:41:33.640596+0000","last_fullsized":"2023-10-26T06:41:33.640596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639814+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:41:33.639814+0000","last_peered":"2023-10-26T06:41:33.639814+0000","last_clean":"2023-10-26T06:41:33.639814+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:41:33.639814+0000","last_undegraded":"2023-10-26T06:41:33.639814+0000","last_fullsized":"2023-10-26T06:41:33.639814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:21.072005+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:42:21.072005+0000","last_peered":"2023-10-26T06:42:21.072005+0000","last_clean":"2023-10-26T06:42:21.072005+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:42:21.072005+0000","last_undegraded":"2023-10-26T06:42:21.072005+0000","last_fullsized":"2023-10-26T06:42:21.072005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942571+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:41:31.942571+0000","last_peered":"2023-10-26T06:41:31.942571+0000","last_clean":"2023-10-26T06:41:31.942571+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:41:31.942571+0000","last_undegraded":"2023-10-26T06:41:31.942571+0000","last_fullsized":"2023-10-26T06:41:31.942571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991018+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:41:33.991018+0000","last_peered":"2023-10-26T06:41:33.991018+0000","last_clean":"2023-10-26T06:41:33.991018+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:41:33.991018+0000","last_undegraded":"2023-10-26T06:41:33.991018+0000","last_fullsized":"2023-10-26T06:41:33.991018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641143+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:41:33.641143+0000","last_peered":"2023-10-26T06:41:33.641143+0000","last_clean":"2023-10-26T06:41:33.641143+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:41:33.641143+0000","last_undegraded":"2023-10-26T06:41:33.641143+0000","last_fullsized":"2023-10-26T06:41:33.641143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992657+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:41:33.992657+0000","last_peered":"2023-10-26T06:41:33.992657+0000","last_clean":"2023-10-26T06:41:33.992657+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:41:33.992657+0000","last_undegraded":"2023-10-26T06:41:33.992657+0000","last_fullsized":"2023-10-26T06:41:33.992657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942519+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:41:31.942519+0000","last_peered":"2023-10-26T06:41:31.942519+0000","last_clean":"2023-10-26T06:41:31.942519+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:41:31.942519+0000","last_undegraded":"2023-10-26T06:41:31.942519+0000","last_fullsized":"2023-10-26T06:41:31.942519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:22.073250+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:42:22.073250+0000","last_peered":"2023-10-26T06:42:22.073250+0000","last_clean":"2023-10-26T06:42:22.073250+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:42:22.073250+0000","last_undegraded":"2023-10-26T06:42:22.073250+0000","last_fullsized":"2023-10-26T06:42:22.073250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":108,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.433005+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:41:33.433005+0000","last_peered":"2023-10-26T06:41:33.433005+0000","last_clean":"2023-10-26T06:41:33.433005+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:41:33.433005+0000","last_undegraded":"2023-10-26T06:41:33.433005+0000","last_fullsized":"2023-10-26T06:41:33.433005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.995754+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:41:34.995754+0000","last_peered":"2023-10-26T06:41:34.995754+0000","last_clean":"2023-10-26T06:41:34.995754+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:41:34.995754+0000","last_undegraded":"2023-10-26T06:41:34.995754+0000","last_fullsized":"2023-10-26T06:41:34.995754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640487+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:41:33.640487+0000","last_peered":"2023-10-26T06:41:33.640487+0000","last_clean":"2023-10-26T06:41:33.640487+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:41:33.640487+0000","last_undegraded":"2023-10-26T06:41:33.640487+0000","last_fullsized":"2023-10-26T06:41:33.640487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992241+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:41:33.992241+0000","last_peered":"2023-10-26T06:41:33.992241+0000","last_clean":"2023-10-26T06:41:33.992241+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:41:33.992241+0000","last_undegraded":"2023-10-26T06:41:33.992241+0000","last_fullsized":"2023-10-26T06:41:33.992241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552190+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:41:32.552190+0000","last_peered":"2023-10-26T06:41:32.552190+0000","last_clean":"2023-10-26T06:41:32.552190+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:41:32.552190+0000","last_undegraded":"2023-10-26T06:41:32.552190+0000","last_fullsized":"2023-10-26T06:41:32.552190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":69,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:23.078969+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:42:23.078969+0000","last_peered":"2023-10-26T06:42:23.078969+0000","last_clean":"2023-10-26T06:42:23.078969+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:42:23.078969+0000","last_undegraded":"2023-10-26T06:42:23.078969+0000","last_fullsized":"2023-10-26T06:42:23.078969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551861+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:41:32.551861+0000","last_peered":"2023-10-26T06:41:32.551861+0000","last_clean":"2023-10-26T06:41:32.551861+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:41:32.551861+0000","last_undegraded":"2023-10-26T06:41:32.551861+0000","last_fullsized":"2023-10-26T06:41:32.551861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996700+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:41:34.996700+0000","last_peered":"2023-10-26T06:41:34.996700+0000","last_clean":"2023-10-26T06:41:34.996700+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:41:34.996700+0000","last_undegraded":"2023-10-26T06:41:34.996700+0000","last_fullsized":"2023-10-26T06:41:34.996700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639977+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:41:33.639977+0000","last_peered":"2023-10-26T06:41:33.639977+0000","last_clean":"2023-10-26T06:41:33.639977+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:41:33.639977+0000","last_undegraded":"2023-10-26T06:41:33.639977+0000","last_fullsized":"2023-10-26T06:41:33.639977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.005443+0000","last_change":"2023-10-26T06:41:29.962764+0000","last_active":"2023-10-26T06:41:36.005443+0000","last_peered":"2023-10-26T06:41:36.005443+0000","last_clean":"2023-10-26T06:41:36.005443+0000","last_became_active":"2023-10-26T06:41:29.962245+0000","last_became_peered":"2023-10-26T06:41:29.962245+0000","last_unstale":"2023-10-26T06:41:36.005443+0000","last_undegraded":"2023-10-26T06:41:36.005443+0000","last_fullsized":"2023-10-26T06:41:36.005443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:33:21.800233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640386+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:41:33.640386+0000","last_peered":"2023-10-26T06:41:33.640386+0000","last_clean":"2023-10-26T06:41:33.640386+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:41:33.640386+0000","last_undegraded":"2023-10-26T06:41:33.640386+0000","last_fullsized":"2023-10-26T06:41:33.640386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.942650+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:41:30.942650+0000","last_peered":"2023-10-26T06:41:30.942650+0000","last_clean":"2023-10-26T06:41:30.942650+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:41:30.942650+0000","last_undegraded":"2023-10-26T06:41:30.942650+0000","last_fullsized":"2023-10-26T06:41:30.942650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640019+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:41:33.640019+0000","last_peered":"2023-10-26T06:41:33.640019+0000","last_clean":"2023-10-26T06:41:33.640019+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:41:33.640019+0000","last_undegraded":"2023-10-26T06:41:33.640019+0000","last_fullsized":"2023-10-26T06:41:33.640019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675117+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:41:33.675117+0000","last_peered":"2023-10-26T06:41:33.675117+0000","last_clean":"2023-10-26T06:41:33.675117+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:41:33.675117+0000","last_undegraded":"2023-10-26T06:41:33.675117+0000","last_fullsized":"2023-10-26T06:41:33.675117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639719+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:41:33.639719+0000","last_peered":"2023-10-26T06:41:33.639719+0000","last_clean":"2023-10-26T06:41:33.639719+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:41:33.639719+0000","last_undegraded":"2023-10-26T06:41:33.639719+0000","last_fullsized":"2023-10-26T06:41:33.639719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640746+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:41:33.640746+0000","last_peered":"2023-10-26T06:41:33.640746+0000","last_clean":"2023-10-26T06:41:33.640746+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:41:33.640746+0000","last_undegraded":"2023-10-26T06:41:33.640746+0000","last_fullsized":"2023-10-26T06:41:33.640746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:24.079863+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:42:24.079863+0000","last_peered":"2023-10-26T06:42:24.079863+0000","last_clean":"2023-10-26T06:42:24.079863+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:42:24.079863+0000","last_undegraded":"2023-10-26T06:42:24.079863+0000","last_fullsized":"2023-10-26T06:42:24.079863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942453+0000","last_change":"2023-10-26T06:41:30.946148+0000","last_active":"2023-10-26T06:41:31.942453+0000","last_peered":"2023-10-26T06:41:31.942453+0000","last_clean":"2023-10-26T06:41:31.942453+0000","last_became_active":"2023-10-26T06:41:30.945835+0000","last_became_peered":"2023-10-26T06:41:30.945835+0000","last_unstale":"2023-10-26T06:41:31.942453+0000","last_undegraded":"2023-10-26T06:41:31.942453+0000","last_fullsized":"2023-10-26T06:41:31.942453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:29:50.330144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.002428+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:41:36.002428+0000","last_peered":"2023-10-26T06:41:36.002428+0000","last_clean":"2023-10-26T06:41:36.002428+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:41:36.002428+0000","last_undegraded":"2023-10-26T06:41:36.002428+0000","last_fullsized":"2023-10-26T06:41:36.002428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.939903+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:41:30.939903+0000","last_peered":"2023-10-26T06:41:30.939903+0000","last_clean":"2023-10-26T06:41:30.939903+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:41:30.939903+0000","last_undegraded":"2023-10-26T06:41:30.939903+0000","last_fullsized":"2023-10-26T06:41:30.939903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639481+0000","last_change":"2023-10-26T06:41:30.954040+0000","last_active":"2023-10-26T06:41:33.639481+0000","last_peered":"2023-10-26T06:41:33.639481+0000","last_clean":"2023-10-26T06:41:33.639481+0000","last_became_active":"2023-10-26T06:41:30.953367+0000","last_became_peered":"2023-10-26T06:41:30.953367+0000","last_unstale":"2023-10-26T06:41:33.639481+0000","last_undegraded":"2023-10-26T06:41:33.639481+0000","last_fullsized":"2023-10-26T06:41:33.639481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:17:37.442177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994555+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:41:34.994555+0000","last_peered":"2023-10-26T06:41:34.994555+0000","last_clean":"2023-10-26T06:41:34.994555+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:41:34.994555+0000","last_undegraded":"2023-10-26T06:41:34.994555+0000","last_fullsized":"2023-10-26T06:41:34.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991384+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:41:33.991384+0000","last_peered":"2023-10-26T06:41:33.991384+0000","last_clean":"2023-10-26T06:41:33.991384+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:41:33.991384+0000","last_undegraded":"2023-10-26T06:41:33.991384+0000","last_fullsized":"2023-10-26T06:41:33.991384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640145+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:41:33.640145+0000","last_peered":"2023-10-26T06:41:33.640145+0000","last_clean":"2023-10-26T06:41:33.640145+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:41:33.640145+0000","last_undegraded":"2023-10-26T06:41:33.640145+0000","last_fullsized":"2023-10-26T06:41:33.640145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:39.421340+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:41:39.421340+0000","last_peered":"2023-10-26T06:41:39.421340+0000","last_clean":"2023-10-26T06:41:39.421340+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:41:39.421340+0000","last_undegraded":"2023-10-26T06:41:39.421340+0000","last_fullsized":"2023-10-26T06:41:39.421340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942707+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:41:31.942707+0000","last_peered":"2023-10-26T06:41:31.942707+0000","last_clean":"2023-10-26T06:41:31.942707+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:41:31.942707+0000","last_undegraded":"2023-10-26T06:41:31.942707+0000","last_fullsized":"2023-10-26T06:41:31.942707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991181+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:41:33.991181+0000","last_peered":"2023-10-26T06:41:33.991181+0000","last_clean":"2023-10-26T06:41:33.991181+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:41:33.991181+0000","last_undegraded":"2023-10-26T06:41:33.991181+0000","last_fullsized":"2023-10-26T06:41:33.991181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641086+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:41:33.641086+0000","last_peered":"2023-10-26T06:41:33.641086+0000","last_clean":"2023-10-26T06:41:33.641086+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:41:33.641086+0000","last_undegraded":"2023-10-26T06:41:33.641086+0000","last_fullsized":"2023-10-26T06:41:33.641086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991058+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:41:33.991058+0000","last_peered":"2023-10-26T06:41:33.991058+0000","last_clean":"2023-10-26T06:41:33.991058+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:41:33.991058+0000","last_undegraded":"2023-10-26T06:41:33.991058+0000","last_fullsized":"2023-10-26T06:41:33.991058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432711+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:41:33.432711+0000","last_peered":"2023-10-26T06:41:33.432711+0000","last_clean":"2023-10-26T06:41:33.432711+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:41:33.432711+0000","last_undegraded":"2023-10-26T06:41:33.432711+0000","last_fullsized":"2023-10-26T06:41:33.432711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991075+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:41:33.991075+0000","last_peered":"2023-10-26T06:41:33.991075+0000","last_clean":"2023-10-26T06:41:33.991075+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:41:33.991075+0000","last_undegraded":"2023-10-26T06:41:33.991075+0000","last_fullsized":"2023-10-26T06:41:33.991075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639521+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:41:33.639521+0000","last_peered":"2023-10-26T06:41:33.639521+0000","last_clean":"2023-10-26T06:41:33.639521+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:41:33.639521+0000","last_undegraded":"2023-10-26T06:41:33.639521+0000","last_fullsized":"2023-10-26T06:41:33.639521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946651+0000","last_change":"2023-10-26T06:41:29.957155+0000","last_active":"2023-10-26T06:41:31.946651+0000","last_peered":"2023-10-26T06:41:31.946651+0000","last_clean":"2023-10-26T06:41:31.946651+0000","last_became_active":"2023-10-26T06:41:29.956740+0000","last_became_peered":"2023-10-26T06:41:29.956740+0000","last_unstale":"2023-10-26T06:41:31.946651+0000","last_undegraded":"2023-10-26T06:41:31.946651+0000","last_fullsized":"2023-10-26T06:41:31.946651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:14:27.826402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942335+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:41:31.942335+0000","last_peered":"2023-10-26T06:41:31.942335+0000","last_clean":"2023-10-26T06:41:31.942335+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:41:31.942335+0000","last_undegraded":"2023-10-26T06:41:31.942335+0000","last_fullsized":"2023-10-26T06:41:31.942335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991813+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:41:33.991813+0000","last_peered":"2023-10-26T06:41:33.991813+0000","last_clean":"2023-10-26T06:41:33.991813+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:41:33.991813+0000","last_undegraded":"2023-10-26T06:41:33.991813+0000","last_fullsized":"2023-10-26T06:41:33.991813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552153+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:41:32.552153+0000","last_peered":"2023-10-26T06:41:32.552153+0000","last_clean":"2023-10-26T06:41:32.552153+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:41:32.552153+0000","last_undegraded":"2023-10-26T06:41:32.552153+0000","last_fullsized":"2023-10-26T06:41:32.552153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.995231+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:41:34.995231+0000","last_peered":"2023-10-26T06:41:34.995231+0000","last_clean":"2023-10-26T06:41:34.995231+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:41:34.995231+0000","last_undegraded":"2023-10-26T06:41:34.995231+0000","last_fullsized":"2023-10-26T06:41:34.995231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552239+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:41:32.552239+0000","last_peered":"2023-10-26T06:41:32.552239+0000","last_clean":"2023-10-26T06:41:32.552239+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:41:32.552239+0000","last_undegraded":"2023-10-26T06:41:32.552239+0000","last_fullsized":"2023-10-26T06:41:32.552239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639966+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:41:33.639966+0000","last_peered":"2023-10-26T06:41:33.639966+0000","last_clean":"2023-10-26T06:41:33.639966+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:41:33.639966+0000","last_undegraded":"2023-10-26T06:41:33.639966+0000","last_fullsized":"2023-10-26T06:41:33.639966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675149+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:41:33.675149+0000","last_peered":"2023-10-26T06:41:33.675149+0000","last_clean":"2023-10-26T06:41:33.675149+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:41:33.675149+0000","last_undegraded":"2023-10-26T06:41:33.675149+0000","last_fullsized":"2023-10-26T06:41:33.675149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.054027+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:41:31.054027+0000","last_peered":"2023-10-26T06:41:31.054027+0000","last_clean":"2023-10-26T06:41:31.054027+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:41:31.054027+0000","last_undegraded":"2023-10-26T06:41:31.054027+0000","last_fullsized":"2023-10-26T06:41:31.054027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552218+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:41:32.552218+0000","last_peered":"2023-10-26T06:41:32.552218+0000","last_clean":"2023-10-26T06:41:32.552218+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:41:32.552218+0000","last_undegraded":"2023-10-26T06:41:32.552218+0000","last_fullsized":"2023-10-26T06:41:32.552218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639593+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:41:33.639593+0000","last_peered":"2023-10-26T06:41:33.639593+0000","last_clean":"2023-10-26T06:41:33.639593+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:41:33.639593+0000","last_undegraded":"2023-10-26T06:41:33.639593+0000","last_fullsized":"2023-10-26T06:41:33.639593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946627+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:41:31.946627+0000","last_peered":"2023-10-26T06:41:31.946627+0000","last_clean":"2023-10-26T06:41:31.946627+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:41:31.946627+0000","last_undegraded":"2023-10-26T06:41:31.946627+0000","last_fullsized":"2023-10-26T06:41:31.946627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946633+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:41:31.946633+0000","last_peered":"2023-10-26T06:41:31.946633+0000","last_clean":"2023-10-26T06:41:31.946633+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:41:31.946633+0000","last_undegraded":"2023-10-26T06:41:31.946633+0000","last_fullsized":"2023-10-26T06:41:31.946633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640660+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:41:33.640660+0000","last_peered":"2023-10-26T06:41:33.640660+0000","last_clean":"2023-10-26T06:41:33.640660+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:41:33.640660+0000","last_undegraded":"2023-10-26T06:41:33.640660+0000","last_fullsized":"2023-10-26T06:41:33.640660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640677+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:41:33.640677+0000","last_peered":"2023-10-26T06:41:33.640677+0000","last_clean":"2023-10-26T06:41:33.640677+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:41:33.640677+0000","last_undegraded":"2023-10-26T06:41:33.640677+0000","last_fullsized":"2023-10-26T06:41:33.640677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639806+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:41:33.639806+0000","last_peered":"2023-10-26T06:41:33.639806+0000","last_clean":"2023-10-26T06:41:33.639806+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:41:33.639806+0000","last_undegraded":"2023-10-26T06:41:33.639806+0000","last_fullsized":"2023-10-26T06:41:33.639806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946954+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:41:31.946954+0000","last_peered":"2023-10-26T06:41:31.946954+0000","last_clean":"2023-10-26T06:41:31.946954+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:41:31.946954+0000","last_undegraded":"2023-10-26T06:41:31.946954+0000","last_fullsized":"2023-10-26T06:41:31.946954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942673+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:41:31.942673+0000","last_peered":"2023-10-26T06:41:31.942673+0000","last_clean":"2023-10-26T06:41:31.942673+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:41:31.942673+0000","last_undegraded":"2023-10-26T06:41:31.942673+0000","last_fullsized":"2023-10-26T06:41:31.942673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640616+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:41:33.640616+0000","last_peered":"2023-10-26T06:41:33.640616+0000","last_clean":"2023-10-26T06:41:33.640616+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:41:33.640616+0000","last_undegraded":"2023-10-26T06:41:33.640616+0000","last_fullsized":"2023-10-26T06:41:33.640616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942404+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:41:31.942404+0000","last_peered":"2023-10-26T06:41:31.942404+0000","last_clean":"2023-10-26T06:41:31.942404+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:41:31.942404+0000","last_undegraded":"2023-10-26T06:41:31.942404+0000","last_fullsized":"2023-10-26T06:41:31.942404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942522+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:41:31.942522+0000","last_peered":"2023-10-26T06:41:31.942522+0000","last_clean":"2023-10-26T06:41:31.942522+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:41:31.942522+0000","last_undegraded":"2023-10-26T06:41:31.942522+0000","last_fullsized":"2023-10-26T06:41:31.942522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640293+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:41:33.640293+0000","last_peered":"2023-10-26T06:41:33.640293+0000","last_clean":"2023-10-26T06:41:33.640293+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:41:33.640293+0000","last_undegraded":"2023-10-26T06:41:33.640293+0000","last_fullsized":"2023-10-26T06:41:33.640293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639807+0000","last_change":"2023-10-26T06:41:30.948857+0000","last_active":"2023-10-26T06:41:33.639807+0000","last_peered":"2023-10-26T06:41:33.639807+0000","last_clean":"2023-10-26T06:41:33.639807+0000","last_became_active":"2023-10-26T06:41:30.948505+0000","last_became_peered":"2023-10-26T06:41:30.948505+0000","last_unstale":"2023-10-26T06:41:33.639807+0000","last_undegraded":"2023-10-26T06:41:33.639807+0000","last_fullsized":"2023-10-26T06:41:33.639807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:11:47.908249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":317,"num_read_kb":224,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416408,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":445170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.873}]},{"osd":7,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.75}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.89000000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005}]}]},{"osd":10,"up_from":72,"seq":309237645339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1095876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.376}]},{"osd":2,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.438},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.626},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.60899999999999999}]},{"osd":11,"last update":"Thu Oct 26 06:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.73099999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":445406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.755}]},{"osd":2,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82999999999999996,"15min":0.83399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88,"15min":0.89600000000000002},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96699999999999997,"15min":0.98699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.94899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.89900000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0629999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.59399999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.88900000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.048,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.2370000000000001,"15min":1.3029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4730000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.92100000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":445326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82499999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.629}]},{"osd":1,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.497},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3759999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.91900000000000004,"15min":0.94399999999999995},"min":{"1min":0.61499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.075,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.68799999999999994}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.87}]},{"osd":10,"last update":"Thu Oct 26 06:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299433,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1037261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.505,"15min":0.47799999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.752,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.626}]},{"osd":5,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64200000000000002,"15min":0.624},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.872},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.71399999999999997},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.995,"15min":0.995},"last":0.73799999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.83299999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.91700000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]}]},{"osd":6,"up_from":47,"seq":201863462958,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":913408,"data_stored":444801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47599999999999998,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.59499999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.67700000000000005},"min":{"1min":0.53500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":1.036,"15min":1.036},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1160000000000001,"5min":1.127,"15min":1.127},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.038,"15min":1.038},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.64600000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.86699999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.071,"5min":1.228,"15min":1.228},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.70899999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.879,"15min":0.88300000000000001},"min":{"1min":0.65700000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.92300000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":0.96899999999999997,"15min":0.92400000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.9790000000000001,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.046,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.97199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":503748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.006,"15min":1.006},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.879},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.33600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81599999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.95399999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96099999999999997,"5min":1.048,"15min":1.048},"last":1.04},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.91500000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":1},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":1.085}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":446066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.46000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.70299999999999996,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.751},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72199999999999998,"15min":0.64000000000000001},"min":{"1min":0.57399999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66300000000000003,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.441,"15min":0.441},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.61099999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93000000000000005,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.90500000000000003}]},{"osd":9,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:41:23 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.92500000000000004}]},{"osd":11,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.028},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.96899999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378690,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":505098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91400000000000003,"5min":2.371,"15min":2.371},"last":0.379}]},{"osd":1,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2370000000000001,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.625}]},{"osd":3,"last update":"Thu Oct 26 06:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63600000000000001,"15min":0.69799999999999995},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81999999999999995,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85099999999999998,"5min":2.282,"15min":2.282},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63100000000000001,"15min":0.64800000000000002},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81100000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65100000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91300000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68200000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.69899999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.63300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":445118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47199999999999998,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.88100000000000001,"5min":1.069,"15min":1.069},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.41899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68799999999999994,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99099999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.753},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.73499999999999999,"15min":0.68899999999999995},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.72599999999999998,"15min":0.66400000000000003},"min":{"1min":0.54600000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Oct 26 06:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.361,"15min":1.361},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.751,"15min":0.70499999999999996},"min":{"1min":0.64100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73999999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.226,"5min":1.419,"15min":1.419},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.292,"15min":1.292},"last":0.58399999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0580000000000001,"15min":1.0880000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.97899999999999998,"15min":0.997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.88200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888120,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":445622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.377},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.44}]},{"osd":2,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.499},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76100000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79900000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.68700000000000006}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93999999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94499999999999995,"5min":1.246,"15min":1.246},"last":0.67100000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93200000000000005,"5min":1.044,"15min":1.044},"last":0.75}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1036224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":5.819,"15min":5.819},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.442}]},{"osd":1,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.751,"5min":5.835,"15min":5.835},"last":0.621},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.497}]},{"osd":4,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.53300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47899999999999998}]},{"osd":9,"last update":"Thu Oct 26 06:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63700000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:42:29.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph pg dump --format=json 2023-10-26T06:42:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:28 smithi125 ceph-mon[130643]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:29.774 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:29.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:29 smithi153 ceph-mon[131657]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-26T06:42:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-26T06:42:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-26T06:42:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-26T06:42:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:29 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-26T06:42:30.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:29 smithi050 ceph-mon[94997]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:30.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-26T06:42:30.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-26T06:42:30.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-26T06:42:30.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-26T06:42:30.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:29 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-26T06:42:30.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:29 smithi125 ceph-mon[130643]: from='client.25060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-26T06:42:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-26T06:42:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-26T06:42:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2023-10-26T06:42:30.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:29 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-26T06:42:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-26T06:42:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-26T06:42:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-26T06:42:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-26T06:42:30.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-26T06:42:30.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:30 smithi153 ceph-mon[131657]: osdmap e85: 12 total, 12 up, 12 in 2023-10-26T06:42:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-26T06:42:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-26T06:42:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-26T06:42:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-26T06:42:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-26T06:42:31.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:30 smithi050 ceph-mon[94997]: osdmap e85: 12 total, 12 up, 12 in 2023-10-26T06:42:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-26T06:42:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-26T06:42:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-26T06:42:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2023-10-26T06:42:31.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-26T06:42:31.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:30 smithi125 ceph-mon[130643]: osdmap e85: 12 total, 12 up, 12 in 2023-10-26T06:42:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 -- 172.21.15.50:0/2963136785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc101260 msgr2=0x7f51fc10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:31.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 --2- 172.21.15.50:0/2963136785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc101260 0x7f51fc10d650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f51f400b0a0 tx=0x7f51f400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 -- 172.21.15.50:0/2963136785 shutdown_connections 2023-10-26T06:42:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 --2- 172.21.15.50:0/2963136785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc101260 0x7f51fc10d650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 --2- 172.21.15.50:0/2963136785 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1057c0 0x7f51fc105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 --2- 172.21.15.50:0/2963136785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc1008a0 0x7f51fc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 -- 172.21.15.50:0/2963136785 >> 172.21.15.50:0/2963136785 conn(0x7f51fc0779e0 msgr2=0x7f51fc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.320+0000 7f5203e43700 1 -- 172.21.15.50:0/2963136785 shutdown_connections 2023-10-26T06:42:31.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.321+0000 7f5203e43700 1 -- 172.21.15.50:0/2963136785 wait complete. 2023-10-26T06:42:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.321+0000 7f5203e43700 1 Processor -- start 2023-10-26T06:42:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 -- start start 2023-10-26T06:42:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1008a0 0x7f51fc198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:31.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc101260 0x7f51fc199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 0x7f51fc19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc19de40 con 0x7f51fc1057c0 2023-10-26T06:42:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc19dfb0 con 0x7f51fc1008a0 2023-10-26T06:42:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5203e43700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc19e170 con 0x7f51fc101260 2023-10-26T06:42:31.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f52023e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 0x7f51fc19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f52023e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 0x7f51fc19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56286/0 (socket says 172.21.15.50:56286) 2023-10-26T06:42:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f52023e0700 1 -- 172.21.15.50:0/2250981076 learned_addr learned my addr 172.21.15.50:0/2250981076 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.322+0000 7f5201bdf700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1008a0 0x7f51fc198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f52013de700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc101260 0x7f51fc199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:31.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5201bdf700 1 -- 172.21.15.50:0/2250981076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc101260 msgr2=0x7f51fc199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5201bdf700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc101260 0x7f51fc199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5201bdf700 1 -- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 msgr2=0x7f51fc19d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5201bdf700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 0x7f51fc19d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5201bdf700 1 -- 172.21.15.50:0/2250981076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009d00 con 0x7f51fc1008a0 2023-10-26T06:42:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f52023e0700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 0x7f51fc19d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5201bdf700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1008a0 0x7f51fc198f40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51f800e9c0 tx=0x7f51f800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8004220 con 0x7f51fc1008a0 2023-10-26T06:42:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc19e450 con 0x7f51fc1008a0 2023-10-26T06:42:31.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51f8004380 con 0x7f51fc1008a0 2023-10-26T06:42:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.323+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8003be0 con 0x7f51fc1008a0 2023-10-26T06:42:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.324+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc1a5cb0 con 0x7f51fc1008a0 2023-10-26T06:42:31.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.325+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc101f30 con 0x7f51fc1008a0 2023-10-26T06:42:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.327+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f51f8003d40 con 0x7f51fc1008a0 2023-10-26T06:42:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.328+0000 7f51f2ffd700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e80a1560 0x7f51e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.328+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f51f8014070 con 0x7f51fc1008a0 2023-10-26T06:42:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.328+0000 7f52013de700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e80a1560 0x7f51e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.329+0000 7f52013de700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e80a1560 0x7f51e80a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51fc19a4a0 tx=0x7f51ec00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:31.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.332+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f51f8096630 con 0x7f51fc1008a0 2023-10-26T06:42:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.539+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51fc110780 con 0x7f51e80a1560 2023-10-26T06:42:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.550+0000 7f51f2ffd700 1 -- 172.21.15.50:0/2250981076 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341124 (secure 0 0 0) 0x7f51fc110780 con 0x7f51e80a1560 2023-10-26T06:42:31.558 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e80a1560 msgr2=0x7f51e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e80a1560 0x7f51e80a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51fc19a4a0 tx=0x7f51ec00b410 comp rx=0 tx=0).stop 2023-10-26T06:42:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1008a0 msgr2=0x7f51fc198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1008a0 0x7f51fc198f40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f51f800e9c0 tx=0x7f51f800ecd0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 shutdown_connections 2023-10-26T06:42:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51e80a1560 0x7f51e80a3a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51fc1057c0 0x7f51fc19d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f51fc1008a0 0x7f51fc198f40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 --2- 172.21.15.50:0/2250981076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51fc101260 0x7f51fc199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 >> 172.21.15.50:0/2250981076 conn(0x7f51fc0779e0 msgr2=0x7f51fc10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 shutdown_connections 2023-10-26T06:42:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:31.555+0000 7f5203e43700 1 -- 172.21.15.50:0/2250981076 wait complete. 2023-10-26T06:42:31.563 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:42:31.978 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:31 smithi050 ceph-mon[94997]: osdmap e86: 12 total, 12 up, 12 in 2023-10-26T06:42:31.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:31 smithi153 ceph-mon[131657]: osdmap e86: 12 total, 12 up, 12 in 2023-10-26T06:42:32.064 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2023-10-26T06:42:30.698043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":478,"num_read_kb":353,"num_write":332,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337032,"kb_used_data":12820,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604792,"statfs":{"total":1151940427776,"available":1151595307008,"internally_reserved":0,"allocated":13127680,"data_stored":7321768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.063640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640504+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:41:33.640504+0000","last_peered":"2023-10-26T06:41:33.640504+0000","last_clean":"2023-10-26T06:41:33.640504+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:41:33.640504+0000","last_undegraded":"2023-10-26T06:41:33.640504+0000","last_fullsized":"2023-10-26T06:41:33.640504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640890+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:41:33.640890+0000","last_peered":"2023-10-26T06:41:33.640890+0000","last_clean":"2023-10-26T06:41:33.640890+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:41:33.640890+0000","last_undegraded":"2023-10-26T06:41:33.640890+0000","last_fullsized":"2023-10-26T06:41:33.640890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640897+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:41:33.640897+0000","last_peered":"2023-10-26T06:41:33.640897+0000","last_clean":"2023-10-26T06:41:33.640897+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:41:33.640897+0000","last_undegraded":"2023-10-26T06:41:33.640897+0000","last_fullsized":"2023-10-26T06:41:33.640897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640010+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:41:33.640010+0000","last_peered":"2023-10-26T06:41:33.640010+0000","last_clean":"2023-10-26T06:41:33.640010+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:41:33.640010+0000","last_undegraded":"2023-10-26T06:41:33.640010+0000","last_fullsized":"2023-10-26T06:41:33.640010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432795+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:41:33.432795+0000","last_peered":"2023-10-26T06:41:33.432795+0000","last_clean":"2023-10-26T06:41:33.432795+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:41:33.432795+0000","last_undegraded":"2023-10-26T06:41:33.432795+0000","last_fullsized":"2023-10-26T06:41:33.432795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640353+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:41:33.640353+0000","last_peered":"2023-10-26T06:41:33.640353+0000","last_clean":"2023-10-26T06:41:33.640353+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:41:33.640353+0000","last_undegraded":"2023-10-26T06:41:33.640353+0000","last_fullsized":"2023-10-26T06:41:33.640353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551931+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:41:32.551931+0000","last_peered":"2023-10-26T06:41:32.551931+0000","last_clean":"2023-10-26T06:41:32.551931+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:41:32.551931+0000","last_undegraded":"2023-10-26T06:41:32.551931+0000","last_fullsized":"2023-10-26T06:41:32.551931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942062+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:41:31.942062+0000","last_peered":"2023-10-26T06:41:31.942062+0000","last_clean":"2023-10-26T06:41:31.942062+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:41:31.942062+0000","last_undegraded":"2023-10-26T06:41:31.942062+0000","last_fullsized":"2023-10-26T06:41:31.942062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942643+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:41:31.942643+0000","last_peered":"2023-10-26T06:41:31.942643+0000","last_clean":"2023-10-26T06:41:31.942643+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:41:31.942643+0000","last_undegraded":"2023-10-26T06:41:31.942643+0000","last_fullsized":"2023-10-26T06:41:31.942643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639839+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:41:33.639839+0000","last_peered":"2023-10-26T06:41:33.639839+0000","last_clean":"2023-10-26T06:41:33.639839+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:41:33.639839+0000","last_undegraded":"2023-10-26T06:41:33.639839+0000","last_fullsized":"2023-10-26T06:41:33.639839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552219+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:41:32.552219+0000","last_peered":"2023-10-26T06:41:32.552219+0000","last_clean":"2023-10-26T06:41:32.552219+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:41:32.552219+0000","last_undegraded":"2023-10-26T06:41:32.552219+0000","last_fullsized":"2023-10-26T06:41:32.552219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639937+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:41:33.639937+0000","last_peered":"2023-10-26T06:41:33.639937+0000","last_clean":"2023-10-26T06:41:33.639937+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:41:33.639937+0000","last_undegraded":"2023-10-26T06:41:33.639937+0000","last_fullsized":"2023-10-26T06:41:33.639937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640417+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:41:33.640417+0000","last_peered":"2023-10-26T06:41:33.640417+0000","last_clean":"2023-10-26T06:41:33.640417+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:41:33.640417+0000","last_undegraded":"2023-10-26T06:41:33.640417+0000","last_fullsized":"2023-10-26T06:41:33.640417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640107+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:41:33.640107+0000","last_peered":"2023-10-26T06:41:33.640107+0000","last_clean":"2023-10-26T06:41:33.640107+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:41:33.640107+0000","last_undegraded":"2023-10-26T06:41:33.640107+0000","last_fullsized":"2023-10-26T06:41:33.640107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640318+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:41:33.640318+0000","last_peered":"2023-10-26T06:41:33.640318+0000","last_clean":"2023-10-26T06:41:33.640318+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:41:33.640318+0000","last_undegraded":"2023-10-26T06:41:33.640318+0000","last_fullsized":"2023-10-26T06:41:33.640318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942255+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:41:31.942255+0000","last_peered":"2023-10-26T06:41:31.942255+0000","last_clean":"2023-10-26T06:41:31.942255+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:41:31.942255+0000","last_undegraded":"2023-10-26T06:41:31.942255+0000","last_fullsized":"2023-10-26T06:41:31.942255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640510+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:41:33.640510+0000","last_peered":"2023-10-26T06:41:33.640510+0000","last_clean":"2023-10-26T06:41:33.640510+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:41:33.640510+0000","last_undegraded":"2023-10-26T06:41:33.640510+0000","last_fullsized":"2023-10-26T06:41:33.640510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640317+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:41:33.640317+0000","last_peered":"2023-10-26T06:41:33.640317+0000","last_clean":"2023-10-26T06:41:33.640317+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:41:33.640317+0000","last_undegraded":"2023-10-26T06:41:33.640317+0000","last_fullsized":"2023-10-26T06:41:33.640317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946826+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:41:31.946826+0000","last_peered":"2023-10-26T06:41:31.946826+0000","last_clean":"2023-10-26T06:41:31.946826+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:41:31.946826+0000","last_undegraded":"2023-10-26T06:41:31.946826+0000","last_fullsized":"2023-10-26T06:41:31.946826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.008535+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:41:36.008535+0000","last_peered":"2023-10-26T06:41:36.008535+0000","last_clean":"2023-10-26T06:41:36.008535+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:41:36.008535+0000","last_undegraded":"2023-10-26T06:41:36.008535+0000","last_fullsized":"2023-10-26T06:41:36.008535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942852+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:41:31.942852+0000","last_peered":"2023-10-26T06:41:31.942852+0000","last_clean":"2023-10-26T06:41:31.942852+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:41:31.942852+0000","last_undegraded":"2023-10-26T06:41:31.942852+0000","last_fullsized":"2023-10-26T06:41:31.942852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.020694+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:41:32.020694+0000","last_peered":"2023-10-26T06:41:32.020694+0000","last_clean":"2023-10-26T06:41:32.020694+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:41:32.020694+0000","last_undegraded":"2023-10-26T06:41:32.020694+0000","last_fullsized":"2023-10-26T06:41:32.020694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641194+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:41:33.641194+0000","last_peered":"2023-10-26T06:41:33.641194+0000","last_clean":"2023-10-26T06:41:33.641194+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:41:33.641194+0000","last_undegraded":"2023-10-26T06:41:33.641194+0000","last_fullsized":"2023-10-26T06:41:33.641194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994464+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:41:34.994464+0000","last_peered":"2023-10-26T06:41:34.994464+0000","last_clean":"2023-10-26T06:41:34.994464+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:41:34.994464+0000","last_undegraded":"2023-10-26T06:41:34.994464+0000","last_fullsized":"2023-10-26T06:41:34.994464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942419+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:41:31.942419+0000","last_peered":"2023-10-26T06:41:31.942419+0000","last_clean":"2023-10-26T06:41:31.942419+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:41:31.942419+0000","last_undegraded":"2023-10-26T06:41:31.942419+0000","last_fullsized":"2023-10-26T06:41:31.942419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.208523+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:41:33.208523+0000","last_peered":"2023-10-26T06:41:33.208523+0000","last_clean":"2023-10-26T06:41:33.208523+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:41:33.208523+0000","last_undegraded":"2023-10-26T06:41:33.208523+0000","last_fullsized":"2023-10-26T06:41:33.208523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640141+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:41:33.640141+0000","last_peered":"2023-10-26T06:41:33.640141+0000","last_clean":"2023-10-26T06:41:33.640141+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:41:33.640141+0000","last_undegraded":"2023-10-26T06:41:33.640141+0000","last_fullsized":"2023-10-26T06:41:33.640141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699374+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:42:29.699374+0000","last_peered":"2023-10-26T06:42:29.699374+0000","last_clean":"2023-10-26T06:42:29.699374+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:42:29.699374+0000","last_undegraded":"2023-10-26T06:42:29.699374+0000","last_fullsized":"2023-10-26T06:42:29.699374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432740+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:41:33.432740+0000","last_peered":"2023-10-26T06:41:33.432740+0000","last_clean":"2023-10-26T06:41:33.432740+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:41:33.432740+0000","last_undegraded":"2023-10-26T06:41:33.432740+0000","last_fullsized":"2023-10-26T06:41:33.432740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996516+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:41:34.996516+0000","last_peered":"2023-10-26T06:41:34.996516+0000","last_clean":"2023-10-26T06:41:34.996516+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:41:34.996516+0000","last_undegraded":"2023-10-26T06:41:34.996516+0000","last_fullsized":"2023-10-26T06:41:34.996516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640026+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:41:33.640026+0000","last_peered":"2023-10-26T06:41:33.640026+0000","last_clean":"2023-10-26T06:41:33.640026+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:41:33.640026+0000","last_undegraded":"2023-10-26T06:41:33.640026+0000","last_fullsized":"2023-10-26T06:41:33.640026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.997042+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:41:34.997042+0000","last_peered":"2023-10-26T06:41:34.997042+0000","last_clean":"2023-10-26T06:41:34.997042+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:41:34.997042+0000","last_undegraded":"2023-10-26T06:41:34.997042+0000","last_fullsized":"2023-10-26T06:41:34.997042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942182+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:41:31.942182+0000","last_peered":"2023-10-26T06:41:31.942182+0000","last_clean":"2023-10-26T06:41:31.942182+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:41:31.942182+0000","last_undegraded":"2023-10-26T06:41:31.942182+0000","last_fullsized":"2023-10-26T06:41:31.942182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991740+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:41:33.991740+0000","last_peered":"2023-10-26T06:41:33.991740+0000","last_clean":"2023-10-26T06:41:33.991740+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:41:33.991740+0000","last_undegraded":"2023-10-26T06:41:33.991740+0000","last_fullsized":"2023-10-26T06:41:33.991740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639876+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:41:33.639876+0000","last_peered":"2023-10-26T06:41:33.639876+0000","last_clean":"2023-10-26T06:41:33.639876+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:41:33.639876+0000","last_undegraded":"2023-10-26T06:41:33.639876+0000","last_fullsized":"2023-10-26T06:41:33.639876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:26.078919+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:42:26.078919+0000","last_peered":"2023-10-26T06:42:26.078919+0000","last_clean":"2023-10-26T06:42:26.078919+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:42:26.078919+0000","last_undegraded":"2023-10-26T06:42:26.078919+0000","last_fullsized":"2023-10-26T06:42:26.078919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942571+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:41:31.942571+0000","last_peered":"2023-10-26T06:41:31.942571+0000","last_clean":"2023-10-26T06:41:31.942571+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:41:31.942571+0000","last_undegraded":"2023-10-26T06:41:31.942571+0000","last_fullsized":"2023-10-26T06:41:31.942571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991018+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:41:33.991018+0000","last_peered":"2023-10-26T06:41:33.991018+0000","last_clean":"2023-10-26T06:41:33.991018+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:41:33.991018+0000","last_undegraded":"2023-10-26T06:41:33.991018+0000","last_fullsized":"2023-10-26T06:41:33.991018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641143+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:41:33.641143+0000","last_peered":"2023-10-26T06:41:33.641143+0000","last_clean":"2023-10-26T06:41:33.641143+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:41:33.641143+0000","last_undegraded":"2023-10-26T06:41:33.641143+0000","last_fullsized":"2023-10-26T06:41:33.641143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.004950+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:41:36.004950+0000","last_peered":"2023-10-26T06:41:36.004950+0000","last_clean":"2023-10-26T06:41:36.004950+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:41:36.004950+0000","last_undegraded":"2023-10-26T06:41:36.004950+0000","last_fullsized":"2023-10-26T06:41:36.004950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942519+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:41:31.942519+0000","last_peered":"2023-10-26T06:41:31.942519+0000","last_clean":"2023-10-26T06:41:31.942519+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:41:31.942519+0000","last_undegraded":"2023-10-26T06:41:31.942519+0000","last_fullsized":"2023-10-26T06:41:31.942519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:27.080191+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:42:27.080191+0000","last_peered":"2023-10-26T06:42:27.080191+0000","last_clean":"2023-10-26T06:42:27.080191+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:42:27.080191+0000","last_undegraded":"2023-10-26T06:42:27.080191+0000","last_fullsized":"2023-10-26T06:42:27.080191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":113,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.433005+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:41:33.433005+0000","last_peered":"2023-10-26T06:41:33.433005+0000","last_clean":"2023-10-26T06:41:33.433005+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:41:33.433005+0000","last_undegraded":"2023-10-26T06:41:33.433005+0000","last_fullsized":"2023-10-26T06:41:33.433005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.004561+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:41:36.004561+0000","last_peered":"2023-10-26T06:41:36.004561+0000","last_clean":"2023-10-26T06:41:36.004561+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:41:36.004561+0000","last_undegraded":"2023-10-26T06:41:36.004561+0000","last_fullsized":"2023-10-26T06:41:36.004561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640487+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:41:33.640487+0000","last_peered":"2023-10-26T06:41:33.640487+0000","last_clean":"2023-10-26T06:41:33.640487+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:41:33.640487+0000","last_undegraded":"2023-10-26T06:41:33.640487+0000","last_fullsized":"2023-10-26T06:41:33.640487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992410+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:41:33.992410+0000","last_peered":"2023-10-26T06:41:33.992410+0000","last_clean":"2023-10-26T06:41:33.992410+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:41:33.992410+0000","last_undegraded":"2023-10-26T06:41:33.992410+0000","last_fullsized":"2023-10-26T06:41:33.992410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552190+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:41:32.552190+0000","last_peered":"2023-10-26T06:41:32.552190+0000","last_clean":"2023-10-26T06:41:32.552190+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:41:32.552190+0000","last_undegraded":"2023-10-26T06:41:32.552190+0000","last_fullsized":"2023-10-26T06:41:32.552190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:28.086836+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:42:28.086836+0000","last_peered":"2023-10-26T06:42:28.086836+0000","last_clean":"2023-10-26T06:42:28.086836+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:42:28.086836+0000","last_undegraded":"2023-10-26T06:42:28.086836+0000","last_fullsized":"2023-10-26T06:42:28.086836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551861+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:41:32.551861+0000","last_peered":"2023-10-26T06:41:32.551861+0000","last_clean":"2023-10-26T06:41:32.551861+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:41:32.551861+0000","last_undegraded":"2023-10-26T06:41:32.551861+0000","last_fullsized":"2023-10-26T06:41:32.551861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.996700+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:41:34.996700+0000","last_peered":"2023-10-26T06:41:34.996700+0000","last_clean":"2023-10-26T06:41:34.996700+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:41:34.996700+0000","last_undegraded":"2023-10-26T06:41:34.996700+0000","last_fullsized":"2023-10-26T06:41:34.996700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640022+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:41:33.640022+0000","last_peered":"2023-10-26T06:41:33.640022+0000","last_clean":"2023-10-26T06:41:33.640022+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:41:33.640022+0000","last_undegraded":"2023-10-26T06:41:33.640022+0000","last_fullsized":"2023-10-26T06:41:33.640022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.005443+0000","last_change":"2023-10-26T06:41:29.962764+0000","last_active":"2023-10-26T06:41:36.005443+0000","last_peered":"2023-10-26T06:41:36.005443+0000","last_clean":"2023-10-26T06:41:36.005443+0000","last_became_active":"2023-10-26T06:41:29.962245+0000","last_became_peered":"2023-10-26T06:41:29.962245+0000","last_unstale":"2023-10-26T06:41:36.005443+0000","last_undegraded":"2023-10-26T06:41:36.005443+0000","last_fullsized":"2023-10-26T06:41:36.005443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:33:21.800233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640386+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:41:33.640386+0000","last_peered":"2023-10-26T06:41:33.640386+0000","last_clean":"2023-10-26T06:41:33.640386+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:41:33.640386+0000","last_undegraded":"2023-10-26T06:41:33.640386+0000","last_fullsized":"2023-10-26T06:41:33.640386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640413+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:41:33.640413+0000","last_peered":"2023-10-26T06:41:33.640413+0000","last_clean":"2023-10-26T06:41:33.640413+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:41:33.640413+0000","last_undegraded":"2023-10-26T06:41:33.640413+0000","last_fullsized":"2023-10-26T06:41:33.640413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640019+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:41:33.640019+0000","last_peered":"2023-10-26T06:41:33.640019+0000","last_clean":"2023-10-26T06:41:33.640019+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:41:33.640019+0000","last_undegraded":"2023-10-26T06:41:33.640019+0000","last_fullsized":"2023-10-26T06:41:33.640019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675117+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:41:33.675117+0000","last_peered":"2023-10-26T06:41:33.675117+0000","last_clean":"2023-10-26T06:41:33.675117+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:41:33.675117+0000","last_undegraded":"2023-10-26T06:41:33.675117+0000","last_fullsized":"2023-10-26T06:41:33.675117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639719+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:41:33.639719+0000","last_peered":"2023-10-26T06:41:33.639719+0000","last_clean":"2023-10-26T06:41:33.639719+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:41:33.639719+0000","last_undegraded":"2023-10-26T06:41:33.639719+0000","last_fullsized":"2023-10-26T06:41:33.639719+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640776+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:41:33.640776+0000","last_peered":"2023-10-26T06:41:33.640776+0000","last_clean":"2023-10-26T06:41:33.640776+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:41:33.640776+0000","last_undegraded":"2023-10-26T06:41:33.640776+0000","last_fullsized":"2023-10-26T06:41:33.640776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:24.079863+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:42:24.079863+0000","last_peered":"2023-10-26T06:42:24.079863+0000","last_clean":"2023-10-26T06:42:24.079863+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:42:24.079863+0000","last_undegraded":"2023-10-26T06:42:24.079863+0000","last_fullsized":"2023-10-26T06:42:24.079863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":85,"state":"peering","last_fresh":"2023-10-26T06:41:30.936012+0000","last_change":"2023-10-26T06:42:30.687245+0000","last_active":"2023-10-26T06:41:29.928608+0000","last_peered":"2023-10-26T06:41:29.928608+0000","last_clean":"2023-10-26T06:41:29.928608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-26T06:41:30.936012+0000","last_undegraded":"2023-10-26T06:41:30.936012+0000","last_fullsized":"2023-10-26T06:41:30.936012+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.002428+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:41:36.002428+0000","last_peered":"2023-10-26T06:41:36.002428+0000","last_clean":"2023-10-26T06:41:36.002428+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:41:36.002428+0000","last_undegraded":"2023-10-26T06:41:36.002428+0000","last_fullsized":"2023-10-26T06:41:36.002428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.939903+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:41:30.939903+0000","last_peered":"2023-10-26T06:41:30.939903+0000","last_clean":"2023-10-26T06:41:30.939903+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:41:30.939903+0000","last_undegraded":"2023-10-26T06:41:30.939903+0000","last_fullsized":"2023-10-26T06:41:30.939903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639481+0000","last_change":"2023-10-26T06:41:30.954040+0000","last_active":"2023-10-26T06:41:33.639481+0000","last_peered":"2023-10-26T06:41:33.639481+0000","last_clean":"2023-10-26T06:41:33.639481+0000","last_became_active":"2023-10-26T06:41:30.953367+0000","last_became_peered":"2023-10-26T06:41:30.953367+0000","last_unstale":"2023-10-26T06:41:33.639481+0000","last_undegraded":"2023-10-26T06:41:33.639481+0000","last_fullsized":"2023-10-26T06:41:33.639481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:17:37.442177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994555+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:41:34.994555+0000","last_peered":"2023-10-26T06:41:34.994555+0000","last_clean":"2023-10-26T06:41:34.994555+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:41:34.994555+0000","last_undegraded":"2023-10-26T06:41:34.994555+0000","last_fullsized":"2023-10-26T06:41:34.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991384+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:41:33.991384+0000","last_peered":"2023-10-26T06:41:33.991384+0000","last_clean":"2023-10-26T06:41:33.991384+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:41:33.991384+0000","last_undegraded":"2023-10-26T06:41:33.991384+0000","last_fullsized":"2023-10-26T06:41:33.991384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640145+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:41:33.640145+0000","last_peered":"2023-10-26T06:41:33.640145+0000","last_clean":"2023-10-26T06:41:33.640145+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:41:33.640145+0000","last_undegraded":"2023-10-26T06:41:33.640145+0000","last_fullsized":"2023-10-26T06:41:33.640145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:44.421264+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:41:44.421264+0000","last_peered":"2023-10-26T06:41:44.421264+0000","last_clean":"2023-10-26T06:41:44.421264+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:41:44.421264+0000","last_undegraded":"2023-10-26T06:41:44.421264+0000","last_fullsized":"2023-10-26T06:41:44.421264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942707+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:41:31.942707+0000","last_peered":"2023-10-26T06:41:31.942707+0000","last_clean":"2023-10-26T06:41:31.942707+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:41:31.942707+0000","last_undegraded":"2023-10-26T06:41:31.942707+0000","last_fullsized":"2023-10-26T06:41:31.942707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991181+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:41:33.991181+0000","last_peered":"2023-10-26T06:41:33.991181+0000","last_clean":"2023-10-26T06:41:33.991181+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:41:33.991181+0000","last_undegraded":"2023-10-26T06:41:33.991181+0000","last_fullsized":"2023-10-26T06:41:33.991181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.641086+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:41:33.641086+0000","last_peered":"2023-10-26T06:41:33.641086+0000","last_clean":"2023-10-26T06:41:33.641086+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:41:33.641086+0000","last_undegraded":"2023-10-26T06:41:33.641086+0000","last_fullsized":"2023-10-26T06:41:33.641086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991058+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:41:33.991058+0000","last_peered":"2023-10-26T06:41:33.991058+0000","last_clean":"2023-10-26T06:41:33.991058+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:41:33.991058+0000","last_undegraded":"2023-10-26T06:41:33.991058+0000","last_fullsized":"2023-10-26T06:41:33.991058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.432711+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:41:33.432711+0000","last_peered":"2023-10-26T06:41:33.432711+0000","last_clean":"2023-10-26T06:41:33.432711+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:41:33.432711+0000","last_undegraded":"2023-10-26T06:41:33.432711+0000","last_fullsized":"2023-10-26T06:41:33.432711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991075+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:41:33.991075+0000","last_peered":"2023-10-26T06:41:33.991075+0000","last_clean":"2023-10-26T06:41:33.991075+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:41:33.991075+0000","last_undegraded":"2023-10-26T06:41:33.991075+0000","last_fullsized":"2023-10-26T06:41:33.991075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639521+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:41:33.639521+0000","last_peered":"2023-10-26T06:41:33.639521+0000","last_clean":"2023-10-26T06:41:33.639521+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:41:33.639521+0000","last_undegraded":"2023-10-26T06:41:33.639521+0000","last_fullsized":"2023-10-26T06:41:33.639521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946651+0000","last_change":"2023-10-26T06:41:29.957155+0000","last_active":"2023-10-26T06:41:31.946651+0000","last_peered":"2023-10-26T06:41:31.946651+0000","last_clean":"2023-10-26T06:41:31.946651+0000","last_became_active":"2023-10-26T06:41:29.956740+0000","last_became_peered":"2023-10-26T06:41:29.956740+0000","last_unstale":"2023-10-26T06:41:31.946651+0000","last_undegraded":"2023-10-26T06:41:31.946651+0000","last_fullsized":"2023-10-26T06:41:31.946651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:14:27.826402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942335+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:41:31.942335+0000","last_peered":"2023-10-26T06:41:31.942335+0000","last_clean":"2023-10-26T06:41:31.942335+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:41:31.942335+0000","last_undegraded":"2023-10-26T06:41:31.942335+0000","last_fullsized":"2023-10-26T06:41:31.942335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991813+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:41:33.991813+0000","last_peered":"2023-10-26T06:41:33.991813+0000","last_clean":"2023-10-26T06:41:33.991813+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:41:33.991813+0000","last_undegraded":"2023-10-26T06:41:33.991813+0000","last_fullsized":"2023-10-26T06:41:33.991813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552153+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:41:32.552153+0000","last_peered":"2023-10-26T06:41:32.552153+0000","last_clean":"2023-10-26T06:41:32.552153+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:41:32.552153+0000","last_undegraded":"2023-10-26T06:41:32.552153+0000","last_fullsized":"2023-10-26T06:41:32.552153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.007940+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:41:36.007940+0000","last_peered":"2023-10-26T06:41:36.007940+0000","last_clean":"2023-10-26T06:41:36.007940+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:41:36.007940+0000","last_undegraded":"2023-10-26T06:41:36.007940+0000","last_fullsized":"2023-10-26T06:41:36.007940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552239+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:41:32.552239+0000","last_peered":"2023-10-26T06:41:32.552239+0000","last_clean":"2023-10-26T06:41:32.552239+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:41:32.552239+0000","last_undegraded":"2023-10-26T06:41:32.552239+0000","last_fullsized":"2023-10-26T06:41:32.552239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.004605+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:41:36.004605+0000","last_peered":"2023-10-26T06:41:36.004605+0000","last_clean":"2023-10-26T06:41:36.004605+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:41:36.004605+0000","last_undegraded":"2023-10-26T06:41:36.004605+0000","last_fullsized":"2023-10-26T06:41:36.004605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675149+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:41:33.675149+0000","last_peered":"2023-10-26T06:41:33.675149+0000","last_clean":"2023-10-26T06:41:33.675149+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:41:33.675149+0000","last_undegraded":"2023-10-26T06:41:33.675149+0000","last_fullsized":"2023-10-26T06:41:33.675149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.054027+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:41:31.054027+0000","last_peered":"2023-10-26T06:41:31.054027+0000","last_clean":"2023-10-26T06:41:31.054027+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:41:31.054027+0000","last_undegraded":"2023-10-26T06:41:31.054027+0000","last_fullsized":"2023-10-26T06:41:31.054027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552218+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:41:32.552218+0000","last_peered":"2023-10-26T06:41:32.552218+0000","last_clean":"2023-10-26T06:41:32.552218+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:41:32.552218+0000","last_undegraded":"2023-10-26T06:41:32.552218+0000","last_fullsized":"2023-10-26T06:41:32.552218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639593+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:41:33.639593+0000","last_peered":"2023-10-26T06:41:33.639593+0000","last_clean":"2023-10-26T06:41:33.639593+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:41:33.639593+0000","last_undegraded":"2023-10-26T06:41:33.639593+0000","last_fullsized":"2023-10-26T06:41:33.639593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946690+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:41:31.946690+0000","last_peered":"2023-10-26T06:41:31.946690+0000","last_clean":"2023-10-26T06:41:31.946690+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:41:31.946690+0000","last_undegraded":"2023-10-26T06:41:31.946690+0000","last_fullsized":"2023-10-26T06:41:31.946690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946685+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:41:31.946685+0000","last_peered":"2023-10-26T06:41:31.946685+0000","last_clean":"2023-10-26T06:41:31.946685+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:41:31.946685+0000","last_undegraded":"2023-10-26T06:41:31.946685+0000","last_fullsized":"2023-10-26T06:41:31.946685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640660+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:41:33.640660+0000","last_peered":"2023-10-26T06:41:33.640660+0000","last_clean":"2023-10-26T06:41:33.640660+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:41:33.640660+0000","last_undegraded":"2023-10-26T06:41:33.640660+0000","last_fullsized":"2023-10-26T06:41:33.640660+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640677+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:41:33.640677+0000","last_peered":"2023-10-26T06:41:33.640677+0000","last_clean":"2023-10-26T06:41:33.640677+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:41:33.640677+0000","last_undegraded":"2023-10-26T06:41:33.640677+0000","last_fullsized":"2023-10-26T06:41:33.640677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639806+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:41:33.639806+0000","last_peered":"2023-10-26T06:41:33.639806+0000","last_clean":"2023-10-26T06:41:33.639806+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:41:33.639806+0000","last_undegraded":"2023-10-26T06:41:33.639806+0000","last_fullsized":"2023-10-26T06:41:33.639806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946982+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:41:31.946982+0000","last_peered":"2023-10-26T06:41:31.946982+0000","last_clean":"2023-10-26T06:41:31.946982+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:41:31.946982+0000","last_undegraded":"2023-10-26T06:41:31.946982+0000","last_fullsized":"2023-10-26T06:41:31.946982+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942673+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:41:31.942673+0000","last_peered":"2023-10-26T06:41:31.942673+0000","last_clean":"2023-10-26T06:41:31.942673+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:41:31.942673+0000","last_undegraded":"2023-10-26T06:41:31.942673+0000","last_fullsized":"2023-10-26T06:41:31.942673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640647+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:41:33.640647+0000","last_peered":"2023-10-26T06:41:33.640647+0000","last_clean":"2023-10-26T06:41:33.640647+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:41:33.640647+0000","last_undegraded":"2023-10-26T06:41:33.640647+0000","last_fullsized":"2023-10-26T06:41:33.640647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942404+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:41:31.942404+0000","last_peered":"2023-10-26T06:41:31.942404+0000","last_clean":"2023-10-26T06:41:31.942404+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:41:31.942404+0000","last_undegraded":"2023-10-26T06:41:31.942404+0000","last_fullsized":"2023-10-26T06:41:31.942404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942522+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:41:31.942522+0000","last_peered":"2023-10-26T06:41:31.942522+0000","last_clean":"2023-10-26T06:41:31.942522+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:41:31.942522+0000","last_undegraded":"2023-10-26T06:41:31.942522+0000","last_fullsized":"2023-10-26T06:41:31.942522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640293+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:41:33.640293+0000","last_peered":"2023-10-26T06:41:33.640293+0000","last_clean":"2023-10-26T06:41:33.640293+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:41:33.640293+0000","last_undegraded":"2023-10-26T06:41:33.640293+0000","last_fullsized":"2023-10-26T06:41:33.640293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639807+0000","last_change":"2023-10-26T06:41:30.948857+0000","last_active":"2023-10-26T06:41:33.639807+0000","last_peered":"2023-10-26T06:41:33.639807+0000","last_clean":"2023-10-26T06:41:33.639807+0000","last_became_active":"2023-10-26T06:41:30.948505+0000","last_became_peered":"2023-10-26T06:41:30.948505+0000","last_unstale":"2023-10-26T06:41:33.639807+0000","last_undegraded":"2023-10-26T06:41:33.639807+0000","last_fullsized":"2023-10-26T06:41:33.639807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:11:47.908249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":342,"num_read_kb":234,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416409,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":445170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.623}]},{"osd":2,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.86099999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78500000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.88600000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645340,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1095876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46800000000000003,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.872},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80800000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.61199999999999999,"5min":0.503,"15min":0.503},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.96699999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Oct 26 06:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72599999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":454090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82999999999999996,"15min":0.83399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.629}]},{"osd":5,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88,"15min":0.89600000000000002},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.621}]},{"osd":6,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96699999999999997,"15min":0.98699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.94899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.88800000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0629999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.59399999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63900000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.048,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.2370000000000001,"15min":1.3029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4730000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.60099999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":445326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82499999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.628}]},{"osd":1,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.497},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3759999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.497}]},{"osd":6,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.91900000000000004,"15min":0.94399999999999995},"min":{"1min":0.61499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.075,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.72299999999999998,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.67100000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.81200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1037261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.502},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.505,"15min":0.47799999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.752,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64200000000000002,"15min":0.624},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.629},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.71399999999999997},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.995,"15min":0.995},"last":0.56999999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.68400000000000005}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462958,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":913408,"data_stored":444801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47599999999999998,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.59499999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.67700000000000005},"min":{"1min":0.53500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":1.036,"15min":1.036},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1160000000000001,"5min":1.127,"15min":1.127},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.038,"15min":1.038},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.64600000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.86699999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.071,"5min":1.228,"15min":1.228},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.70899999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.879,"15min":0.88300000000000001},"min":{"1min":0.65700000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.92300000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":0.96899999999999997,"15min":0.92400000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.9790000000000001,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.046,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.97199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542214,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":503748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.006,"15min":1.006},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Oct 26 06:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.33600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.746}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.371},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61799999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76000000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96099999999999997,"5min":1.048,"15min":1.048},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66900000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.69899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":446066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.46000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.70299999999999996,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72199999999999998,"15min":0.64000000000000001},"min":{"1min":0.57399999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:39:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.34499999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66300000000000003,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.441,"15min":0.441},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.61099999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93000000000000005,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.96899999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.095},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90100000000000002}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.006},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0149999999999999}]},{"osd":11,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.0589999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378691,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":513782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91400000000000003,"5min":2.371,"15min":2.371},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2370000000000001,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Oct 26 06:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.751},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63600000000000001,"15min":0.69799999999999995},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81999999999999995,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91300000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58199999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.879}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.63300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.65100000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":445118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47199999999999998,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.88100000000000001,"5min":1.069,"15min":1.069},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.41899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68799999999999994,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99099999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.753},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.73499999999999999,"15min":0.68899999999999995},"min":{"1min":0.57999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.72599999999999998,"15min":0.66400000000000003},"min":{"1min":0.54600000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Oct 26 06:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.361,"15min":1.361},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.751,"15min":0.70499999999999996},"min":{"1min":0.64100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73999999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.226,"5min":1.419,"15min":1.419},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.292,"15min":1.292},"last":0.58399999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0580000000000001,"15min":1.0880000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.97899999999999998,"15min":0.997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.88200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888121,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":445622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.377},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76100000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.628}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.87}]},{"osd":8,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.88500000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93999999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94499999999999995,"5min":1.246,"15min":1.246},"last":0.86199999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93200000000000005,"5min":1.044,"15min":1.044},"last":0.753}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724596,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1544192,"data_stored":1044908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":5.819,"15min":5.819},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.751,"5min":5.835,"15min":5.835},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.53300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66100000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.754,"15min":0.748},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:42:32.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph pg dump --format=json 2023-10-26T06:42:32.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:31 smithi125 ceph-mon[130643]: osdmap e86: 12 total, 12 up, 12 in 2023-10-26T06:42:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:32 smithi153 ceph-mon[131657]: from='client.25052 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:32 smithi153 ceph-mon[131657]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:32.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:32 smithi153 ceph-mon[131657]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-10-26T06:42:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:32 smithi050 ceph-mon[94997]: from='client.25052 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:32 smithi050 ceph-mon[94997]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:33.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:32 smithi050 ceph-mon[94997]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-10-26T06:42:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:32 smithi125 ceph-mon[130643]: from='client.25052 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:32 smithi125 ceph-mon[130643]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:33.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:32 smithi125 ceph-mon[130643]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-10-26T06:42:33.972 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:33 smithi050 ceph-mon[94997]: pgmap v286: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:34.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:33 smithi125 ceph-mon[130643]: pgmap v286: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:34.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 -- 172.21.15.50:0/144493558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7810d300 msgr2=0x7fce7810f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:34.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 --2- 172.21.15.50:0/144493558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7810d300 0x7fce7810f6f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce7000b0a0 tx=0x7fce7000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 -- 172.21.15.50:0/144493558 shutdown_connections 2023-10-26T06:42:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 --2- 172.21.15.50:0/144493558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce7810d300 0x7fce7810f6f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 --2- 172.21.15.50:0/144493558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 0x7fce78068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 --2- 172.21.15.50:0/144493558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce78068ab0 0x7fce7810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 -- 172.21.15.50:0/144493558 >> 172.21.15.50:0/144493558 conn(0x7fce78075790 msgr2=0x7fce78075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:34.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 -- 172.21.15.50:0/144493558 shutdown_connections 2023-10-26T06:42:34.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.227+0000 7fce7e411700 1 -- 172.21.15.50:0/144493558 wait complete. 2023-10-26T06:42:34.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.229+0000 7fce7e411700 1 Processor -- start 2023-10-26T06:42:34.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.229+0000 7fce7e411700 1 -- start start 2023-10-26T06:42:34.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7e411700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 0x7fce78198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:34.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7e411700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78068ab0 0x7fce781994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:34.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7e411700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 0x7fce7819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:34.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7e411700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7819de60 con 0x7fce78068ab0 2023-10-26T06:42:34.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7e411700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7819dfd0 con 0x7fce78068190 2023-10-26T06:42:34.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7e411700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7819e190 con 0x7fce7810d300 2023-10-26T06:42:34.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78068ab0 0x7fce781994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:34.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7c9ae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 0x7fce7819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:34.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7c9ae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 0x7fce7819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:50462/0 (socket says 172.21.15.50:50462) 2023-10-26T06:42:34.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce7c9ae700 1 -- 172.21.15.50:0/3537439909 learned_addr learned my addr 172.21.15.50:0/3537439909 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:34.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.230+0000 7fce77fff700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 0x7fce78198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:34.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:33 smithi153 ceph-mon[131657]: pgmap v286: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:34.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce777fe700 1 -- 172.21.15.50:0/3537439909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 msgr2=0x7fce7819d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:34.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce777fe700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 0x7fce7819d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce777fe700 1 -- 172.21.15.50:0/3537439909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 msgr2=0x7fce78198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:34.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce777fe700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 0x7fce78198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce777fe700 1 -- 172.21.15.50:0/3537439909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce70009d00 con 0x7fce78068ab0 2023-10-26T06:42:34.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce7c9ae700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 0x7fce7819d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:34.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce77fff700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 0x7fce78198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:34.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce777fe700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78068ab0 0x7fce781994a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00e9f0 tx=0x7fce6c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:34.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00c9c0 con 0x7fce78068ab0 2023-10-26T06:42:34.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce6c010430 con 0x7fce78068ab0 2023-10-26T06:42:34.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7819e470 con 0x7fce78068ab0 2023-10-26T06:42:34.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.231+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c018680 con 0x7fce78068ab0 2023-10-26T06:42:34.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.232+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce781a5cd0 con 0x7fce78068ab0 2023-10-26T06:42:34.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.233+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce78108520 con 0x7fce78068ab0 2023-10-26T06:42:34.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.235+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fce6c00cb20 con 0x7fce78068ab0 2023-10-26T06:42:34.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.236+0000 7fce757fa700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fce600a15e0 0x7fce600a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:34.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.236+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fce6c014070 con 0x7fce78068ab0 2023-10-26T06:42:34.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.236+0000 7fce77fff700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fce600a15e0 0x7fce600a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:34.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.237+0000 7fce77fff700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fce600a15e0 0x7fce600a3aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fce68011490 tx=0x7fce68009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:34.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.241+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce6c096540 con 0x7fce78068ab0 2023-10-26T06:42:34.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.455+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce7819a270 con 0x7fce600a15e0 2023-10-26T06:42:34.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.467+0000 7fce757fa700 1 -- 172.21.15.50:0/3537439909 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341968 (secure 0 0 0) 0x7fce7819a270 con 0x7fce600a15e0 2023-10-26T06:42:34.474 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.471+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fce600a15e0 msgr2=0x7fce600a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.471+0000 7fce7e411700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fce600a15e0 0x7fce600a3aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fce68011490 tx=0x7fce68009260 comp rx=0 tx=0).stop 2023-10-26T06:42:34.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.471+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78068ab0 msgr2=0x7fce781994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.471+0000 7fce7e411700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78068ab0 0x7fce781994a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00e9f0 tx=0x7fce6c00ed00 comp rx=0 tx=0).stop 2023-10-26T06:42:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 shutdown_connections 2023-10-26T06:42:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fce600a15e0 0x7fce600a3aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce7810d300 0x7fce7819d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce78068190 0x7fce78198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 --2- 172.21.15.50:0/3537439909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78068ab0 0x7fce781994a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 >> 172.21.15.50:0/3537439909 conn(0x7fce78075790 msgr2=0x7fce7810e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 shutdown_connections 2023-10-26T06:42:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:34.472+0000 7fce7e411700 1 -- 172.21.15.50:0/3537439909 wait complete. 2023-10-26T06:42:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:42:34.903 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-10-26T06:42:33.637417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":497,"num_read_kb":367,"num_write":332,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":290,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337240,"kb_used_data":12996,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604584,"statfs":{"total":1151940427776,"available":1151595094016,"internally_reserved":0,"allocated":13307904,"data_stored":7417412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001853"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703203+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:42:29.703203+0000","last_peered":"2023-10-26T06:42:29.703203+0000","last_clean":"2023-10-26T06:42:29.703203+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:42:29.703203+0000","last_undegraded":"2023-10-26T06:42:29.703203+0000","last_fullsized":"2023-10-26T06:42:29.703203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408093+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:42:30.408093+0000","last_peered":"2023-10-26T06:42:30.408093+0000","last_clean":"2023-10-26T06:42:30.408093+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:42:30.408093+0000","last_undegraded":"2023-10-26T06:42:30.408093+0000","last_fullsized":"2023-10-26T06:42:30.408093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408054+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:42:30.408054+0000","last_peered":"2023-10-26T06:42:30.408054+0000","last_clean":"2023-10-26T06:42:30.408054+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:42:30.408054+0000","last_undegraded":"2023-10-26T06:42:30.408054+0000","last_fullsized":"2023-10-26T06:42:30.408054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640010+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:41:33.640010+0000","last_peered":"2023-10-26T06:41:33.640010+0000","last_clean":"2023-10-26T06:41:33.640010+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:41:33.640010+0000","last_undegraded":"2023-10-26T06:41:33.640010+0000","last_fullsized":"2023-10-26T06:41:33.640010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703894+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:42:29.703894+0000","last_peered":"2023-10-26T06:42:29.703894+0000","last_clean":"2023-10-26T06:42:29.703894+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:42:29.703894+0000","last_undegraded":"2023-10-26T06:42:29.703894+0000","last_fullsized":"2023-10-26T06:42:29.703894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698534+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:42:29.698534+0000","last_peered":"2023-10-26T06:42:29.698534+0000","last_clean":"2023-10-26T06:42:29.698534+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:42:29.698534+0000","last_undegraded":"2023-10-26T06:42:29.698534+0000","last_fullsized":"2023-10-26T06:42:29.698534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551931+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:41:32.551931+0000","last_peered":"2023-10-26T06:41:32.551931+0000","last_clean":"2023-10-26T06:41:32.551931+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:41:32.551931+0000","last_undegraded":"2023-10-26T06:41:32.551931+0000","last_fullsized":"2023-10-26T06:41:32.551931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698334+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:42:29.698334+0000","last_peered":"2023-10-26T06:42:29.698334+0000","last_clean":"2023-10-26T06:42:29.698334+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:42:29.698334+0000","last_undegraded":"2023-10-26T06:42:29.698334+0000","last_fullsized":"2023-10-26T06:42:29.698334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942643+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:41:31.942643+0000","last_peered":"2023-10-26T06:41:31.942643+0000","last_clean":"2023-10-26T06:41:31.942643+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:41:31.942643+0000","last_undegraded":"2023-10-26T06:41:31.942643+0000","last_fullsized":"2023-10-26T06:41:31.942643+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698804+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:42:29.698804+0000","last_peered":"2023-10-26T06:42:29.698804+0000","last_clean":"2023-10-26T06:42:29.698804+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:42:29.698804+0000","last_undegraded":"2023-10-26T06:42:29.698804+0000","last_fullsized":"2023-10-26T06:42:29.698804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552219+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:41:32.552219+0000","last_peered":"2023-10-26T06:41:32.552219+0000","last_clean":"2023-10-26T06:41:32.552219+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:41:32.552219+0000","last_undegraded":"2023-10-26T06:41:32.552219+0000","last_fullsized":"2023-10-26T06:41:32.552219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639937+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:41:33.639937+0000","last_peered":"2023-10-26T06:41:33.639937+0000","last_clean":"2023-10-26T06:41:33.639937+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:41:33.639937+0000","last_undegraded":"2023-10-26T06:41:33.639937+0000","last_fullsized":"2023-10-26T06:41:33.639937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706123+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:42:29.706123+0000","last_peered":"2023-10-26T06:42:29.706123+0000","last_clean":"2023-10-26T06:42:29.706123+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:42:29.706123+0000","last_undegraded":"2023-10-26T06:42:29.706123+0000","last_fullsized":"2023-10-26T06:42:29.706123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407805+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:42:30.407805+0000","last_peered":"2023-10-26T06:42:30.407805+0000","last_clean":"2023-10-26T06:42:30.407805+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:42:30.407805+0000","last_undegraded":"2023-10-26T06:42:30.407805+0000","last_fullsized":"2023-10-26T06:42:30.407805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407974+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:42:30.407974+0000","last_peered":"2023-10-26T06:42:30.407974+0000","last_clean":"2023-10-26T06:42:30.407974+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:42:30.407974+0000","last_undegraded":"2023-10-26T06:42:30.407974+0000","last_fullsized":"2023-10-26T06:42:30.407974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942255+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:41:31.942255+0000","last_peered":"2023-10-26T06:41:31.942255+0000","last_clean":"2023-10-26T06:41:31.942255+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:41:31.942255+0000","last_undegraded":"2023-10-26T06:41:31.942255+0000","last_fullsized":"2023-10-26T06:41:31.942255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703097+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:42:29.703097+0000","last_peered":"2023-10-26T06:42:29.703097+0000","last_clean":"2023-10-26T06:42:29.703097+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:42:29.703097+0000","last_undegraded":"2023-10-26T06:42:29.703097+0000","last_fullsized":"2023-10-26T06:42:29.703097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640317+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:41:33.640317+0000","last_peered":"2023-10-26T06:41:33.640317+0000","last_clean":"2023-10-26T06:41:33.640317+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:41:33.640317+0000","last_undegraded":"2023-10-26T06:41:33.640317+0000","last_fullsized":"2023-10-26T06:41:33.640317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946826+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:41:31.946826+0000","last_peered":"2023-10-26T06:41:31.946826+0000","last_clean":"2023-10-26T06:41:31.946826+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:41:31.946826+0000","last_undegraded":"2023-10-26T06:41:31.946826+0000","last_fullsized":"2023-10-26T06:41:31.946826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.008535+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:41:36.008535+0000","last_peered":"2023-10-26T06:41:36.008535+0000","last_clean":"2023-10-26T06:41:36.008535+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:41:36.008535+0000","last_undegraded":"2023-10-26T06:41:36.008535+0000","last_fullsized":"2023-10-26T06:41:36.008535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698714+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:42:29.698714+0000","last_peered":"2023-10-26T06:42:29.698714+0000","last_clean":"2023-10-26T06:42:29.698714+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:42:29.698714+0000","last_undegraded":"2023-10-26T06:42:29.698714+0000","last_fullsized":"2023-10-26T06:42:29.698714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698805+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:42:29.698805+0000","last_peered":"2023-10-26T06:42:29.698805+0000","last_clean":"2023-10-26T06:42:29.698805+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:42:29.698805+0000","last_undegraded":"2023-10-26T06:42:29.698805+0000","last_fullsized":"2023-10-26T06:42:29.698805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408232+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:42:30.408232+0000","last_peered":"2023-10-26T06:42:30.408232+0000","last_clean":"2023-10-26T06:42:30.408232+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:42:30.408232+0000","last_undegraded":"2023-10-26T06:42:30.408232+0000","last_fullsized":"2023-10-26T06:42:30.408232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704769+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:42:29.704769+0000","last_peered":"2023-10-26T06:42:29.704769+0000","last_clean":"2023-10-26T06:42:29.704769+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:42:29.704769+0000","last_undegraded":"2023-10-26T06:42:29.704769+0000","last_fullsized":"2023-10-26T06:42:29.704769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942419+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:41:31.942419+0000","last_peered":"2023-10-26T06:41:31.942419+0000","last_clean":"2023-10-26T06:41:31.942419+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:41:31.942419+0000","last_undegraded":"2023-10-26T06:41:31.942419+0000","last_fullsized":"2023-10-26T06:41:31.942419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704515+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:42:29.704515+0000","last_peered":"2023-10-26T06:42:29.704515+0000","last_clean":"2023-10-26T06:42:29.704515+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:42:29.704515+0000","last_undegraded":"2023-10-26T06:42:29.704515+0000","last_fullsized":"2023-10-26T06:42:29.704515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640141+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:41:33.640141+0000","last_peered":"2023-10-26T06:41:33.640141+0000","last_clean":"2023-10-26T06:41:33.640141+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:41:33.640141+0000","last_undegraded":"2023-10-26T06:41:33.640141+0000","last_fullsized":"2023-10-26T06:41:33.640141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699374+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:42:29.699374+0000","last_peered":"2023-10-26T06:42:29.699374+0000","last_clean":"2023-10-26T06:42:29.699374+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:42:29.699374+0000","last_undegraded":"2023-10-26T06:42:29.699374+0000","last_fullsized":"2023-10-26T06:42:29.699374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704237+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:42:29.704237+0000","last_peered":"2023-10-26T06:42:29.704237+0000","last_clean":"2023-10-26T06:42:29.704237+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:42:29.704237+0000","last_undegraded":"2023-10-26T06:42:29.704237+0000","last_fullsized":"2023-10-26T06:42:29.704237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698424+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:42:29.698424+0000","last_peered":"2023-10-26T06:42:29.698424+0000","last_clean":"2023-10-26T06:42:29.698424+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:42:29.698424+0000","last_undegraded":"2023-10-26T06:42:29.698424+0000","last_fullsized":"2023-10-26T06:42:29.698424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640026+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:41:33.640026+0000","last_peered":"2023-10-26T06:41:33.640026+0000","last_clean":"2023-10-26T06:41:33.640026+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:41:33.640026+0000","last_undegraded":"2023-10-26T06:41:33.640026+0000","last_fullsized":"2023-10-26T06:41:33.640026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706715+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:42:29.706715+0000","last_peered":"2023-10-26T06:42:29.706715+0000","last_clean":"2023-10-26T06:42:29.706715+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:42:29.706715+0000","last_undegraded":"2023-10-26T06:42:29.706715+0000","last_fullsized":"2023-10-26T06:42:29.706715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698257+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:42:29.698257+0000","last_peered":"2023-10-26T06:42:29.698257+0000","last_clean":"2023-10-26T06:42:29.698257+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:42:29.698257+0000","last_undegraded":"2023-10-26T06:42:29.698257+0000","last_fullsized":"2023-10-26T06:42:29.698257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991740+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:41:33.991740+0000","last_peered":"2023-10-26T06:41:33.991740+0000","last_clean":"2023-10-26T06:41:33.991740+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:41:33.991740+0000","last_undegraded":"2023-10-26T06:41:33.991740+0000","last_fullsized":"2023-10-26T06:41:33.991740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.639876+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:41:33.639876+0000","last_peered":"2023-10-26T06:41:33.639876+0000","last_clean":"2023-10-26T06:41:33.639876+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:41:33.639876+0000","last_undegraded":"2023-10-26T06:41:33.639876+0000","last_fullsized":"2023-10-26T06:41:33.639876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.086001+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:42:31.086001+0000","last_peered":"2023-10-26T06:42:31.086001+0000","last_clean":"2023-10-26T06:42:31.086001+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:42:31.086001+0000","last_undegraded":"2023-10-26T06:42:31.086001+0000","last_fullsized":"2023-10-26T06:42:31.086001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942571+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:41:31.942571+0000","last_peered":"2023-10-26T06:41:31.942571+0000","last_clean":"2023-10-26T06:41:31.942571+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:41:31.942571+0000","last_undegraded":"2023-10-26T06:41:31.942571+0000","last_fullsized":"2023-10-26T06:41:31.942571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991018+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:41:33.991018+0000","last_peered":"2023-10-26T06:41:33.991018+0000","last_clean":"2023-10-26T06:41:33.991018+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:41:33.991018+0000","last_undegraded":"2023-10-26T06:41:33.991018+0000","last_fullsized":"2023-10-26T06:41:33.991018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408184+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:42:30.408184+0000","last_peered":"2023-10-26T06:42:30.408184+0000","last_clean":"2023-10-26T06:42:30.408184+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:42:30.408184+0000","last_undegraded":"2023-10-26T06:42:30.408184+0000","last_fullsized":"2023-10-26T06:42:30.408184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.004950+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:41:36.004950+0000","last_peered":"2023-10-26T06:41:36.004950+0000","last_clean":"2023-10-26T06:41:36.004950+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:41:36.004950+0000","last_undegraded":"2023-10-26T06:41:36.004950+0000","last_fullsized":"2023-10-26T06:41:36.004950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942519+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:41:31.942519+0000","last_peered":"2023-10-26T06:41:31.942519+0000","last_clean":"2023-10-26T06:41:31.942519+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:41:31.942519+0000","last_undegraded":"2023-10-26T06:41:31.942519+0000","last_fullsized":"2023-10-26T06:41:31.942519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":164,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:32.087302+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:42:32.087302+0000","last_peered":"2023-10-26T06:42:32.087302+0000","last_clean":"2023-10-26T06:42:32.087302+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:42:32.087302+0000","last_undegraded":"2023-10-26T06:42:32.087302+0000","last_fullsized":"2023-10-26T06:42:32.087302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704506+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:42:29.704506+0000","last_peered":"2023-10-26T06:42:29.704506+0000","last_clean":"2023-10-26T06:42:29.704506+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:42:29.704506+0000","last_undegraded":"2023-10-26T06:42:29.704506+0000","last_fullsized":"2023-10-26T06:42:29.704506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.004561+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:41:36.004561+0000","last_peered":"2023-10-26T06:41:36.004561+0000","last_clean":"2023-10-26T06:41:36.004561+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:41:36.004561+0000","last_undegraded":"2023-10-26T06:41:36.004561+0000","last_fullsized":"2023-10-26T06:41:36.004561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705997+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:42:29.705997+0000","last_peered":"2023-10-26T06:42:29.705997+0000","last_clean":"2023-10-26T06:42:29.705997+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:42:29.705997+0000","last_undegraded":"2023-10-26T06:42:29.705997+0000","last_fullsized":"2023-10-26T06:42:29.705997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.992410+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:41:33.992410+0000","last_peered":"2023-10-26T06:41:33.992410+0000","last_clean":"2023-10-26T06:41:33.992410+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:41:33.992410+0000","last_undegraded":"2023-10-26T06:41:33.992410+0000","last_fullsized":"2023-10-26T06:41:33.992410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552190+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:41:32.552190+0000","last_peered":"2023-10-26T06:41:32.552190+0000","last_clean":"2023-10-26T06:41:32.552190+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:41:32.552190+0000","last_undegraded":"2023-10-26T06:41:32.552190+0000","last_fullsized":"2023-10-26T06:41:32.552190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:42:28.086836+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:42:28.086836+0000","last_peered":"2023-10-26T06:42:28.086836+0000","last_clean":"2023-10-26T06:42:28.086836+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:42:28.086836+0000","last_undegraded":"2023-10-26T06:42:28.086836+0000","last_fullsized":"2023-10-26T06:42:28.086836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.551861+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:41:32.551861+0000","last_peered":"2023-10-26T06:41:32.551861+0000","last_clean":"2023-10-26T06:41:32.551861+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:41:32.551861+0000","last_undegraded":"2023-10-26T06:41:32.551861+0000","last_fullsized":"2023-10-26T06:41:32.551861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703869+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:42:29.703869+0000","last_peered":"2023-10-26T06:42:29.703869+0000","last_clean":"2023-10-26T06:42:29.703869+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:42:29.703869+0000","last_undegraded":"2023-10-26T06:42:29.703869+0000","last_fullsized":"2023-10-26T06:42:29.703869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640022+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:41:33.640022+0000","last_peered":"2023-10-26T06:41:33.640022+0000","last_clean":"2023-10-26T06:41:33.640022+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:41:33.640022+0000","last_undegraded":"2023-10-26T06:41:33.640022+0000","last_fullsized":"2023-10-26T06:41:33.640022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.714855+0000","last_change":"2023-10-26T06:42:30.714354+0000","last_active":"2023-10-26T06:42:30.714855+0000","last_peered":"2023-10-26T06:42:30.714855+0000","last_clean":"2023-10-26T06:42:30.714855+0000","last_became_active":"2023-10-26T06:42:30.709396+0000","last_became_peered":"2023-10-26T06:42:30.709396+0000","last_unstale":"2023-10-26T06:42:30.714855+0000","last_undegraded":"2023-10-26T06:42:30.714855+0000","last_fullsized":"2023-10-26T06:42:30.714855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:04:20.594879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702570+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:42:29.702570+0000","last_peered":"2023-10-26T06:42:29.702570+0000","last_clean":"2023-10-26T06:42:29.702570+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:42:29.702570+0000","last_undegraded":"2023-10-26T06:42:29.702570+0000","last_fullsized":"2023-10-26T06:42:29.702570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640413+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:41:33.640413+0000","last_peered":"2023-10-26T06:41:33.640413+0000","last_clean":"2023-10-26T06:41:33.640413+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:41:33.640413+0000","last_undegraded":"2023-10-26T06:41:33.640413+0000","last_fullsized":"2023-10-26T06:41:33.640413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698681+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:42:29.698681+0000","last_peered":"2023-10-26T06:42:29.698681+0000","last_clean":"2023-10-26T06:42:29.698681+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:42:29.698681+0000","last_undegraded":"2023-10-26T06:42:29.698681+0000","last_fullsized":"2023-10-26T06:42:29.698681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675117+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:41:33.675117+0000","last_peered":"2023-10-26T06:41:33.675117+0000","last_clean":"2023-10-26T06:41:33.675117+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:41:33.675117+0000","last_undegraded":"2023-10-26T06:41:33.675117+0000","last_fullsized":"2023-10-26T06:41:33.675117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698676+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:42:29.698676+0000","last_peered":"2023-10-26T06:42:29.698676+0000","last_clean":"2023-10-26T06:42:29.698676+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:42:29.698676+0000","last_undegraded":"2023-10-26T06:42:29.698676+0000","last_fullsized":"2023-10-26T06:42:29.698676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640776+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:41:33.640776+0000","last_peered":"2023-10-26T06:41:33.640776+0000","last_clean":"2023-10-26T06:41:33.640776+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:41:33.640776+0000","last_undegraded":"2023-10-26T06:41:33.640776+0000","last_fullsized":"2023-10-26T06:41:33.640776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.088708+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:42:30.088708+0000","last_peered":"2023-10-26T06:42:30.088708+0000","last_clean":"2023-10-26T06:42:30.088708+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:42:30.088708+0000","last_undegraded":"2023-10-26T06:42:30.088708+0000","last_fullsized":"2023-10-26T06:42:30.088708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":2,"reported_epoch":85,"state":"peering","last_fresh":"2023-10-26T06:41:30.936012+0000","last_change":"2023-10-26T06:42:30.687245+0000","last_active":"2023-10-26T06:41:29.928608+0000","last_peered":"2023-10-26T06:41:29.928608+0000","last_clean":"2023-10-26T06:41:29.928608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-26T06:41:30.936012+0000","last_undegraded":"2023-10-26T06:41:30.936012+0000","last_fullsized":"2023-10-26T06:41:30.936012+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.002428+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:41:36.002428+0000","last_peered":"2023-10-26T06:41:36.002428+0000","last_clean":"2023-10-26T06:41:36.002428+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:41:36.002428+0000","last_undegraded":"2023-10-26T06:41:36.002428+0000","last_fullsized":"2023-10-26T06:41:36.002428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-26T06:41:30.939903+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:41:30.939903+0000","last_peered":"2023-10-26T06:41:30.939903+0000","last_clean":"2023-10-26T06:41:30.939903+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:41:30.939903+0000","last_undegraded":"2023-10-26T06:41:30.939903+0000","last_fullsized":"2023-10-26T06:41:30.939903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.706066+0000","last_change":"2023-10-26T06:42:30.706066+0000","last_active":"2023-10-26T06:42:30.706066+0000","last_peered":"2023-10-26T06:42:30.706066+0000","last_clean":"2023-10-26T06:42:30.706066+0000","last_became_active":"2023-10-26T06:42:30.705682+0000","last_became_peered":"2023-10-26T06:42:30.705682+0000","last_unstale":"2023-10-26T06:42:30.706066+0000","last_undegraded":"2023-10-26T06:42:30.706066+0000","last_fullsized":"2023-10-26T06:42:30.706066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:40:13.366566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:34.994555+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:41:34.994555+0000","last_peered":"2023-10-26T06:41:34.994555+0000","last_clean":"2023-10-26T06:41:34.994555+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:41:34.994555+0000","last_undegraded":"2023-10-26T06:41:34.994555+0000","last_fullsized":"2023-10-26T06:41:34.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704685+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:42:29.704685+0000","last_peered":"2023-10-26T06:42:29.704685+0000","last_clean":"2023-10-26T06:42:29.704685+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:42:29.704685+0000","last_undegraded":"2023-10-26T06:42:29.704685+0000","last_fullsized":"2023-10-26T06:42:29.704685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706153+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:42:29.706153+0000","last_peered":"2023-10-26T06:42:29.706153+0000","last_clean":"2023-10-26T06:42:29.706153+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:42:29.706153+0000","last_undegraded":"2023-10-26T06:42:29.706153+0000","last_fullsized":"2023-10-26T06:42:29.706153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:44.421264+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:41:44.421264+0000","last_peered":"2023-10-26T06:41:44.421264+0000","last_clean":"2023-10-26T06:41:44.421264+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:41:44.421264+0000","last_undegraded":"2023-10-26T06:41:44.421264+0000","last_fullsized":"2023-10-26T06:41:44.421264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698722+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:42:29.698722+0000","last_peered":"2023-10-26T06:42:29.698722+0000","last_clean":"2023-10-26T06:42:29.698722+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:42:29.698722+0000","last_undegraded":"2023-10-26T06:42:29.698722+0000","last_fullsized":"2023-10-26T06:42:29.698722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991181+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:41:33.991181+0000","last_peered":"2023-10-26T06:41:33.991181+0000","last_clean":"2023-10-26T06:41:33.991181+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:41:33.991181+0000","last_undegraded":"2023-10-26T06:41:33.991181+0000","last_fullsized":"2023-10-26T06:41:33.991181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408161+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:42:30.408161+0000","last_peered":"2023-10-26T06:42:30.408161+0000","last_clean":"2023-10-26T06:42:30.408161+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:42:30.408161+0000","last_undegraded":"2023-10-26T06:42:30.408161+0000","last_fullsized":"2023-10-26T06:42:30.408161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.991058+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:41:33.991058+0000","last_peered":"2023-10-26T06:41:33.991058+0000","last_clean":"2023-10-26T06:41:33.991058+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:41:33.991058+0000","last_undegraded":"2023-10-26T06:41:33.991058+0000","last_fullsized":"2023-10-26T06:41:33.991058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704158+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:42:29.704158+0000","last_peered":"2023-10-26T06:42:29.704158+0000","last_clean":"2023-10-26T06:42:29.704158+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:42:29.704158+0000","last_undegraded":"2023-10-26T06:42:29.704158+0000","last_fullsized":"2023-10-26T06:42:29.704158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698478+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:42:29.698478+0000","last_peered":"2023-10-26T06:42:29.698478+0000","last_clean":"2023-10-26T06:42:29.698478+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:42:29.698478+0000","last_undegraded":"2023-10-26T06:42:29.698478+0000","last_fullsized":"2023-10-26T06:42:29.698478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702211+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:42:29.702211+0000","last_peered":"2023-10-26T06:42:29.702211+0000","last_clean":"2023-10-26T06:42:29.702211+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:42:29.702211+0000","last_undegraded":"2023-10-26T06:42:29.702211+0000","last_fullsized":"2023-10-26T06:42:29.702211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.717232+0000","last_change":"2023-10-26T06:42:30.716756+0000","last_active":"2023-10-26T06:42:30.717232+0000","last_peered":"2023-10-26T06:42:30.717232+0000","last_clean":"2023-10-26T06:42:30.717232+0000","last_became_active":"2023-10-26T06:42:30.709797+0000","last_became_peered":"2023-10-26T06:42:30.709797+0000","last_unstale":"2023-10-26T06:42:30.717232+0000","last_undegraded":"2023-10-26T06:42:30.717232+0000","last_fullsized":"2023-10-26T06:42:30.717232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:54.345261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698489+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:42:29.698489+0000","last_peered":"2023-10-26T06:42:29.698489+0000","last_clean":"2023-10-26T06:42:29.698489+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:42:29.698489+0000","last_undegraded":"2023-10-26T06:42:29.698489+0000","last_fullsized":"2023-10-26T06:42:29.698489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704002+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:42:29.704002+0000","last_peered":"2023-10-26T06:42:29.704002+0000","last_clean":"2023-10-26T06:42:29.704002+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:42:29.704002+0000","last_undegraded":"2023-10-26T06:42:29.704002+0000","last_fullsized":"2023-10-26T06:42:29.704002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552153+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:41:32.552153+0000","last_peered":"2023-10-26T06:41:32.552153+0000","last_clean":"2023-10-26T06:41:32.552153+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:41:32.552153+0000","last_undegraded":"2023-10-26T06:41:32.552153+0000","last_fullsized":"2023-10-26T06:41:32.552153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.007940+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:41:36.007940+0000","last_peered":"2023-10-26T06:41:36.007940+0000","last_clean":"2023-10-26T06:41:36.007940+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:41:36.007940+0000","last_undegraded":"2023-10-26T06:41:36.007940+0000","last_fullsized":"2023-10-26T06:41:36.007940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552239+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:41:32.552239+0000","last_peered":"2023-10-26T06:41:32.552239+0000","last_clean":"2023-10-26T06:41:32.552239+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:41:32.552239+0000","last_undegraded":"2023-10-26T06:41:32.552239+0000","last_fullsized":"2023-10-26T06:41:32.552239+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:36.004605+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:41:36.004605+0000","last_peered":"2023-10-26T06:41:36.004605+0000","last_clean":"2023-10-26T06:41:36.004605+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:41:36.004605+0000","last_undegraded":"2023-10-26T06:41:36.004605+0000","last_fullsized":"2023-10-26T06:41:36.004605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.675149+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:41:33.675149+0000","last_peered":"2023-10-26T06:41:33.675149+0000","last_clean":"2023-10-26T06:41:33.675149+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:41:33.675149+0000","last_undegraded":"2023-10-26T06:41:33.675149+0000","last_fullsized":"2023-10-26T06:41:33.675149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706318+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:42:29.706318+0000","last_peered":"2023-10-26T06:42:29.706318+0000","last_clean":"2023-10-26T06:42:29.706318+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:42:29.706318+0000","last_undegraded":"2023-10-26T06:42:29.706318+0000","last_fullsized":"2023-10-26T06:42:29.706318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:32.552218+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:41:32.552218+0000","last_peered":"2023-10-26T06:41:32.552218+0000","last_clean":"2023-10-26T06:41:32.552218+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:41:32.552218+0000","last_undegraded":"2023-10-26T06:41:32.552218+0000","last_fullsized":"2023-10-26T06:41:32.552218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702186+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:42:29.702186+0000","last_peered":"2023-10-26T06:42:29.702186+0000","last_clean":"2023-10-26T06:42:29.702186+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:42:29.702186+0000","last_undegraded":"2023-10-26T06:42:29.702186+0000","last_fullsized":"2023-10-26T06:42:29.702186+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946690+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:41:31.946690+0000","last_peered":"2023-10-26T06:41:31.946690+0000","last_clean":"2023-10-26T06:41:31.946690+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:41:31.946690+0000","last_undegraded":"2023-10-26T06:41:31.946690+0000","last_fullsized":"2023-10-26T06:41:31.946690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946685+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:41:31.946685+0000","last_peered":"2023-10-26T06:41:31.946685+0000","last_clean":"2023-10-26T06:41:31.946685+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:41:31.946685+0000","last_undegraded":"2023-10-26T06:41:31.946685+0000","last_fullsized":"2023-10-26T06:41:31.946685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407881+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:42:30.407881+0000","last_peered":"2023-10-26T06:42:30.407881+0000","last_clean":"2023-10-26T06:42:30.407881+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:42:30.407881+0000","last_undegraded":"2023-10-26T06:42:30.407881+0000","last_fullsized":"2023-10-26T06:42:30.407881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706187+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:42:29.706187+0000","last_peered":"2023-10-26T06:42:29.706187+0000","last_clean":"2023-10-26T06:42:29.706187+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:42:29.706187+0000","last_undegraded":"2023-10-26T06:42:29.706187+0000","last_fullsized":"2023-10-26T06:42:29.706187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702600+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:42:29.702600+0000","last_peered":"2023-10-26T06:42:29.702600+0000","last_clean":"2023-10-26T06:42:29.702600+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:42:29.702600+0000","last_undegraded":"2023-10-26T06:42:29.702600+0000","last_fullsized":"2023-10-26T06:42:29.702600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.946982+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:41:31.946982+0000","last_peered":"2023-10-26T06:41:31.946982+0000","last_clean":"2023-10-26T06:41:31.946982+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:41:31.946982+0000","last_undegraded":"2023-10-26T06:41:31.946982+0000","last_fullsized":"2023-10-26T06:41:31.946982+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698675+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:42:29.698675+0000","last_peered":"2023-10-26T06:42:29.698675+0000","last_clean":"2023-10-26T06:42:29.698675+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:42:29.698675+0000","last_undegraded":"2023-10-26T06:42:29.698675+0000","last_fullsized":"2023-10-26T06:42:29.698675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:33.640647+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:41:33.640647+0000","last_peered":"2023-10-26T06:41:33.640647+0000","last_clean":"2023-10-26T06:41:33.640647+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:41:33.640647+0000","last_undegraded":"2023-10-26T06:41:33.640647+0000","last_fullsized":"2023-10-26T06:41:33.640647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698360+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:42:29.698360+0000","last_peered":"2023-10-26T06:42:29.698360+0000","last_clean":"2023-10-26T06:42:29.698360+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:42:29.698360+0000","last_undegraded":"2023-10-26T06:42:29.698360+0000","last_fullsized":"2023-10-26T06:42:29.698360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-26T06:41:31.942522+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:41:31.942522+0000","last_peered":"2023-10-26T06:41:31.942522+0000","last_clean":"2023-10-26T06:41:31.942522+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:41:31.942522+0000","last_undegraded":"2023-10-26T06:41:31.942522+0000","last_fullsized":"2023-10-26T06:41:31.942522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706047+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:42:29.706047+0000","last_peered":"2023-10-26T06:42:29.706047+0000","last_clean":"2023-10-26T06:42:29.706047+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:42:29.706047+0000","last_undegraded":"2023-10-26T06:42:29.706047+0000","last_fullsized":"2023-10-26T06:42:29.706047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.708612+0000","last_change":"2023-10-26T06:42:30.708612+0000","last_active":"2023-10-26T06:42:30.708612+0000","last_peered":"2023-10-26T06:42:30.708612+0000","last_clean":"2023-10-26T06:42:30.708612+0000","last_became_active":"2023-10-26T06:42:30.707927+0000","last_became_peered":"2023-10-26T06:42:30.707927+0000","last_unstale":"2023-10-26T06:42:30.708612+0000","last_undegraded":"2023-10-26T06:42:30.708612+0000","last_fullsized":"2023-10-26T06:42:30.708612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:59:10.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":361,"num_read_kb":248,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416410,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.878}]},{"osd":7,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.81000000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":9,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.82399999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.83499999999999996}]}]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1634304,"data_stored":1113268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46800000000000003,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.872},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80800000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.372}]},{"osd":5,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.498}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.61199999999999999,"5min":0.503,"15min":0.503},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.61599999999999999}]},{"osd":11,"last update":"Thu Oct 26 06:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67200000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":454090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82999999999999996,"15min":0.83399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.629}]},{"osd":5,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88,"15min":0.89600000000000002},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.621}]},{"osd":6,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96699999999999997,"15min":0.98699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.94899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.88800000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0629999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.59399999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63900000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.048,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.2370000000000001,"15min":1.3029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4730000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.60099999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070502,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":462696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.626},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82499999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88700000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.496,"15min":0.497},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3759999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.502},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.39300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68400000000000005,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.91900000000000004,"15min":0.94399999999999995},"min":{"1min":0.61499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.075,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.872},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.80400000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83199999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.72299999999999998,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.67100000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.85699999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78600000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1037261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.502},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.505,"15min":0.47799999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.752,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64200000000000002,"15min":0.624},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.629},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.71399999999999997},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.995,"15min":0.995},"last":0.56999999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.68400000000000005}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462959,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":453485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47599999999999998,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.59499999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.67700000000000005},"min":{"1min":0.53500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":1.036,"15min":1.036},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.5},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1160000000000001,"5min":1.127,"15min":1.127},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.038,"15min":1.038},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.64600000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.48699999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.071,"5min":1.228,"15min":1.228},"last":0.64800000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.70899999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.879,"15min":0.88300000000000001},"min":{"1min":0.65700000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.621}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":0.96899999999999997,"15min":0.92400000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.9790000000000001,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.046,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.80200000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542214,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":503748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.006,"15min":1.006},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.39500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Oct 26 06:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.33600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.746}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.371},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61799999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76000000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96099999999999997,"5min":1.048,"15min":1.048},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66900000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.69899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":463458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.46000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.70299999999999996,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72199999999999998,"15min":0.64000000000000001},"min":{"1min":0.57399999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66300000000000003,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Oct 26 06:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.441,"15min":0.441},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.73499999999999999},"min":{"1min":0.61099999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93000000000000005,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.63600000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.75600000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.81599999999999995}]},{"osd":11,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.84199999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378691,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":513782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91400000000000003,"5min":2.371,"15min":2.371},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2370000000000001,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Oct 26 06:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.751},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63600000000000001,"15min":0.69799999999999995},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81999999999999995,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91300000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58199999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.879}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.63300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.65100000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":462510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47199999999999998,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.88100000000000001,"5min":1.069,"15min":1.069},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.41899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68799999999999994,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99099999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.497}]},{"osd":5,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.69699999999999995},"min":{"1min":0.61499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93899999999999995,"5min":1.196,"15min":1.196},"last":0.623}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.72599999999999998,"15min":0.66400000000000003},"min":{"1min":0.54600000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.747},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.361,"15min":1.361},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.751,"15min":0.70499999999999996},"min":{"1min":0.64100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.226,"5min":1.419,"15min":1.419},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.292,"15min":1.292},"last":0.65800000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0580000000000001,"15min":1.0880000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.97899999999999998,"15min":0.997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.69099999999999995}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.75900000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888121,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":445622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.377},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76100000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.628}]},{"osd":5,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.379,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.87}]},{"osd":8,"last update":"Thu Oct 26 06:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.88500000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93999999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94499999999999995,"5min":1.246,"15min":1.246},"last":0.86199999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93200000000000005,"5min":1.044,"15min":1.044},"last":0.753}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724596,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1544192,"data_stored":1044908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":5.819,"15min":5.819},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52100000000000002,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.61299999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.61099999999999999,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.751,"5min":5.835,"15min":5.835},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.72899999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:29 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79200000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.53300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66100000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.754,"15min":0.748},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:42:34.910 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.2 is not active+clean 2023-10-26T06:42:34.911 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 85, 'state': 'peering', 'last_fresh': '2023-10-26T06:41:30.936012+0000', 'last_change': '2023-10-26T06:42:30.687245+0000', 'last_active': '2023-10-26T06:41:29.928608+0000', 'last_peered': '2023-10-26T06:41:29.928608+0000', 'last_clean': '2023-10-26T06:41:29.928608+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-26T06:41:30.936012+0000', 'last_undegraded': '2023-10-26T06:41:30.936012+0000', 'last_fullsized': '2023-10-26T06:41:30.936012+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-26T06:41:29.928608+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-26T06:41:29.928608+0000', 'last_clean_scrub_stamp': '2023-10-26T06:41:29.928608+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 5, 1], 'acting': [9, 5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2023-10-26T06:42:34.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph status --format=json 2023-10-26T06:42:35.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:34 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:42:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:34 smithi125 ceph-mon[130643]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:34 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:42:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:34 smithi153 ceph-mon[131657]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:35.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:34 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:42:35.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:34 smithi050 ceph-mon[94997]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:35.700 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:36.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:35 smithi125 ceph-mon[130643]: pgmap v287: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:36.227 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:35 smithi050 ceph-mon[94997]: pgmap v287: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:35 smithi153 ceph-mon[131657]: pgmap v287: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.485+0000 7f568f693700 1 -- 172.21.15.50:0/368473528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 msgr2=0x7f568810d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.485+0000 7f568f693700 1 --2- 172.21.15.50:0/368473528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 0x7f568810d620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f568000b0a0 tx=0x7f568000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.486+0000 7f568f693700 1 -- 172.21.15.50:0/368473528 shutdown_connections 2023-10-26T06:42:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.487+0000 7f568f693700 1 --2- 172.21.15.50:0/368473528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 0x7f568810d620 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.487+0000 7f568f693700 1 --2- 172.21.15.50:0/368473528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688106750 0x7f5688106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.487+0000 7f568f693700 1 --2- 172.21.15.50:0/368473528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688100750 0x7f5688100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.487+0000 7f568f693700 1 -- 172.21.15.50:0/368473528 >> 172.21.15.50:0/368473528 conn(0x7f56880fc200 msgr2=0x7f56880fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.487+0000 7f568f693700 1 -- 172.21.15.50:0/368473528 shutdown_connections 2023-10-26T06:42:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.487+0000 7f568f693700 1 -- 172.21.15.50:0/368473528 wait complete. 2023-10-26T06:42:37.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.488+0000 7f568f693700 1 Processor -- start 2023-10-26T06:42:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.488+0000 7f568f693700 1 -- start start 2023-10-26T06:42:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.488+0000 7f568f693700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 0x7f5688198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.488+0000 7f568f693700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 0x7f5688199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.488+0000 7f568f693700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688106750 0x7f568819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:37.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568f693700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568819dde0 con 0x7f5688101110 2023-10-26T06:42:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568f693700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568819df50 con 0x7f5688100750 2023-10-26T06:42:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568f693700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568819e110 con 0x7f5688106750 2023-10-26T06:42:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568cc2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 0x7f5688199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 0x7f5688198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 0x7f5688198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47490/0 (socket says 172.21.15.50:47490) 2023-10-26T06:42:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 -- 172.21.15.50:0/191502458 learned_addr learned my addr 172.21.15.50:0/191502458 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568dc30700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688106750 0x7f568819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 -- 172.21.15.50:0/191502458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688106750 msgr2=0x7f568819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688106750 0x7f568819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 -- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 msgr2=0x7f5688199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 0x7f5688199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.489+0000 7f568d42f700 1 -- 172.21.15.50:0/191502458 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009d00 con 0x7f5688100750 2023-10-26T06:42:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.490+0000 7f568d42f700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 0x7f5688198ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9a0 tx=0x7f568400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.490+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684009790 con 0x7f5688100750 2023-10-26T06:42:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.490+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568819e3f0 con 0x7f5688100750 2023-10-26T06:42:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.490+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5684010430 con 0x7f5688100750 2023-10-26T06:42:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.490+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684018680 con 0x7f5688100750 2023-10-26T06:42:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.490+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56881a5c50 con 0x7f5688100750 2023-10-26T06:42:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.491+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5688101e90 con 0x7f5688100750 2023-10-26T06:42:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.493+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f56840105a0 con 0x7f5688100750 2023-10-26T06:42:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.495+0000 7f567e7fc700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f56740a15e0 0x7f56740a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:37.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.495+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5684014070 con 0x7f5688100750 2023-10-26T06:42:37.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.495+0000 7f568cc2e700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f56740a15e0 0x7f56740a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:37.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.496+0000 7f568cc2e700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f56740a15e0 0x7f56740a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f568819a440 tx=0x7f5678009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:37.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.498+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f56840964b0 con 0x7f5688100750 2023-10-26T06:42:37.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.811+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5688110730 con 0x7f5688100750 2023-10-26T06:42:37.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.812+0000 7f567e7fc700 1 -- 172.21.15.50:0/191502458 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2551 (secure 0 0 0) 0x7f5684099ad0 con 0x7f5688100750 2023-10-26T06:42:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:37.814 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg inactive, 1 pg peering","count":2},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":442,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":86,"num_osds":12,"num_up_osds":12,"osd_up_since":1698302442,"num_in_osds":12,"osd_in_since":1698302425,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":64,"data_bytes":653774,"bytes_used":345456640,"bytes_avail":1151594971136,"bytes_total":1151940427776,"inactive_pgs_ratio":0.010309278033673763,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":2,"recovering_keys_per_sec":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"read_bytes_sec":3071,"read_op_per_sec":6,"write_op_per_sec":0},"fsmap":{"epoch":23,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24665},{"filesystem_id":1,"rank":1,"name":"f","status":"up:standby-replay","gid":24682},{"filesystem_id":1,"rank":0,"name":"h","status":"up:standby-replay","gid":24692},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24694},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24709},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24740}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"services":{"dashboard":"https://172.21.15.50:8443/"}},"servicemap":{"epoch":24,"modified":"2023-10-26T06:42:35.638237+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-26T06:42:37.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.814+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f56740a15e0 msgr2=0x7f56740a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:37.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.814+0000 7f568f693700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f56740a15e0 0x7f56740a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f568819a440 tx=0x7f5678009260 comp rx=0 tx=0).stop 2023-10-26T06:42:37.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.814+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 msgr2=0x7f5688198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:37.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.814+0000 7f568f693700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 0x7f5688198ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9a0 tx=0x7f568400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 shutdown_connections 2023-10-26T06:42:37.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f56740a15e0 0x7f56740a3aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688106750 0x7f568819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5688100750 0x7f5688198ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 --2- 172.21.15.50:0/191502458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5688101110 0x7f5688199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:37.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 >> 172.21.15.50:0/191502458 conn(0x7f56880fc200 msgr2=0x7f568810d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:37.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 shutdown_connections 2023-10-26T06:42:37.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:37.815+0000 7f568f693700 1 -- 172.21.15.50:0/191502458 wait complete. 2023-10-26T06:42:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:37 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:37 smithi125 ceph-mon[130643]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:38.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:37 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/191502458' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-10-26T06:42:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:37 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:37 smithi153 ceph-mon[131657]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:37 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/191502458' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-10-26T06:42:38.241 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.241 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.242 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.242 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:37 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:38.242 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:37 smithi050 ceph-mon[94997]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:38.242 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:37 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/191502458' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2023-10-26T06:42:38.304 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2023-10-26T06:42:38.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph pg dump --format=json 2023-10-26T06:42:39.069 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:38 smithi125 ceph-mon[130643]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2023-10-26T06:42:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:38 smithi125 ceph-mon[130643]: Cluster is now healthy 2023-10-26T06:42:39.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:39.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:38 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:38 smithi153 ceph-mon[131657]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2023-10-26T06:42:39.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:38 smithi153 ceph-mon[131657]: Cluster is now healthy 2023-10-26T06:42:39.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:39.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:38 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:38 smithi050 ceph-mon[94997]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2023-10-26T06:42:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:38 smithi050 ceph-mon[94997]: Cluster is now healthy 2023-10-26T06:42:39.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:39.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:38 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:40.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:39 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:42:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:39 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:42:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:39 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:39 smithi125 ceph-mon[130643]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:40.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:39 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:42:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:39 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:42:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:39 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:39 smithi153 ceph-mon[131657]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:39 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:42:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:39 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:42:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:39 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:42:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:39 smithi050 ceph-mon[94997]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:40.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 -- 172.21.15.50:0/547564786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981008a0 msgr2=0x7f0798100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:40.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 --2- 172.21.15.50:0/547564786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981008a0 0x7f0798100d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0788009990 tx=0x7f0788009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 -- 172.21.15.50:0/547564786 shutdown_connections 2023-10-26T06:42:40.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 --2- 172.21.15.50:0/547564786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0798101260 0x7f079810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 --2- 172.21.15.50:0/547564786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981057c0 0x7f0798105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 --2- 172.21.15.50:0/547564786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981008a0 0x7f0798100d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 -- 172.21.15.50:0/547564786 >> 172.21.15.50:0/547564786 conn(0x7f07980779e0 msgr2=0x7f0798077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 -- 172.21.15.50:0/547564786 shutdown_connections 2023-10-26T06:42:40.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.626+0000 7f07a00d6700 1 -- 172.21.15.50:0/547564786 wait complete. 2023-10-26T06:42:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 Processor -- start 2023-10-26T06:42:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 -- start start 2023-10-26T06:42:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 0x7f0798072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:40.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0798101260 0x7f0798073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981057c0 0x7f0798073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07981a4f90 con 0x7f07981057c0 2023-10-26T06:42:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07981a5100 con 0x7f07981008a0 2023-10-26T06:42:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.628+0000 7f07a00d6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07981a52c0 con 0x7f0798101260 2023-10-26T06:42:40.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079de72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 0x7f0798072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079de72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 0x7f0798072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47502/0 (socket says 172.21.15.50:47502) 2023-10-26T06:42:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079de72700 1 -- 172.21.15.50:0/1653901309 learned_addr learned my addr 172.21.15.50:0/1653901309 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079e673700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981057c0 0x7f0798073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079d671700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0798101260 0x7f0798073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:40.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079e673700 1 -- 172.21.15.50:0/1653901309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0798101260 msgr2=0x7f0798073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079e673700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0798101260 0x7f0798073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079e673700 1 -- 172.21.15.50:0/1653901309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 msgr2=0x7f0798072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079e673700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 0x7f0798072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079e673700 1 -- 172.21.15.50:0/1653901309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880095f0 con 0x7f07981057c0 2023-10-26T06:42:40.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.629+0000 7f079de72700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 0x7f0798072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.630+0000 7f079e673700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981057c0 0x7f0798073570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0790007f10 tx=0x7f079000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.630+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790004db0 con 0x7f07981057c0 2023-10-26T06:42:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.630+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f079000f040 con 0x7f07981057c0 2023-10-26T06:42:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.630+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07981a55a0 con 0x7f07981057c0 2023-10-26T06:42:40.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.630+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790005830 con 0x7f07981057c0 2023-10-26T06:42:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.630+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07981a5aa0 con 0x7f07981057c0 2023-10-26T06:42:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.631+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0798108da0 con 0x7f07981057c0 2023-10-26T06:42:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.633+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f079000db20 con 0x7f07981057c0 2023-10-26T06:42:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.635+0000 7f078effd700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07840a15e0 0x7f07840a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.635+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f07900cc780 con 0x7f07981057c0 2023-10-26T06:42:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.636+0000 7f079de72700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07840a15e0 0x7f07840a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.636+0000 7f079de72700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07840a15e0 0x7f07840a3aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0794005950 tx=0x7f0794009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.640+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f079004f100 con 0x7f07981057c0 2023-10-26T06:42:40.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.848+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0798073f80 con 0x7f07840a15e0 2023-10-26T06:42:40.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.860+0000 7f078effd700 1 -- 172.21.15.50:0/1653901309 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344067 (secure 0 0 0) 0x7f0798073f80 con 0x7f07840a15e0 2023-10-26T06:42:40.866 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:40.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07840a15e0 msgr2=0x7f07840a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:40.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07840a15e0 0x7f07840a3aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0794005950 tx=0x7f0794009260 comp rx=0 tx=0).stop 2023-10-26T06:42:40.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981057c0 msgr2=0x7f0798073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:40.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981057c0 0x7f0798073570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0790007f10 tx=0x7f079000d3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 shutdown_connections 2023-10-26T06:42:40.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07840a15e0 0x7f07840a3aa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07981057c0 0x7f0798073570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07981008a0 0x7f0798072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 --2- 172.21.15.50:0/1653901309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0798101260 0x7f0798073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:40.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.864+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 >> 172.21.15.50:0/1653901309 conn(0x7f07980779e0 msgr2=0x7f07980fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:40.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.865+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 shutdown_connections 2023-10-26T06:42:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:40.865+0000 7f07a00d6700 1 -- 172.21.15.50:0/1653901309 wait complete. 2023-10-26T06:42:40.871 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:42:41.351 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2023-10-26T06:42:39.639054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":532,"num_read_kb":382,"num_write":332,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":289,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337428,"kb_used_data":13156,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604396,"statfs":{"total":1151940427776,"available":1151594901504,"internally_reserved":0,"allocated":13471744,"data_stored":7504420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.942450"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703203+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:42:29.703203+0000","last_peered":"2023-10-26T06:42:29.703203+0000","last_clean":"2023-10-26T06:42:29.703203+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:42:29.703203+0000","last_undegraded":"2023-10-26T06:42:29.703203+0000","last_fullsized":"2023-10-26T06:42:29.703203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408093+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:42:30.408093+0000","last_peered":"2023-10-26T06:42:30.408093+0000","last_clean":"2023-10-26T06:42:30.408093+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:42:30.408093+0000","last_undegraded":"2023-10-26T06:42:30.408093+0000","last_fullsized":"2023-10-26T06:42:30.408093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408054+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:42:30.408054+0000","last_peered":"2023-10-26T06:42:30.408054+0000","last_clean":"2023-10-26T06:42:30.408054+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:42:30.408054+0000","last_undegraded":"2023-10-26T06:42:30.408054+0000","last_fullsized":"2023-10-26T06:42:30.408054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704320+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:42:29.704320+0000","last_peered":"2023-10-26T06:42:29.704320+0000","last_clean":"2023-10-26T06:42:29.704320+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:42:29.704320+0000","last_undegraded":"2023-10-26T06:42:29.704320+0000","last_fullsized":"2023-10-26T06:42:29.704320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703894+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:42:29.703894+0000","last_peered":"2023-10-26T06:42:29.703894+0000","last_clean":"2023-10-26T06:42:29.703894+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:42:29.703894+0000","last_undegraded":"2023-10-26T06:42:29.703894+0000","last_fullsized":"2023-10-26T06:42:29.703894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698534+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:42:29.698534+0000","last_peered":"2023-10-26T06:42:29.698534+0000","last_clean":"2023-10-26T06:42:29.698534+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:42:29.698534+0000","last_undegraded":"2023-10-26T06:42:29.698534+0000","last_fullsized":"2023-10-26T06:42:29.698534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946849+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:42:29.946849+0000","last_peered":"2023-10-26T06:42:29.946849+0000","last_clean":"2023-10-26T06:42:29.946849+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:42:29.946849+0000","last_undegraded":"2023-10-26T06:42:29.946849+0000","last_fullsized":"2023-10-26T06:42:29.946849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698334+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:42:29.698334+0000","last_peered":"2023-10-26T06:42:29.698334+0000","last_clean":"2023-10-26T06:42:29.698334+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:42:29.698334+0000","last_undegraded":"2023-10-26T06:42:29.698334+0000","last_fullsized":"2023-10-26T06:42:29.698334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704641+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:42:29.704641+0000","last_peered":"2023-10-26T06:42:29.704641+0000","last_clean":"2023-10-26T06:42:29.704641+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:42:29.704641+0000","last_undegraded":"2023-10-26T06:42:29.704641+0000","last_fullsized":"2023-10-26T06:42:29.704641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698804+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:42:29.698804+0000","last_peered":"2023-10-26T06:42:29.698804+0000","last_clean":"2023-10-26T06:42:29.698804+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:42:29.698804+0000","last_undegraded":"2023-10-26T06:42:29.698804+0000","last_fullsized":"2023-10-26T06:42:29.698804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947149+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:42:29.947149+0000","last_peered":"2023-10-26T06:42:29.947149+0000","last_clean":"2023-10-26T06:42:29.947149+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:42:29.947149+0000","last_undegraded":"2023-10-26T06:42:29.947149+0000","last_fullsized":"2023-10-26T06:42:29.947149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704210+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:42:29.704210+0000","last_peered":"2023-10-26T06:42:29.704210+0000","last_clean":"2023-10-26T06:42:29.704210+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:42:29.704210+0000","last_undegraded":"2023-10-26T06:42:29.704210+0000","last_fullsized":"2023-10-26T06:42:29.704210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706123+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:42:29.706123+0000","last_peered":"2023-10-26T06:42:29.706123+0000","last_clean":"2023-10-26T06:42:29.706123+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:42:29.706123+0000","last_undegraded":"2023-10-26T06:42:29.706123+0000","last_fullsized":"2023-10-26T06:42:29.706123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407805+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:42:30.407805+0000","last_peered":"2023-10-26T06:42:30.407805+0000","last_clean":"2023-10-26T06:42:30.407805+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:42:30.407805+0000","last_undegraded":"2023-10-26T06:42:30.407805+0000","last_fullsized":"2023-10-26T06:42:30.407805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407974+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:42:30.407974+0000","last_peered":"2023-10-26T06:42:30.407974+0000","last_clean":"2023-10-26T06:42:30.407974+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:42:30.407974+0000","last_undegraded":"2023-10-26T06:42:30.407974+0000","last_fullsized":"2023-10-26T06:42:30.407974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703559+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:42:29.703559+0000","last_peered":"2023-10-26T06:42:29.703559+0000","last_clean":"2023-10-26T06:42:29.703559+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:42:29.703559+0000","last_undegraded":"2023-10-26T06:42:29.703559+0000","last_fullsized":"2023-10-26T06:42:29.703559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703097+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:42:29.703097+0000","last_peered":"2023-10-26T06:42:29.703097+0000","last_clean":"2023-10-26T06:42:29.703097+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:42:29.703097+0000","last_undegraded":"2023-10-26T06:42:29.703097+0000","last_fullsized":"2023-10-26T06:42:29.703097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700701+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:42:29.700701+0000","last_peered":"2023-10-26T06:42:29.700701+0000","last_clean":"2023-10-26T06:42:29.700701+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:42:29.700701+0000","last_undegraded":"2023-10-26T06:42:29.700701+0000","last_fullsized":"2023-10-26T06:42:29.700701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705375+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:42:29.705375+0000","last_peered":"2023-10-26T06:42:29.705375+0000","last_clean":"2023-10-26T06:42:29.705375+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:42:29.705375+0000","last_undegraded":"2023-10-26T06:42:29.705375+0000","last_fullsized":"2023-10-26T06:42:29.705375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.701211+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:42:29.701211+0000","last_peered":"2023-10-26T06:42:29.701211+0000","last_clean":"2023-10-26T06:42:29.701211+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:42:29.701211+0000","last_undegraded":"2023-10-26T06:42:29.701211+0000","last_fullsized":"2023-10-26T06:42:29.701211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698714+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:42:29.698714+0000","last_peered":"2023-10-26T06:42:29.698714+0000","last_clean":"2023-10-26T06:42:29.698714+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:42:29.698714+0000","last_undegraded":"2023-10-26T06:42:29.698714+0000","last_fullsized":"2023-10-26T06:42:29.698714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698805+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:42:29.698805+0000","last_peered":"2023-10-26T06:42:29.698805+0000","last_clean":"2023-10-26T06:42:29.698805+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:42:29.698805+0000","last_undegraded":"2023-10-26T06:42:29.698805+0000","last_fullsized":"2023-10-26T06:42:29.698805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408232+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:42:30.408232+0000","last_peered":"2023-10-26T06:42:30.408232+0000","last_clean":"2023-10-26T06:42:30.408232+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:42:30.408232+0000","last_undegraded":"2023-10-26T06:42:30.408232+0000","last_fullsized":"2023-10-26T06:42:30.408232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704769+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:42:29.704769+0000","last_peered":"2023-10-26T06:42:29.704769+0000","last_clean":"2023-10-26T06:42:29.704769+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:42:29.704769+0000","last_undegraded":"2023-10-26T06:42:29.704769+0000","last_fullsized":"2023-10-26T06:42:29.704769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704563+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:42:29.704563+0000","last_peered":"2023-10-26T06:42:29.704563+0000","last_clean":"2023-10-26T06:42:29.704563+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:42:29.704563+0000","last_undegraded":"2023-10-26T06:42:29.704563+0000","last_fullsized":"2023-10-26T06:42:29.704563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704515+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:42:29.704515+0000","last_peered":"2023-10-26T06:42:29.704515+0000","last_clean":"2023-10-26T06:42:29.704515+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:42:29.704515+0000","last_undegraded":"2023-10-26T06:42:29.704515+0000","last_fullsized":"2023-10-26T06:42:29.704515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699688+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:42:29.699688+0000","last_peered":"2023-10-26T06:42:29.699688+0000","last_clean":"2023-10-26T06:42:29.699688+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:42:29.699688+0000","last_undegraded":"2023-10-26T06:42:29.699688+0000","last_fullsized":"2023-10-26T06:42:29.699688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":82,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:34.091341+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:42:34.091341+0000","last_peered":"2023-10-26T06:42:34.091341+0000","last_clean":"2023-10-26T06:42:34.091341+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:42:34.091341+0000","last_undegraded":"2023-10-26T06:42:34.091341+0000","last_fullsized":"2023-10-26T06:42:34.091341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704237+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:42:29.704237+0000","last_peered":"2023-10-26T06:42:29.704237+0000","last_clean":"2023-10-26T06:42:29.704237+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:42:29.704237+0000","last_undegraded":"2023-10-26T06:42:29.704237+0000","last_fullsized":"2023-10-26T06:42:29.704237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698424+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:42:29.698424+0000","last_peered":"2023-10-26T06:42:29.698424+0000","last_clean":"2023-10-26T06:42:29.698424+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:42:29.698424+0000","last_undegraded":"2023-10-26T06:42:29.698424+0000","last_fullsized":"2023-10-26T06:42:29.698424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699561+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:42:29.699561+0000","last_peered":"2023-10-26T06:42:29.699561+0000","last_clean":"2023-10-26T06:42:29.699561+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:42:29.699561+0000","last_undegraded":"2023-10-26T06:42:29.699561+0000","last_fullsized":"2023-10-26T06:42:29.699561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706715+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:42:29.706715+0000","last_peered":"2023-10-26T06:42:29.706715+0000","last_clean":"2023-10-26T06:42:29.706715+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:42:29.706715+0000","last_undegraded":"2023-10-26T06:42:29.706715+0000","last_fullsized":"2023-10-26T06:42:29.706715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698257+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:42:29.698257+0000","last_peered":"2023-10-26T06:42:29.698257+0000","last_clean":"2023-10-26T06:42:29.698257+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:42:29.698257+0000","last_undegraded":"2023-10-26T06:42:29.698257+0000","last_fullsized":"2023-10-26T06:42:29.698257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699672+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:42:29.699672+0000","last_peered":"2023-10-26T06:42:29.699672+0000","last_clean":"2023-10-26T06:42:29.699672+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:42:29.699672+0000","last_undegraded":"2023-10-26T06:42:29.699672+0000","last_fullsized":"2023-10-26T06:42:29.699672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700612+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:42:29.700612+0000","last_peered":"2023-10-26T06:42:29.700612+0000","last_clean":"2023-10-26T06:42:29.700612+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:42:29.700612+0000","last_undegraded":"2023-10-26T06:42:29.700612+0000","last_fullsized":"2023-10-26T06:42:29.700612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":80,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:36.093292+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:42:36.093292+0000","last_peered":"2023-10-26T06:42:36.093292+0000","last_clean":"2023-10-26T06:42:36.093292+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:42:36.093292+0000","last_undegraded":"2023-10-26T06:42:36.093292+0000","last_fullsized":"2023-10-26T06:42:36.093292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704216+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:42:29.704216+0000","last_peered":"2023-10-26T06:42:29.704216+0000","last_clean":"2023-10-26T06:42:29.704216+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:42:29.704216+0000","last_undegraded":"2023-10-26T06:42:29.704216+0000","last_fullsized":"2023-10-26T06:42:29.704216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947188+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:42:29.947188+0000","last_peered":"2023-10-26T06:42:29.947188+0000","last_clean":"2023-10-26T06:42:29.947188+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:42:29.947188+0000","last_undegraded":"2023-10-26T06:42:29.947188+0000","last_fullsized":"2023-10-26T06:42:29.947188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408184+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:42:30.408184+0000","last_peered":"2023-10-26T06:42:30.408184+0000","last_clean":"2023-10-26T06:42:30.408184+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:42:30.408184+0000","last_undegraded":"2023-10-26T06:42:30.408184+0000","last_fullsized":"2023-10-26T06:42:30.408184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699839+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:42:29.699839+0000","last_peered":"2023-10-26T06:42:29.699839+0000","last_clean":"2023-10-26T06:42:29.699839+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:42:29.699839+0000","last_undegraded":"2023-10-26T06:42:29.699839+0000","last_fullsized":"2023-10-26T06:42:29.699839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704563+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:42:29.704563+0000","last_peered":"2023-10-26T06:42:29.704563+0000","last_clean":"2023-10-26T06:42:29.704563+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:42:29.704563+0000","last_undegraded":"2023-10-26T06:42:29.704563+0000","last_fullsized":"2023-10-26T06:42:29.704563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":174,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:37.094329+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:42:37.094329+0000","last_peered":"2023-10-26T06:42:37.094329+0000","last_clean":"2023-10-26T06:42:37.094329+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:42:37.094329+0000","last_undegraded":"2023-10-26T06:42:37.094329+0000","last_fullsized":"2023-10-26T06:42:37.094329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":123,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704506+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:42:29.704506+0000","last_peered":"2023-10-26T06:42:29.704506+0000","last_clean":"2023-10-26T06:42:29.704506+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:42:29.704506+0000","last_undegraded":"2023-10-26T06:42:29.704506+0000","last_fullsized":"2023-10-26T06:42:29.704506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705196+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:42:29.705196+0000","last_peered":"2023-10-26T06:42:29.705196+0000","last_clean":"2023-10-26T06:42:29.705196+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:42:29.705196+0000","last_undegraded":"2023-10-26T06:42:29.705196+0000","last_fullsized":"2023-10-26T06:42:29.705196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705997+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:42:29.705997+0000","last_peered":"2023-10-26T06:42:29.705997+0000","last_clean":"2023-10-26T06:42:29.705997+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:42:29.705997+0000","last_undegraded":"2023-10-26T06:42:29.705997+0000","last_fullsized":"2023-10-26T06:42:29.705997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699304+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:42:29.699304+0000","last_peered":"2023-10-26T06:42:29.699304+0000","last_clean":"2023-10-26T06:42:29.699304+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:42:29.699304+0000","last_undegraded":"2023-10-26T06:42:29.699304+0000","last_fullsized":"2023-10-26T06:42:29.699304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947098+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:42:29.947098+0000","last_peered":"2023-10-26T06:42:29.947098+0000","last_clean":"2023-10-26T06:42:29.947098+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:42:29.947098+0000","last_undegraded":"2023-10-26T06:42:29.947098+0000","last_fullsized":"2023-10-26T06:42:29.947098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":86,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:38.100702+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:42:38.100702+0000","last_peered":"2023-10-26T06:42:38.100702+0000","last_clean":"2023-10-26T06:42:38.100702+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:42:38.100702+0000","last_undegraded":"2023-10-26T06:42:38.100702+0000","last_fullsized":"2023-10-26T06:42:38.100702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946774+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:42:29.946774+0000","last_peered":"2023-10-26T06:42:29.946774+0000","last_clean":"2023-10-26T06:42:29.946774+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:42:29.946774+0000","last_undegraded":"2023-10-26T06:42:29.946774+0000","last_fullsized":"2023-10-26T06:42:29.946774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703869+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:42:29.703869+0000","last_peered":"2023-10-26T06:42:29.703869+0000","last_clean":"2023-10-26T06:42:29.703869+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:42:29.703869+0000","last_undegraded":"2023-10-26T06:42:29.703869+0000","last_fullsized":"2023-10-26T06:42:29.703869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699497+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:42:29.699497+0000","last_peered":"2023-10-26T06:42:29.699497+0000","last_clean":"2023-10-26T06:42:29.699497+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:42:29.699497+0000","last_undegraded":"2023-10-26T06:42:29.699497+0000","last_fullsized":"2023-10-26T06:42:29.699497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.714855+0000","last_change":"2023-10-26T06:42:30.714354+0000","last_active":"2023-10-26T06:42:30.714855+0000","last_peered":"2023-10-26T06:42:30.714855+0000","last_clean":"2023-10-26T06:42:30.714855+0000","last_became_active":"2023-10-26T06:42:30.709396+0000","last_became_peered":"2023-10-26T06:42:30.709396+0000","last_unstale":"2023-10-26T06:42:30.714855+0000","last_undegraded":"2023-10-26T06:42:30.714855+0000","last_fullsized":"2023-10-26T06:42:30.714855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:04:20.594879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702570+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:42:29.702570+0000","last_peered":"2023-10-26T06:42:29.702570+0000","last_clean":"2023-10-26T06:42:29.702570+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:42:29.702570+0000","last_undegraded":"2023-10-26T06:42:29.702570+0000","last_fullsized":"2023-10-26T06:42:29.702570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700656+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:42:29.700656+0000","last_peered":"2023-10-26T06:42:29.700656+0000","last_clean":"2023-10-26T06:42:29.700656+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:42:29.700656+0000","last_undegraded":"2023-10-26T06:42:29.700656+0000","last_fullsized":"2023-10-26T06:42:29.700656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698681+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:42:29.698681+0000","last_peered":"2023-10-26T06:42:29.698681+0000","last_clean":"2023-10-26T06:42:29.698681+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:42:29.698681+0000","last_undegraded":"2023-10-26T06:42:29.698681+0000","last_fullsized":"2023-10-26T06:42:29.698681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946991+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:42:29.946991+0000","last_peered":"2023-10-26T06:42:29.946991+0000","last_clean":"2023-10-26T06:42:29.946991+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:42:29.946991+0000","last_undegraded":"2023-10-26T06:42:29.946991+0000","last_fullsized":"2023-10-26T06:42:29.946991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698676+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:42:29.698676+0000","last_peered":"2023-10-26T06:42:29.698676+0000","last_clean":"2023-10-26T06:42:29.698676+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:42:29.698676+0000","last_undegraded":"2023-10-26T06:42:29.698676+0000","last_fullsized":"2023-10-26T06:42:29.698676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699599+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:42:29.699599+0000","last_peered":"2023-10-26T06:42:29.699599+0000","last_clean":"2023-10-26T06:42:29.699599+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:42:29.699599+0000","last_undegraded":"2023-10-26T06:42:29.699599+0000","last_fullsized":"2023-10-26T06:42:29.699599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":79,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:34.095128+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:42:34.095128+0000","last_peered":"2023-10-26T06:42:34.095128+0000","last_clean":"2023-10-26T06:42:34.095128+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:42:34.095128+0000","last_undegraded":"2023-10-26T06:42:34.095128+0000","last_fullsized":"2023-10-26T06:42:34.095128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.709009+0000","last_change":"2023-10-26T06:42:30.709009+0000","last_active":"2023-10-26T06:42:30.709009+0000","last_peered":"2023-10-26T06:42:30.709009+0000","last_clean":"2023-10-26T06:42:30.709009+0000","last_became_active":"2023-10-26T06:42:30.708638+0000","last_became_peered":"2023-10-26T06:42:30.708638+0000","last_unstale":"2023-10-26T06:42:30.709009+0000","last_undegraded":"2023-10-26T06:42:30.709009+0000","last_fullsized":"2023-10-26T06:42:30.709009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:53:48.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704180+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:42:29.704180+0000","last_peered":"2023-10-26T06:42:29.704180+0000","last_clean":"2023-10-26T06:42:29.704180+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:42:29.704180+0000","last_undegraded":"2023-10-26T06:42:29.704180+0000","last_fullsized":"2023-10-26T06:42:29.704180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946806+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:42:29.946806+0000","last_peered":"2023-10-26T06:42:29.946806+0000","last_clean":"2023-10-26T06:42:29.946806+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:42:29.946806+0000","last_undegraded":"2023-10-26T06:42:29.946806+0000","last_fullsized":"2023-10-26T06:42:29.946806+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.706066+0000","last_change":"2023-10-26T06:42:30.706066+0000","last_active":"2023-10-26T06:42:30.706066+0000","last_peered":"2023-10-26T06:42:30.706066+0000","last_clean":"2023-10-26T06:42:30.706066+0000","last_became_active":"2023-10-26T06:42:30.705682+0000","last_became_peered":"2023-10-26T06:42:30.705682+0000","last_unstale":"2023-10-26T06:42:30.706066+0000","last_undegraded":"2023-10-26T06:42:30.706066+0000","last_fullsized":"2023-10-26T06:42:30.706066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:40:13.366566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946918+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:42:29.946918+0000","last_peered":"2023-10-26T06:42:29.946918+0000","last_clean":"2023-10-26T06:42:29.946918+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:42:29.946918+0000","last_undegraded":"2023-10-26T06:42:29.946918+0000","last_fullsized":"2023-10-26T06:42:29.946918+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704685+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:42:29.704685+0000","last_peered":"2023-10-26T06:42:29.704685+0000","last_clean":"2023-10-26T06:42:29.704685+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:42:29.704685+0000","last_undegraded":"2023-10-26T06:42:29.704685+0000","last_fullsized":"2023-10-26T06:42:29.704685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706153+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:42:29.706153+0000","last_peered":"2023-10-26T06:42:29.706153+0000","last_clean":"2023-10-26T06:42:29.706153+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:42:29.706153+0000","last_undegraded":"2023-10-26T06:42:29.706153+0000","last_fullsized":"2023-10-26T06:42:29.706153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700652+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:42:29.700652+0000","last_peered":"2023-10-26T06:42:29.700652+0000","last_clean":"2023-10-26T06:42:29.700652+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:42:29.700652+0000","last_undegraded":"2023-10-26T06:42:29.700652+0000","last_fullsized":"2023-10-26T06:42:29.700652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698722+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:42:29.698722+0000","last_peered":"2023-10-26T06:42:29.698722+0000","last_clean":"2023-10-26T06:42:29.698722+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:42:29.698722+0000","last_undegraded":"2023-10-26T06:42:29.698722+0000","last_fullsized":"2023-10-26T06:42:29.698722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704776+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:42:29.704776+0000","last_peered":"2023-10-26T06:42:29.704776+0000","last_clean":"2023-10-26T06:42:29.704776+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:42:29.704776+0000","last_undegraded":"2023-10-26T06:42:29.704776+0000","last_fullsized":"2023-10-26T06:42:29.704776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408161+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:42:30.408161+0000","last_peered":"2023-10-26T06:42:30.408161+0000","last_clean":"2023-10-26T06:42:30.408161+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:42:30.408161+0000","last_undegraded":"2023-10-26T06:42:30.408161+0000","last_fullsized":"2023-10-26T06:42:30.408161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703873+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:42:29.703873+0000","last_peered":"2023-10-26T06:42:29.703873+0000","last_clean":"2023-10-26T06:42:29.703873+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:42:29.703873+0000","last_undegraded":"2023-10-26T06:42:29.703873+0000","last_fullsized":"2023-10-26T06:42:29.703873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704158+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:42:29.704158+0000","last_peered":"2023-10-26T06:42:29.704158+0000","last_clean":"2023-10-26T06:42:29.704158+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:42:29.704158+0000","last_undegraded":"2023-10-26T06:42:29.704158+0000","last_fullsized":"2023-10-26T06:42:29.704158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698478+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:42:29.698478+0000","last_peered":"2023-10-26T06:42:29.698478+0000","last_clean":"2023-10-26T06:42:29.698478+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:42:29.698478+0000","last_undegraded":"2023-10-26T06:42:29.698478+0000","last_fullsized":"2023-10-26T06:42:29.698478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702211+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:42:29.702211+0000","last_peered":"2023-10-26T06:42:29.702211+0000","last_clean":"2023-10-26T06:42:29.702211+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:42:29.702211+0000","last_undegraded":"2023-10-26T06:42:29.702211+0000","last_fullsized":"2023-10-26T06:42:29.702211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.717232+0000","last_change":"2023-10-26T06:42:30.716756+0000","last_active":"2023-10-26T06:42:30.717232+0000","last_peered":"2023-10-26T06:42:30.717232+0000","last_clean":"2023-10-26T06:42:30.717232+0000","last_became_active":"2023-10-26T06:42:30.709797+0000","last_became_peered":"2023-10-26T06:42:30.709797+0000","last_unstale":"2023-10-26T06:42:30.717232+0000","last_undegraded":"2023-10-26T06:42:30.717232+0000","last_fullsized":"2023-10-26T06:42:30.717232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:54.345261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698489+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:42:29.698489+0000","last_peered":"2023-10-26T06:42:29.698489+0000","last_clean":"2023-10-26T06:42:29.698489+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:42:29.698489+0000","last_undegraded":"2023-10-26T06:42:29.698489+0000","last_fullsized":"2023-10-26T06:42:29.698489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704002+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:42:29.704002+0000","last_peered":"2023-10-26T06:42:29.704002+0000","last_clean":"2023-10-26T06:42:29.704002+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:42:29.704002+0000","last_undegraded":"2023-10-26T06:42:29.704002+0000","last_fullsized":"2023-10-26T06:42:29.704002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947055+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:42:29.947055+0000","last_peered":"2023-10-26T06:42:29.947055+0000","last_clean":"2023-10-26T06:42:29.947055+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:42:29.947055+0000","last_undegraded":"2023-10-26T06:42:29.947055+0000","last_fullsized":"2023-10-26T06:42:29.947055+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705370+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:42:29.705370+0000","last_peered":"2023-10-26T06:42:29.705370+0000","last_clean":"2023-10-26T06:42:29.705370+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:42:29.705370+0000","last_undegraded":"2023-10-26T06:42:29.705370+0000","last_fullsized":"2023-10-26T06:42:29.705370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947203+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:42:29.947203+0000","last_peered":"2023-10-26T06:42:29.947203+0000","last_clean":"2023-10-26T06:42:29.947203+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:42:29.947203+0000","last_undegraded":"2023-10-26T06:42:29.947203+0000","last_fullsized":"2023-10-26T06:42:29.947203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699564+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:42:29.699564+0000","last_peered":"2023-10-26T06:42:29.699564+0000","last_clean":"2023-10-26T06:42:29.699564+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:42:29.699564+0000","last_undegraded":"2023-10-26T06:42:29.699564+0000","last_fullsized":"2023-10-26T06:42:29.699564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947112+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:42:29.947112+0000","last_peered":"2023-10-26T06:42:29.947112+0000","last_clean":"2023-10-26T06:42:29.947112+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:42:29.947112+0000","last_undegraded":"2023-10-26T06:42:29.947112+0000","last_fullsized":"2023-10-26T06:42:29.947112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706318+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:42:29.706318+0000","last_peered":"2023-10-26T06:42:29.706318+0000","last_clean":"2023-10-26T06:42:29.706318+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:42:29.706318+0000","last_undegraded":"2023-10-26T06:42:29.706318+0000","last_fullsized":"2023-10-26T06:42:29.706318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947290+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:42:29.947290+0000","last_peered":"2023-10-26T06:42:29.947290+0000","last_clean":"2023-10-26T06:42:29.947290+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:42:29.947290+0000","last_undegraded":"2023-10-26T06:42:29.947290+0000","last_fullsized":"2023-10-26T06:42:29.947290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702186+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:42:29.702186+0000","last_peered":"2023-10-26T06:42:29.702186+0000","last_clean":"2023-10-26T06:42:29.702186+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:42:29.702186+0000","last_undegraded":"2023-10-26T06:42:29.702186+0000","last_fullsized":"2023-10-26T06:42:29.702186+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703861+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:42:29.703861+0000","last_peered":"2023-10-26T06:42:29.703861+0000","last_clean":"2023-10-26T06:42:29.703861+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:42:29.703861+0000","last_undegraded":"2023-10-26T06:42:29.703861+0000","last_fullsized":"2023-10-26T06:42:29.703861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705042+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:42:29.705042+0000","last_peered":"2023-10-26T06:42:29.705042+0000","last_clean":"2023-10-26T06:42:29.705042+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:42:29.705042+0000","last_undegraded":"2023-10-26T06:42:29.705042+0000","last_fullsized":"2023-10-26T06:42:29.705042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407881+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:42:30.407881+0000","last_peered":"2023-10-26T06:42:30.407881+0000","last_clean":"2023-10-26T06:42:30.407881+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:42:30.407881+0000","last_undegraded":"2023-10-26T06:42:30.407881+0000","last_fullsized":"2023-10-26T06:42:30.407881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706187+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:42:29.706187+0000","last_peered":"2023-10-26T06:42:29.706187+0000","last_clean":"2023-10-26T06:42:29.706187+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:42:29.706187+0000","last_undegraded":"2023-10-26T06:42:29.706187+0000","last_fullsized":"2023-10-26T06:42:29.706187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702600+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:42:29.702600+0000","last_peered":"2023-10-26T06:42:29.702600+0000","last_clean":"2023-10-26T06:42:29.702600+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:42:29.702600+0000","last_undegraded":"2023-10-26T06:42:29.702600+0000","last_fullsized":"2023-10-26T06:42:29.702600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705561+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:42:29.705561+0000","last_peered":"2023-10-26T06:42:29.705561+0000","last_clean":"2023-10-26T06:42:29.705561+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:42:29.705561+0000","last_undegraded":"2023-10-26T06:42:29.705561+0000","last_fullsized":"2023-10-26T06:42:29.705561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698675+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:42:29.698675+0000","last_peered":"2023-10-26T06:42:29.698675+0000","last_clean":"2023-10-26T06:42:29.698675+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:42:29.698675+0000","last_undegraded":"2023-10-26T06:42:29.698675+0000","last_fullsized":"2023-10-26T06:42:29.698675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699335+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:42:29.699335+0000","last_peered":"2023-10-26T06:42:29.699335+0000","last_clean":"2023-10-26T06:42:29.699335+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:42:29.699335+0000","last_undegraded":"2023-10-26T06:42:29.699335+0000","last_fullsized":"2023-10-26T06:42:29.699335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698360+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:42:29.698360+0000","last_peered":"2023-10-26T06:42:29.698360+0000","last_clean":"2023-10-26T06:42:29.698360+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:42:29.698360+0000","last_undegraded":"2023-10-26T06:42:29.698360+0000","last_fullsized":"2023-10-26T06:42:29.698360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704483+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:42:29.704483+0000","last_peered":"2023-10-26T06:42:29.704483+0000","last_clean":"2023-10-26T06:42:29.704483+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:42:29.704483+0000","last_undegraded":"2023-10-26T06:42:29.704483+0000","last_fullsized":"2023-10-26T06:42:29.704483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706047+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:42:29.706047+0000","last_peered":"2023-10-26T06:42:29.706047+0000","last_clean":"2023-10-26T06:42:29.706047+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:42:29.706047+0000","last_undegraded":"2023-10-26T06:42:29.706047+0000","last_fullsized":"2023-10-26T06:42:29.706047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.708612+0000","last_change":"2023-10-26T06:42:30.708612+0000","last_active":"2023-10-26T06:42:30.708612+0000","last_peered":"2023-10-26T06:42:30.708612+0000","last_clean":"2023-10-26T06:42:30.708612+0000","last_became_active":"2023-10-26T06:42:30.707927+0000","last_became_peered":"2023-10-26T06:42:30.707927+0000","last_unstale":"2023-10-26T06:42:30.708612+0000","last_undegraded":"2023-10-26T06:42:30.708612+0000","last_fullsized":"2023-10-26T06:42:30.708612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:59:10.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416411,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.317},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.505}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.878}]},{"osd":7,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64800000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68999999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63600000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1634304,"data_stored":1113268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.313},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46800000000000003,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.376},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.872},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80800000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.61199999999999999,"5min":0.503,"15min":0.503},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.503}]},{"osd":9,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59999999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58899999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":462798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82999999999999996,"15min":0.83399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.629}]},{"osd":5,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88,"15min":0.89600000000000002},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.621}]},{"osd":6,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96699999999999997,"15min":0.98699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.38800000000000001}]},{"osd":7,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.94899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.88800000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0629999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.59399999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63900000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.048,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.2370000000000001,"15min":1.3029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4730000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.60099999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070503,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":462696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81799999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.56899999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.42099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.38,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38}]},{"osd":3,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.73799999999999999,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0109999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63600000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84999999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.65400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.48599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.95099999999999996,"5min":1.766,"15min":1.766},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.68500000000000005},"min":{"1min":0.64700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0389999999999999,"5min":1.087,"15min":1.087},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":0.93400000000000005},"min":{"1min":0.60699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.101,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.63700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.405,"15min":1.405},"last":0.497}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.72399999999999998}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.72299999999999998,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.67100000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.753}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78400000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1552384,"data_stored":1054653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.505,"15min":0.47799999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.495},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.752,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64200000000000002,"15min":0.624},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.71399999999999997},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.995,"15min":0.995},"last":0.60999999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85999999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47599999999999998,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.503}]},{"osd":1,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.624}]},{"osd":2,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.59499999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.67700000000000005},"min":{"1min":0.53500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":1.036,"15min":1.036},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1160000000000001,"5min":1.127,"15min":1.127},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.038,"15min":1.038},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.64600000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.874},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.071,"5min":1.228,"15min":1.228},"last":0.95099999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.70899999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.879,"15min":0.88300000000000001},"min":{"1min":0.65700000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.83399999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":0.96899999999999997,"15min":0.92400000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.9790000000000001,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.046,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":1.006}]}]},{"osd":1,"up_from":14,"seq":60129542216,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":521140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.006,"15min":1.006},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.33600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.55800000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.625},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Oct 26 06:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.56799999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69099999999999995,"15min":0.66200000000000003},"min":{"1min":0.57099999999999995,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96099999999999997,"5min":1.048,"15min":1.048},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.79700000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.88300000000000001}]},{"osd":11,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.872},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.85999999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":463458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.432},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.46000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.70299999999999996,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72199999999999998,"15min":0.64000000000000001},"min":{"1min":0.57399999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66300000000000003,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.748},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.621}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.5269999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.79200000000000004,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.1040000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93000000000000005,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.194}]},{"osd":9,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1539999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.274},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.232},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.84399999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":522490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91400000000000003,"5min":2.371,"15min":2.371},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2370000000000001,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63600000000000001,"15min":0.69799999999999995},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81999999999999995,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.626},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.433}]},{"osd":6,"last update":"Thu Oct 26 06:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91300000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63400000000000001,"15min":0.64000000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68799999999999994}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.92100000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.745},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.63300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.72499999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76800000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":462510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47199999999999998,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.88100000000000001,"5min":1.069,"15min":1.069},"last":0.432},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.41899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68799999999999994,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99099999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.69699999999999995},"min":{"1min":0.61499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93899999999999995,"5min":1.196,"15min":1.196},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.72599999999999998,"15min":0.66400000000000003},"min":{"1min":0.54600000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.361,"15min":1.361},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.751,"15min":0.70499999999999996},"min":{"1min":0.64100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77200000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.226,"5min":1.419,"15min":1.419},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.292,"15min":1.292},"last":0.91900000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0580000000000001,"15min":1.0880000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.97899999999999998,"15min":0.997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.80800000000000005}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.879},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.86199999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888123,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":463014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.377},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76100000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81799999999999995,"5min":1.863,"15min":1.863},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49099999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.81499999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93999999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94499999999999995,"5min":1.246,"15min":1.246},"last":0.72199999999999998}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93200000000000005,"5min":1.044,"15min":1.044},"last":0.55200000000000005}]},{"osd":11,"last update":"Thu Oct 26 06:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.754},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84199999999999997}]}]},{"osd":5,"up_from":39,"seq":167503724597,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1053616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82099999999999995,"5min":5.819,"15min":5.819},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55200000000000005,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.32900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.57399999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.374}]},{"osd":3,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.56999999999999995},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":5.835,"15min":5.835},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.505}]},{"osd":4,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.59299999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.53300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.626},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61699999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.65200000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60499999999999998}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.754,"15min":0.748},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:42:42.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:42 smithi153 ceph-mon[131657]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:42.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:42 smithi153 ceph-mon[131657]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:42 smithi050 ceph-mon[94997]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:42 smithi050 ceph-mon[94997]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:42 smithi125 ceph-mon[130643]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:43.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:42 smithi125 ceph-mon[130643]: pgmap v290: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2023-10-26T06:42:44.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:43 smithi125 ceph-mon[130643]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 1 B/s, 0 objects/s recovering 2023-10-26T06:42:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:43 smithi153 ceph-mon[131657]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 1 B/s, 0 objects/s recovering 2023-10-26T06:42:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:43 smithi050 ceph-mon[94997]: pgmap v291: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 1 B/s, 0 objects/s recovering 2023-10-26T06:42:44.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph pg dump --format=json 2023-10-26T06:42:45.144 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 -- 172.21.15.50:0/3214427274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13201057c0 msgr2=0x7f1320105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 --2- 172.21.15.50:0/3214427274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13201057c0 0x7f1320105ba0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f131c009990 tx=0x7f131c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 -- 172.21.15.50:0/3214427274 shutdown_connections 2023-10-26T06:42:46.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 --2- 172.21.15.50:0/3214427274 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1320101260 0x7f132010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 --2- 172.21.15.50:0/3214427274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13201057c0 0x7f1320105ba0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 --2- 172.21.15.50:0/3214427274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201008a0 0x7f1320100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 -- 172.21.15.50:0/3214427274 >> 172.21.15.50:0/3214427274 conn(0x7f13200779e0 msgr2=0x7f1320077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 -- 172.21.15.50:0/3214427274 shutdown_connections 2023-10-26T06:42:46.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.822+0000 7f1327607700 1 -- 172.21.15.50:0/3214427274 wait complete. 2023-10-26T06:42:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.823+0000 7f1327607700 1 Processor -- start 2023-10-26T06:42:46.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.823+0000 7f1327607700 1 -- start start 2023-10-26T06:42:46.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1327607700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13201008a0 0x7f1320198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:46.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1327607700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 0x7f13201993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1327607700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201057c0 0x7f132019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1327607700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132019dd60 con 0x7f1320101260 2023-10-26T06:42:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1327607700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132019ded0 con 0x7f13201008a0 2023-10-26T06:42:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1327607700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132019e090 con 0x7f13201057c0 2023-10-26T06:42:46.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1324ba2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 0x7f13201993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1324ba2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 0x7f13201993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57340/0 (socket says 172.21.15.50:57340) 2023-10-26T06:42:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1324ba2700 1 -- 172.21.15.50:0/4243445919 learned_addr learned my addr 172.21.15.50:0/4243445919 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f13253a3700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13201008a0 0x7f1320198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1325ba4700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201057c0 0x7f132019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:46.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1324ba2700 1 -- 172.21.15.50:0/4243445919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201057c0 msgr2=0x7f132019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.824+0000 7f1324ba2700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201057c0 0x7f132019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1324ba2700 1 -- 172.21.15.50:0/4243445919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13201008a0 msgr2=0x7f1320198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1324ba2700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13201008a0 0x7f1320198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1324ba2700 1 -- 172.21.15.50:0/4243445919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318009c40 con 0x7f1320101260 2023-10-26T06:42:46.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1325ba4700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201057c0 0x7f132019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:42:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1324ba2700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 0x7f13201993a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f131000d950 tx=0x7f131000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310009940 con 0x7f1320101260 2023-10-26T06:42:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c0095f0 con 0x7f1320101260 2023-10-26T06:42:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1310010460 con 0x7f1320101260 2023-10-26T06:42:46.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000f620 con 0x7f1320101260 2023-10-26T06:42:46.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.825+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13201a5a00 con 0x7f1320101260 2023-10-26T06:42:46.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.826+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320101f30 con 0x7f1320101260 2023-10-26T06:42:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.828+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f13100108d0 con 0x7f1320101260 2023-10-26T06:42:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.830+0000 7f13167fc700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f130c0a15e0 0x7f130c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.830+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f13100cd140 con 0x7f1320101260 2023-10-26T06:42:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.830+0000 7f13253a3700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f130c0a15e0 0x7f130c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:46.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.830+0000 7f13253a3700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f130c0a15e0 0x7f130c0a3aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f131c006010 tx=0x7f131c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:46.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:46.834+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1310096570 con 0x7f1320101260 2023-10-26T06:42:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:46 smithi153 ceph-mon[131657]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:46 smithi050 ceph-mon[94997]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:47.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.042+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1320110710 con 0x7f130c0a15e0 2023-10-26T06:42:47.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.052+0000 7f13167fc700 1 -- 172.21.15.50:0/4243445919 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344046 (secure 0 0 0) 0x7f1320110710 con 0x7f130c0a15e0 2023-10-26T06:42:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f130c0a15e0 msgr2=0x7f130c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f130c0a15e0 0x7f130c0a3aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f131c006010 tx=0x7f131c005960 comp rx=0 tx=0).stop 2023-10-26T06:42:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 msgr2=0x7f13201993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:47.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 0x7f13201993a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f131000d950 tx=0x7f131000dc60 comp rx=0 tx=0).stop 2023-10-26T06:42:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 shutdown_connections 2023-10-26T06:42:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f130c0a15e0 0x7f130c0a3aa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13201057c0 0x7f132019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13201008a0 0x7f1320198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:47.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 --2- 172.21.15.50:0/4243445919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1320101260 0x7f13201993a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 >> 172.21.15.50:0/4243445919 conn(0x7f13200779e0 msgr2=0x7f132010ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 shutdown_connections 2023-10-26T06:42:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:47.058+0000 7f1327607700 1 -- 172.21.15.50:0/4243445919 wait complete. 2023-10-26T06:42:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:42:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:46 smithi125 ceph-mon[130643]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:47.529 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-10-26T06:42:45.640718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":562,"num_read_kb":397,"num_write":332,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337428,"kb_used_data":13156,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604396,"statfs":{"total":1151940427776,"available":1151594901504,"internally_reserved":0,"allocated":13471744,"data_stored":7504420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003300"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703203+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:42:29.703203+0000","last_peered":"2023-10-26T06:42:29.703203+0000","last_clean":"2023-10-26T06:42:29.703203+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:42:29.703203+0000","last_undegraded":"2023-10-26T06:42:29.703203+0000","last_fullsized":"2023-10-26T06:42:29.703203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408093+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:42:30.408093+0000","last_peered":"2023-10-26T06:42:30.408093+0000","last_clean":"2023-10-26T06:42:30.408093+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:42:30.408093+0000","last_undegraded":"2023-10-26T06:42:30.408093+0000","last_fullsized":"2023-10-26T06:42:30.408093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408054+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:42:30.408054+0000","last_peered":"2023-10-26T06:42:30.408054+0000","last_clean":"2023-10-26T06:42:30.408054+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:42:30.408054+0000","last_undegraded":"2023-10-26T06:42:30.408054+0000","last_fullsized":"2023-10-26T06:42:30.408054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704320+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:42:29.704320+0000","last_peered":"2023-10-26T06:42:29.704320+0000","last_clean":"2023-10-26T06:42:29.704320+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:42:29.704320+0000","last_undegraded":"2023-10-26T06:42:29.704320+0000","last_fullsized":"2023-10-26T06:42:29.704320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703894+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:42:29.703894+0000","last_peered":"2023-10-26T06:42:29.703894+0000","last_clean":"2023-10-26T06:42:29.703894+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:42:29.703894+0000","last_undegraded":"2023-10-26T06:42:29.703894+0000","last_fullsized":"2023-10-26T06:42:29.703894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698534+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:42:29.698534+0000","last_peered":"2023-10-26T06:42:29.698534+0000","last_clean":"2023-10-26T06:42:29.698534+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:42:29.698534+0000","last_undegraded":"2023-10-26T06:42:29.698534+0000","last_fullsized":"2023-10-26T06:42:29.698534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946849+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:42:29.946849+0000","last_peered":"2023-10-26T06:42:29.946849+0000","last_clean":"2023-10-26T06:42:29.946849+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:42:29.946849+0000","last_undegraded":"2023-10-26T06:42:29.946849+0000","last_fullsized":"2023-10-26T06:42:29.946849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698334+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:42:29.698334+0000","last_peered":"2023-10-26T06:42:29.698334+0000","last_clean":"2023-10-26T06:42:29.698334+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:42:29.698334+0000","last_undegraded":"2023-10-26T06:42:29.698334+0000","last_fullsized":"2023-10-26T06:42:29.698334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704641+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:42:29.704641+0000","last_peered":"2023-10-26T06:42:29.704641+0000","last_clean":"2023-10-26T06:42:29.704641+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:42:29.704641+0000","last_undegraded":"2023-10-26T06:42:29.704641+0000","last_fullsized":"2023-10-26T06:42:29.704641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698804+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:42:29.698804+0000","last_peered":"2023-10-26T06:42:29.698804+0000","last_clean":"2023-10-26T06:42:29.698804+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:42:29.698804+0000","last_undegraded":"2023-10-26T06:42:29.698804+0000","last_fullsized":"2023-10-26T06:42:29.698804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947149+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:42:29.947149+0000","last_peered":"2023-10-26T06:42:29.947149+0000","last_clean":"2023-10-26T06:42:29.947149+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:42:29.947149+0000","last_undegraded":"2023-10-26T06:42:29.947149+0000","last_fullsized":"2023-10-26T06:42:29.947149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704210+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:42:29.704210+0000","last_peered":"2023-10-26T06:42:29.704210+0000","last_clean":"2023-10-26T06:42:29.704210+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:42:29.704210+0000","last_undegraded":"2023-10-26T06:42:29.704210+0000","last_fullsized":"2023-10-26T06:42:29.704210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706123+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:42:29.706123+0000","last_peered":"2023-10-26T06:42:29.706123+0000","last_clean":"2023-10-26T06:42:29.706123+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:42:29.706123+0000","last_undegraded":"2023-10-26T06:42:29.706123+0000","last_fullsized":"2023-10-26T06:42:29.706123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407805+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:42:30.407805+0000","last_peered":"2023-10-26T06:42:30.407805+0000","last_clean":"2023-10-26T06:42:30.407805+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:42:30.407805+0000","last_undegraded":"2023-10-26T06:42:30.407805+0000","last_fullsized":"2023-10-26T06:42:30.407805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407974+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:42:30.407974+0000","last_peered":"2023-10-26T06:42:30.407974+0000","last_clean":"2023-10-26T06:42:30.407974+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:42:30.407974+0000","last_undegraded":"2023-10-26T06:42:30.407974+0000","last_fullsized":"2023-10-26T06:42:30.407974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703559+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:42:29.703559+0000","last_peered":"2023-10-26T06:42:29.703559+0000","last_clean":"2023-10-26T06:42:29.703559+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:42:29.703559+0000","last_undegraded":"2023-10-26T06:42:29.703559+0000","last_fullsized":"2023-10-26T06:42:29.703559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703097+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:42:29.703097+0000","last_peered":"2023-10-26T06:42:29.703097+0000","last_clean":"2023-10-26T06:42:29.703097+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:42:29.703097+0000","last_undegraded":"2023-10-26T06:42:29.703097+0000","last_fullsized":"2023-10-26T06:42:29.703097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700701+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:42:29.700701+0000","last_peered":"2023-10-26T06:42:29.700701+0000","last_clean":"2023-10-26T06:42:29.700701+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:42:29.700701+0000","last_undegraded":"2023-10-26T06:42:29.700701+0000","last_fullsized":"2023-10-26T06:42:29.700701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705375+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:42:29.705375+0000","last_peered":"2023-10-26T06:42:29.705375+0000","last_clean":"2023-10-26T06:42:29.705375+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:42:29.705375+0000","last_undegraded":"2023-10-26T06:42:29.705375+0000","last_fullsized":"2023-10-26T06:42:29.705375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.701211+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:42:29.701211+0000","last_peered":"2023-10-26T06:42:29.701211+0000","last_clean":"2023-10-26T06:42:29.701211+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:42:29.701211+0000","last_undegraded":"2023-10-26T06:42:29.701211+0000","last_fullsized":"2023-10-26T06:42:29.701211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698714+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:42:29.698714+0000","last_peered":"2023-10-26T06:42:29.698714+0000","last_clean":"2023-10-26T06:42:29.698714+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:42:29.698714+0000","last_undegraded":"2023-10-26T06:42:29.698714+0000","last_fullsized":"2023-10-26T06:42:29.698714+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698805+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:42:29.698805+0000","last_peered":"2023-10-26T06:42:29.698805+0000","last_clean":"2023-10-26T06:42:29.698805+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:42:29.698805+0000","last_undegraded":"2023-10-26T06:42:29.698805+0000","last_fullsized":"2023-10-26T06:42:29.698805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408232+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:42:30.408232+0000","last_peered":"2023-10-26T06:42:30.408232+0000","last_clean":"2023-10-26T06:42:30.408232+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:42:30.408232+0000","last_undegraded":"2023-10-26T06:42:30.408232+0000","last_fullsized":"2023-10-26T06:42:30.408232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704769+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:42:29.704769+0000","last_peered":"2023-10-26T06:42:29.704769+0000","last_clean":"2023-10-26T06:42:29.704769+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:42:29.704769+0000","last_undegraded":"2023-10-26T06:42:29.704769+0000","last_fullsized":"2023-10-26T06:42:29.704769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704563+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:42:29.704563+0000","last_peered":"2023-10-26T06:42:29.704563+0000","last_clean":"2023-10-26T06:42:29.704563+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:42:29.704563+0000","last_undegraded":"2023-10-26T06:42:29.704563+0000","last_fullsized":"2023-10-26T06:42:29.704563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704515+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:42:29.704515+0000","last_peered":"2023-10-26T06:42:29.704515+0000","last_clean":"2023-10-26T06:42:29.704515+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:42:29.704515+0000","last_undegraded":"2023-10-26T06:42:29.704515+0000","last_fullsized":"2023-10-26T06:42:29.704515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699688+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:42:29.699688+0000","last_peered":"2023-10-26T06:42:29.699688+0000","last_clean":"2023-10-26T06:42:29.699688+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:42:29.699688+0000","last_undegraded":"2023-10-26T06:42:29.699688+0000","last_fullsized":"2023-10-26T06:42:29.699688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":87,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:39.097653+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:42:39.097653+0000","last_peered":"2023-10-26T06:42:39.097653+0000","last_clean":"2023-10-26T06:42:39.097653+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:42:39.097653+0000","last_undegraded":"2023-10-26T06:42:39.097653+0000","last_fullsized":"2023-10-26T06:42:39.097653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704237+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:42:29.704237+0000","last_peered":"2023-10-26T06:42:29.704237+0000","last_clean":"2023-10-26T06:42:29.704237+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:42:29.704237+0000","last_undegraded":"2023-10-26T06:42:29.704237+0000","last_fullsized":"2023-10-26T06:42:29.704237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698424+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:42:29.698424+0000","last_peered":"2023-10-26T06:42:29.698424+0000","last_clean":"2023-10-26T06:42:29.698424+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:42:29.698424+0000","last_undegraded":"2023-10-26T06:42:29.698424+0000","last_fullsized":"2023-10-26T06:42:29.698424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699561+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:42:29.699561+0000","last_peered":"2023-10-26T06:42:29.699561+0000","last_clean":"2023-10-26T06:42:29.699561+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:42:29.699561+0000","last_undegraded":"2023-10-26T06:42:29.699561+0000","last_fullsized":"2023-10-26T06:42:29.699561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706715+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:42:29.706715+0000","last_peered":"2023-10-26T06:42:29.706715+0000","last_clean":"2023-10-26T06:42:29.706715+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:42:29.706715+0000","last_undegraded":"2023-10-26T06:42:29.706715+0000","last_fullsized":"2023-10-26T06:42:29.706715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698257+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:42:29.698257+0000","last_peered":"2023-10-26T06:42:29.698257+0000","last_clean":"2023-10-26T06:42:29.698257+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:42:29.698257+0000","last_undegraded":"2023-10-26T06:42:29.698257+0000","last_fullsized":"2023-10-26T06:42:29.698257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699672+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:42:29.699672+0000","last_peered":"2023-10-26T06:42:29.699672+0000","last_clean":"2023-10-26T06:42:29.699672+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:42:29.699672+0000","last_undegraded":"2023-10-26T06:42:29.699672+0000","last_fullsized":"2023-10-26T06:42:29.699672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700612+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:42:29.700612+0000","last_peered":"2023-10-26T06:42:29.700612+0000","last_clean":"2023-10-26T06:42:29.700612+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:42:29.700612+0000","last_undegraded":"2023-10-26T06:42:29.700612+0000","last_fullsized":"2023-10-26T06:42:29.700612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":85,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:41.099966+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:42:41.099966+0000","last_peered":"2023-10-26T06:42:41.099966+0000","last_clean":"2023-10-26T06:42:41.099966+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:42:41.099966+0000","last_undegraded":"2023-10-26T06:42:41.099966+0000","last_fullsized":"2023-10-26T06:42:41.099966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704216+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:42:29.704216+0000","last_peered":"2023-10-26T06:42:29.704216+0000","last_clean":"2023-10-26T06:42:29.704216+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:42:29.704216+0000","last_undegraded":"2023-10-26T06:42:29.704216+0000","last_fullsized":"2023-10-26T06:42:29.704216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947188+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:42:29.947188+0000","last_peered":"2023-10-26T06:42:29.947188+0000","last_clean":"2023-10-26T06:42:29.947188+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:42:29.947188+0000","last_undegraded":"2023-10-26T06:42:29.947188+0000","last_fullsized":"2023-10-26T06:42:29.947188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408184+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:42:30.408184+0000","last_peered":"2023-10-26T06:42:30.408184+0000","last_clean":"2023-10-26T06:42:30.408184+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:42:30.408184+0000","last_undegraded":"2023-10-26T06:42:30.408184+0000","last_fullsized":"2023-10-26T06:42:30.408184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699839+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:42:29.699839+0000","last_peered":"2023-10-26T06:42:29.699839+0000","last_clean":"2023-10-26T06:42:29.699839+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:42:29.699839+0000","last_undegraded":"2023-10-26T06:42:29.699839+0000","last_fullsized":"2023-10-26T06:42:29.699839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704563+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:42:29.704563+0000","last_peered":"2023-10-26T06:42:29.704563+0000","last_clean":"2023-10-26T06:42:29.704563+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:42:29.704563+0000","last_undegraded":"2023-10-26T06:42:29.704563+0000","last_fullsized":"2023-10-26T06:42:29.704563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'27","reported_seq":184,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:42.101488+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:42:42.101488+0000","last_peered":"2023-10-26T06:42:42.101488+0000","last_clean":"2023-10-26T06:42:42.101488+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:42:42.101488+0000","last_undegraded":"2023-10-26T06:42:42.101488+0000","last_fullsized":"2023-10-26T06:42:42.101488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59160,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":128,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704506+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:42:29.704506+0000","last_peered":"2023-10-26T06:42:29.704506+0000","last_clean":"2023-10-26T06:42:29.704506+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:42:29.704506+0000","last_undegraded":"2023-10-26T06:42:29.704506+0000","last_fullsized":"2023-10-26T06:42:29.704506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705196+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:42:29.705196+0000","last_peered":"2023-10-26T06:42:29.705196+0000","last_clean":"2023-10-26T06:42:29.705196+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:42:29.705196+0000","last_undegraded":"2023-10-26T06:42:29.705196+0000","last_fullsized":"2023-10-26T06:42:29.705196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705997+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:42:29.705997+0000","last_peered":"2023-10-26T06:42:29.705997+0000","last_clean":"2023-10-26T06:42:29.705997+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:42:29.705997+0000","last_undegraded":"2023-10-26T06:42:29.705997+0000","last_fullsized":"2023-10-26T06:42:29.705997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699304+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:42:29.699304+0000","last_peered":"2023-10-26T06:42:29.699304+0000","last_clean":"2023-10-26T06:42:29.699304+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:42:29.699304+0000","last_undegraded":"2023-10-26T06:42:29.699304+0000","last_fullsized":"2023-10-26T06:42:29.699304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947098+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:42:29.947098+0000","last_peered":"2023-10-26T06:42:29.947098+0000","last_clean":"2023-10-26T06:42:29.947098+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:42:29.947098+0000","last_undegraded":"2023-10-26T06:42:29.947098+0000","last_fullsized":"2023-10-26T06:42:29.947098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":91,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:43.107713+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:42:43.107713+0000","last_peered":"2023-10-26T06:42:43.107713+0000","last_clean":"2023-10-26T06:42:43.107713+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:42:43.107713+0000","last_undegraded":"2023-10-26T06:42:43.107713+0000","last_fullsized":"2023-10-26T06:42:43.107713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946774+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:42:29.946774+0000","last_peered":"2023-10-26T06:42:29.946774+0000","last_clean":"2023-10-26T06:42:29.946774+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:42:29.946774+0000","last_undegraded":"2023-10-26T06:42:29.946774+0000","last_fullsized":"2023-10-26T06:42:29.946774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703869+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:42:29.703869+0000","last_peered":"2023-10-26T06:42:29.703869+0000","last_clean":"2023-10-26T06:42:29.703869+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:42:29.703869+0000","last_undegraded":"2023-10-26T06:42:29.703869+0000","last_fullsized":"2023-10-26T06:42:29.703869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699497+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:42:29.699497+0000","last_peered":"2023-10-26T06:42:29.699497+0000","last_clean":"2023-10-26T06:42:29.699497+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:42:29.699497+0000","last_undegraded":"2023-10-26T06:42:29.699497+0000","last_fullsized":"2023-10-26T06:42:29.699497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.714855+0000","last_change":"2023-10-26T06:42:30.714354+0000","last_active":"2023-10-26T06:42:30.714855+0000","last_peered":"2023-10-26T06:42:30.714855+0000","last_clean":"2023-10-26T06:42:30.714855+0000","last_became_active":"2023-10-26T06:42:30.709396+0000","last_became_peered":"2023-10-26T06:42:30.709396+0000","last_unstale":"2023-10-26T06:42:30.714855+0000","last_undegraded":"2023-10-26T06:42:30.714855+0000","last_fullsized":"2023-10-26T06:42:30.714855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:04:20.594879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702570+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:42:29.702570+0000","last_peered":"2023-10-26T06:42:29.702570+0000","last_clean":"2023-10-26T06:42:29.702570+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:42:29.702570+0000","last_undegraded":"2023-10-26T06:42:29.702570+0000","last_fullsized":"2023-10-26T06:42:29.702570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700656+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:42:29.700656+0000","last_peered":"2023-10-26T06:42:29.700656+0000","last_clean":"2023-10-26T06:42:29.700656+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:42:29.700656+0000","last_undegraded":"2023-10-26T06:42:29.700656+0000","last_fullsized":"2023-10-26T06:42:29.700656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698681+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:42:29.698681+0000","last_peered":"2023-10-26T06:42:29.698681+0000","last_clean":"2023-10-26T06:42:29.698681+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:42:29.698681+0000","last_undegraded":"2023-10-26T06:42:29.698681+0000","last_fullsized":"2023-10-26T06:42:29.698681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946991+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:42:29.946991+0000","last_peered":"2023-10-26T06:42:29.946991+0000","last_clean":"2023-10-26T06:42:29.946991+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:42:29.946991+0000","last_undegraded":"2023-10-26T06:42:29.946991+0000","last_fullsized":"2023-10-26T06:42:29.946991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698676+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:42:29.698676+0000","last_peered":"2023-10-26T06:42:29.698676+0000","last_clean":"2023-10-26T06:42:29.698676+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:42:29.698676+0000","last_undegraded":"2023-10-26T06:42:29.698676+0000","last_fullsized":"2023-10-26T06:42:29.698676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699599+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:42:29.699599+0000","last_peered":"2023-10-26T06:42:29.699599+0000","last_clean":"2023-10-26T06:42:29.699599+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:42:29.699599+0000","last_undegraded":"2023-10-26T06:42:29.699599+0000","last_fullsized":"2023-10-26T06:42:29.699599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":84,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:39.101465+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:42:39.101465+0000","last_peered":"2023-10-26T06:42:39.101465+0000","last_clean":"2023-10-26T06:42:39.101465+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:42:39.101465+0000","last_undegraded":"2023-10-26T06:42:39.101465+0000","last_fullsized":"2023-10-26T06:42:39.101465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.709009+0000","last_change":"2023-10-26T06:42:30.709009+0000","last_active":"2023-10-26T06:42:30.709009+0000","last_peered":"2023-10-26T06:42:30.709009+0000","last_clean":"2023-10-26T06:42:30.709009+0000","last_became_active":"2023-10-26T06:42:30.708638+0000","last_became_peered":"2023-10-26T06:42:30.708638+0000","last_unstale":"2023-10-26T06:42:30.709009+0000","last_undegraded":"2023-10-26T06:42:30.709009+0000","last_fullsized":"2023-10-26T06:42:30.709009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:53:48.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704180+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:42:29.704180+0000","last_peered":"2023-10-26T06:42:29.704180+0000","last_clean":"2023-10-26T06:42:29.704180+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:42:29.704180+0000","last_undegraded":"2023-10-26T06:42:29.704180+0000","last_fullsized":"2023-10-26T06:42:29.704180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946806+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:42:29.946806+0000","last_peered":"2023-10-26T06:42:29.946806+0000","last_clean":"2023-10-26T06:42:29.946806+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:42:29.946806+0000","last_undegraded":"2023-10-26T06:42:29.946806+0000","last_fullsized":"2023-10-26T06:42:29.946806+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.706066+0000","last_change":"2023-10-26T06:42:30.706066+0000","last_active":"2023-10-26T06:42:30.706066+0000","last_peered":"2023-10-26T06:42:30.706066+0000","last_clean":"2023-10-26T06:42:30.706066+0000","last_became_active":"2023-10-26T06:42:30.705682+0000","last_became_peered":"2023-10-26T06:42:30.705682+0000","last_unstale":"2023-10-26T06:42:30.706066+0000","last_undegraded":"2023-10-26T06:42:30.706066+0000","last_fullsized":"2023-10-26T06:42:30.706066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:40:13.366566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946918+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:42:29.946918+0000","last_peered":"2023-10-26T06:42:29.946918+0000","last_clean":"2023-10-26T06:42:29.946918+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:42:29.946918+0000","last_undegraded":"2023-10-26T06:42:29.946918+0000","last_fullsized":"2023-10-26T06:42:29.946918+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704685+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:42:29.704685+0000","last_peered":"2023-10-26T06:42:29.704685+0000","last_clean":"2023-10-26T06:42:29.704685+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:42:29.704685+0000","last_undegraded":"2023-10-26T06:42:29.704685+0000","last_fullsized":"2023-10-26T06:42:29.704685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706153+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:42:29.706153+0000","last_peered":"2023-10-26T06:42:29.706153+0000","last_clean":"2023-10-26T06:42:29.706153+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:42:29.706153+0000","last_undegraded":"2023-10-26T06:42:29.706153+0000","last_fullsized":"2023-10-26T06:42:29.706153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700652+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:42:29.700652+0000","last_peered":"2023-10-26T06:42:29.700652+0000","last_clean":"2023-10-26T06:42:29.700652+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:42:29.700652+0000","last_undegraded":"2023-10-26T06:42:29.700652+0000","last_fullsized":"2023-10-26T06:42:29.700652+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698722+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:42:29.698722+0000","last_peered":"2023-10-26T06:42:29.698722+0000","last_clean":"2023-10-26T06:42:29.698722+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:42:29.698722+0000","last_undegraded":"2023-10-26T06:42:29.698722+0000","last_fullsized":"2023-10-26T06:42:29.698722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704776+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:42:29.704776+0000","last_peered":"2023-10-26T06:42:29.704776+0000","last_clean":"2023-10-26T06:42:29.704776+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:42:29.704776+0000","last_undegraded":"2023-10-26T06:42:29.704776+0000","last_fullsized":"2023-10-26T06:42:29.704776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.408161+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:42:30.408161+0000","last_peered":"2023-10-26T06:42:30.408161+0000","last_clean":"2023-10-26T06:42:30.408161+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:42:30.408161+0000","last_undegraded":"2023-10-26T06:42:30.408161+0000","last_fullsized":"2023-10-26T06:42:30.408161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703873+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:42:29.703873+0000","last_peered":"2023-10-26T06:42:29.703873+0000","last_clean":"2023-10-26T06:42:29.703873+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:42:29.703873+0000","last_undegraded":"2023-10-26T06:42:29.703873+0000","last_fullsized":"2023-10-26T06:42:29.703873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704158+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:42:29.704158+0000","last_peered":"2023-10-26T06:42:29.704158+0000","last_clean":"2023-10-26T06:42:29.704158+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:42:29.704158+0000","last_undegraded":"2023-10-26T06:42:29.704158+0000","last_fullsized":"2023-10-26T06:42:29.704158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698478+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:42:29.698478+0000","last_peered":"2023-10-26T06:42:29.698478+0000","last_clean":"2023-10-26T06:42:29.698478+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:42:29.698478+0000","last_undegraded":"2023-10-26T06:42:29.698478+0000","last_fullsized":"2023-10-26T06:42:29.698478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702211+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:42:29.702211+0000","last_peered":"2023-10-26T06:42:29.702211+0000","last_clean":"2023-10-26T06:42:29.702211+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:42:29.702211+0000","last_undegraded":"2023-10-26T06:42:29.702211+0000","last_fullsized":"2023-10-26T06:42:29.702211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.717232+0000","last_change":"2023-10-26T06:42:30.716756+0000","last_active":"2023-10-26T06:42:30.717232+0000","last_peered":"2023-10-26T06:42:30.717232+0000","last_clean":"2023-10-26T06:42:30.717232+0000","last_became_active":"2023-10-26T06:42:30.709797+0000","last_became_peered":"2023-10-26T06:42:30.709797+0000","last_unstale":"2023-10-26T06:42:30.717232+0000","last_undegraded":"2023-10-26T06:42:30.717232+0000","last_fullsized":"2023-10-26T06:42:30.717232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:54.345261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698489+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:42:29.698489+0000","last_peered":"2023-10-26T06:42:29.698489+0000","last_clean":"2023-10-26T06:42:29.698489+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:42:29.698489+0000","last_undegraded":"2023-10-26T06:42:29.698489+0000","last_fullsized":"2023-10-26T06:42:29.698489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704002+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:42:29.704002+0000","last_peered":"2023-10-26T06:42:29.704002+0000","last_clean":"2023-10-26T06:42:29.704002+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:42:29.704002+0000","last_undegraded":"2023-10-26T06:42:29.704002+0000","last_fullsized":"2023-10-26T06:42:29.704002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947055+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:42:29.947055+0000","last_peered":"2023-10-26T06:42:29.947055+0000","last_clean":"2023-10-26T06:42:29.947055+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:42:29.947055+0000","last_undegraded":"2023-10-26T06:42:29.947055+0000","last_fullsized":"2023-10-26T06:42:29.947055+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705370+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:42:29.705370+0000","last_peered":"2023-10-26T06:42:29.705370+0000","last_clean":"2023-10-26T06:42:29.705370+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:42:29.705370+0000","last_undegraded":"2023-10-26T06:42:29.705370+0000","last_fullsized":"2023-10-26T06:42:29.705370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947203+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:42:29.947203+0000","last_peered":"2023-10-26T06:42:29.947203+0000","last_clean":"2023-10-26T06:42:29.947203+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:42:29.947203+0000","last_undegraded":"2023-10-26T06:42:29.947203+0000","last_fullsized":"2023-10-26T06:42:29.947203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699564+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:42:29.699564+0000","last_peered":"2023-10-26T06:42:29.699564+0000","last_clean":"2023-10-26T06:42:29.699564+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:42:29.699564+0000","last_undegraded":"2023-10-26T06:42:29.699564+0000","last_fullsized":"2023-10-26T06:42:29.699564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947112+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:42:29.947112+0000","last_peered":"2023-10-26T06:42:29.947112+0000","last_clean":"2023-10-26T06:42:29.947112+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:42:29.947112+0000","last_undegraded":"2023-10-26T06:42:29.947112+0000","last_fullsized":"2023-10-26T06:42:29.947112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706318+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:42:29.706318+0000","last_peered":"2023-10-26T06:42:29.706318+0000","last_clean":"2023-10-26T06:42:29.706318+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:42:29.706318+0000","last_undegraded":"2023-10-26T06:42:29.706318+0000","last_fullsized":"2023-10-26T06:42:29.706318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947290+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:42:29.947290+0000","last_peered":"2023-10-26T06:42:29.947290+0000","last_clean":"2023-10-26T06:42:29.947290+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:42:29.947290+0000","last_undegraded":"2023-10-26T06:42:29.947290+0000","last_fullsized":"2023-10-26T06:42:29.947290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702186+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:42:29.702186+0000","last_peered":"2023-10-26T06:42:29.702186+0000","last_clean":"2023-10-26T06:42:29.702186+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:42:29.702186+0000","last_undegraded":"2023-10-26T06:42:29.702186+0000","last_fullsized":"2023-10-26T06:42:29.702186+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703861+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:42:29.703861+0000","last_peered":"2023-10-26T06:42:29.703861+0000","last_clean":"2023-10-26T06:42:29.703861+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:42:29.703861+0000","last_undegraded":"2023-10-26T06:42:29.703861+0000","last_fullsized":"2023-10-26T06:42:29.703861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705042+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:42:29.705042+0000","last_peered":"2023-10-26T06:42:29.705042+0000","last_clean":"2023-10-26T06:42:29.705042+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:42:29.705042+0000","last_undegraded":"2023-10-26T06:42:29.705042+0000","last_fullsized":"2023-10-26T06:42:29.705042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.407881+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:42:30.407881+0000","last_peered":"2023-10-26T06:42:30.407881+0000","last_clean":"2023-10-26T06:42:30.407881+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:42:30.407881+0000","last_undegraded":"2023-10-26T06:42:30.407881+0000","last_fullsized":"2023-10-26T06:42:30.407881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706187+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:42:29.706187+0000","last_peered":"2023-10-26T06:42:29.706187+0000","last_clean":"2023-10-26T06:42:29.706187+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:42:29.706187+0000","last_undegraded":"2023-10-26T06:42:29.706187+0000","last_fullsized":"2023-10-26T06:42:29.706187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.702600+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:42:29.702600+0000","last_peered":"2023-10-26T06:42:29.702600+0000","last_clean":"2023-10-26T06:42:29.702600+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:42:29.702600+0000","last_undegraded":"2023-10-26T06:42:29.702600+0000","last_fullsized":"2023-10-26T06:42:29.702600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705561+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:42:29.705561+0000","last_peered":"2023-10-26T06:42:29.705561+0000","last_clean":"2023-10-26T06:42:29.705561+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:42:29.705561+0000","last_undegraded":"2023-10-26T06:42:29.705561+0000","last_fullsized":"2023-10-26T06:42:29.705561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698675+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:42:29.698675+0000","last_peered":"2023-10-26T06:42:29.698675+0000","last_clean":"2023-10-26T06:42:29.698675+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:42:29.698675+0000","last_undegraded":"2023-10-26T06:42:29.698675+0000","last_fullsized":"2023-10-26T06:42:29.698675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699335+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:42:29.699335+0000","last_peered":"2023-10-26T06:42:29.699335+0000","last_clean":"2023-10-26T06:42:29.699335+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:42:29.699335+0000","last_undegraded":"2023-10-26T06:42:29.699335+0000","last_fullsized":"2023-10-26T06:42:29.699335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698360+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:42:29.698360+0000","last_peered":"2023-10-26T06:42:29.698360+0000","last_clean":"2023-10-26T06:42:29.698360+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:42:29.698360+0000","last_undegraded":"2023-10-26T06:42:29.698360+0000","last_fullsized":"2023-10-26T06:42:29.698360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704483+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:42:29.704483+0000","last_peered":"2023-10-26T06:42:29.704483+0000","last_clean":"2023-10-26T06:42:29.704483+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:42:29.704483+0000","last_undegraded":"2023-10-26T06:42:29.704483+0000","last_fullsized":"2023-10-26T06:42:29.704483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706047+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:42:29.706047+0000","last_peered":"2023-10-26T06:42:29.706047+0000","last_clean":"2023-10-26T06:42:29.706047+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:42:29.706047+0000","last_undegraded":"2023-10-26T06:42:29.706047+0000","last_fullsized":"2023-10-26T06:42:29.706047+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.708612+0000","last_change":"2023-10-26T06:42:30.708612+0000","last_active":"2023-10-26T06:42:30.708612+0000","last_peered":"2023-10-26T06:42:30.708612+0000","last_clean":"2023-10-26T06:42:30.708612+0000","last_became_active":"2023-10-26T06:42:30.707927+0000","last_became_peered":"2023-10-26T06:42:30.707927+0000","last_unstale":"2023-10-26T06:42:30.708612+0000","last_undegraded":"2023-10-26T06:42:30.708612+0000","last_fullsized":"2023-10-26T06:42:30.708612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:59:10.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":426,"num_read_kb":278,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.878}]},{"osd":7,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.753},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.84999999999999998}]},{"osd":8,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79300000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.82599999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.83999999999999997}]}]},{"osd":10,"up_from":72,"seq":309237645343,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1634304,"data_stored":1113268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.315},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46800000000000003,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.872},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80800000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93200000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.61199999999999999,"5min":0.503,"15min":0.503},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59999999999999998}]},{"osd":9,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81200000000000006,"15min":0.81299999999999994},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96199999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81499999999999995}]},{"osd":11,"last update":"Thu Oct 26 06:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.90900000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":462798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.371},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":7.2320000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.56899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.82999999999999996,"15min":0.83399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.95499999999999996,"15min":0.96799999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88,"15min":0.89600000000000002},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.622}]},{"osd":6,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96699999999999997,"15min":0.98699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.753},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.94899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.89800000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.0629999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.59399999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":7.2809999999999997}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.048,"15min":1.056},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.2370000000000001,"15min":1.3029999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4730000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.77100000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":462696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81799999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.499}]},{"osd":1,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.56899999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.42099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.38,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.73799999999999999,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0109999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63600000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.746}]},{"osd":4,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84999999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.65400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.48599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.95099999999999996,"5min":1.766,"15min":1.766},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.68500000000000005},"min":{"1min":0.64700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0389999999999999,"5min":1.087,"15min":1.087},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":0.93400000000000005},"min":{"1min":0.60699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.101,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.63700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.405,"15min":1.405},"last":0.66700000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.69399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.82099999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.72299999999999998,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.67100000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.84799999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78000000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1552384,"data_stored":1054653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.248,"15min":0.248},"max":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.436},{"interface":"front","average":{"1min":0.498,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.27200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71499999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.505,"15min":0.47799999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.499,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.752,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.75},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.64200000000000002,"15min":0.624},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.53100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.71399999999999997},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.995,"15min":0.995},"last":0.69899999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.61099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.996,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.84099999999999997}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.73899999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.72299999999999998},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76600000000000001}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.88800000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47599999999999998,"15min":0.46400000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53400000000000003,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92500000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67700000000000005,"15min":0.65600000000000003},"min":{"1min":0.59499999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.72199999999999998,"15min":0.67700000000000005},"min":{"1min":0.53500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":1.036,"15min":1.036},"last":0.623},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1160000000000001,"5min":1.127,"15min":1.127},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.038,"15min":1.038},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.64600000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.071,"5min":1.228,"15min":1.228},"last":0.69099999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.70899999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.879,"15min":0.88300000000000001},"min":{"1min":0.65700000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76800000000000002}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":0.96899999999999997,"15min":0.92400000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.9790000000000001,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.046,"15min":1.004},"min":{"1min":0.78300000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":6.9969999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.82899999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":521140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":1.006,"15min":1.006},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.436,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.33600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.55800000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Oct 26 06:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.55300000000000005},"min":{"1min":0.435,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57499999999999996,"15min":0.56100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48499999999999999}]},{"osd":8,"last update":"Thu Oct 26 06:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.56799999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69099999999999995,"15min":0.66200000000000003},"min":{"1min":0.57099999999999995,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78800000000000003}]},{"osd":9,"last update":"Thu Oct 26 06:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.57599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96099999999999997,"5min":1.048,"15min":1.048},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.755}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.92000000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705740,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":463458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.46000000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.752}]},{"osd":2,"last update":"Thu Oct 26 06:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.70299999999999996,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72199999999999998,"15min":0.64000000000000001},"min":{"1min":0.57399999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.499},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.66300000000000003,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71299999999999997,"15min":0.64300000000000002},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.5269999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.79200000000000004,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.626}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92100000000000004,"15min":0.93000000000000005},"min":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.599,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92700000000000005,"15min":0.93600000000000005},"min":{"1min":0.63600000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.88200000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.78900000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.014,"15min":1.018},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.65000000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.90300000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.94399999999999995}]}]},{"osd":2,"up_from":19,"seq":81604378693,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":522490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91400000000000003,"5min":2.371,"15min":2.371},"last":0.443}]},{"osd":1,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2370000000000001,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Oct 26 06:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63600000000000001,"15min":0.69799999999999995},"min":{"1min":0.33500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81999999999999995,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.51600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Thu Oct 26 06:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.64300000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.63300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.745},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68500000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149760,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":462510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47199999999999998,"15min":0.44600000000000001},"min":{"1min":0.38700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.88100000000000001,"5min":1.069,"15min":1.069},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.41899999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.49399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.94899999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Oct 26 06:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68799999999999994,"15min":0.64000000000000001},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99099999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Oct 26 06:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72599999999999998,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.69699999999999995},"min":{"1min":0.61499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93899999999999995,"5min":1.196,"15min":1.196},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Oct 26 06:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.72599999999999998,"15min":0.66400000000000003},"min":{"1min":0.54600000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.747}]},{"osd":7,"last update":"Thu Oct 26 06:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.82399999999999995,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.361,"15min":1.361},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.751,"15min":0.70499999999999996},"min":{"1min":0.64100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.80400000000000005}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.226,"5min":1.419,"15min":1.419},"last":0.873},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59899999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.292,"15min":1.292},"last":0.63600000000000001}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.0580000000000001,"15min":1.0880000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.97899999999999998,"15min":0.997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.85299999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.03},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.82599999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888124,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":463014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.312},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.377},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76100000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Oct 26 06:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60999999999999999,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81799999999999995,"5min":1.863,"15min":1.863},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.51600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.872,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Oct 26 06:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45900000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.81499999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.59999999999999998}]},{"osd":9,"last update":"Thu Oct 26 06:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93999999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94499999999999995,"5min":1.246,"15min":1.246},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93200000000000005,"5min":1.044,"15min":1.044},"last":0.71899999999999997}]},{"osd":11,"last update":"Thu Oct 26 06:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.747},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73499999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724598,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1053616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82099999999999995,"5min":5.819,"15min":5.819},"last":0.503},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55200000000000005,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.32900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.57399999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.56999999999999995},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":5.835,"15min":5.835},"last":0.626},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.59299999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96599999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Oct 26 06:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.53300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67500000000000004,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73099999999999998}]},{"osd":8,"last update":"Thu Oct 26 06:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.751}]},{"osd":9,"last update":"Thu Oct 26 06:42:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.71799999999999997}]},{"osd":10,"last update":"Thu Oct 26 06:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.754,"15min":0.748},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:42:47.537 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-26T06:42:47.538 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-26T06:42:47.538 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-26T06:42:47.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph health --format=json 2023-10-26T06:42:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:48.836 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:48 smithi050 ceph-mon[94997]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:48.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:48 smithi050 ceph-mon[94997]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:48 smithi153 ceph-mon[131657]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:48 smithi153 ceph-mon[131657]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:48 smithi125 ceph-mon[130643]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:42:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:48 smithi125 ceph-mon[130643]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:49.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 -- 172.21.15.50:0/2899730666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 msgr2=0x7fe0cc105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 --2- 172.21.15.50:0/2899730666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc105ba0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009990 tx=0x7fe0bc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 -- 172.21.15.50:0/2899730666 shutdown_connections 2023-10-26T06:42:49.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 --2- 172.21.15.50:0/2899730666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0cc101260 0x7fe0cc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 --2- 172.21.15.50:0/2899730666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc105ba0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 --2- 172.21.15.50:0/2899730666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 0x7fe0cc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 -- 172.21.15.50:0/2899730666 >> 172.21.15.50:0/2899730666 conn(0x7fe0cc0779e0 msgr2=0x7fe0cc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 -- 172.21.15.50:0/2899730666 shutdown_connections 2023-10-26T06:42:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.792+0000 7fe0d250e700 1 -- 172.21.15.50:0/2899730666 wait complete. 2023-10-26T06:42:49.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 Processor -- start 2023-10-26T06:42:49.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 -- start start 2023-10-26T06:42:49.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 0x7fe0cc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:49.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0cc101260 0x7fe0cc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:49.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:49.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1a4fe0 con 0x7fe0cc1057c0 2023-10-26T06:42:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1a5150 con 0x7fe0cc101260 2023-10-26T06:42:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d250e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1a5310 con 0x7fe0cc1008a0 2023-10-26T06:42:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d0aab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0cbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 0x7fe0cc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:49.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.794+0000 7fe0d0aab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57364/0 (socket says 172.21.15.50:57364) 2023-10-26T06:42:49.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0d0aab700 1 -- 172.21.15.50:0/3448203887 learned_addr learned my addr 172.21.15.50:0/3448203887 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:49.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cb7fe700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0cc101260 0x7fe0cc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:49.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cbfff700 1 -- 172.21.15.50:0/3448203887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0cc101260 msgr2=0x7fe0cc073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:49.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cbfff700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0cc101260 0x7fe0cc073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:49.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cbfff700 1 -- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 msgr2=0x7fe0cc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:49.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cbfff700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:49.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cbfff700 1 -- 172.21.15.50:0/3448203887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0095f0 con 0x7fe0cc1008a0 2023-10-26T06:42:49.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0d0aab700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:49.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0cbfff700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 0x7fe0cc072af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0059d0 tx=0x7fe0bc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:49.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc01d070 con 0x7fe0cc1008a0 2023-10-26T06:42:49.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc1a5590 con 0x7fe0cc1008a0 2023-10-26T06:42:49.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.795+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0bc022470 con 0x7fe0cc1008a0 2023-10-26T06:42:49.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.796+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc017650 con 0x7fe0cc1008a0 2023-10-26T06:42:49.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.796+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc1a5a00 con 0x7fe0cc1008a0 2023-10-26T06:42:49.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.797+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc108d80 con 0x7fe0cc1008a0 2023-10-26T06:42:49.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.799+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fe0bc00fad0 con 0x7fe0cc1008a0 2023-10-26T06:42:49.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.800+0000 7fe0c97fa700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0b40a1560 0x7fe0b40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.800+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe0bc0ce0c0 con 0x7fe0cc1008a0 2023-10-26T06:42:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.800+0000 7fe0cb7fe700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0b40a1560 0x7fe0b40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.801+0000 7fe0cb7fe700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0b40a1560 0x7fe0b40a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0741d0 tx=0x7fe0c0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:49.802+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe0bc097580 con 0x7fe0cc1008a0 2023-10-26T06:42:50.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.061+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe0cc073f80 con 0x7fe0cc1008a0 2023-10-26T06:42:50.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.061+0000 7fe0c97fa700 1 -- 172.21.15.50:0/3448203887 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe0bc09aba0 con 0x7fe0cc1008a0 2023-10-26T06:42:50.063 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:50.064 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-26T06:42:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0b40a1560 msgr2=0x7fe0b40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0b40a1560 0x7fe0b40a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0741d0 tx=0x7fe0c0009260 comp rx=0 tx=0).stop 2023-10-26T06:42:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 msgr2=0x7fe0cc072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 0x7fe0cc072af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0059d0 tx=0x7fe0bc005740 comp rx=0 tx=0).stop 2023-10-26T06:42:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 shutdown_connections 2023-10-26T06:42:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0b40a1560 0x7fe0b40a3a20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0cc1057c0 0x7fe0cc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0cc1008a0 0x7fe0cc072af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 --2- 172.21.15.50:0/3448203887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0cc101260 0x7fe0cc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 >> 172.21.15.50:0/3448203887 conn(0x7fe0cc0779e0 msgr2=0x7fe0cc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.064+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 shutdown_connections 2023-10-26T06:42:50.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.065+0000 7fe0d250e700 1 -- 172.21.15.50:0/3448203887 wait complete. 2023-10-26T06:42:50.467 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-26T06:42:50.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:42:50.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.676+0000 7f4688fff700 1 -- 172.21.15.50:0/3445155546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4684072c20 msgr2=0x7f4684073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.676+0000 7f4688fff700 1 --2- 172.21.15.50:0/3445155546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4684072c20 0x7f4684073000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4674009990 tx=0x7f4674009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 -- 172.21.15.50:0/3445155546 shutdown_connections 2023-10-26T06:42:50.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 --2- 172.21.15.50:0/3445155546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f468410cee0 0x7f468410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 --2- 172.21.15.50:0/3445155546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4684072c20 0x7f4684073000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 --2- 172.21.15.50:0/3445155546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4684073540 0x7f468410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 -- 172.21.15.50:0/3445155546 >> 172.21.15.50:0/3445155546 conn(0x7f46840fc170 msgr2=0x7f46840fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:50.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 -- 172.21.15.50:0/3445155546 shutdown_connections 2023-10-26T06:42:50.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.677+0000 7f4688fff700 1 -- 172.21.15.50:0/3445155546 wait complete. 2023-10-26T06:42:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 Processor -- start 2023-10-26T06:42:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 -- start start 2023-10-26T06:42:50.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4684072c20 0x7f4684198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4684073540 0x7f4684199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 0x7f468419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468419dce0 con 0x7f468410cee0 2023-10-26T06:42:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468419de50 con 0x7f4684072c20 2023-10-26T06:42:50.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4688fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468419e010 con 0x7f4684073540 2023-10-26T06:42:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4682d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 0x7f468419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f468259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4684072c20 0x7f4684198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4682d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 0x7f468419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57386/0 (socket says 172.21.15.50:57386) 2023-10-26T06:42:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.678+0000 7f4682d9d700 1 -- 172.21.15.50:0/2429804926 learned_addr learned my addr 172.21.15.50:0/2429804926 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4681d9b700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4684073540 0x7f4684199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:50.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4682d9d700 1 -- 172.21.15.50:0/2429804926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4684073540 msgr2=0x7f4684199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4682d9d700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4684073540 0x7f4684199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4682d9d700 1 -- 172.21.15.50:0/2429804926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4684072c20 msgr2=0x7f4684198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4682d9d700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4684072c20 0x7f4684198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4682d9d700 1 -- 172.21.15.50:0/2429804926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740095f0 con 0x7f468410cee0 2023-10-26T06:42:50.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4682d9d700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 0x7f468419d6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f467c00ef30 tx=0x7f467c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c018070 con 0x7f468410cee0 2023-10-26T06:42:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468419e290 con 0x7f468410cee0 2023-10-26T06:42:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f467c00f040 con 0x7f468410cee0 2023-10-26T06:42:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00cd00 con 0x7f468410cee0 2023-10-26T06:42:50.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.679+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46841a5b30 con 0x7f468410cee0 2023-10-26T06:42:50.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.681+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46841080f0 con 0x7f468410cee0 2023-10-26T06:42:50.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.682+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f467c003a00 con 0x7f468410cee0 2023-10-26T06:42:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.684+0000 7f46737fe700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f466c0a1560 0x7f466c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.684+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f467c0cca80 con 0x7f468410cee0 2023-10-26T06:42:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.684+0000 7f468259c700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f466c0a1560 0x7f466c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:50.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.685+0000 7f468259c700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f466c0a1560 0x7f466c0a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4674006010 tx=0x7f467400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.688+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f467c095f40 con 0x7f468410cee0 2023-10-26T06:42:50.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:50 smithi050 ceph-mon[94997]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:50.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:50 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3448203887' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-26T06:42:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.904+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46840742d0 con 0x7f468410cee0 2023-10-26T06:42:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.906+0000 7f46737fe700 1 -- 172.21.15.50:0/2429804926 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7f467c099560 con 0x7f468410cee0 2023-10-26T06:42:50.908 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:50.908 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:42:50.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.908+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f466c0a1560 msgr2=0x7f466c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.908+0000 7f4688fff700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f466c0a1560 0x7f466c0a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4674006010 tx=0x7f467400b260 comp rx=0 tx=0).stop 2023-10-26T06:42:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 msgr2=0x7f468419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 0x7f468419d6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f467c00ef30 tx=0x7f467c00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 shutdown_connections 2023-10-26T06:42:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f466c0a1560 0x7f466c0a3a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f468410cee0 0x7f468419d6a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4684072c20 0x7f4684198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 --2- 172.21.15.50:0/2429804926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4684073540 0x7f4684199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 >> 172.21.15.50:0/2429804926 conn(0x7f46840fc170 msgr2=0x7f46840fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 shutdown_connections 2023-10-26T06:42:50.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:50.909+0000 7f4688fff700 1 -- 172.21.15.50:0/2429804926 wait complete. 2023-10-26T06:42:50.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:42:50.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:42:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:50 smithi153 ceph-mon[131657]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:50 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3448203887' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-26T06:42:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 -- 172.21.15.50:0/3082813751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c073540 msgr2=0x7f9e7c10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 --2- 172.21.15.50:0/3082813751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c073540 0x7f9e7c10ca20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009990 tx=0x7f9e70009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 -- 172.21.15.50:0/3082813751 shutdown_connections 2023-10-26T06:42:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 --2- 172.21.15.50:0/3082813751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c10cf60 0x7f9e7c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 --2- 172.21.15.50:0/3082813751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c072c20 0x7f9e7c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 --2- 172.21.15.50:0/3082813751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c073540 0x7f9e7c10ca20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 -- 172.21.15.50:0/3082813751 >> 172.21.15.50:0/3082813751 conn(0x7f9e7c0fc1b0 msgr2=0x7f9e7c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.140+0000 7f9e825ff700 1 -- 172.21.15.50:0/3082813751 shutdown_connections 2023-10-26T06:42:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.141+0000 7f9e825ff700 1 -- 172.21.15.50:0/3082813751 wait complete. 2023-10-26T06:42:51.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.141+0000 7f9e825ff700 1 Processor -- start 2023-10-26T06:42:51.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 -- start start 2023-10-26T06:42:51.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 0x7f9e7c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c073540 0x7f9e7c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c10cf60 0x7f9e7c19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c19ddc0 con 0x7f9e7c10cf60 2023-10-26T06:42:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c19df30 con 0x7f9e7c072c20 2023-10-26T06:42:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e825ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c19e0f0 con 0x7f9e7c073540 2023-10-26T06:42:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e7bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 0x7f9e7c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e80b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c10cf60 0x7f9e7c19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e7b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c073540 0x7f9e7c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e7bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 0x7f9e7c198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:54458/0 (socket says 172.21.15.50:54458) 2023-10-26T06:42:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.142+0000 7f9e7bfff700 1 -- 172.21.15.50:0/172707707 learned_addr learned my addr 172.21.15.50:0/172707707 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7bfff700 1 -- 172.21.15.50:0/172707707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c073540 msgr2=0x7f9e7c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7bfff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c073540 0x7f9e7c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7bfff700 1 -- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c10cf60 msgr2=0x7f9e7c19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7bfff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c10cf60 0x7f9e7c19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7bfff700 1 -- 172.21.15.50:0/172707707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700095f0 con 0x7f9e7c072c20 2023-10-26T06:42:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e80b9c700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c10cf60 0x7f9e7c19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7b7fe700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c073540 0x7f9e7c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e7bfff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 0x7f9e7c198ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00e9a0 tx=0x7f9e6c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c009790 con 0x7f9e7c072c20 2023-10-26T06:42:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c19e3d0 con 0x7f9e7c072c20 2023-10-26T06:42:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e6c010430 con 0x7f9e7c072c20 2023-10-26T06:42:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.143+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c018680 con 0x7f9e7c072c20 2023-10-26T06:42:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.144+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c1a5c10 con 0x7f9e7c072c20 2023-10-26T06:42:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.144+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c108170 con 0x7f9e7c072c20 2023-10-26T06:42:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.147+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f9e6c0105a0 con 0x7f9e7c072c20 2023-10-26T06:42:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.148+0000 7f9e797fa700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9e640a15e0 0x7f9e640a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.148+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9e6c014070 con 0x7f9e7c072c20 2023-10-26T06:42:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.148+0000 7f9e7b7fe700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9e640a15e0 0x7f9e640a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.149+0000 7f9e7b7fe700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9e640a15e0 0x7f9e640a3aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c19a3f0 tx=0x7f9e7000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.150+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9e6c0967b0 con 0x7f9e7c072c20 2023-10-26T06:42:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:50 smithi125 ceph-mon[130643]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:50 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3448203887' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-26T06:42:51.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.361+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e7c19a1a0 con 0x7f9e7c072c20 2023-10-26T06:42:51.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.362+0000 7f9e797fa700 1 -- 172.21.15.50:0/172707707 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e6c026020 con 0x7f9e7c072c20 2023-10-26T06:42:51.364 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:42:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9e640a15e0 msgr2=0x7f9e640a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9e640a15e0 0x7f9e640a3aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c19a3f0 tx=0x7f9e7000b260 comp rx=0 tx=0).stop 2023-10-26T06:42:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 msgr2=0x7f9e7c198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 0x7f9e7c198ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00e9a0 tx=0x7f9e6c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 shutdown_connections 2023-10-26T06:42:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9e640a15e0 0x7f9e640a3aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e7c10cf60 0x7f9e7c19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e7c072c20 0x7f9e7c198ea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 --2- 172.21.15.50:0/172707707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e7c073540 0x7f9e7c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 >> 172.21.15.50:0/172707707 conn(0x7f9e7c0fc1b0 msgr2=0x7f9e7c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 shutdown_connections 2023-10-26T06:42:51.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.364+0000 7f9e825ff700 1 -- 172.21.15.50:0/172707707 wait complete. 2023-10-26T06:42:51.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:42:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 -- 172.21.15.50:0/1324090193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c100720 msgr2=0x7f032c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 --2- 172.21.15.50:0/1324090193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c100720 0x7f032c100ba0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0314009990 tx=0x7f0314009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 -- 172.21.15.50:0/1324090193 shutdown_connections 2023-10-26T06:42:51.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 --2- 172.21.15.50:0/1324090193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f032c1010e0 0x7f032c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 --2- 172.21.15.50:0/1324090193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f032c106730 0x7f032c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 --2- 172.21.15.50:0/1324090193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c100720 0x7f032c100ba0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 -- 172.21.15.50:0/1324090193 >> 172.21.15.50:0/1324090193 conn(0x7f032c0fc1b0 msgr2=0x7f032c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:51.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 -- 172.21.15.50:0/1324090193 shutdown_connections 2023-10-26T06:42:51.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.592+0000 7f0330dff700 1 -- 172.21.15.50:0/1324090193 wait complete. 2023-10-26T06:42:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.593+0000 7f0330dff700 1 Processor -- start 2023-10-26T06:42:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 -- start start 2023-10-26T06:42:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f032c100720 0x7f032c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 0x7f032c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f032c106730 0x7f032c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c1a4f50 con 0x7f032c1010e0 2023-10-26T06:42:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c1a50c0 con 0x7f032c100720 2023-10-26T06:42:51.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0330dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c1a5280 con 0x7f032c106730 2023-10-26T06:42:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0323fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 0x7f032c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0323fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 0x7f032c073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57436/0 (socket says 172.21.15.50:57436) 2023-10-26T06:42:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.594+0000 7f0323fff700 1 -- 172.21.15.50:0/828580984 learned_addr learned my addr 172.21.15.50:0/828580984 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f032a59c700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f032c100720 0x7f032c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f032ad9d700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f032c106730 0x7f032c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0323fff700 1 -- 172.21.15.50:0/828580984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f032c106730 msgr2=0x7f032c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0323fff700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f032c106730 0x7f032c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0323fff700 1 -- 172.21.15.50:0/828580984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f032c100720 msgr2=0x7f032c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0323fff700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f032c100720 0x7f032c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0323fff700 1 -- 172.21.15.50:0/828580984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03140095f0 con 0x7f032c1010e0 2023-10-26T06:42:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0323fff700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 0x7f032c073030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0314000c00 tx=0x7f0314005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031401d070 con 0x7f032c1010e0 2023-10-26T06:42:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0314022470 con 0x7f032c1010e0 2023-10-26T06:42:51.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f0330dff700 1 -- 172.21.15.50:0/828580984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c1a5500 con 0x7f032c1010e0 2023-10-26T06:42:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.595+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314017650 con 0x7f032c1010e0 2023-10-26T06:42:51.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.596+0000 7f0330dff700 1 -- 172.21.15.50:0/828580984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c1a5a30 con 0x7f032c1010e0 2023-10-26T06:42:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.597+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c101e60 con 0x7f032c1010e0 2023-10-26T06:42:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.599+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f03140225e0 con 0x7f032c1010e0 2023-10-26T06:42:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.601+0000 7f03237fe700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03180a15e0 0x7f03180a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:51.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.601+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f03140ce100 con 0x7f032c1010e0 2023-10-26T06:42:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.601+0000 7f032a59c700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03180a15e0 0x7f03180a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.602+0000 7f032a59c700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03180a15e0 0x7f03180a3aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f031c009be0 tx=0x7f031c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:51.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.604+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0314097740 con 0x7f032c1010e0 2023-10-26T06:42:51.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.819+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f032c0675a0 con 0x7f032c1010e0 2023-10-26T06:42:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.820+0000 7f03237fe700 1 -- 172.21.15.50:0/828580984 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0314027020 con 0x7f032c1010e0 2023-10-26T06:42:51.821 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:42:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03180a15e0 msgr2=0x7f03180a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03180a15e0 0x7f03180a3aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f031c009be0 tx=0x7f031c009260 comp rx=0 tx=0).stop 2023-10-26T06:42:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 msgr2=0x7f032c073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:51.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 0x7f032c073030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0314000c00 tx=0x7f0314005740 comp rx=0 tx=0).stop 2023-10-26T06:42:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 shutdown_connections 2023-10-26T06:42:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03180a15e0 0x7f03180a3aa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f032c106730 0x7f032c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f032c100720 0x7f032c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 --2- 172.21.15.50:0/828580984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f032c1010e0 0x7f032c073030 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:51.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 >> 172.21.15.50:0/828580984 conn(0x7f032c0fc1b0 msgr2=0x7f032c0fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 shutdown_connections 2023-10-26T06:42:51.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:51.822+0000 7f03217fa700 1 -- 172.21.15.50:0/828580984 wait complete. 2023-10-26T06:42:51.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:42:51.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:51 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2429804926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:51.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:51 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/172707707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:42:52.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:51 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2429804926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:52.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:51 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/172707707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:42:52.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 -- 172.21.15.50:0/1954102570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 msgr2=0x7f2a90106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 --2- 172.21.15.50:0/1954102570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a90106b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009990 tx=0x7f2a8c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 -- 172.21.15.50:0/1954102570 shutdown_connections 2023-10-26T06:42:52.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 --2- 172.21.15.50:0/1954102570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 0x7f2a9010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 --2- 172.21.15.50:0/1954102570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a90106b10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 --2- 172.21.15.50:0/1954102570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 -- 172.21.15.50:0/1954102570 >> 172.21.15.50:0/1954102570 conn(0x7f2a900fc1b0 msgr2=0x7f2a900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:52.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 -- 172.21.15.50:0/1954102570 shutdown_connections 2023-10-26T06:42:52.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.049+0000 7f2a975ff700 1 -- 172.21.15.50:0/1954102570 wait complete. 2023-10-26T06:42:52.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.050+0000 7f2a975ff700 1 Processor -- start 2023-10-26T06:42:52.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.050+0000 7f2a975ff700 1 -- start start 2023-10-26T06:42:52.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a975ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a975ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 0x7f2a90199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a975ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a9019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a975ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9019dc90 con 0x7f2a90106730 2023-10-26T06:42:52.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a975ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9019de00 con 0x7f2a901010e0 2023-10-26T06:42:52.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a975ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9019dfc0 con 0x7f2a90100720 2023-10-26T06:42:52.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a95b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a9019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:40102/0 (socket says 172.21.15.50:40102) 2023-10-26T06:42:52.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 -- 172.21.15.50:0/3688851249 learned_addr learned my addr 172.21.15.50:0/3688851249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:52.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a94b9a700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 0x7f2a90199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 -- 172.21.15.50:0/3688851249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 msgr2=0x7f2a90199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 0x7f2a90199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 -- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 msgr2=0x7f2a9019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.051+0000 7f2a9539b700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a9019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a9539b700 1 -- 172.21.15.50:0/3688851249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c0095f0 con 0x7f2a90100720 2023-10-26T06:42:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a95b9c700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a9019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a94b9a700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 0x7f2a90199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:52.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a9539b700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90198dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c000c00 tx=0x7f2a8c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c01d070 con 0x7f2a90100720 2023-10-26T06:42:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9019e240 con 0x7f2a90100720 2023-10-26T06:42:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a8c022470 con 0x7f2a90100720 2023-10-26T06:42:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c017650 con 0x7f2a90100720 2023-10-26T06:42:52.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.052+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a901a5ae0 con 0x7f2a90100720 2023-10-26T06:42:52.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.053+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a90101e60 con 0x7f2a90100720 2023-10-26T06:42:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.055+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f2a8c0225e0 con 0x7f2a90100720 2023-10-26T06:42:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.057+0000 7f2a867fc700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a7c0a1560 0x7f2a7c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.057+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2a8c0ce380 con 0x7f2a90100720 2023-10-26T06:42:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.057+0000 7f2a94b9a700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a7c0a1560 0x7f2a7c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.057+0000 7f2a94b9a700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a7c0a1560 0x7f2a7c0a3a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2a9019a2c0 tx=0x7f2a80009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.059+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2a8c097840 con 0x7f2a90100720 2023-10-26T06:42:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:51 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2429804926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:51 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/172707707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:42:52.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.272+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a9019a070 con 0x7f2a90100720 2023-10-26T06:42:52.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.273+0000 7f2a867fc700 1 -- 172.21.15.50:0/3688851249 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a8c09ae60 con 0x7f2a90100720 2023-10-26T06:42:52.274 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:42:52.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a7c0a1560 msgr2=0x7f2a7c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a7c0a1560 0x7f2a7c0a3a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2a9019a2c0 tx=0x7f2a80009260 comp rx=0 tx=0).stop 2023-10-26T06:42:52.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 msgr2=0x7f2a90198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90198dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c000c00 tx=0x7f2a8c005740 comp rx=0 tx=0).stop 2023-10-26T06:42:52.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 shutdown_connections 2023-10-26T06:42:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a7c0a1560 0x7f2a7c0a3a20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90106730 0x7f2a9019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a90100720 0x7f2a90198dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 --2- 172.21.15.50:0/3688851249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a901010e0 0x7f2a90199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 >> 172.21.15.50:0/3688851249 conn(0x7f2a900fc1b0 msgr2=0x7f2a900fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 shutdown_connections 2023-10-26T06:42:52.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.275+0000 7f2a975ff700 1 -- 172.21.15.50:0/3688851249 wait complete. 2023-10-26T06:42:52.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:42:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 -- 172.21.15.50:0/2487865878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 msgr2=0x7fabbc10c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 --2- 172.21.15.50:0/2487865878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 0x7fabbc10c9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009990 tx=0x7fabb0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 -- 172.21.15.50:0/2487865878 shutdown_connections 2023-10-26T06:42:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 --2- 172.21.15.50:0/2487865878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc10f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 --2- 172.21.15.50:0/2487865878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabbc072c20 0x7fabbc073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 --2- 172.21.15.50:0/2487865878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 0x7fabbc10c9a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 -- 172.21.15.50:0/2487865878 >> 172.21.15.50:0/2487865878 conn(0x7fabbc0fc170 msgr2=0x7fabbc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 -- 172.21.15.50:0/2487865878 shutdown_connections 2023-10-26T06:42:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.499+0000 7fabc23ff700 1 -- 172.21.15.50:0/2487865878 wait complete. 2023-10-26T06:42:52.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.500+0000 7fabc23ff700 1 Processor -- start 2023-10-26T06:42:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 -- start start 2023-10-26T06:42:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabbc072c20 0x7fabbc19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 0x7fabbc19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc199200 con 0x7fabbc10cee0 2023-10-26T06:42:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc199370 con 0x7fabbc072c20 2023-10-26T06:42:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc23ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc199530 con 0x7fabbc073540 2023-10-26T06:42:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.501+0000 7fabc099c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57482/0 (socket says 172.21.15.50:57482) 2023-10-26T06:42:52.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 -- 172.21.15.50:0/75123217 learned_addr learned my addr 172.21.15.50:0/75123217 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabbb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 0x7fabbc19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabbbfff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabbc072c20 0x7fabbc19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 -- 172.21.15.50:0/75123217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 msgr2=0x7fabbc19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 0x7fabbc19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 -- 172.21.15.50:0/75123217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabbc072c20 msgr2=0x7fabbc19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabbc072c20 0x7fabbc19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 -- 172.21.15.50:0/75123217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00095f0 con 0x7fabbc10cee0 2023-10-26T06:42:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc099c700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc198ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fabb400ef30 tx=0x7fabb400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4018070 con 0x7fabbc10cee0 2023-10-26T06:42:52.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabb400f040 con 0x7fabbc10cee0 2023-10-26T06:42:52.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc1997b0 con 0x7fabbc10cee0 2023-10-26T06:42:52.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.502+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400cd00 con 0x7fabbc10cee0 2023-10-26T06:42:52.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.503+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc1a5a60 con 0x7fabbc10cee0 2023-10-26T06:42:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.504+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc1080f0 con 0x7fabbc10cee0 2023-10-26T06:42:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.506+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fabb4003a00 con 0x7fabbc10cee0 2023-10-26T06:42:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.508+0000 7fabb97fa700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7faba40a1560 0x7faba40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.508+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fabb40cca80 con 0x7fabbc10cee0 2023-10-26T06:42:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.508+0000 7fabbbfff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7faba40a1560 0x7faba40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:52.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.509+0000 7fabbbfff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7faba40a1560 0x7faba40a3a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fabac009c60 tx=0x7fabac009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.512+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fabb4095f40 con 0x7fabbc10cee0 2023-10-26T06:42:52.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.772+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabbc0742d0 con 0x7fabbc10cee0 2023-10-26T06:42:52.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.772+0000 7fabb97fa700 1 -- 172.21.15.50:0/75123217 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7fabb4099560 con 0x7fabbc10cee0 2023-10-26T06:42:52.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:52.774 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:42:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7faba40a1560 msgr2=0x7faba40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7faba40a1560 0x7faba40a3a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fabac009c60 tx=0x7fabac009260 comp rx=0 tx=0).stop 2023-10-26T06:42:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 msgr2=0x7fabbc198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc198ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fabb400ef30 tx=0x7fabb400c3a0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 shutdown_connections 2023-10-26T06:42:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7faba40a1560 0x7faba40a3a20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabbc10cee0 0x7fabbc198ba0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabbc072c20 0x7fabbc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 --2- 172.21.15.50:0/75123217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabbc073540 0x7fabbc19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 >> 172.21.15.50:0/75123217 conn(0x7fabbc0fc170 msgr2=0x7fabbc0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 shutdown_connections 2023-10-26T06:42:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.775+0000 7fabc23ff700 1 -- 172.21.15.50:0/75123217 wait complete. 2023-10-26T06:42:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:42:52.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:42:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:52 smithi153 ceph-mon[131657]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:52 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/828580984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:42:52.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:52 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3688851249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:42:53.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 -- 172.21.15.50:0/4106320338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0201066b0 msgr2=0x7fc020106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 --2- 172.21.15.50:0/4106320338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0201066b0 0x7fc020106a90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009990 tx=0x7fc01c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 -- 172.21.15.50:0/4106320338 shutdown_connections 2023-10-26T06:42:53.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 --2- 172.21.15.50:0/4106320338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc020101060 0x7fc02010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 --2- 172.21.15.50:0/4106320338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0201066b0 0x7fc020106a90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 --2- 172.21.15.50:0/4106320338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 0x7fc020100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 -- 172.21.15.50:0/4106320338 >> 172.21.15.50:0/4106320338 conn(0x7fc0200fc170 msgr2=0x7fc0200fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:53.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 -- 172.21.15.50:0/4106320338 shutdown_connections 2023-10-26T06:42:53.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:52.999+0000 7fc027fff700 1 -- 172.21.15.50:0/4106320338 wait complete. 2023-10-26T06:42:53.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.000+0000 7fc027fff700 1 Processor -- start 2023-10-26T06:42:53.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 -- start start 2023-10-26T06:42:53.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 0x7fc020198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 0x7fc020199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0201066b0 0x7fc02019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02019cb50 con 0x7fc020101060 2023-10-26T06:42:53.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02019ccc0 con 0x7fc0201006a0 2023-10-26T06:42:53.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc027fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02019ce80 con 0x7fc0201066b0 2023-10-26T06:42:53.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc02559a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 0x7fc020199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc025d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 0x7fc020198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc02559a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 0x7fc020199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57502/0 (socket says 172.21.15.50:57502) 2023-10-26T06:42:53.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc02559a700 1 -- 172.21.15.50:0/17365535 learned_addr learned my addr 172.21.15.50:0/17365535 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:53.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.001+0000 7fc02659c700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0201066b0 0x7fc02019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc025d9b700 1 -- 172.21.15.50:0/17365535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0201066b0 msgr2=0x7fc02019c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc025d9b700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0201066b0 0x7fc02019c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc025d9b700 1 -- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 msgr2=0x7fc020199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc025d9b700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 0x7fc020199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc025d9b700 1 -- 172.21.15.50:0/17365535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018009c40 con 0x7fc0201006a0 2023-10-26T06:42:53.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc02559a700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 0x7fc020199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:53.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc025d9b700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 0x7fc020198d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0098e0 tx=0x7fc01c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:53.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c01d070 con 0x7fc0201006a0 2023-10-26T06:42:53.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c0095f0 con 0x7fc0201006a0 2023-10-26T06:42:53.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc01c022470 con 0x7fc0201006a0 2023-10-26T06:42:53.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0201a58e0 con 0x7fc0201006a0 2023-10-26T06:42:53.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.002+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c017650 con 0x7fc0201006a0 2023-10-26T06:42:53.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.003+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc020101de0 con 0x7fc0201006a0 2023-10-26T06:42:53.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.005+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fc01c0225e0 con 0x7fc0201006a0 2023-10-26T06:42:53.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.007+0000 7fc016ffd700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc00c0a15e0 0x7fc00c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.007+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc01c0cdf80 con 0x7fc0201006a0 2023-10-26T06:42:53.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.007+0000 7fc02559a700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc00c0a15e0 0x7fc00c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.007+0000 7fc02559a700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc00c0a15e0 0x7fc00c0a3aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc02019a230 tx=0x7fc010009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:53.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.009+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc01c097440 con 0x7fc0201006a0 2023-10-26T06:42:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:52 smithi050 ceph-mon[94997]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:52 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/828580984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:42:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:52 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3688851249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:42:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:52 smithi125 ceph-mon[130643]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:53.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:52 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/828580984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:42:53.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:52 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3688851249' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:42:53.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.224+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc020067530 con 0x7fc0201006a0 2023-10-26T06:42:53.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.226+0000 7fc016ffd700 1 -- 172.21.15.50:0/17365535 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7fc01c027090 con 0x7fc0201006a0 2023-10-26T06:42:53.228 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:42:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc00c0a15e0 msgr2=0x7fc00c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc00c0a15e0 0x7fc00c0a3aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc02019a230 tx=0x7fc010009260 comp rx=0 tx=0).stop 2023-10-26T06:42:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 msgr2=0x7fc020198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 0x7fc020198d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0098e0 tx=0x7fc01c005740 comp rx=0 tx=0).stop 2023-10-26T06:42:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 shutdown_connections 2023-10-26T06:42:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc00c0a15e0 0x7fc00c0a3aa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0201066b0 0x7fc02019c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc0201006a0 0x7fc020198d20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 --2- 172.21.15.50:0/17365535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc020101060 0x7fc020199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 >> 172.21.15.50:0/17365535 conn(0x7fc0200fc170 msgr2=0x7fc02010bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 shutdown_connections 2023-10-26T06:42:53.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.229+0000 7fc027fff700 1 -- 172.21.15.50:0/17365535 wait complete. 2023-10-26T06:42:53.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:42:53.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:42:53.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 -- 172.21.15.50:0/2671659755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c1010d0 msgr2=0x7fe96c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 --2- 172.21.15.50:0/2671659755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c1010d0 0x7fe96c10d5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b0a0 tx=0x7fe96400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 -- 172.21.15.50:0/2671659755 shutdown_connections 2023-10-26T06:42:53.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 --2- 172.21.15.50:0/2671659755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c1010d0 0x7fe96c10d5e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 --2- 172.21.15.50:0/2671659755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe96c106720 0x7fe96c106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 --2- 172.21.15.50:0/2671659755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c100710 0x7fe96c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 -- 172.21.15.50:0/2671659755 >> 172.21.15.50:0/2671659755 conn(0x7fe96c0fc200 msgr2=0x7fe96c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 -- 172.21.15.50:0/2671659755 shutdown_connections 2023-10-26T06:42:53.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.457+0000 7fe9717ff700 1 -- 172.21.15.50:0/2671659755 wait complete. 2023-10-26T06:42:53.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.458+0000 7fe9717ff700 1 Processor -- start 2023-10-26T06:42:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.458+0000 7fe9717ff700 1 -- start start 2023-10-26T06:42:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe9717ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 0x7fe96c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe9717ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe96c1010d0 0x7fe96c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe9717ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c106720 0x7fe96c19c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe9717ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c19cb30 con 0x7fe96c100710 2023-10-26T06:42:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe9717ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c19cca0 con 0x7fe96c106720 2023-10-26T06:42:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe9717ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c19ce60 con 0x7fe96c1010d0 2023-10-26T06:42:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe96affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 0x7fe96c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe96affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 0x7fe96c198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57520/0 (socket says 172.21.15.50:57520) 2023-10-26T06:42:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe96affd700 1 -- 172.21.15.50:0/3822562624 learned_addr learned my addr 172.21.15.50:0/3822562624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe96c1010d0 0x7fe96c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.459+0000 7fe96b7fe700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c106720 0x7fe96c19c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96affd700 1 -- 172.21.15.50:0/3822562624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe96c1010d0 msgr2=0x7fe96c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96affd700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe96c1010d0 0x7fe96c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96affd700 1 -- 172.21.15.50:0/3822562624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c106720 msgr2=0x7fe96c19c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96affd700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c106720 0x7fe96c19c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96affd700 1 -- 172.21.15.50:0/3822562624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009d00 con 0x7fe96c100710 2023-10-26T06:42:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96b7fe700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c106720 0x7fe96c19c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:42:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe96affd700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 0x7fe96c198d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e9a0 tx=0x7fe95c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:53.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c009790 con 0x7fe96c100710 2023-10-26T06:42:53.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe95c00cbd0 con 0x7fe96c100710 2023-10-26T06:42:53.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c018680 con 0x7fe96c100710 2023-10-26T06:42:53.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c19d140 con 0x7fe96c100710 2023-10-26T06:42:53.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.460+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c1a5aa0 con 0x7fe96c100710 2023-10-26T06:42:53.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.461+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c101e50 con 0x7fe96c100710 2023-10-26T06:42:53.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.463+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fe95c00cd40 con 0x7fe96c100710 2023-10-26T06:42:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.465+0000 7fe953fff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9540a15e0 0x7fe9540a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.465+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe95c014070 con 0x7fe96c100710 2023-10-26T06:42:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.465+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9540a15e0 0x7fe9540a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.465+0000 7fe96a7fc700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9540a15e0 0x7fe9540a3aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe96c19a210 tx=0x7fe960009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:53.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.469+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe95c052100 con 0x7fe96c100710 2023-10-26T06:42:53.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.680+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe96c1106e0 con 0x7fe96c100710 2023-10-26T06:42:53.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.680+0000 7fe953fff700 1 -- 172.21.15.50:0/3822562624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe95c096560 con 0x7fe96c100710 2023-10-26T06:42:53.682 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:42:53.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9540a15e0 msgr2=0x7fe9540a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9540a15e0 0x7fe9540a3aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe96c19a210 tx=0x7fe960009260 comp rx=0 tx=0).stop 2023-10-26T06:42:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 msgr2=0x7fe96c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 0x7fe96c198d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e9a0 tx=0x7fe95c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 shutdown_connections 2023-10-26T06:42:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9540a15e0 0x7fe9540a3aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe96c106720 0x7fe96c19c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe96c100710 0x7fe96c198d00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 --2- 172.21.15.50:0/3822562624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe96c1010d0 0x7fe96c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.682+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 >> 172.21.15.50:0/3822562624 conn(0x7fe96c0fc200 msgr2=0x7fe96c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.683+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 shutdown_connections 2023-10-26T06:42:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.683+0000 7fe9717ff700 1 -- 172.21.15.50:0/3822562624 wait complete. 2023-10-26T06:42:53.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:42:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 -- 172.21.15.50:0/769449318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978100720 msgr2=0x7f8978100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 --2- 172.21.15.50:0/769449318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978100720 0x7f8978100ba0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8968009990 tx=0x7f8968009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 -- 172.21.15.50:0/769449318 shutdown_connections 2023-10-26T06:42:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 --2- 172.21.15.50:0/769449318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89781010e0 0x7f897810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 --2- 172.21.15.50:0/769449318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8978106730 0x7f8978106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 --2- 172.21.15.50:0/769449318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978100720 0x7f8978100ba0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 -- 172.21.15.50:0/769449318 >> 172.21.15.50:0/769449318 conn(0x7f89780fc1b0 msgr2=0x7f89780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 -- 172.21.15.50:0/769449318 shutdown_connections 2023-10-26T06:42:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.911+0000 7f89801ff700 1 -- 172.21.15.50:0/769449318 wait complete. 2023-10-26T06:42:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.912+0000 7f89801ff700 1 Processor -- start 2023-10-26T06:42:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.912+0000 7f89801ff700 1 -- start start 2023-10-26T06:42:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.912+0000 7f89801ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8978100720 0x7f8978198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f89801ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89781010e0 0x7f89781992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f89801ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 0x7f897819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f89801ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897819dcc0 con 0x7f8978106730 2023-10-26T06:42:53.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f89801ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897819de30 con 0x7f8978100720 2023-10-26T06:42:53.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f89801ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897819dff0 con 0x7f89781010e0 2023-10-26T06:42:53.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 0x7f897819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 0x7f897819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41042/0 (socket says 172.21.15.50:41042) 2023-10-26T06:42:53.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 -- 172.21.15.50:0/3234236538 learned_addr learned my addr 172.21.15.50:0/3234236538 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:53.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897df9b700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8978100720 0x7f8978198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897d79a700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89781010e0 0x7f89781992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 -- 172.21.15.50:0/3234236538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89781010e0 msgr2=0x7f89781992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89781010e0 0x7f89781992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 -- 172.21.15.50:0/3234236538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8978100720 msgr2=0x7f8978198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:53.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8978100720 0x7f8978198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:53.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 -- 172.21.15.50:0/3234236538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89680095f0 con 0x7f8978106730 2023-10-26T06:42:53.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.913+0000 7f897e79c700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 0x7f897819d680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8970007ee0 tx=0x7f897000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:53.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.914+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000dd20 con 0x7f8978106730 2023-10-26T06:42:53.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.914+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f897000f040 con 0x7f8978106730 2023-10-26T06:42:53.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.914+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700048a0 con 0x7f8978106730 2023-10-26T06:42:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.914+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897819e2d0 con 0x7f8978106730 2023-10-26T06:42:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.914+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89781a5b10 con 0x7f8978106730 2023-10-26T06:42:53.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.915+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8978101e60 con 0x7f8978106730 2023-10-26T06:42:53.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.917+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f8970003a00 con 0x7f8978106730 2023-10-26T06:42:53.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.918+0000 7f896effd700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f89640a15e0 0x7f89640a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:53.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.918+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f89700cc7b0 con 0x7f8978106730 2023-10-26T06:42:53.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.918+0000 7f897df9b700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f89640a15e0 0x7f89640a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:53.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.919+0000 7f897df9b700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f89640a15e0 0x7f89640a3aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8974005950 tx=0x7f897400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:53.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:53.922+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f897004f100 con 0x7f8978106730 2023-10-26T06:42:53.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:53 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/75123217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:53.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:53 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/17365535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:53.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:53 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3822562624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:42:54.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:53 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/75123217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:54.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:53 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/17365535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:54.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:53 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3822562624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:42:54.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.134+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8978110690 con 0x7f8978106730 2023-10-26T06:42:54.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.134+0000 7f896effd700 1 -- 172.21.15.50:0/3234236538 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8970095be0 con 0x7f8978106730 2023-10-26T06:42:54.136 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:42:54.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f89640a15e0 msgr2=0x7f89640a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f89640a15e0 0x7f89640a3aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8974005950 tx=0x7f897400b410 comp rx=0 tx=0).stop 2023-10-26T06:42:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 msgr2=0x7f897819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 0x7f897819d680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8970007ee0 tx=0x7f897000d3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 shutdown_connections 2023-10-26T06:42:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f89640a15e0 0x7f89640a3aa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8978106730 0x7f897819d680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8978100720 0x7f8978198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 --2- 172.21.15.50:0/3234236538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89781010e0 0x7f89781992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 >> 172.21.15.50:0/3234236538 conn(0x7f89780fc1b0 msgr2=0x7f89780fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 shutdown_connections 2023-10-26T06:42:54.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.137+0000 7f89801ff700 1 -- 172.21.15.50:0/3234236538 wait complete. 2023-10-26T06:42:54.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:42:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:53 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/75123217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:53 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/17365535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:53 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3822562624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:42:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.363+0000 7fde1b9ff700 1 -- 172.21.15.50:0/1027305426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde14100720 msgr2=0x7fde14100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.363+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/1027305426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde14100720 0x7fde14100ba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde04009990 tx=0x7fde04009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 -- 172.21.15.50:0/1027305426 shutdown_connections 2023-10-26T06:42:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/1027305426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde141010e0 0x7fde1410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/1027305426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde14106730 0x7fde14106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/1027305426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde14100720 0x7fde14100ba0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 -- 172.21.15.50:0/1027305426 >> 172.21.15.50:0/1027305426 conn(0x7fde140fc1b0 msgr2=0x7fde140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 -- 172.21.15.50:0/1027305426 shutdown_connections 2023-10-26T06:42:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.364+0000 7fde1b9ff700 1 -- 172.21.15.50:0/1027305426 wait complete. 2023-10-26T06:42:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 Processor -- start 2023-10-26T06:42:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 -- start start 2023-10-26T06:42:54.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde14100720 0x7fde14198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 0x7fde141992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde14106730 0x7fde1419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1419dcb0 con 0x7fde141010e0 2023-10-26T06:42:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1419de20 con 0x7fde14100720 2023-10-26T06:42:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde1b9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1419dfe0 con 0x7fde14106730 2023-10-26T06:42:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde18f9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 0x7fde141992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde18f9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 0x7fde141992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41064/0 (socket says 172.21.15.50:41064) 2023-10-26T06:42:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde18f9a700 1 -- 172.21.15.50:0/2397018266 learned_addr learned my addr 172.21.15.50:0/2397018266 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.365+0000 7fde19f9c700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde14106730 0x7fde1419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde1979b700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde14100720 0x7fde14198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde18f9a700 1 -- 172.21.15.50:0/2397018266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde14106730 msgr2=0x7fde1419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde18f9a700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde14106730 0x7fde1419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde18f9a700 1 -- 172.21.15.50:0/2397018266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde14100720 msgr2=0x7fde14198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde18f9a700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde14100720 0x7fde14198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde18f9a700 1 -- 172.21.15.50:0/2397018266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040095f0 con 0x7fde141010e0 2023-10-26T06:42:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde18f9a700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 0x7fde141992d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde04005910 tx=0x7fde04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0401d070 con 0x7fde141010e0 2023-10-26T06:42:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde04022470 con 0x7fde141010e0 2023-10-26T06:42:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04017650 con 0x7fde141010e0 2023-10-26T06:42:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.366+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1419e260 con 0x7fde141010e0 2023-10-26T06:42:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.367+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde141a5b00 con 0x7fde141010e0 2023-10-26T06:42:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.368+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde14101e60 con 0x7fde141010e0 2023-10-26T06:42:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.370+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fde040225e0 con 0x7fde141010e0 2023-10-26T06:42:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.371+0000 7fde0a7fc700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fde000a15e0 0x7fde000a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.371+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fde040ce120 con 0x7fde141010e0 2023-10-26T06:42:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.371+0000 7fde1979b700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fde000a15e0 0x7fde000a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.372+0000 7fde1979b700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fde000a15e0 0x7fde000a3aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fde10009be0 tx=0x7fde10009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.375+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fde04097760 con 0x7fde141010e0 2023-10-26T06:42:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.587+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde14110690 con 0x7fde141010e0 2023-10-26T06:42:54.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.588+0000 7fde0a7fc700 1 -- 172.21.15.50:0/2397018266 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde040270a0 con 0x7fde141010e0 2023-10-26T06:42:54.590 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:42:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fde000a15e0 msgr2=0x7fde000a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fde000a15e0 0x7fde000a3aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fde10009be0 tx=0x7fde10009260 comp rx=0 tx=0).stop 2023-10-26T06:42:54.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 msgr2=0x7fde141992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 0x7fde141992d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde04005910 tx=0x7fde04004730 comp rx=0 tx=0).stop 2023-10-26T06:42:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 shutdown_connections 2023-10-26T06:42:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fde000a15e0 0x7fde000a3aa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde14106730 0x7fde1419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde14100720 0x7fde14198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.590+0000 7fde1b9ff700 1 --2- 172.21.15.50:0/2397018266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde141010e0 0x7fde141992d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.591+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 >> 172.21.15.50:0/2397018266 conn(0x7fde140fc1b0 msgr2=0x7fde1410bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.591+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 shutdown_connections 2023-10-26T06:42:54.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.591+0000 7fde1b9ff700 1 -- 172.21.15.50:0/2397018266 wait complete. 2023-10-26T06:42:54.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:42:54.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 -- 172.21.15.50:0/3705815966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 msgr2=0x7fabac10d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 --2- 172.21.15.50:0/3705815966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac10d570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faba400b0a0 tx=0x7faba400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 -- 172.21.15.50:0/3705815966 shutdown_connections 2023-10-26T06:42:54.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 --2- 172.21.15.50:0/3705815966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac10d570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 --2- 172.21.15.50:0/3705815966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1066b0 0x7fabac106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 --2- 172.21.15.50:0/3705815966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac1006a0 0x7fabac100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 -- 172.21.15.50:0/3705815966 >> 172.21.15.50:0/3705815966 conn(0x7fabac0fc170 msgr2=0x7fabac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:54.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 -- 172.21.15.50:0/3705815966 shutdown_connections 2023-10-26T06:42:54.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.817+0000 7fabb3dff700 1 -- 172.21.15.50:0/3705815966 wait complete. 2023-10-26T06:42:54.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.818+0000 7fabb3dff700 1 Processor -- start 2023-10-26T06:42:54.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.818+0000 7fabb3dff700 1 -- start start 2023-10-26T06:42:54.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb3dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1006a0 0x7fabac19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb3dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb3dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac1066b0 0x7fabac1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb3dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac197070 con 0x7fabac101060 2023-10-26T06:42:54.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb3dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac1971e0 con 0x7fabac1006a0 2023-10-26T06:42:54.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb3dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac1973a0 con 0x7fabac1066b0 2023-10-26T06:42:54.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb139a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb1b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1006a0 0x7fabac19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb139a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41082/0 (socket says 172.21.15.50:41082) 2023-10-26T06:42:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb139a700 1 -- 172.21.15.50:0/4214451715 learned_addr learned my addr 172.21.15.50:0/4214451715 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.819+0000 7fabb239c700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac1066b0 0x7fabac1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb139a700 1 -- 172.21.15.50:0/4214451715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac1066b0 msgr2=0x7fabac1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb139a700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac1066b0 0x7fabac1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb139a700 1 -- 172.21.15.50:0/4214451715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1006a0 msgr2=0x7fabac19c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:54.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb139a700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1006a0 0x7fabac19c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:54.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb139a700 1 -- 172.21.15.50:0/4214451715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009d00 con 0x7fabac101060 2023-10-26T06:42:54.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb1b9b700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1006a0 0x7fabac19c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:54.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb139a700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac19cd40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00d950 tx=0x7fab9c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:54.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00f890 con 0x7fabac101060 2023-10-26T06:42:54.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab9c010460 con 0x7fabac101060 2023-10-26T06:42:54.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac197680 con 0x7fabac101060 2023-10-26T06:42:54.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00e610 con 0x7fabac101060 2023-10-26T06:42:54.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.820+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac1a37d0 con 0x7fabac101060 2023-10-26T06:42:54.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.821+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac108cc0 con 0x7fabac101060 2023-10-26T06:42:54.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.824+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fab9c0108d0 con 0x7fabac101060 2023-10-26T06:42:54.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.825+0000 7faba2ffd700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fab980a15e0 0x7fab980a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:54.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.825+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fab9c0ccc20 con 0x7fabac101060 2023-10-26T06:42:54.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.825+0000 7fabb1b9b700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fab980a15e0 0x7fab980a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:54.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.826+0000 7fabb1b9b700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fab980a15e0 0x7fab980a3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faba8009fd0 tx=0x7faba8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:54.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:54.827+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fab9c0960b0 con 0x7fabac101060 2023-10-26T06:42:54.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:54 smithi153 ceph-mon[131657]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:54.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:54 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3234236538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:42:54.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:54 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2397018266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:42:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:54 smithi050 ceph-mon[94997]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:54 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3234236538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:42:55.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:54 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2397018266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:42:55.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.089+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabac197d80 con 0x7fabac101060 2023-10-26T06:42:55.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.090+0000 7faba2ffd700 1 -- 172.21.15.50:0/4214451715 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7fab9c020090 con 0x7fabac101060 2023-10-26T06:42:55.091 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:55.092 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:42:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fab980a15e0 msgr2=0x7fab980a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fab980a15e0 0x7fab980a3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faba8009fd0 tx=0x7faba8009260 comp rx=0 tx=0).stop 2023-10-26T06:42:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 msgr2=0x7fabac19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac19cd40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00d950 tx=0x7fab9c00dc60 comp rx=0 tx=0).stop 2023-10-26T06:42:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 shutdown_connections 2023-10-26T06:42:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fab980a15e0 0x7fab980a3aa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabac1066b0 0x7fabac1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabac1006a0 0x7fabac19c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 --2- 172.21.15.50:0/4214451715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fabac101060 0x7fabac19cd40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 >> 172.21.15.50:0/4214451715 conn(0x7fabac0fc170 msgr2=0x7fabac0fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 shutdown_connections 2023-10-26T06:42:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.092+0000 7fabb3dff700 1 -- 172.21.15.50:0/4214451715 wait complete. 2023-10-26T06:42:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:42:55.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:42:55.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:54 smithi125 ceph-mon[130643]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:42:55.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:54 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3234236538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:42:55.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:54 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2397018266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:42:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/3648377162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9410cee0 msgr2=0x7f3e9410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/3648377162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9410cee0 0x7f3e9410f350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00b0a0 tx=0x7f3e8c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/3648377162 shutdown_connections 2023-10-26T06:42:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/3648377162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e9410cee0 0x7f3e9410f350 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/3648377162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e94072c20 0x7f3e94073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/3648377162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e94073540 0x7f3e9410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/3648377162 >> 172.21.15.50:0/3648377162 conn(0x7f3e940fc170 msgr2=0x7f3e940fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.315+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/3648377162 shutdown_connections 2023-10-26T06:42:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.316+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/3648377162 wait complete. 2023-10-26T06:42:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.316+0000 7f3e9b9ff700 1 Processor -- start 2023-10-26T06:42:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 -- start start 2023-10-26T06:42:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e94072c20 0x7f3e94198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 0x7f3e941993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e9410cee0 0x7f3e9419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419dd40 con 0x7f3e94073540 2023-10-26T06:42:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419deb0 con 0x7f3e9410cee0 2023-10-26T06:42:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9b9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9419e070 con 0x7f3e94072c20 2023-10-26T06:42:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e98f9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 0x7f3e941993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e98f9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 0x7f3e941993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41100/0 (socket says 172.21.15.50:41100) 2023-10-26T06:42:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e98f9a700 1 -- 172.21.15.50:0/866587879 learned_addr learned my addr 172.21.15.50:0/866587879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e9979b700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e94072c20 0x7f3e94198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.317+0000 7f3e99f9c700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e9410cee0 0x7f3e9419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e98f9a700 1 -- 172.21.15.50:0/866587879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e94072c20 msgr2=0x7f3e94198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e98f9a700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e94072c20 0x7f3e94198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e98f9a700 1 -- 172.21.15.50:0/866587879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e9410cee0 msgr2=0x7f3e9419d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e98f9a700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e9410cee0 0x7f3e9419d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e98f9a700 1 -- 172.21.15.50:0/866587879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c009d00 con 0x7f3e94073540 2023-10-26T06:42:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e99f9c700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e9410cee0 0x7f3e9419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e98f9a700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 0x7f3e941993b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e9a0 tx=0x7f3e8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84009790 con 0x7f3e94073540 2023-10-26T06:42:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e84010430 con 0x7f3e94073540 2023-10-26T06:42:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9419e350 con 0x7f3e94073540 2023-10-26T06:42:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84018680 con 0x7f3e94073540 2023-10-26T06:42:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.318+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e941a5b90 con 0x7f3e94073540 2023-10-26T06:42:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.319+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e941080f0 con 0x7f3e94073540 2023-10-26T06:42:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.321+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f3e840105a0 con 0x7f3e94073540 2023-10-26T06:42:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.323+0000 7f3e8a7fc700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3e800a1560 0x7f3e800a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.323+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3e84014070 con 0x7f3e94073540 2023-10-26T06:42:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.323+0000 7f3e9979b700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3e800a1560 0x7f3e800a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.323+0000 7f3e9979b700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3e800a1560 0x7f3e800a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009c60 tx=0x7f3e90009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.326+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e84052100 con 0x7f3e94073540 2023-10-26T06:42:55.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.542+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e940742d0 con 0x7f3e94073540 2023-10-26T06:42:55.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.543+0000 7f3e8a7fc700 1 -- 172.21.15.50:0/866587879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7f3e84096540 con 0x7f3e94073540 2023-10-26T06:42:55.545 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:55.546 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:42:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3e800a1560 msgr2=0x7f3e800a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3e800a1560 0x7f3e800a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009c60 tx=0x7f3e90009260 comp rx=0 tx=0).stop 2023-10-26T06:42:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 msgr2=0x7f3e941993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 0x7f3e941993b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e9a0 tx=0x7f3e8400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 shutdown_connections 2023-10-26T06:42:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3e800a1560 0x7f3e800a3a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e9410cee0 0x7f3e9419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e94072c20 0x7f3e94198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 --2- 172.21.15.50:0/866587879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e94073540 0x7f3e941993b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 >> 172.21.15.50:0/866587879 conn(0x7f3e940fc170 msgr2=0x7f3e940fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 shutdown_connections 2023-10-26T06:42:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.546+0000 7f3e9b9ff700 1 -- 172.21.15.50:0/866587879 wait complete. 2023-10-26T06:42:55.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:42:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/3618574803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd81066c0 msgr2=0x7f0cd8106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/3618574803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd81066c0 0x7f0cd8106aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009990 tx=0x7f0cc8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/3618574803 shutdown_connections 2023-10-26T06:42:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/3618574803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd810d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/3618574803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd81066c0 0x7f0cd8106aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/3618574803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd8106fe0 0x7f0cd8067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/3618574803 >> 172.21.15.50:0/3618574803 conn(0x7f0cd8076400 msgr2=0x7f0cd8076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/3618574803 shutdown_connections 2023-10-26T06:42:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.772+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/3618574803 wait complete. 2023-10-26T06:42:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.773+0000 7f0cdc9ff700 1 Processor -- start 2023-10-26T06:42:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.773+0000 7f0cdc9ff700 1 -- start start 2023-10-26T06:42:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cdc9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cdc9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd81066c0 0x7f0cd81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cdc9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd8106fe0 0x7f0cd819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cdc9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd819dcc0 con 0x7f0cd8106fe0 2023-10-26T06:42:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cdc9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd819de30 con 0x7f0cd8067fa0 2023-10-26T06:42:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cdc9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd819dff0 con 0x7f0cd81066c0 2023-10-26T06:42:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd8198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44998/0 (socket says 172.21.15.50:44998) 2023-10-26T06:42:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 -- 172.21.15.50:0/2798503745 learned_addr learned my addr 172.21.15.50:0/2798503745 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd6d9d700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd8106fe0 0x7f0cd819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd5d9b700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd81066c0 0x7f0cd81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 -- 172.21.15.50:0/2798503745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd81066c0 msgr2=0x7f0cd81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd81066c0 0x7f0cd81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 -- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd8106fe0 msgr2=0x7f0cd819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:55.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd8106fe0 0x7f0cd819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.774+0000 7f0cd659c700 1 -- 172.21.15.50:0/2798503745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80095f0 con 0x7f0cd8067fa0 2023-10-26T06:42:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.775+0000 7f0cd659c700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd8198da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005910 tx=0x7f0cc8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.775+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc801d070 con 0x7f0cd8067fa0 2023-10-26T06:42:55.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.775+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd819e270 con 0x7f0cd8067fa0 2023-10-26T06:42:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.775+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cc8022470 con 0x7f0cd8067fa0 2023-10-26T06:42:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.775+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8017650 con 0x7f0cd8067fa0 2023-10-26T06:42:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.775+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd81a5b10 con 0x7f0cd8067fa0 2023-10-26T06:42:55.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.776+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd8101de0 con 0x7f0cd8067fa0 2023-10-26T06:42:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.778+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f0cc80225e0 con 0x7f0cd8067fa0 2023-10-26T06:42:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.779+0000 7f0cc77fe700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0cc00a1560 0x7f0cc00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:55.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.779+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0cc80ce1b0 con 0x7f0cd8067fa0 2023-10-26T06:42:55.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.780+0000 7f0cd5d9b700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0cc00a1560 0x7f0cc00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:55.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.780+0000 7f0cd5d9b700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0cc00a1560 0x7f0cc00a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cd819a2f0 tx=0x7f0ccc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:55.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:55.782+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0cc8097670 con 0x7f0cd8067fa0 2023-10-26T06:42:55.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:55 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4214451715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:55.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:55 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/866587879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:56.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:55 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4214451715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:56.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:55 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/866587879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:56.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.045+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cd8067530 con 0x7f0cd8067fa0 2023-10-26T06:42:56.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.046+0000 7f0cc77fe700 1 -- 172.21.15.50:0/2798503745 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7f0cc809ac90 con 0x7f0cd8067fa0 2023-10-26T06:42:56.047 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:42:56.048 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:42:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0cc00a1560 msgr2=0x7f0cc00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0cc00a1560 0x7f0cc00a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cd819a2f0 tx=0x7f0ccc009260 comp rx=0 tx=0).stop 2023-10-26T06:42:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 msgr2=0x7f0cd8198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd8198da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005910 tx=0x7f0cc8004730 comp rx=0 tx=0).stop 2023-10-26T06:42:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 shutdown_connections 2023-10-26T06:42:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0cc00a1560 0x7f0cc00a3a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd8106fe0 0x7f0cd819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cd8067fa0 0x7f0cd8198da0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 --2- 172.21.15.50:0/2798503745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cd81066c0 0x7f0cd81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 >> 172.21.15.50:0/2798503745 conn(0x7f0cd8076400 msgr2=0x7f0cd810b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 shutdown_connections 2023-10-26T06:42:56.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.048+0000 7f0cdc9ff700 1 -- 172.21.15.50:0/2798503745 wait complete. 2023-10-26T06:42:56.053 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:42:56.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-26T06:41:30.489106+0000', 'modified': '2023-10-26T06:41:35.994192+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24740, 'mds_1': 24709, 'mds_2': 24694}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24665': {'gid': 24665, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.125:6835/3214904167', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6834', 'nonce': 3214904167}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 3214904167}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24682': {'gid': 24682, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/2747210301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 2747210301}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 2747210301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24692': {'gid': 24692, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.125:6837/2652114750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6836', 'nonce': 2652114750}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 2652114750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24694': {'gid': 24694, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.153:6837/3558298736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 3558298736}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 3558298736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24709': {'gid': 24709, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.153:6839/1756575060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1756575060}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1756575060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24740': {'gid': 24740, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6839/1086282741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6838', 'nonce': 1086282741}, {'type': 'v1', 'addr': '172.21.15.125:6839', 'nonce': 1086282741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-26T06:42:56.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-26T06:42:56.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-26T06:42:56.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:55 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4214451715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:56.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:55 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/866587879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:42:56.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 -- 172.21.15.50:0/217701454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01006a0 msgr2=0x7f09e0100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 --2- 172.21.15.50:0/217701454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01006a0 0x7f09e0100b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09d40098f0 tx=0x7f09d4009c00 comp rx=0 tx=0).stop 2023-10-26T06:42:56.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 -- 172.21.15.50:0/217701454 shutdown_connections 2023-10-26T06:42:56.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 --2- 172.21.15.50:0/217701454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e0101060 0x7f09e010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 --2- 172.21.15.50:0/217701454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e01066b0 0x7f09e0106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 --2- 172.21.15.50:0/217701454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01006a0 0x7f09e0100b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 -- 172.21.15.50:0/217701454 >> 172.21.15.50:0/217701454 conn(0x7f09e00fc170 msgr2=0x7f09e00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 -- 172.21.15.50:0/217701454 shutdown_connections 2023-10-26T06:42:56.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.276+0000 7f09e5bff700 1 -- 172.21.15.50:0/217701454 wait complete. 2023-10-26T06:42:56.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.277+0000 7f09e5bff700 1 Processor -- start 2023-10-26T06:42:56.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.277+0000 7f09e5bff700 1 -- start start 2023-10-26T06:42:56.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.277+0000 7f09e5bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e01006a0 0x7f09e0198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.277+0000 7f09e5bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 0x7f09e01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09e5bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01066b0 0x7f09e019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09e5bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e019dcb0 con 0x7f09e0101060 2023-10-26T06:42:56.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09e5bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e019de20 con 0x7f09e01066b0 2023-10-26T06:42:56.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09e5bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e019dfe0 con 0x7f09e01006a0 2023-10-26T06:42:56.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 0x7f09e01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 0x7f09e01992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41128/0 (socket says 172.21.15.50:41128) 2023-10-26T06:42:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 -- 172.21.15.50:0/1103743455 learned_addr learned my addr 172.21.15.50:0/1103743455 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09dffff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01066b0 0x7f09e019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e01006a0 0x7f09e0198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 -- 172.21.15.50:0/1103743455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e01006a0 msgr2=0x7f09e0198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e01006a0 0x7f09e0198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 -- 172.21.15.50:0/1103743455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01066b0 msgr2=0x7f09e019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01066b0 0x7f09e019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 -- 172.21.15.50:0/1103743455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009520 con 0x7f09e0101060 2023-10-26T06:42:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.278+0000 7f09deffd700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 0x7f09e01992d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09d4005950 tx=0x7f09d400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.279+0000 7f09dcff9700 1 -- 172.21.15.50:0/1103743455 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d401c070 con 0x7f09e0101060 2023-10-26T06:42:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.279+0000 7f09dcff9700 1 -- 172.21.15.50:0/1103743455 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09d400bb20 con 0x7f09e0101060 2023-10-26T06:42:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.279+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e019e260 con 0x7f09e0101060 2023-10-26T06:42:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.279+0000 7f09dcff9700 1 -- 172.21.15.50:0/1103743455 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40038e0 con 0x7f09e0101060 2023-10-26T06:42:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.279+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e01a5b00 con 0x7f09e0101060 2023-10-26T06:42:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.282+0000 7f09dcff9700 1 -- 172.21.15.50:0/1103743455 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f09d4020030 con 0x7f09e0101060 2023-10-26T06:42:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.283+0000 7f09f95bcb80 1 Processor -- start 2023-10-26T06:42:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.283+0000 7f09f95bcb80 1 -- start start 2023-10-26T06:42:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09dcff9700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f09c80a15e0 0x7f09c80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ec0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ebb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418e2e690 con 0x55a418ec0b90 2023-10-26T06:42:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418e14c10 con 0x55a418ebb580 2023-10-26T06:42:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418e12530 con 0x55a418ec14b0 2023-10-26T06:42:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09dffff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f09c80a15e0 0x7f09c80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ec0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09dcff9700 1 -- 172.21.15.50:0/1103743455 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f09d40cdd80 con 0x7f09e0101060 2023-10-26T06:42:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ec0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41140/0 (socket says 172.21.15.50:41140) 2023-10-26T06:42:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09df7fe700 1 -- 172.21.15.50:0/1636941800 learned_addr learned my addr 172.21.15.50:0/1636941800 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09dffff700 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09deffd700 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ebb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09deffd700 1 -- 172.21.15.50:0/1636941800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 msgr2=0x55a418ebba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09deffd700 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09deffd700 1 -- 172.21.15.50:0/1636941800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 msgr2=0x55a418ec0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09deffd700 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ec0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09deffd700 1 -- 172.21.15.50:0/1636941800 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a418dcb3a0 con 0x55a418ec14b0 2023-10-26T06:42:56.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.284+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ec0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.285+0000 7f09deffd700 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ebb040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cb660 tx=0x7f09d4005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13eb7c27429a7001 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.285+0000 7f09dffff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f09c80a15e0 0x7f09c80a3aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ec0 tx=0x7f09d80134a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.285+0000 7f09c5ffb700 1 -- 172.21.15.50:0/1636941800 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d409b600 con 0x55a418ec14b0 2023-10-26T06:42:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.285+0000 7f09c5ffb700 1 -- 172.21.15.50:0/1636941800 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09d409af00 con 0x55a418ec14b0 2023-10-26T06:42:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.285+0000 7f09c5ffb700 1 -- 172.21.15.50:0/1636941800 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40cb8b0 con 0x55a418ec14b0 2023-10-26T06:42:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1636941800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 msgr2=0x55a418ebb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ebb040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cb660 tx=0x7f09d4005040 comp rx=0 tx=0).stop 2023-10-26T06:42:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1636941800 shutdown_connections 2023-10-26T06:42:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ec0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1636941800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ebb040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1636941800 >> 172.21.15.50:0/1636941800 conn(0x55a418e2f6d0 msgr2=0x55a418eb5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1636941800 shutdown_connections 2023-10-26T06:42:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1636941800 wait complete. 2023-10-26T06:42:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.286+0000 7f09f95bcb80 1 -- start start 2023-10-26T06:42:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 Processor -- start 2023-10-26T06:42:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ec7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec0b90 0x55a418ec4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec14b0 0x55a418ec4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418e0de20 con 0x55a418ec14b0 2023-10-26T06:42:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418daa6c0 con 0x55a418ebb580 2023-10-26T06:42:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418daa360 con 0x55a418ec0b90 2023-10-26T06:42:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09f95bcb80 10 client.0 _ll_register_callbacks cb 0x55a418cf4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:42:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ec7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ec7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45038/0 (socket says 172.21.15.50:45038) 2023-10-26T06:42:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec14b0 0x55a418ec4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09df7fe700 1 -- 172.21.15.50:0/1567800535 learned_addr learned my addr 172.21.15.50:0/1567800535 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.287+0000 7f09deffd700 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec0b90 0x55a418ec4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09df7fe700 1 -- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec0b90 msgr2=0x55a418ec4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec0b90 0x55a418ec4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09df7fe700 1 -- 172.21.15.50:0/1567800535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec14b0 msgr2=0x55a418ec4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec14b0 0x55a418ec4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09df7fe700 1 -- 172.21.15.50:0/1567800535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d00098c0 con 0x55a418ebb580 2023-10-26T06:42:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ec7360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09d00092b0 tx=0x7f09d0012c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd075333e3b4b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09beffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:42:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09beffd700 1 -- 172.21.15.50:0/1567800535 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0017070 con 0x55a418ebb580 2023-10-26T06:42:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a418e12ea0 con 0x55a418ebb580 2023-10-26T06:42:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09beffd700 1 -- 172.21.15.50:0/1567800535 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f09d0004260 con 0x55a418ebb580 2023-10-26T06:42:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.288+0000 7f09beffd700 1 -- 172.21.15.50:0/1567800535 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d0004420 con 0x55a418ebb580 2023-10-26T06:42:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 10 client.25166 fetch_fsmap learned FSMap version 23 2023-10-26T06:42:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f09e01a5b00 con 0x55a418ebb580 2023-10-26T06:42:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09beffd700 1 -- 172.21.15.50:0/1567800535 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a418e12ea0 con 0x55a418ebb580 2023-10-26T06:42:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09beffd700 1 -- 172.21.15.50:0/1567800535 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09d0024020 con 0x55a418ebb580 2023-10-26T06:42:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 10 client.25166 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:42:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 10 client.25166 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-26T06:42:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 20 client.25166 populate_metadata read hostname 'smithi050' 2023-10-26T06:42:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418ed4b40 0x55a418ed3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 4 client.25166 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:42:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.289+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a418e8a860 con 0x55a418ed4b40 2023-10-26T06:42:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.290+0000 7f09deffd700 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418ed4b40 0x55a418ed3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.290+0000 7f09deffd700 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418ed4b40 0x55a418ed3630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a4ffa379828f240f server_cookie=c09f1aef18c96c28 in_seq=0 out_seq=0 2023-10-26T06:42:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.290+0000 7f09beffd700 10 client.25166 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:42:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09beffd700 1 -- 172.21.15.50:0/1567800535 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a418e8a860 con 0x55a418ed4b40 2023-10-26T06:42:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09beffd700 10 client.25166 handle_command_reply: tid=0 2023-10-26T06:42:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 client.25166 shutdown 2023-10-26T06:42:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 msgr2=0x55a418ec7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ec7360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09d00092b0 tx=0x7f09d0012c30 comp rx=0 tx=0).stop 2023-10-26T06:42:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 shutdown_connections 2023-10-26T06:42:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418ed4b40 0x55a418ed3630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec14b0 0x55a418ec4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09beffd700 0 client.25166 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:42:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ec7360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1567800535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec0b90 0x55a418ec4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 >> 172.21.15.50:0/1567800535 conn(0x55a418e2f6d0 msgr2=0x55a418eb5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 shutdown_connections 2023-10-26T06:42:56.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.291+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1567800535 wait complete. 2023-10-26T06:42:56.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.292+0000 7f09f95bcb80 20 client.25166 trim_cache size 0 max 16384 2023-10-26T06:42:56.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 Processor -- start 2023-10-26T06:42:56.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 -- start start 2023-10-26T06:42:56.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ebb580 0x55a418ebb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ed3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ec14b0 0x55a418edd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418c8e8d0 con 0x55a418ec0b90 2023-10-26T06:42:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418e12ea0 con 0x55a418ec14b0 2023-10-26T06:42:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418eb2150 con 0x55a418ebb580 2023-10-26T06:42:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09deffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ed3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09deffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ed3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41158/0 (socket says 172.21.15.50:41158) 2023-10-26T06:42:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09deffd700 1 -- 172.21.15.50:0/2403902876 learned_addr learned my addr 172.21.15.50:0/2403902876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09df7fe700 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ebb580 0x55a418ebb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.310+0000 7f09dffff700 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ec14b0 0x55a418edd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09deffd700 1 -- 172.21.15.50:0/2403902876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ebb580 msgr2=0x55a418ebb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09deffd700 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ebb580 0x55a418ebb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09deffd700 1 -- 172.21.15.50:0/2403902876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ec14b0 msgr2=0x55a418edd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09deffd700 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ec14b0 0x55a418edd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09deffd700 1 -- 172.21.15.50:0/2403902876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a418c38d90 con 0x55a418ec0b90 2023-10-26T06:42:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09df7fe700 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ebb580 0x55a418ebb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09deffd700 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ed3d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009fd0 tx=0x7f09d400bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c025ad02d26fe18 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09c67fc700 1 -- 172.21.15.50:0/2403902876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d409f050 con 0x55a418ec0b90 2023-10-26T06:42:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09c67fc700 1 -- 172.21.15.50:0/2403902876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09d40a10b0 con 0x55a418ec0b90 2023-10-26T06:42:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.311+0000 7f09c67fc700 1 -- 172.21.15.50:0/2403902876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40051d0 con 0x55a418ec0b90 2023-10-26T06:42:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 -- 172.21.15.50:0/2403902876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 msgr2=0x55a418ed3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ed3d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009fd0 tx=0x7f09d400bc90 comp rx=0 tx=0).stop 2023-10-26T06:42:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 -- 172.21.15.50:0/2403902876 shutdown_connections 2023-10-26T06:42:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ec14b0 0x55a418edd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ebb580 0x55a418ebb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/2403902876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ed3d40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 -- 172.21.15.50:0/2403902876 >> 172.21.15.50:0/2403902876 conn(0x55a418e2f6d0 msgr2=0x55a418ed3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 -- 172.21.15.50:0/2403902876 shutdown_connections 2023-10-26T06:42:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 -- 172.21.15.50:0/2403902876 wait complete. 2023-10-26T06:42:56.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.312+0000 7f09f95bcb80 1 -- start start 2023-10-26T06:42:56.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 Processor -- start 2023-10-26T06:42:56.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ebdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ecfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418edd760 con 0x55a418ec0b90 2023-10-26T06:42:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418edd8a0 con 0x55a418ebb580 2023-10-26T06:42:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418edda60 con 0x55a418ec14b0 2023-10-26T06:42:56.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.313+0000 7f09f95bcb80 10 client.0 _ll_register_callbacks cb 0x55a418cf4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:42:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09deffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ebdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45054/0 (socket says 172.21.15.50:45054) 2023-10-26T06:42:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09deffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ebdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41170/0 (socket says 172.21.15.50:41170) 2023-10-26T06:42:56.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 -- 172.21.15.50:0/1742612503 learned_addr learned my addr 172.21.15.50:0/1742612503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09dffff700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ecfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 -- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 msgr2=0x55a418ecfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ecfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 -- 172.21.15.50:0/1742612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 msgr2=0x55a418ebdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ebdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 -- 172.21.15.50:0/1742612503 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e01a5b00 con 0x55a418ebb580 2023-10-26T06:42:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09deffd700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ebdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09df7fe700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebd5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09d0011ed0 tx=0x7f09d0011870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d59c21d6a489b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09beffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:42:56.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.314+0000 7f09beffd700 1 -- 172.21.15.50:0/1742612503 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0017040 con 0x55a418ebb580 2023-10-26T06:42:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09d409af00 con 0x55a418ebb580 2023-10-26T06:42:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09beffd700 1 -- 172.21.15.50:0/1742612503 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f09d00055b0 con 0x55a418ebb580 2023-10-26T06:42:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09beffd700 1 -- 172.21.15.50:0/1742612503 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d0003680 con 0x55a418ebb580 2023-10-26T06:42:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 10 client.25172 fetch_fsmap learned FSMap version 23 2023-10-26T06:42:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a418dcb3a0 con 0x55a418ebb580 2023-10-26T06:42:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09beffd700 1 -- 172.21.15.50:0/1742612503 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09d003e020 con 0x55a418ebb580 2023-10-26T06:42:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09beffd700 1 -- 172.21.15.50:0/1742612503 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f09d0024050 con 0x55a418ebb580 2023-10-26T06:42:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 10 client.25172 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:42:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 10 client.25172 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-26T06:42:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 20 client.25172 populate_metadata read hostname 'smithi050' 2023-10-26T06:42:56.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418f2dc10 0x55a418f2a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 4 client.25172 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-26T06:42:56.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.315+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a418e06e00 con 0x55a418f2dc10 2023-10-26T06:42:56.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.316+0000 7f09deffd700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418f2dc10 0x55a418f2a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.316+0000 7f09deffd700 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418f2dc10 0x55a418f2a540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54b0a861e13c2fcc server_cookie=2f184a0f0aebc90 in_seq=0 out_seq=0 2023-10-26T06:42:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.316+0000 7f09beffd700 10 client.25172 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:42:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09beffd700 1 -- 172.21.15.50:0/1742612503 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a418e06e00 con 0x55a418f2dc10 2023-10-26T06:42:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09beffd700 10 client.25172 handle_command_reply: tid=0 2023-10-26T06:42:56.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 client.25172 shutdown 2023-10-26T06:42:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 msgr2=0x55a418ebd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebd5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09d0011ed0 tx=0x7f09d0011870 comp rx=0 tx=0).stop 2023-10-26T06:42:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 shutdown_connections 2023-10-26T06:42:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55a418f2dc10 0x55a418f2a540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a418ec14b0 0x55a418ecfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a418ebb580 0x55a418ebd5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 --2- 172.21.15.50:0/1742612503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a418ec0b90 0x55a418ebdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09beffd700 0 client.25172 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:42:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 >> 172.21.15.50:0/1742612503 conn(0x55a418e2f6d0 msgr2=0x55a418eaf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 shutdown_connections 2023-10-26T06:42:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 1 -- 172.21.15.50:0/1742612503 wait complete. 2023-10-26T06:42:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.317+0000 7f09f95bcb80 20 client.25172 trim_cache size 0 max 16384 2023-10-26T06:42:56.334 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:42:56.335 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:42:56.335 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2023-10-26T06:42:56.335 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24694, 2023-10-26T06:42:56.335 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-26T06:42:56.335 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-26T06:42:56.336 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-26T06:42:56.336 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 81.331855927999996, 2023-10-26T06:42:56.336 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-10-26T06:42:56.336 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 86, 2023-10-26T06:42:56.336 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 84, 2023-10-26T06:42:56.337 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 105.314283129 2023-10-26T06:42:56.337 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:42:56.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f09c80a15e0 msgr2=0x7f09c80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f09c80a15e0 0x7f09c80a3aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ec0 tx=0x7f09d80134a0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 msgr2=0x7f09e01992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 0x7f09e01992d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09d4005950 tx=0x7f09d400fa00 comp rx=0 tx=0).stop 2023-10-26T06:42:56.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 shutdown_connections 2023-10-26T06:42:56.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f09c80a15e0 0x7f09c80a3aa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09e01066b0 0x7f09e019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e01006a0 0x7f09e0198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 --2- 172.21.15.50:0/1103743455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09e0101060 0x7f09e01992d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 >> 172.21.15.50:0/1103743455 conn(0x7f09e00fc170 msgr2=0x7f09e010be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 shutdown_connections 2023-10-26T06:42:56.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.318+0000 7f09e5bff700 1 -- 172.21.15.50:0/1103743455 wait complete. 2023-10-26T06:42:56.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-26T06:42:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 -- 172.21.15.50:0/4085236864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 msgr2=0x7f3ae4100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/4085236864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae4100ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009990 tx=0x7f3acc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 -- 172.21.15.50:0/4085236864 shutdown_connections 2023-10-26T06:42:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/4085236864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/4085236864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 0x7f3ae4106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/4085236864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae4100ab0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 -- 172.21.15.50:0/4085236864 >> 172.21.15.50:0/4085236864 conn(0x7f3ae40fc120 msgr2=0x7f3ae40fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 -- 172.21.15.50:0/4085236864 shutdown_connections 2023-10-26T06:42:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.545+0000 7f3ae9bff700 1 -- 172.21.15.50:0/4085236864 wait complete. 2023-10-26T06:42:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 Processor -- start 2023-10-26T06:42:56.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 -- start start 2023-10-26T06:42:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 0x7f3ae4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4199110 con 0x7f3ae4100630 2023-10-26T06:42:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4199280 con 0x7f3ae4100ff0 2023-10-26T06:42:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae9bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4199440 con 0x7f3ae4106640 2023-10-26T06:42:56.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.546+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae419eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45074/0 (socket says 172.21.15.50:45074) 2023-10-26T06:42:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae419e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41200/0 (socket says 172.21.15.50:41200) 2023-10-26T06:42:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 -- 172.21.15.50:0/3862213430 learned_addr learned my addr 172.21.15.50:0/3862213430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 0x7f3ae4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 -- 172.21.15.50:0/3862213430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 msgr2=0x7f3ae4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 0x7f3ae4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 -- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 msgr2=0x7f3ae419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 -- 172.21.15.50:0/3862213430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0095f0 con 0x7f3ae4100ff0 2023-10-26T06:42:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 0x7f3ae4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.547+0000 7f3adbfff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae419eec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3acc005910 tx=0x7f3acc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.548+0000 7f3ae17fa700 1 -- 172.21.15.50:0/3862213430 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc01d070 con 0x7f3ae4100ff0 2023-10-26T06:42:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.548+0000 7f3ae17fa700 1 -- 172.21.15.50:0/3862213430 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3acc022470 con 0x7f3ae4100ff0 2023-10-26T06:42:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.548+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae41996c0 con 0x7f3ae4100ff0 2023-10-26T06:42:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.548+0000 7f3ae17fa700 1 -- 172.21.15.50:0/3862213430 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc017650 con 0x7f3ae4100ff0 2023-10-26T06:42:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.548+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae41a5970 con 0x7f3ae4100ff0 2023-10-26T06:42:56.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.551+0000 7f3ae17fa700 1 -- 172.21.15.50:0/3862213430 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f3acc0225e0 con 0x7f3ae4100ff0 2023-10-26T06:42:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.552+0000 7f3afd590b80 1 Processor -- start 2023-10-26T06:42:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 -- start start 2023-10-26T06:42:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e08927690 con 0x556e089b4580 2023-10-26T06:42:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0890dc10 con 0x556e089ba4b0 2023-10-26T06:42:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3afd590b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0890b530 con 0x556e089b9b90 2023-10-26T06:42:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.553+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089b9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57466/0 (socket says 172.21.15.50:57466) 2023-10-26T06:42:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3ae3fff700 1 -- 172.21.15.50:0/1940705379 learned_addr learned my addr 172.21.15.50:0/1940705379 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3ae17fa700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ad00a1560 0x7f3ad00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3ae17fa700 1 -- 172.21.15.50:0/3862213430 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3acc0ce1d0 con 0x7f3ae4100ff0 2023-10-26T06:42:56.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ad00a1560 0x7f3ad00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3adbfff700 1 -- 172.21.15.50:0/1940705379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 msgr2=0x556e089b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3adbfff700 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3adbfff700 1 -- 172.21.15.50:0/1940705379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 msgr2=0x556e089b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3adbfff700 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3adbfff700 1 -- 172.21.15.50:0/1940705379 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e088c43a0 con 0x556e089b4580 2023-10-26T06:42:56.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.554+0000 7f3adbfff700 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089b4a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0cbab0 tx=0x7f3acc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8af222d8129b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ad00a1560 0x7f3ad00a3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3adc003fd0 tx=0x7f3adc004b40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3ad9ffb700 1 -- 172.21.15.50:0/1940705379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc09b240 con 0x556e089b4580 2023-10-26T06:42:56.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3ad9ffb700 1 -- 172.21.15.50:0/1940705379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3acc09afb0 con 0x556e089b4580 2023-10-26T06:42:56.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3ad9ffb700 1 -- 172.21.15.50:0/1940705379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0a3800 con 0x556e089b4580 2023-10-26T06:42:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 -- 172.21.15.50:0/1940705379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 msgr2=0x556e089b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089b4a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0cbab0 tx=0x7f3acc009310 comp rx=0 tx=0).stop 2023-10-26T06:42:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 -- 172.21.15.50:0/1940705379 shutdown_connections 2023-10-26T06:42:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089b4a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 --2- 172.21.15.50:0/1940705379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 -- 172.21.15.50:0/1940705379 >> 172.21.15.50:0/1940705379 conn(0x556e089286d0 msgr2=0x556e089aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 -- 172.21.15.50:0/1940705379 shutdown_connections 2023-10-26T06:42:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.555+0000 7f3afd590b80 1 -- 172.21.15.50:0/1940705379 wait complete. 2023-10-26T06:42:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.556+0000 7f3afd590b80 1 -- start start 2023-10-26T06:42:56.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.556+0000 7f3afd590b80 1 Processor -- start 2023-10-26T06:42:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b9b90 0x556e089bd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089ba4b0 0x556e089bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e08906e20 con 0x556e089b4580 2023-10-26T06:42:56.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e088a36c0 con 0x556e089b9b90 2023-10-26T06:42:56.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e088a3360 con 0x556e089ba4b0 2023-10-26T06:42:56.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3afd590b80 10 client.0 _ll_register_callbacks cb 0x556e087eda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:42:56.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089c03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41220/0 (socket says 172.21.15.50:41220) 2023-10-26T06:42:56.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 -- 172.21.15.50:0/4070967186 learned_addr learned my addr 172.21.15.50:0/4070967186 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b9b90 0x556e089bd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089ba4b0 0x556e089bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 -- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089ba4b0 msgr2=0x556e089bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089ba4b0 0x556e089bdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 -- 172.21.15.50:0/4070967186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b9b90 msgr2=0x556e089bd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b9b90 0x556e089bd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 -- 172.21.15.50:0/4070967186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae41a5970 con 0x556e089b4580 2023-10-26T06:42:56.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089ba4b0 0x556e089bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:42:56.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b9b90 0x556e089bd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089c03c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4012d00 tx=0x7f3ad400f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84fee20adf98962 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.557+0000 7f3ac2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:42:56.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4070967186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4017070 con 0x556e089b4580 2023-10-26T06:42:56.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4070967186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3ad400fc30 con 0x556e089b4580 2023-10-26T06:42:56.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e0890bea0 con 0x556e089b4580 2023-10-26T06:42:56.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4070967186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ad400fe30 con 0x556e089b4580 2023-10-26T06:42:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3afd590b80 10 client.15180 fetch_fsmap learned FSMap version 23 2023-10-26T06:42:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556e08731d90 con 0x556e089b4580 2023-10-26T06:42:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4070967186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e0890bea0 con 0x556e089b4580 2023-10-26T06:42:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.558+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4070967186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3ad4024020 con 0x556e089b4580 2023-10-26T06:42:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3afd590b80 10 client.15180 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:42:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3afd590b80 10 client.15180 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-26T06:42:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3afd590b80 20 client.15180 populate_metadata read hostname 'smithi050' 2023-10-26T06:42:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e089cdb80 0x556e089cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3afd590b80 4 client.15180 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:42:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e08983860 con 0x556e089cdb80 2023-10-26T06:42:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.559+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e089cdb80 0x556e089cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.560+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e089cdb80 0x556e089cc630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20d9f0b2852b9018 server_cookie=4b15f57270f3de37 in_seq=0 out_seq=0 2023-10-26T06:42:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.560+0000 7f3ac2ffd700 10 client.15180 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:42:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.560+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4070967186 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e08983860 con 0x556e089cdb80 2023-10-26T06:42:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.560+0000 7f3ac2ffd700 10 client.15180 handle_command_reply: tid=0 2023-10-26T06:42:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 client.15180 shutdown 2023-10-26T06:42:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 msgr2=0x556e089c03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089c03c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4012d00 tx=0x7f3ad400f6a0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 shutdown_connections 2023-10-26T06:42:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089ba4b0 0x556e089bdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b4580 0x556e089c03c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e089cdb80 0x556e089cc630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4070967186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b9b90 0x556e089bd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3ac2ffd700 0 client.15180 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:42:56.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 >> 172.21.15.50:0/4070967186 conn(0x556e089286d0 msgr2=0x556e089b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 shutdown_connections 2023-10-26T06:42:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 1 -- 172.21.15.50:0/4070967186 wait complete. 2023-10-26T06:42:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.561+0000 7f3afd590b80 20 client.15180 trim_cache size 0 max 16384 2023-10-26T06:42:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.579+0000 7f3afd590b80 1 Processor -- start 2023-10-26T06:42:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 -- start start 2023-10-26T06:42:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b4580 0x556e089c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 0x556e089bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e087878d0 con 0x556e089ba4b0 2023-10-26T06:42:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e08902f10 con 0x556e089b4580 2023-10-26T06:42:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3afd590b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e088ad4d0 con 0x556e089b9b90 2023-10-26T06:42:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 0x556e089bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 0x556e089bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2023-10-26T06:42:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 -- 172.21.15.50:0/334307151 learned_addr learned my addr 172.21.15.50:0/334307151 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b4580 0x556e089c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3adbfff700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 -- 172.21.15.50:0/334307151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 msgr2=0x556e089ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 -- 172.21.15.50:0/334307151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b4580 msgr2=0x556e089c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.580+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b4580 0x556e089c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3ae3fff700 1 -- 172.21.15.50:0/334307151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e0871ac10 con 0x556e089ba4b0 2023-10-26T06:42:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3adbfff700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:42:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b4580 0x556e089c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 0x556e089bc040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009210 tx=0x7f3adc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f436b81099ba6c server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3ada7fc700 1 -- 172.21.15.50:0/334307151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc007700 con 0x556e089ba4b0 2023-10-26T06:42:56.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3ada7fc700 1 -- 172.21.15.50:0/334307151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3adc00f040 con 0x556e089ba4b0 2023-10-26T06:42:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.581+0000 7f3ada7fc700 1 -- 172.21.15.50:0/334307151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc01ab00 con 0x556e089ba4b0 2023-10-26T06:42:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 -- 172.21.15.50:0/334307151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 msgr2=0x556e089bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 0x556e089bc040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009210 tx=0x7f3adc009920 comp rx=0 tx=0).stop 2023-10-26T06:42:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 -- 172.21.15.50:0/334307151 shutdown_connections 2023-10-26T06:42:56.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089ba4b0 0x556e089bc040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089b4580 0x556e089c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 --2- 172.21.15.50:0/334307151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b9b90 0x556e089ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 -- 172.21.15.50:0/334307151 >> 172.21.15.50:0/334307151 conn(0x556e089286d0 msgr2=0x556e089b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 -- 172.21.15.50:0/334307151 shutdown_connections 2023-10-26T06:42:56.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 -- 172.21.15.50:0/334307151 wait complete. 2023-10-26T06:42:56.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 -- start start 2023-10-26T06:42:56.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.582+0000 7f3afd590b80 1 Processor -- start 2023-10-26T06:42:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b4580 0x556e089b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 0x556e089b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e089d6900 con 0x556e089b9b90 2023-10-26T06:42:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e089d6a70 con 0x556e089ba4b0 2023-10-26T06:42:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e08a215c0 con 0x556e089b4580 2023-10-26T06:42:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3afd590b80 10 client.0 _ll_register_callbacks cb 0x556e087eda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:42:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 0x556e089b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b4580 0x556e089b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 0x556e089b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41240/0 (socket says 172.21.15.50:41240) 2023-10-26T06:42:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 -- 172.21.15.50:0/4267920609 learned_addr learned my addr 172.21.15.50:0/4267920609 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3ae3fff700 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 -- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b4580 msgr2=0x556e089b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b4580 0x556e089b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 -- 172.21.15.50:0/4267920609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 msgr2=0x556e089b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.583+0000 7f3adbfff700 1 -- 172.21.15.50:0/4267920609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e08731d90 con 0x556e089b9b90 2023-10-26T06:42:56.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3adbfff700 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 0x556e089b8da0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3acc006010 tx=0x7f3acc0971b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea35640505a40d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3ac2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:42:56.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4267920609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0b3ea0 con 0x556e089b9b90 2023-10-26T06:42:56.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4267920609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3acc09bb70 con 0x556e089b9b90 2023-10-26T06:42:56.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3acc09afb0 con 0x556e089b9b90 2023-10-26T06:42:56.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4267920609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3acc0d1770 con 0x556e089b9b90 2023-10-26T06:42:56.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3afd590b80 10 client.15186 fetch_fsmap learned FSMap version 23 2023-10-26T06:42:56.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f3adc0048c0 con 0x556e089b9b90 2023-10-26T06:42:56.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4267920609 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3acc09afb0 con 0x556e089b9b90 2023-10-26T06:42:56.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.584+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4267920609 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3acc09a960 con 0x556e089b9b90 2023-10-26T06:42:56.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3afd590b80 10 client.15186 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:42:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3afd590b80 10 client.15186 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-26T06:42:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3afd590b80 20 client.15186 populate_metadata read hostname 'smithi050' 2023-10-26T06:42:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e08a26500 0x556e08a229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3afd590b80 4 client.15186 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-26T06:42:56.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e088ffe00 con 0x556e08a26500 2023-10-26T06:42:56.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e08a26500 0x556e08a229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3ae37fe700 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e08a26500 0x556e08a229a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59e5b1c7865fdcfa server_cookie=c58b0c9bc1a89291 in_seq=0 out_seq=0 2023-10-26T06:42:56.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.585+0000 7f3ac2ffd700 10 client.15186 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:42:56.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3ac2ffd700 1 -- 172.21.15.50:0/4267920609 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x556e088ffe00 con 0x556e08a26500 2023-10-26T06:42:56.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3ac2ffd700 10 client.15186 handle_command_reply: tid=0 2023-10-26T06:42:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 client.15186 shutdown 2023-10-26T06:42:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 msgr2=0x556e089b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 0x556e089b8da0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3acc006010 tx=0x7f3acc0971b0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 shutdown_connections 2023-10-26T06:42:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556e08a26500 0x556e08a229a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556e089ba4b0 0x556e089b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e089b4580 0x556e089b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 --2- 172.21.15.50:0/4267920609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e089b9b90 0x556e089b8da0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 >> 172.21.15.50:0/4267920609 conn(0x556e089286d0 msgr2=0x556e089ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3ac2ffd700 0 client.15186 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:42:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 shutdown_connections 2023-10-26T06:42:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 1 -- 172.21.15.50:0/4267920609 wait complete. 2023-10-26T06:42:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.586+0000 7f3afd590b80 20 client.15186 trim_cache size 0 max 16384 2023-10-26T06:42:56.604 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:42:56.604 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:42:56.604 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2023-10-26T06:42:56.604 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24709, 2023-10-26T06:42:56.605 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-26T06:42:56.605 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-26T06:42:56.605 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-26T06:42:56.605 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 82.604603302000001, 2023-10-26T06:42:56.605 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-10-26T06:42:56.606 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 86, 2023-10-26T06:42:56.606 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 84, 2023-10-26T06:42:56.606 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 100.934625092 2023-10-26T06:42:56.606 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:42:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ad00a1560 msgr2=0x7f3ad00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ad00a1560 0x7f3ad00a3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3adc003fd0 tx=0x7f3adc004b40 comp rx=0 tx=0).stop 2023-10-26T06:42:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 msgr2=0x7f3ae419eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae419eec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3acc005910 tx=0x7f3acc004730 comp rx=0 tx=0).stop 2023-10-26T06:42:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 shutdown_connections 2023-10-26T06:42:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3ad00a1560 0x7f3ad00a3a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ae4106640 0x7f3ae4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ae4100630 0x7f3ae419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 --2- 172.21.15.50:0/3862213430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ae4100ff0 0x7f3ae419eec0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 >> 172.21.15.50:0/3862213430 conn(0x7f3ae40fc120 msgr2=0x7f3ae410d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 shutdown_connections 2023-10-26T06:42:56.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.587+0000 7f3ae9bff700 1 -- 172.21.15.50:0/3862213430 wait complete. 2023-10-26T06:42:56.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-26T06:42:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 -- 172.21.15.50:0/20065922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd578073540 msgr2=0x7fd57810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 --2- 172.21.15.50:0/20065922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd578073540 0x7fd57810c9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0098f0 tx=0x7fd56c009c00 comp rx=0 tx=0).stop 2023-10-26T06:42:56.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 -- 172.21.15.50:0/20065922 shutdown_connections 2023-10-26T06:42:56.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 --2- 172.21.15.50:0/20065922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57810cee0 0x7fd57810f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 --2- 172.21.15.50:0/20065922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd578072c20 0x7fd578073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 --2- 172.21.15.50:0/20065922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd578073540 0x7fd57810c9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 -- 172.21.15.50:0/20065922 >> 172.21.15.50:0/20065922 conn(0x7fd5780fc170 msgr2=0x7fd5780fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 -- 172.21.15.50:0/20065922 shutdown_connections 2023-10-26T06:42:56.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.815+0000 7fd57ddff700 1 -- 172.21.15.50:0/20065922 wait complete. 2023-10-26T06:42:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 Processor -- start 2023-10-26T06:42:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 -- start start 2023-10-26T06:42:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 0x7fd578198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd578073540 0x7fd578199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd57810cee0 0x7fd57819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57819dd10 con 0x7fd578072c20 2023-10-26T06:42:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57819de80 con 0x7fd57810cee0 2023-10-26T06:42:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.816+0000 7fd57ddff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57819e040 con 0x7fd578073540 2023-10-26T06:42:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 0x7fd578198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd577fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd57810cee0 0x7fd57819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 0x7fd578198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41254/0 (socket says 172.21.15.50:41254) 2023-10-26T06:42:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 -- 172.21.15.50:0/1460125237 learned_addr learned my addr 172.21.15.50:0/1460125237 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd576ffd700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd578073540 0x7fd578199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 -- 172.21.15.50:0/1460125237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd578073540 msgr2=0x7fd578199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd578073540 0x7fd578199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 -- 172.21.15.50:0/1460125237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd57810cee0 msgr2=0x7fd57819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd57810cee0 0x7fd57819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 -- 172.21.15.50:0/1460125237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c009520 con 0x7fd578072c20 2023-10-26T06:42:56.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd577fff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd57810cee0 0x7fd57819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd5777fe700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 0x7fd578198df0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd56800e9a0 tx=0x7fd56800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd574ff9700 1 -- 172.21.15.50:0/1460125237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568009790 con 0x7fd578072c20 2023-10-26T06:42:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd574ff9700 1 -- 172.21.15.50:0/1460125237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd568010430 con 0x7fd578072c20 2023-10-26T06:42:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57819e320 con 0x7fd578072c20 2023-10-26T06:42:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.817+0000 7fd574ff9700 1 -- 172.21.15.50:0/1460125237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568018680 con 0x7fd578072c20 2023-10-26T06:42:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.818+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5781a5b60 con 0x7fd578072c20 2023-10-26T06:42:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.821+0000 7fd574ff9700 1 -- 172.21.15.50:0/1460125237 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7fd5680105a0 con 0x7fd578072c20 2023-10-26T06:42:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.822+0000 7fd5916c2b80 1 Processor -- start 2023-10-26T06:42:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.822+0000 7fd574ff9700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5600a1560 0x7fd5600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.822+0000 7fd574ff9700 1 -- 172.21.15.50:0/1460125237 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd568014070 con 0x7fd578072c20 2023-10-26T06:42:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.822+0000 7fd5916c2b80 1 -- start start 2023-10-26T06:42:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.822+0000 7fd577fff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5600a1560 0x7fd5600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 0x564f17e9ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17e9aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17e0d690 con 0x564f17e9a580 2023-10-26T06:42:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17df3c10 con 0x564f17e9fb90 2023-10-26T06:42:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17df1530 con 0x564f17ea04b0 2023-10-26T06:42:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 0x564f17e9ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5777fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 0x564f17e9ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45132/0 (socket says 172.21.15.50:45132) 2023-10-26T06:42:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5777fe700 1 -- 172.21.15.50:0/2473599395 learned_addr learned my addr 172.21.15.50:0/2473599395 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd577fff700 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17e9aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd576ffd700 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd577fff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5600a1560 0x7fd5600a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd570003e30 tx=0x7fd57000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.823+0000 7fd5777fe700 1 -- 172.21.15.50:0/2473599395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 msgr2=0x564f17e9a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd5777fe700 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd5777fe700 1 -- 172.21.15.50:0/2473599395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 msgr2=0x564f17e9aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd5777fe700 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17e9aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd5777fe700 1 -- 172.21.15.50:0/2473599395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f17daa3a0 con 0x564f17e9fb90 2023-10-26T06:42:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd5777fe700 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 0x564f17e9ff70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5680a20c0 tx=0x7fd56809a960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3ee41b42e87283 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd55dffb700 1 -- 172.21.15.50:0/2473599395 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56809e170 con 0x564f17e9fb90 2023-10-26T06:42:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd55dffb700 1 -- 172.21.15.50:0/2473599395 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd56809e3b0 con 0x564f17e9fb90 2023-10-26T06:42:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.824+0000 7fd55dffb700 1 -- 172.21.15.50:0/2473599395 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680999b0 con 0x564f17e9fb90 2023-10-26T06:42:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 -- 172.21.15.50:0/2473599395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 msgr2=0x564f17e9ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 0x564f17e9ff70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5680a20c0 tx=0x7fd56809a960 comp rx=0 tx=0).stop 2023-10-26T06:42:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 -- 172.21.15.50:0/2473599395 shutdown_connections 2023-10-26T06:42:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17e9aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9fb90 0x564f17e9ff70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/2473599395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 -- 172.21.15.50:0/2473599395 >> 172.21.15.50:0/2473599395 conn(0x564f17e0e6d0 msgr2=0x564f17e94b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 -- 172.21.15.50:0/2473599395 shutdown_connections 2023-10-26T06:42:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 -- 172.21.15.50:0/2473599395 wait complete. 2023-10-26T06:42:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.825+0000 7fd5916c2b80 1 -- start start 2023-10-26T06:42:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.826+0000 7fd5916c2b80 1 Processor -- start 2023-10-26T06:42:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17ea3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9fb90 0x564f17ea3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17ea42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17dece20 con 0x564f17e9a580 2023-10-26T06:42:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17d896c0 con 0x564f17ea04b0 2023-10-26T06:42:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17d89360 con 0x564f17e9fb90 2023-10-26T06:42:56.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5916c2b80 10 client.0 _ll_register_callbacks cb 0x564f17cd3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:42:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17ea3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17ea3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41262/0 (socket says 172.21.15.50:41262) 2023-10-26T06:42:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 -- 172.21.15.50:0/562511343 learned_addr learned my addr 172.21.15.50:0/562511343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd577fff700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17ea42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd576ffd700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9fb90 0x564f17ea3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 -- 172.21.15.50:0/562511343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9fb90 msgr2=0x564f17ea3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9fb90 0x564f17ea3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 -- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 msgr2=0x564f17ea42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17ea42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 -- 172.21.15.50:0/562511343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568094e70 con 0x564f17e9a580 2023-10-26T06:42:56.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd576ffd700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9fb90 0x564f17ea3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:42:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd5777fe700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17ea3820 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd56809a8c0 tx=0x7fd568010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f23c09f4c0e258 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.827+0000 7fd556ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:42:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd556ffd700 1 -- 172.21.15.50:0/562511343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680b6070 con 0x564f17e9a580 2023-10-26T06:42:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f17df1ea0 con 0x564f17e9a580 2023-10-26T06:42:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd556ffd700 1 -- 172.21.15.50:0/562511343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd5680a25f0 con 0x564f17e9a580 2023-10-26T06:42:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd556ffd700 1 -- 172.21.15.50:0/562511343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd56809e170 con 0x564f17e9a580 2023-10-26T06:42:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 10 client.15198 fetch_fsmap learned FSMap version 23 2023-10-26T06:42:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564f17c17d90 con 0x564f17e9a580 2023-10-26T06:42:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd556ffd700 1 -- 172.21.15.50:0/562511343 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f17df1ea0 con 0x564f17e9a580 2023-10-26T06:42:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd556ffd700 1 -- 172.21.15.50:0/562511343 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd5680b2d20 con 0x564f17e9a580 2023-10-26T06:42:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 10 client.15198 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:42:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 10 client.15198 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-26T06:42:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 20 client.15198 populate_metadata read hostname 'smithi050' 2023-10-26T06:42:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17eb3b80 0x564f17eb2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 4 client.15198 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:42:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.828+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f17e69860 con 0x564f17eb3b80 2023-10-26T06:42:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.829+0000 7fd576ffd700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17eb3b80 0x564f17eb2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.829+0000 7fd576ffd700 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17eb3b80 0x564f17eb2870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c4a92feb7038c6 server_cookie=41ba4b02543cfe98 in_seq=0 out_seq=0 2023-10-26T06:42:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.829+0000 7fd556ffd700 10 client.15198 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:42:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd556ffd700 1 -- 172.21.15.50:0/562511343 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f17e69860 con 0x564f17eb3b80 2023-10-26T06:42:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd556ffd700 10 client.15198 handle_command_reply: tid=0 2023-10-26T06:42:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 client.15198 shutdown 2023-10-26T06:42:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 msgr2=0x564f17ea3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17ea3820 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd56809a8c0 tx=0x7fd568010bf0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 shutdown_connections 2023-10-26T06:42:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17eb3b80 0x564f17eb2870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17ea42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9a580 0x564f17ea3820 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd556ffd700 0 client.15198 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:42:56.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/562511343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9fb90 0x564f17ea3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.830+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 >> 172.21.15.50:0/562511343 conn(0x564f17e0e6d0 msgr2=0x564f17e99030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.831+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 shutdown_connections 2023-10-26T06:42:56.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.831+0000 7fd5916c2b80 1 -- 172.21.15.50:0/562511343 wait complete. 2023-10-26T06:42:56.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.831+0000 7fd5916c2b80 20 client.15198 trim_cache size 0 max 16384 2023-10-26T06:42:56.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 Processor -- start 2023-10-26T06:42:56.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 -- start start 2023-10-26T06:42:56.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9a580 0x564f17e9f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17ea40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17e8faa0 con 0x564f17e9fb90 2023-10-26T06:42:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17c6d8d0 con 0x564f17e9a580 2023-10-26T06:42:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17dee0b0 con 0x564f17ea04b0 2023-10-26T06:42:56.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd576ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17ea40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd576ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17ea40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41268/0 (socket says 172.21.15.50:41268) 2023-10-26T06:42:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd576ffd700 1 -- 172.21.15.50:0/3791227654 learned_addr learned my addr 172.21.15.50:0/3791227654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.849+0000 7fd5777fe700 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9a580 0x564f17e9f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd577fff700 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd576ffd700 1 -- 172.21.15.50:0/3791227654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 msgr2=0x564f17e9d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd576ffd700 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd576ffd700 1 -- 172.21.15.50:0/3791227654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9a580 msgr2=0x564f17e9f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd576ffd700 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9a580 0x564f17e9f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd576ffd700 1 -- 172.21.15.50:0/3791227654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f17c00c10 con 0x564f17e9fb90 2023-10-26T06:42:56.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd5777fe700 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9a580 0x564f17e9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:56.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd576ffd700 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17ea40c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0098c0 tx=0x7fd56c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f43cddd3c19788 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd55e7fc700 1 -- 172.21.15.50:0/3791227654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c025c00 con 0x564f17e9fb90 2023-10-26T06:42:56.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd55e7fc700 1 -- 172.21.15.50:0/3791227654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd56c01d040 con 0x564f17e9fb90 2023-10-26T06:42:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.850+0000 7fd55e7fc700 1 -- 172.21.15.50:0/3791227654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c00b7c0 con 0x564f17e9fb90 2023-10-26T06:42:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 -- 172.21.15.50:0/3791227654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 msgr2=0x564f17ea40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17ea40c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0098c0 tx=0x7fd56c005dc0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 -- 172.21.15.50:0/3791227654 shutdown_connections 2023-10-26T06:42:56.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17ea04b0 0x564f17e9d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17e9a580 0x564f17e9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/3791227654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17ea40c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 -- 172.21.15.50:0/3791227654 >> 172.21.15.50:0/3791227654 conn(0x564f17e0e6d0 msgr2=0x564f17e9e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 -- 172.21.15.50:0/3791227654 shutdown_connections 2023-10-26T06:42:56.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 -- 172.21.15.50:0/3791227654 wait complete. 2023-10-26T06:42:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.851+0000 7fd5916c2b80 1 -- start start 2023-10-26T06:42:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 Processor -- start 2023-10-26T06:42:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9a580 0x564f17ebc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17eb6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17eb7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17eb7720 con 0x564f17e9fb90 2023-10-26T06:42:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17eb7890 con 0x564f17ea04b0 2023-10-26T06:42:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f17f07570 con 0x564f17e9a580 2023-10-26T06:42:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5916c2b80 10 client.0 _ll_register_callbacks cb 0x564f17cd3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:42:56.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd576ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17eb6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd576ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17eb6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41274/0 (socket says 172.21.15.50:41274) 2023-10-26T06:42:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd576ffd700 1 -- 172.21.15.50:0/1054694499 learned_addr learned my addr 172.21.15.50:0/1054694499 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.852+0000 7fd5777fe700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9a580 0x564f17ebc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd577fff700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17eb7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd576ffd700 1 -- 172.21.15.50:0/1054694499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9a580 msgr2=0x564f17ebc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd576ffd700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9a580 0x564f17ebc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd576ffd700 1 -- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 msgr2=0x564f17eb7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:42:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd576ffd700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17eb7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd576ffd700 1 -- 172.21.15.50:0/1054694499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f17c17d90 con 0x564f17e9fb90 2023-10-26T06:42:56.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd576ffd700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17eb6ad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd56c000c00 tx=0x7fd56c025410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac60c399583a112 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:56.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd556ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:42:56.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd556ffd700 1 -- 172.21.15.50:0/1054694499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c025e10 con 0x564f17e9fb90 2023-10-26T06:42:56.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd556ffd700 1 -- 172.21.15.50:0/1054694499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd56c00f460 con 0x564f17e9fb90 2023-10-26T06:42:56.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.853+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd56809e3b0 con 0x564f17e9fb90 2023-10-26T06:42:56.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd556ffd700 1 -- 172.21.15.50:0/1054694499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd56c00f620 con 0x564f17e9fb90 2023-10-26T06:42:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 10 client.15204 fetch_fsmap learned FSMap version 23 2023-10-26T06:42:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fd578110010 con 0x564f17e9fb90 2023-10-26T06:42:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd556ffd700 1 -- 172.21.15.50:0/1054694499 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd56809e3b0 con 0x564f17e9fb90 2023-10-26T06:42:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd556ffd700 1 -- 172.21.15.50:0/1054694499 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd56c03f050 con 0x564f17e9fb90 2023-10-26T06:42:56.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 10 client.15204 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:42:56.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 10 client.15204 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-26T06:42:56.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 20 client.15204 populate_metadata read hostname 'smithi050' 2023-10-26T06:42:56.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17f0c360 0x564f17f08820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:56.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 4 client.15204 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-26T06:42:56.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564f17de5e00 con 0x564f17f0c360 2023-10-26T06:42:56.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.854+0000 7fd5777fe700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17f0c360 0x564f17f08820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:56.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5777fe700 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17f0c360 0x564f17f08820 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b52e9424b54888bc server_cookie=72d64fbcdcc281ac in_seq=0 out_seq=0 2023-10-26T06:42:56.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd556ffd700 10 client.15204 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:42:56.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd556ffd700 1 -- 172.21.15.50:0/1054694499 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564f17de5e00 con 0x564f17f0c360 2023-10-26T06:42:56.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd556ffd700 10 client.15204 handle_command_reply: tid=0 2023-10-26T06:42:56.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 client.15204 shutdown 2023-10-26T06:42:56.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 msgr2=0x564f17eb6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17eb6ad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd56c000c00 tx=0x7fd56c025410 comp rx=0 tx=0).stop 2023-10-26T06:42:56.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 shutdown_connections 2023-10-26T06:42:56.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x564f17f0c360 0x564f17f08820 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x564f17ea04b0 0x564f17eb7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564f17e9a580 0x564f17ebc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 --2- 172.21.15.50:0/1054694499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564f17e9fb90 0x564f17eb6ad0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 >> 172.21.15.50:0/1054694499 conn(0x564f17e0e6d0 msgr2=0x564f17ea4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd556ffd700 0 client.15204 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:42:56.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.855+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 shutdown_connections 2023-10-26T06:42:56.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd5916c2b80 1 -- 172.21.15.50:0/1054694499 wait complete. 2023-10-26T06:42:56.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd5916c2b80 20 client.15204 trim_cache size 0 max 16384 2023-10-26T06:42:56.872 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:42:56.872 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:42:56.873 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-10-26T06:42:56.873 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24740, 2023-10-26T06:42:56.873 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-26T06:42:56.873 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-26T06:42:56.874 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-26T06:42:56.874 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 85.897628972000007, 2023-10-26T06:42:56.874 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-10-26T06:42:56.874 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 86, 2023-10-26T06:42:56.874 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 84, 2023-10-26T06:42:56.875 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 92.439189118000002 2023-10-26T06:42:56.875 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:42:56.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5600a1560 msgr2=0x7fd5600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5600a1560 0x7fd5600a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd570003e30 tx=0x7fd57000b040 comp rx=0 tx=0).stop 2023-10-26T06:42:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 msgr2=0x7fd578198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 0x7fd578198df0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd56800e9a0 tx=0x7fd56800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 shutdown_connections 2023-10-26T06:42:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5600a1560 0x7fd5600a3a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd57810cee0 0x7fd57819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd578072c20 0x7fd578198df0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 --2- 172.21.15.50:0/1460125237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd578073540 0x7fd578199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 >> 172.21.15.50:0/1460125237 conn(0x7fd5780fc170 msgr2=0x7fd5780fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:56.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 shutdown_connections 2023-10-26T06:42:56.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:56.856+0000 7fd57ddff700 1 -- 172.21.15.50:0/1460125237 wait complete. 2023-10-26T06:42:56.878 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:56 smithi050 ceph-mon[94997]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:56.878 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:56 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2798503745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:56.879 INFO:tasks.cephadm:Setup complete, yielding 2023-10-26T06:42:56.880 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-26T06:42:56.889 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:42:56.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-26T06:42:56.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:56 smithi153 ceph-mon[131657]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:56.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:56 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2798503745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:56 smithi125 ceph-mon[130643]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:42:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:56 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2798503745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:42:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:42:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:42:58 smithi050 ceph-mon[94997]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:42:58 smithi153 ceph-mon[131657]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:42:58 smithi125 ceph-mon[130643]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:42:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 -- 172.21.15.50:0/1975683210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 msgr2=0x7f74ec10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:59.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 --2- 172.21.15.50:0/1975683210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec10d650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f74e400b0a0 tx=0x7f74e400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 -- 172.21.15.50:0/1975683210 shutdown_connections 2023-10-26T06:42:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 --2- 172.21.15.50:0/1975683210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec10d650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 --2- 172.21.15.50:0/1975683210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1057c0 0x7f74ec105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 --2- 172.21.15.50:0/1975683210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1008a0 0x7f74ec100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 -- 172.21.15.50:0/1975683210 >> 172.21.15.50:0/1975683210 conn(0x7f74ec0779e0 msgr2=0x7f74ec077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.192+0000 7f74f0950700 1 -- 172.21.15.50:0/1975683210 shutdown_connections 2023-10-26T06:42:59.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.193+0000 7f74f0950700 1 -- 172.21.15.50:0/1975683210 wait complete. 2023-10-26T06:42:59.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.193+0000 7f74f0950700 1 Processor -- start 2023-10-26T06:42:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 -- start start 2023-10-26T06:42:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 0x7f74ec072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:59.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1057c0 0x7f74ec073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec1a5090 con 0x7f74ec101260 2023-10-26T06:42:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec1a5200 con 0x7f74ec1057c0 2023-10-26T06:42:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74f0950700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec1a53c0 con 0x7f74ec1008a0 2023-10-26T06:42:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74e9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74ea59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 0x7f74ec072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:59.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74e9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41298/0 (socket says 172.21.15.50:41298) 2023-10-26T06:42:59.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74ead9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1057c0 0x7f74ec073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:59.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74e9d9b700 1 -- 172.21.15.50:0/4109715825 learned_addr learned my addr 172.21.15.50:0/4109715825 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:42:59.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.194+0000 7f74ea59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 0x7f74ec072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57554/0 (socket says 172.21.15.50:57554) 2023-10-26T06:42:59.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74e9d9b700 1 -- 172.21.15.50:0/4109715825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 msgr2=0x7f74ec072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:59.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74e9d9b700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 0x7f74ec072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74e9d9b700 1 -- 172.21.15.50:0/4109715825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1057c0 msgr2=0x7f74ec073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74e9d9b700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1057c0 0x7f74ec073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74e9d9b700 1 -- 172.21.15.50:0/4109715825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4009d00 con 0x7f74ec101260 2023-10-26T06:42:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74ea59c700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 0x7f74ec072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:59.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74ead9d700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1057c0 0x7f74ec073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:42:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74e9d9b700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec073030 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e9a0 tx=0x7f74e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0009790 con 0x7f74ec101260 2023-10-26T06:42:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74e0010430 con 0x7f74ec101260 2023-10-26T06:42:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0018680 con 0x7f74ec101260 2023-10-26T06:42:59.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.195+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec1a56a0 con 0x7f74ec101260 2023-10-26T06:42:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.196+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec1a5b50 con 0x7f74ec101260 2023-10-26T06:42:59.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.197+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec108da0 con 0x7f74ec101260 2023-10-26T06:42:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.199+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) v1 ==== 136071+0+0 (secure 0 0 0) 0x7f74e00105a0 con 0x7f74ec101260 2023-10-26T06:42:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.200+0000 7f74db7fe700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f74d40a15e0 0x7f74d40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:42:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.200+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f74e0014070 con 0x7f74ec101260 2023-10-26T06:42:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.200+0000 7f74ea59c700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f74d40a15e0 0x7f74d40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:42:59.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.201+0000 7f74ea59c700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f74d40a15e0 0x7f74d40a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f74ec101930 tx=0x7f74dc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:42:59.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.204+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f74e0096540 con 0x7f74ec101260 2023-10-26T06:42:59.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.431+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74ec110780 con 0x7f74d40a15e0 2023-10-26T06:42:59.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.432+0000 7f74db7fe700 1 -- 172.21.15.50:0/4109715825 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f74ec110780 con 0x7f74d40a15e0 2023-10-26T06:42:59.433 INFO:teuthology.orchestra.run.smithi050.stdout:Backend: cephadm 2023-10-26T06:42:59.434 INFO:teuthology.orchestra.run.smithi050.stdout:Available: Yes 2023-10-26T06:42:59.434 INFO:teuthology.orchestra.run.smithi050.stdout:Paused: No 2023-10-26T06:42:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f74d40a15e0 msgr2=0x7f74d40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f74d40a15e0 0x7f74d40a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f74ec101930 tx=0x7f74dc009260 comp rx=0 tx=0).stop 2023-10-26T06:42:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 msgr2=0x7f74ec073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:42:59.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec073030 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e9a0 tx=0x7f74e000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 shutdown_connections 2023-10-26T06:42:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f74d40a15e0 0x7f74d40a3aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74ec1057c0 0x7f74ec073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74ec1008a0 0x7f74ec072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 --2- 172.21.15.50:0/4109715825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74ec101260 0x7f74ec073030 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:42:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.434+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 >> 172.21.15.50:0/4109715825 conn(0x7f74ec0779e0 msgr2=0x7f74ec0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:42:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.435+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 shutdown_connections 2023-10-26T06:42:59.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:42:59.435+0000 7f74f0950700 1 -- 172.21.15.50:0/4109715825 wait complete. 2023-10-26T06:42:59.923 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-26T06:43:00.667 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:00.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:00 smithi153 ceph-mon[131657]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:00.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:00 smithi153 ceph-mon[131657]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:00.999 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:00 smithi050 ceph-mon[94997]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:00.999 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:00 smithi050 ceph-mon[94997]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:00 smithi125 ceph-mon[130643]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:00 smithi125 ceph-mon[130643]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:01.959 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:01 smithi050 ceph-mon[94997]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-26T06:43:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:01 smithi125 ceph-mon[130643]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-26T06:43:02.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 -- 172.21.15.50:0/4009950957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f201067a0 msgr2=0x7f7f20106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 --2- 172.21.15.50:0/4009950957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f201067a0 0x7f7f20106b80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098f0 tx=0x7f7f10009c00 comp rx=0 tx=0).stop 2023-10-26T06:43:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 -- 172.21.15.50:0/4009950957 shutdown_connections 2023-10-26T06:43:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 --2- 172.21.15.50:0/4009950957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f20068b30 0x7f7f2010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 --2- 172.21.15.50:0/4009950957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f201067a0 0x7f7f20106b80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 --2- 172.21.15.50:0/4009950957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f20068190 0x7f7f200685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 -- 172.21.15.50:0/4009950957 >> 172.21.15.50:0/4009950957 conn(0x7f7f20075790 msgr2=0x7f7f20075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:02.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.209+0000 7f7f25800700 1 -- 172.21.15.50:0/4009950957 shutdown_connections 2023-10-26T06:43:02.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.210+0000 7f7f25800700 1 -- 172.21.15.50:0/4009950957 wait complete. 2023-10-26T06:43:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.210+0000 7f7f25800700 1 Processor -- start 2023-10-26T06:43:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 -- start start 2023-10-26T06:43:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 0x7f7f2019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f20068b30 0x7f7f2019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:02.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f201067a0 0x7f7f20196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20197140 con 0x7f7f20068190 2023-10-26T06:43:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f201972b0 con 0x7f7f201067a0 2023-10-26T06:43:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f25800700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20197470 con 0x7f7f20068b30 2023-10-26T06:43:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f1effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 0x7f7f2019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:02.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f1effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 0x7f7f2019c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41304/0 (socket says 172.21.15.50:41304) 2023-10-26T06:43:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f1effd700 1 -- 172.21.15.50:0/1633336724 learned_addr learned my addr 172.21.15.50:0/1633336724 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f1f7fe700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f201067a0 0x7f7f20196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.211+0000 7f7f1e7fc700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f20068b30 0x7f7f2019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f1effd700 1 -- 172.21.15.50:0/1633336724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f20068b30 msgr2=0x7f7f2019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:02.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f1effd700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f20068b30 0x7f7f2019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f1effd700 1 -- 172.21.15.50:0/1633336724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f201067a0 msgr2=0x7f7f20196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f1effd700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f201067a0 0x7f7f20196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f1effd700 1 -- 172.21.15.50:0/1633336724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009d00 con 0x7f7f20068190 2023-10-26T06:43:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f1effd700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 0x7f7f2019c9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f10005950 tx=0x7f7f1000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:02.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1001c070 con 0x7f7f20068190 2023-10-26T06:43:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f1000baa0 con 0x7f7f20068190 2023-10-26T06:43:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100038e0 con 0x7f7f20068190 2023-10-26T06:43:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.212+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f10009520 con 0x7f7f20068190 2023-10-26T06:43:02.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.213+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f201a37c0 con 0x7f7f20068190 2023-10-26T06:43:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.214+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20108d50 con 0x7f7f20068190 2023-10-26T06:43:02.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.216+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7f10020030 con 0x7f7f20068190 2023-10-26T06:43:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.217+0000 7f7f07fff700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7f080a1550 0x7f7f080a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.217+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7f100cdaf0 con 0x7f7f20068190 2023-10-26T06:43:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.217+0000 7f7f1e7fc700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7f080a1550 0x7f7f080a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:02.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.218+0000 7f7f1e7fc700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7f080a1550 0x7f7f080a3a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7f20197ca0 tx=0x7f7f14009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:02.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.221+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7f10097110 con 0x7f7f20068190 2023-10-26T06:43:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:01 smithi153 ceph-mon[131657]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-26T06:43:02.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.447+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f20197fa0 con 0x7f7f080a1550 2023-10-26T06:43:02.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.461+0000 7f7f07fff700 1 -- 172.21.15.50:0/1633336724 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f7f20197fa0 con 0x7f7f080a1550 2023-10-26T06:43:02.463 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-26T06:43:02.463 INFO:teuthology.orchestra.run.smithi050.stdout:mds.a smithi050 running (100s) 23s ago 100s 13.7M - 18.0.0-6863-g38499368 3c558842a6a5 8a8951df3194 2023-10-26T06:43:02.463 INFO:teuthology.orchestra.run.smithi050.stdout:mds.b smithi125 running (98s) 25s ago 97s 30.0M - 18.0.0-6863-g38499368 3c558842a6a5 f79d7cf2916d 2023-10-26T06:43:02.463 INFO:teuthology.orchestra.run.smithi050.stdout:mds.c smithi153 running (111s) 25s ago 111s 19.2M - 18.0.0-6863-g38499368 3c558842a6a5 4482f876b796 2023-10-26T06:43:02.463 INFO:teuthology.orchestra.run.smithi050.stdout:mds.d smithi050 running (118s) 23s ago 118s 13.9M - 18.0.0-6863-g38499368 3c558842a6a5 87ddb7156ad4 2023-10-26T06:43:02.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.e smithi125 running (116s) 25s ago 115s 19.7M - 18.0.0-6863-g38499368 3c558842a6a5 21307d512598 2023-10-26T06:43:02.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.f smithi153 running (113s) 25s ago 113s 18.3M - 18.0.0-6863-g38499368 3c558842a6a5 6077184dda60 2023-10-26T06:43:02.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.g smithi050 running (103s) 23s ago 103s 13.7M - 18.0.0-6863-g38499368 3c558842a6a5 42e694213ffc 2023-10-26T06:43:02.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.h smithi125 running (109s) 25s ago 109s 22.0M - 18.0.0-6863-g38499368 3c558842a6a5 1aff41cc7c0a 2023-10-26T06:43:02.464 INFO:teuthology.orchestra.run.smithi050.stdout:mds.i smithi153 running (107s) 25s ago 106s 19.7M - 18.0.0-6863-g38499368 3c558842a6a5 2f49872fe9a1 2023-10-26T06:43:02.465 INFO:teuthology.orchestra.run.smithi050.stdout:mds.j smithi050 running (2m) 23s ago 2m 13.8M - 18.0.0-6863-g38499368 3c558842a6a5 a3f2e81b9e91 2023-10-26T06:43:02.465 INFO:teuthology.orchestra.run.smithi050.stdout:mds.k smithi125 running (2m) 25s ago 2m 16.5M - 18.0.0-6863-g38499368 3c558842a6a5 c655bdf56206 2023-10-26T06:43:02.465 INFO:teuthology.orchestra.run.smithi050.stdout:mds.l smithi153 running (2m) 25s ago 2m 15.0M - 18.0.0-6863-g38499368 3c558842a6a5 f84cd7fe016d 2023-10-26T06:43:02.465 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.x smithi050 *:9283,8765 running (9m) 23s ago 9m 522M - 18.0.0-6863-g38499368 3c558842a6a5 ec1677c82baf 2023-10-26T06:43:02.465 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.y smithi125 *:8443,8765 running (7m) 25s ago 7m 451M - 18.0.0-6863-g38499368 3c558842a6a5 749339ab9573 2023-10-26T06:43:02.465 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.z smithi153 *:8443,8765 running (7m) 25s ago 7m 453M - 18.0.0-6863-g38499368 3c558842a6a5 3b2d65b084a0 2023-10-26T06:43:02.466 INFO:teuthology.orchestra.run.smithi050.stdout:mon.a smithi050 running (9m) 23s ago 9m 98.4M 2048M 18.0.0-6863-g38499368 3c558842a6a5 92de4461b3b4 2023-10-26T06:43:02.466 INFO:teuthology.orchestra.run.smithi050.stdout:mon.b smithi125 running (7m) 25s ago 7m 68.1M 2048M 18.0.0-6863-g38499368 3c558842a6a5 2d5ebda7d9ce 2023-10-26T06:43:02.466 INFO:teuthology.orchestra.run.smithi050.stdout:mon.c smithi153 running (8m) 25s ago 8m 71.2M 2048M 18.0.0-6863-g38499368 3c558842a6a5 68a17b289567 2023-10-26T06:43:02.466 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (6m) 23s ago 6m 64.2M 4319M 18.0.0-6863-g38499368 3c558842a6a5 a8fc546aace1 2023-10-26T06:43:02.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi125 running (6m) 25s ago 6m 68.6M 4292M 18.0.0-6863-g38499368 3c558842a6a5 939d404697b3 2023-10-26T06:43:02.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi153 running (5m) 25s ago 5m 66.5M 4292M 18.0.0-6863-g38499368 3c558842a6a5 985f80c1ff6c 2023-10-26T06:43:02.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi050 running (5m) 23s ago 5m 62.7M 4319M 18.0.0-6863-g38499368 3c558842a6a5 46c54bcd065b 2023-10-26T06:43:02.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi125 running (5m) 25s ago 5m 61.6M 4292M 18.0.0-6863-g38499368 3c558842a6a5 db43d666f3f6 2023-10-26T06:43:02.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi153 running (4m) 25s ago 4m 61.9M 4292M 18.0.0-6863-g38499368 3c558842a6a5 723a48bf8f0c 2023-10-26T06:43:02.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 smithi050 running (4m) 23s ago 4m 57.4M 4319M 18.0.0-6863-g38499368 3c558842a6a5 189256e05b3e 2023-10-26T06:43:02.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 smithi125 running (3m) 25s ago 3m 60.9M 4292M 18.0.0-6863-g38499368 3c558842a6a5 cc919a01217f 2023-10-26T06:43:02.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 smithi153 running (3m) 25s ago 3m 59.8M 4292M 18.0.0-6863-g38499368 3c558842a6a5 472fd9dc484f 2023-10-26T06:43:02.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 smithi050 running (3m) 23s ago 3m 54.5M 4319M 18.0.0-6863-g38499368 3c558842a6a5 c47196ac6944 2023-10-26T06:43:02.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 smithi125 running (2m) 25s ago 2m 63.2M 4292M 18.0.0-6863-g38499368 3c558842a6a5 45dd429b8aa0 2023-10-26T06:43:02.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 smithi153 running (2m) 25s ago 2m 55.8M 4292M 18.0.0-6863-g38499368 3c558842a6a5 4f65708ba1aa 2023-10-26T06:43:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7f080a1550 msgr2=0x7f7f080a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7f080a1550 0x7f7f080a3a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7f20197ca0 tx=0x7f7f14009260 comp rx=0 tx=0).stop 2023-10-26T06:43:02.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 msgr2=0x7f7f2019c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 0x7f7f2019c9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f10005950 tx=0x7f7f1000fa00 comp rx=0 tx=0).stop 2023-10-26T06:43:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 shutdown_connections 2023-10-26T06:43:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7f080a1550 0x7f7f080a3a10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f201067a0 0x7f7f20196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f20068190 0x7f7f2019c9a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 --2- 172.21.15.50:0/1633336724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f20068b30 0x7f7f2019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.463+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 >> 172.21.15.50:0/1633336724 conn(0x7f7f20075790 msgr2=0x7f7f200fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.464+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 shutdown_connections 2023-10-26T06:43:02.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:02.464+0000 7f7f25800700 1 -- 172.21.15.50:0/1633336724 wait complete. 2023-10-26T06:43:02.995 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:02 smithi050 ceph-mon[94997]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:03.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-26T06:43:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:02 smithi125 ceph-mon[130643]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:02 smithi153 ceph-mon[131657]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:04.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:03 smithi050 ceph-mon[94997]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:03 smithi125 ceph-mon[130643]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:03 smithi153 ceph-mon[131657]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:05.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:04 smithi050 ceph-mon[94997]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:04 smithi125 ceph-mon[130643]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:05.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:04 smithi153 ceph-mon[131657]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:05.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 -- 172.21.15.50:0/1640788582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac072a20 msgr2=0x7f7bac072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:05.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/1640788582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac072a20 0x7f7bac072e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009990 tx=0x7f7b9c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 -- 172.21.15.50:0/1640788582 shutdown_connections 2023-10-26T06:43:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/1640788582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 0x7f7bac10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/1640788582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac072a20 0x7f7bac072e00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/1640788582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac073340 0x7f7bac10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 -- 172.21.15.50:0/1640788582 >> 172.21.15.50:0/1640788582 conn(0x7f7bac0779e0 msgr2=0x7f7bac077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 -- 172.21.15.50:0/1640788582 shutdown_connections 2023-10-26T06:43:05.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.234+0000 7f7bb09f0700 1 -- 172.21.15.50:0/1640788582 wait complete. 2023-10-26T06:43:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 Processor -- start 2023-10-26T06:43:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 -- start start 2023-10-26T06:43:05.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac072a20 0x7f7bac198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 0x7f7bac199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 0x7f7bac19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac19dde0 con 0x7f7bac073340 2023-10-26T06:43:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac19df50 con 0x7f7bac10d250 2023-10-26T06:43:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.235+0000 7f7bb09f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac19e110 con 0x7f7bac072a20 2023-10-26T06:43:05.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 0x7f7bac199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7baa59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac072a20 0x7f7bac198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 0x7f7bac199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59718/0 (socket says 172.21.15.50:59718) 2023-10-26T06:43:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 -- 172.21.15.50:0/3387799736 learned_addr learned my addr 172.21.15.50:0/3387799736 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7baad9d700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 0x7f7bac19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:05.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 -- 172.21.15.50:0/3387799736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac072a20 msgr2=0x7f7bac198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac072a20 0x7f7bac198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 -- 172.21.15.50:0/3387799736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 msgr2=0x7f7bac19d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 0x7f7bac19d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 -- 172.21.15.50:0/3387799736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0095f0 con 0x7f7bac073340 2023-10-26T06:43:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7baad9d700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 0x7f7bac19d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.236+0000 7f7ba9d9b700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 0x7f7bac199420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000d950 tx=0x7f7ba000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.237+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0009940 con 0x7f7bac073340 2023-10-26T06:43:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.237+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ba0010460 con 0x7f7bac073340 2023-10-26T06:43:05.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.237+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac19e3f0 con 0x7f7bac073340 2023-10-26T06:43:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.237+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000f620 con 0x7f7bac073340 2023-10-26T06:43:05.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.237+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac1a5c50 con 0x7f7bac073340 2023-10-26T06:43:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.238+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac108460 con 0x7f7bac073340 2023-10-26T06:43:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.240+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7ba00108d0 con 0x7f7bac073340 2023-10-26T06:43:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.242+0000 7f7b9b7fe700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b940a14d0 0x7f7b940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:05.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.243+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7ba00ccca0 con 0x7f7bac073340 2023-10-26T06:43:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.243+0000 7f7baa59c700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b940a14d0 0x7f7b940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:05.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.243+0000 7f7baa59c700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b940a14d0 0x7f7b940a3990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c006010 tx=0x7f7b9c00b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:05.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.247+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ba0096230 con 0x7f7bac073340 2023-10-26T06:43:05.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.466+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bac04e560 con 0x7f7b940a14d0 2023-10-26T06:43:05.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.473+0000 7f7b9b7fe700 1 -- 172.21.15.50:0/3387799736 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f7bac04e560 con 0x7f7b940a14d0 2023-10-26T06:43:05.474 INFO:teuthology.orchestra.run.smithi050.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-26T06:43:05.475 INFO:teuthology.orchestra.run.smithi050.stdout:mds.all 12/12 28s ago 2m smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi125=b;smithi125=e;smithi125=h;smithi125=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2023-10-26T06:43:05.475 INFO:teuthology.orchestra.run.smithi050.stdout:mgr 3/3 28s ago 7m smithi050=x;smithi125=y;smithi153=z;count:3 2023-10-26T06:43:05.475 INFO:teuthology.orchestra.run.smithi050.stdout:mon 3/3 28s ago 8m smithi050:172.21.15.50=a;smithi125:172.21.15.125=b;smithi153:172.21.15.153=c;count:3 2023-10-26T06:43:05.475 INFO:teuthology.orchestra.run.smithi050.stdout:osd 12 28s ago - 2023-10-26T06:43:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b940a14d0 msgr2=0x7f7b940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b940a14d0 0x7f7b940a3990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c006010 tx=0x7f7b9c00b540 comp rx=0 tx=0).stop 2023-10-26T06:43:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 msgr2=0x7f7bac199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 0x7f7bac199420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000d950 tx=0x7f7ba000dc60 comp rx=0 tx=0).stop 2023-10-26T06:43:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 shutdown_connections 2023-10-26T06:43:05.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b940a14d0 0x7f7b940a3990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bac10d250 0x7f7bac19d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bac072a20 0x7f7bac198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 --2- 172.21.15.50:0/3387799736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bac073340 0x7f7bac199420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 >> 172.21.15.50:0/3387799736 conn(0x7f7bac0779e0 msgr2=0x7f7bac0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 shutdown_connections 2023-10-26T06:43:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:05.475+0000 7f7bb09f0700 1 -- 172.21.15.50:0/3387799736 wait complete. 2023-10-26T06:43:05.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-26T06:43:06.735 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:06 smithi050 ceph-mon[94997]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:07.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:06 smithi050 ceph-mon[94997]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-10-26T06:43:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:06 smithi125 ceph-mon[130643]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:06 smithi125 ceph-mon[130643]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-10-26T06:43:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:06 smithi153 ceph-mon[131657]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:06 smithi153 ceph-mon[131657]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-10-26T06:43:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 -- 172.21.15.50:0/1274000940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea101008a0 msgr2=0x7fea10100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 --2- 172.21.15.50:0/1274000940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea101008a0 0x7fea10100d20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fea00009990 tx=0x7fea00009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 -- 172.21.15.50:0/1274000940 shutdown_connections 2023-10-26T06:43:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 --2- 172.21.15.50:0/1274000940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea10101260 0x7fea1010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 --2- 172.21.15.50:0/1274000940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea101057c0 0x7fea10105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 --2- 172.21.15.50:0/1274000940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea101008a0 0x7fea10100d20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 -- 172.21.15.50:0/1274000940 >> 172.21.15.50:0/1274000940 conn(0x7fea100779e0 msgr2=0x7fea10077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 -- 172.21.15.50:0/1274000940 shutdown_connections 2023-10-26T06:43:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.259+0000 7fea17aeb700 1 -- 172.21.15.50:0/1274000940 wait complete. 2023-10-26T06:43:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.260+0000 7fea17aeb700 1 Processor -- start 2023-10-26T06:43:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.260+0000 7fea17aeb700 1 -- start start 2023-10-26T06:43:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea17aeb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea101008a0 0x7fea10198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea17aeb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 0x7fea10199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea17aeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101057c0 0x7fea1019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea17aeb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1019dd20 con 0x7fea10101260 2023-10-26T06:43:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea17aeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1019de90 con 0x7fea101057c0 2023-10-26T06:43:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea17aeb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1019e050 con 0x7fea101008a0 2023-10-26T06:43:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 0x7fea10199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 0x7fea10199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59738/0 (socket says 172.21.15.50:59738) 2023-10-26T06:43:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 -- 172.21.15.50:0/979763524 learned_addr learned my addr 172.21.15.50:0/979763524 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea16088700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101057c0 0x7fea1019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15887700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea101008a0 0x7fea10198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 -- 172.21.15.50:0/979763524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea101008a0 msgr2=0x7fea10198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea101008a0 0x7fea10198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 -- 172.21.15.50:0/979763524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101057c0 msgr2=0x7fea1019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101057c0 0x7fea1019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea15086700 1 -- 172.21.15.50:0/979763524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000095f0 con 0x7fea10101260 2023-10-26T06:43:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.261+0000 7fea16088700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101057c0 0x7fea1019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.262+0000 7fea15086700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 0x7fea10199360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea00000c00 tx=0x7fea00005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.262+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0001d070 con 0x7fea10101260 2023-10-26T06:43:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.262+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea00022470 con 0x7fea10101260 2023-10-26T06:43:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.262+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00017650 con 0x7fea10101260 2023-10-26T06:43:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.262+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1019e2d0 con 0x7fea10101260 2023-10-26T06:43:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.262+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea101a5b90 con 0x7fea10101260 2023-10-26T06:43:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.263+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10101f30 con 0x7fea10101260 2023-10-26T06:43:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.265+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fea000225e0 con 0x7fea10101260 2023-10-26T06:43:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.268+0000 7fea06ffd700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9fc0a1550 0x7fe9fc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.268+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fea000ce0a0 con 0x7fea10101260 2023-10-26T06:43:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.268+0000 7fea15887700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9fc0a1550 0x7fe9fc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.268+0000 7fea15887700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9fc0a1550 0x7fe9fc0a3a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea10101930 tx=0x7fea0c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.272+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea000976c0 con 0x7fea10101260 2023-10-26T06:43:08.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.487+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fea1019a130 con 0x7fe9fc0a1550 2023-10-26T06:43:08.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.489+0000 7fea06ffd700 1 -- 172.21.15.50:0/979763524 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fea1019a130 con 0x7fe9fc0a1550 2023-10-26T06:43:08.491 INFO:teuthology.orchestra.run.smithi050.stdout:HOST ADDR LABELS STATUS 2023-10-26T06:43:08.491 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 172.21.15.50 2023-10-26T06:43:08.491 INFO:teuthology.orchestra.run.smithi050.stdout:smithi125 172.21.15.125 2023-10-26T06:43:08.491 INFO:teuthology.orchestra.run.smithi050.stdout:smithi153 172.21.15.153 2023-10-26T06:43:08.491 INFO:teuthology.orchestra.run.smithi050.stdout:3 hosts in cluster 2023-10-26T06:43:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9fc0a1550 msgr2=0x7fe9fc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9fc0a1550 0x7fe9fc0a3a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea10101930 tx=0x7fea0c009260 comp rx=0 tx=0).stop 2023-10-26T06:43:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 msgr2=0x7fea10199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 0x7fea10199360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea00000c00 tx=0x7fea00005740 comp rx=0 tx=0).stop 2023-10-26T06:43:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 shutdown_connections 2023-10-26T06:43:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe9fc0a1550 0x7fe9fc0a3a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101057c0 0x7fea1019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea101008a0 0x7fea10198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 --2- 172.21.15.50:0/979763524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea10101260 0x7fea10199360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 >> 172.21.15.50:0/979763524 conn(0x7fea100779e0 msgr2=0x7fea100fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.491+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 shutdown_connections 2023-10-26T06:43:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:08.492+0000 7fea17aeb700 1 -- 172.21.15.50:0/979763524 wait complete. 2023-10-26T06:43:08.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:08 smithi050 ceph-mon[94997]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:08.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-26T06:43:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:08 smithi125 ceph-mon[130643]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:08 smithi153 ceph-mon[131657]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:10.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:09 smithi050 ceph-mon[94997]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:10.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:09 smithi125 ceph-mon[130643]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:10.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:09 smithi153 ceph-mon[131657]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:10.976 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:10 smithi050 ceph-mon[94997]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2023-10-26T06:43:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:10 smithi125 ceph-mon[130643]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2023-10-26T06:43:11.339 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:10 smithi153 ceph-mon[131657]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2023-10-26T06:43:11.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 -- 172.21.15.50:0/3735338664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 msgr2=0x7fb6e8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:11.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3735338664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8105ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009990 tx=0x7fb6d8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 -- 172.21.15.50:0/3735338664 shutdown_connections 2023-10-26T06:43:11.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3735338664 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6e8101260 0x7fb6e810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3735338664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8105ba0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3735338664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6e81008a0 0x7fb6e8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 -- 172.21.15.50:0/3735338664 >> 172.21.15.50:0/3735338664 conn(0x7fb6e80779e0 msgr2=0x7fb6e8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 -- 172.21.15.50:0/3735338664 shutdown_connections 2023-10-26T06:43:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.233+0000 7fb6ee176700 1 -- 172.21.15.50:0/3735338664 wait complete. 2023-10-26T06:43:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.234+0000 7fb6ee176700 1 Processor -- start 2023-10-26T06:43:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 -- start start 2023-10-26T06:43:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6e81008a0 0x7fb6e8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:11.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6e8101260 0x7fb6e8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81a4fe0 con 0x7fb6e81057c0 2023-10-26T06:43:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81a5150 con 0x7fb6e81008a0 2023-10-26T06:43:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6ee176700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e81a5310 con 0x7fb6e8101260 2023-10-26T06:43:11.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59764/0 (socket says 172.21.15.50:59764) 2023-10-26T06:43:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6e7fff700 1 -- 172.21.15.50:0/3499538939 learned_addr learned my addr 172.21.15.50:0/3499538939 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6e77fe700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6e81008a0 0x7fb6e8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:11.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.235+0000 7fb6e6ffd700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6e8101260 0x7fb6e8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e7fff700 1 -- 172.21.15.50:0/3499538939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6e8101260 msgr2=0x7fb6e8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e7fff700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6e8101260 0x7fb6e8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e7fff700 1 -- 172.21.15.50:0/3499538939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6e81008a0 msgr2=0x7fb6e8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e7fff700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6e81008a0 0x7fb6e8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e7fff700 1 -- 172.21.15.50:0/3499538939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80095f0 con 0x7fb6e81057c0 2023-10-26T06:43:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e7fff700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8073570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000efc0 tx=0x7fb6e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0018070 con 0x7fb6e81057c0 2023-10-26T06:43:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6e000f040 con 0x7fb6e81057c0 2023-10-26T06:43:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e81a5590 con 0x7fb6e81057c0 2023-10-26T06:43:11.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000cc10 con 0x7fb6e81057c0 2023-10-26T06:43:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.236+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e81a5a90 con 0x7fb6e81057c0 2023-10-26T06:43:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.237+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e8108d80 con 0x7fb6e81057c0 2023-10-26T06:43:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.239+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb6e0003a00 con 0x7fb6e81057c0 2023-10-26T06:43:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.241+0000 7fb6e4ff9700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6d00a1550 0x7fb6d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.241+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb6e00cc6e0 con 0x7fb6e81057c0 2023-10-26T06:43:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.241+0000 7fb6e77fe700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6d00a1550 0x7fb6d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.242+0000 7fb6e77fe700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6d00a1550 0x7fb6d00a3a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b2e0 tx=0x7fb6d8005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.245+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6e0095d00 con 0x7fb6e81057c0 2023-10-26T06:43:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.460+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6e8073f80 con 0x7fb6d00a1550 2023-10-26T06:43:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.462+0000 7fb6e4ff9700 1 -- 172.21.15.50:0/3499538939 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fb6e8073f80 con 0x7fb6d00a1550 2023-10-26T06:43:11.464 INFO:teuthology.orchestra.run.smithi050.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-26T06:43:11.464 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001F480DGN 447G No 3m ago Has a FileSystem, LVM detected 2023-10-26T06:43:11.464 INFO:teuthology.orchestra.run.smithi050.stdout:smithi125 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040123400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-26T06:43:11.464 INFO:teuthology.orchestra.run.smithi050.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-26T06:43:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6d00a1550 msgr2=0x7fb6d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6d00a1550 0x7fb6d00a3a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b2e0 tx=0x7fb6d8005960 comp rx=0 tx=0).stop 2023-10-26T06:43:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 msgr2=0x7fb6e8073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8073570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000efc0 tx=0x7fb6e000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 shutdown_connections 2023-10-26T06:43:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6d00a1550 0x7fb6d00a3a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81057c0 0x7fb6e8073570 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6e81008a0 0x7fb6e8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 --2- 172.21.15.50:0/3499538939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6e8101260 0x7fb6e8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.464+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 >> 172.21.15.50:0/3499538939 conn(0x7fb6e80779e0 msgr2=0x7fb6e80fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.465+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 shutdown_connections 2023-10-26T06:43:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:11.465+0000 7fb6ee176700 1 -- 172.21.15.50:0/3499538939 wait complete. 2023-10-26T06:43:11.967 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-26T06:43:11.976 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:43:11.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-26T06:43:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:13.014 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:12 smithi050 ceph-mon[94997]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:13.015 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:12 smithi050 ceph-mon[94997]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:12 smithi125 ceph-mon[130643]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:12 smithi125 ceph-mon[130643]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:12 smithi153 ceph-mon[131657]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:12 smithi153 ceph-mon[131657]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:13 smithi125 ceph-mon[130643]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:13 smithi153 ceph-mon[131657]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:14.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.259+0000 7f8197213700 1 -- 172.21.15.50:0/3062805794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 msgr2=0x7f8190106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:14.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.259+0000 7f8197213700 1 --2- 172.21.15.50:0/3062805794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190106b80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8184009990 tx=0x7f8184009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.259+0000 7f8197213700 1 -- 172.21.15.50:0/3062805794 shutdown_connections 2023-10-26T06:43:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.259+0000 7f8197213700 1 --2- 172.21.15.50:0/3062805794 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8190068b30 0x7f819010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.260+0000 7f8197213700 1 --2- 172.21.15.50:0/3062805794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190106b80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.260+0000 7f8197213700 1 --2- 172.21.15.50:0/3062805794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8190068190 0x7f81900685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.260+0000 7f8197213700 1 -- 172.21.15.50:0/3062805794 >> 172.21.15.50:0/3062805794 conn(0x7f8190075790 msgr2=0x7f8190075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.260+0000 7f8197213700 1 -- 172.21.15.50:0/3062805794 shutdown_connections 2023-10-26T06:43:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.260+0000 7f8197213700 1 -- 172.21.15.50:0/3062805794 wait complete. 2023-10-26T06:43:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 Processor -- start 2023-10-26T06:43:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 -- start start 2023-10-26T06:43:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8190068190 0x7f819019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8190068b30 0x7f819019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190197120 con 0x7f81901067a0 2023-10-26T06:43:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190197290 con 0x7f8190068b30 2023-10-26T06:43:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.261+0000 7f8197213700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190197450 con 0x7f8190068190 2023-10-26T06:43:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f8194faf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8190068190 0x7f819019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40920/0 (socket says 172.21.15.50:40920) 2023-10-26T06:43:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 -- 172.21.15.50:0/1586831180 learned_addr learned my addr 172.21.15.50:0/1586831180 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f818ffff700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8190068b30 0x7f819019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 -- 172.21.15.50:0/1586831180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8190068190 msgr2=0x7f819019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8190068190 0x7f819019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 -- 172.21.15.50:0/1586831180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8190068b30 msgr2=0x7f819019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8190068b30 0x7f819019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 -- 172.21.15.50:0/1586831180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840095f0 con 0x7f81901067a0 2023-10-26T06:43:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.262+0000 7f81957b0700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190196ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f818800ef30 tx=0x7f818800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.263+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188018070 con 0x7f81901067a0 2023-10-26T06:43:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.263+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81901976d0 con 0x7f81901067a0 2023-10-26T06:43:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.263+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f818800f040 con 0x7f81901067a0 2023-10-26T06:43:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.263+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81901a3970 con 0x7f81901067a0 2023-10-26T06:43:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.263+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818800ccc0 con 0x7f81901067a0 2023-10-26T06:43:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.264+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8190108d50 con 0x7f81901067a0 2023-10-26T06:43:14.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:13 smithi050 ceph-mon[94997]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.266+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8188003a00 con 0x7f81901067a0 2023-10-26T06:43:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.267+0000 7f818dffb700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f81800a58e0 0x7f81800a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.268+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f81880cc8c0 con 0x7f81901067a0 2023-10-26T06:43:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.268+0000 7f8194faf700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f81800a58e0 0x7f81800a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.268+0000 7f8194faf700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f81800a58e0 0x7f81800a7da0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8184006010 tx=0x7f818400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:14.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.272+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8188095ee0 con 0x7f81901067a0 2023-10-26T06:43:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.528+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8190101ee0 con 0x7f81901067a0 2023-10-26T06:43:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.528+0000 7f818dffb700 1 -- 172.21.15.50:0/1586831180 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2943 (secure 0 0 0) 0x7f8188099500 con 0x7f81901067a0 2023-10-26T06:43:14.530 INFO:teuthology.orchestra.run.smithi050.stdout:e23 2023-10-26T06:43:14.530 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-26T06:43:14.531 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-26T06:43:14.531 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2023-10-26T06:43:14.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:14.531 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2023-10-26T06:43:14.531 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2023-10-26T06:43:14.532 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 23 2023-10-26T06:43:14.532 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-26T06:43:14.532 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-10-26T06:41:30.489106+0000 2023-10-26T06:43:14.532 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-10-26T06:41:35.994192+0000 2023-10-26T06:43:14.532 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2023-10-26T06:43:14.533 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2023-10-26T06:43:14.533 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 300 2023-10-26T06:43:14.533 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2023-10-26T06:43:14.533 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2023-10-26T06:43:14.533 INFO:teuthology.orchestra.run.smithi050.stdout:max_xattr_size 65536 2023-10-26T06:43:14.533 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2023-10-26T06:43:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2023-10-26T06:43:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2023-10-26T06:43:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-26T06:43:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 3 2023-10-26T06:43:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:in 0,1,2 2023-10-26T06:43:14.535 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=24740,1=24709,2=24694} 2023-10-26T06:43:14.535 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2023-10-26T06:43:14.535 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2023-10-26T06:43:14.535 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2023-10-26T06:43:14.535 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2023-10-26T06:43:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2023-10-26T06:43:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data disabled 2023-10-26T06:43:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2023-10-26T06:43:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:bal_rank_mask -1 2023-10-26T06:43:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 0 2023-10-26T06:43:14.536 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b{0:24740} state up:active seq 3 addr [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.537 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.h{0:24692} state up:standby-replay seq 1 addr [v2:172.21.15.125:6836/2652114750,v1:172.21.15.125:6837/2652114750] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.537 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.i{1:24709} state up:active seq 6 addr [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.537 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.f{1:24682} state up:standby-replay seq 1 addr [v2:172.21.15.153:6834/2747210301,v1:172.21.15.153:6835/2747210301] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.537 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c{2:24694} state up:active seq 7 addr [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.537 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.e{2:24665} state up:standby-replay seq 1 addr [v2:172.21.15.125:6834/3214904167,v1:172.21.15.125:6835/3214904167] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:14.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:14.538 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2023-10-26T06:43:14.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:14.538 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d{-1:14649} state up:standby seq 1 addr [v2:172.21.15.50:6836/373696388,v1:172.21.15.50:6837/373696388] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.539 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.g{-1:14709} state up:standby seq 1 addr [v2:172.21.15.50:6838/212825483,v1:172.21.15.50:6839/212825483] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.539 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a{-1:14721} state up:standby seq 1 addr [v2:172.21.15.50:6840/2366491284,v1:172.21.15.50:6841/2366491284] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.539 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.l{-1:24625} state up:standby seq 1 addr [v2:172.21.15.153:6832/2111783202,v1:172.21.15.153:6833/2111783202] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.539 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.k{-1:24629} state up:standby seq 1 addr [v2:172.21.15.125:6832/1915771333,v1:172.21.15.125:6833/1915771333] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.539 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.j{-1:24647} state up:standby seq 1 addr [v2:172.21.15.50:6834/817994746,v1:172.21.15.50:6835/817994746] compat {c=[1],r=[1],i=[fff]}] 2023-10-26T06:43:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f81800a58e0 msgr2=0x7f81800a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f81800a58e0 0x7f81800a7da0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8184006010 tx=0x7f818400b260 comp rx=0 tx=0).stop 2023-10-26T06:43:14.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 msgr2=0x7f8190196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:14.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190196ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f818800ef30 tx=0x7f818800c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 shutdown_connections 2023-10-26T06:43:14.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f81800a58e0 0x7f81800a7da0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81901067a0 0x7f8190196ac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8190068190 0x7f819019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 --2- 172.21.15.50:0/1586831180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8190068b30 0x7f819019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:14.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 >> 172.21.15.50:0/1586831180 conn(0x7f8190075790 msgr2=0x7f81900fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:14.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 shutdown_connections 2023-10-26T06:43:14.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:14.531+0000 7f8197213700 1 -- 172.21.15.50:0/1586831180 wait complete. 2023-10-26T06:43:14.543 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:43:15.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-26T06:43:15.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:14 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1586831180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-26T06:43:15.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:14 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1586831180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-26T06:43:15.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:14 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1586831180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-26T06:43:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:16.149 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:15 smithi050 ceph-mon[94997]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:16.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:15 smithi125 ceph-mon[130643]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:16.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:15 smithi153 ceph-mon[131657]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:17.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.456+0000 7f99e7e61700 1 -- 172.21.15.50:0/3745843430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e01057c0 msgr2=0x7f99e0105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:17.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.456+0000 7f99e7e61700 1 --2- 172.21.15.50:0/3745843430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e01057c0 0x7f99e0105ba0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009990 tx=0x7f99dc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 -- 172.21.15.50:0/3745843430 shutdown_connections 2023-10-26T06:43:17.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 --2- 172.21.15.50:0/3745843430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99e0101260 0x7f99e010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 --2- 172.21.15.50:0/3745843430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e01057c0 0x7f99e0105ba0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 --2- 172.21.15.50:0/3745843430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 0x7f99e0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 -- 172.21.15.50:0/3745843430 >> 172.21.15.50:0/3745843430 conn(0x7f99e00779e0 msgr2=0x7f99e0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:17.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 -- 172.21.15.50:0/3745843430 shutdown_connections 2023-10-26T06:43:17.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.457+0000 7f99e7e61700 1 -- 172.21.15.50:0/3745843430 wait complete. 2023-10-26T06:43:17.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.458+0000 7f99e7e61700 1 Processor -- start 2023-10-26T06:43:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 -- start start 2023-10-26T06:43:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 0x7f99e019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 0x7f99e019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99e01057c0 0x7f99e0196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:17.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e01970e0 con 0x7f99e0101260 2023-10-26T06:43:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0197250 con 0x7f99e01008a0 2023-10-26T06:43:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e7e61700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0197410 con 0x7f99e01057c0 2023-10-26T06:43:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.459+0000 7f99e53fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 0x7f99e019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 0x7f99e019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40934/0 (socket says 172.21.15.50:40934) 2023-10-26T06:43:17.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 -- 172.21.15.50:0/609169085 learned_addr learned my addr 172.21.15.50:0/609169085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:17.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e5bfd700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 0x7f99e019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:17.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e63fe700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99e01057c0 0x7f99e0196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:17.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 -- 172.21.15.50:0/609169085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99e01057c0 msgr2=0x7f99e0196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:17.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99e01057c0 0x7f99e0196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 -- 172.21.15.50:0/609169085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 msgr2=0x7f99e019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:17.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 0x7f99e019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 -- 172.21.15.50:0/609169085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0095f0 con 0x7f99e0101260 2023-10-26T06:43:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e5bfd700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 0x7f99e019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99e53fc700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 0x7f99e019ce80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e9a0 tx=0x7f99d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0009790 con 0x7f99e0101260 2023-10-26T06:43:17.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99d0010430 con 0x7f99e0101260 2023-10-26T06:43:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.460+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0018680 con 0x7f99e0101260 2023-10-26T06:43:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.461+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e01976f0 con 0x7f99e0101260 2023-10-26T06:43:17.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.461+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e01a3930 con 0x7f99e0101260 2023-10-26T06:43:17.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.462+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0108d80 con 0x7f99e0101260 2023-10-26T06:43:17.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.464+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f99d00105a0 con 0x7f99e0101260 2023-10-26T06:43:17.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.465+0000 7f99d6ffd700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99cc0a1550 0x7f99cc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.465+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f99d0014070 con 0x7f99e0101260 2023-10-26T06:43:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.465+0000 7f99e5bfd700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99cc0a1550 0x7f99cc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:17.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.466+0000 7f99e5bfd700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99cc0a1550 0x7f99cc0a3a10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00b2e0 tx=0x7f99dc005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:17.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.469+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99d0096510 con 0x7f99e0101260 2023-10-26T06:43:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.681+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f99e0197f40 con 0x7f99e0101260 2023-10-26T06:43:17.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.682+0000 7f99d6ffd700 1 -- 172.21.15.50:0/609169085 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5597 (secure 0 0 0) 0x7f99d0099b30 con 0x7f99e0101260 2023-10-26T06:43:17.684 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 86 2023-10-26T06:43:17.684 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:43:17.684 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-10-26T06:33:16.188624+0000 2023-10-26T06:43:17.685 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2023-10-26T06:42:30.695908+0000 2023-10-26T06:43:17.685 INFO:teuthology.orchestra.run.smithi050.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-26T06:43:17.685 INFO:teuthology.orchestra.run.smithi050.stdout:crush_version 26 2023-10-26T06:43:17.685 INFO:teuthology.orchestra.run.smithi050.stdout:full_ratio 0.95 2023-10-26T06:43:17.685 INFO:teuthology.orchestra.run.smithi050.stdout:backfillfull_ratio 0.9 2023-10-26T06:43:17.686 INFO:teuthology.orchestra.run.smithi050.stdout:nearfull_ratio 0.85 2023-10-26T06:43:17.686 INFO:teuthology.orchestra.run.smithi050.stdout:require_min_compat_client luminous 2023-10-26T06:43:17.686 INFO:teuthology.orchestra.run.smithi050.stdout:min_compat_client luminous 2023-10-26T06:43:17.686 INFO:teuthology.orchestra.run.smithi050.stdout:require_osd_release reef 2023-10-26T06:43:17.686 INFO:teuthology.orchestra.run.smithi050.stdout:stretch_mode_enabled false 2023-10-26T06:43:17.687 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-26T06:43:17.687 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-26T06:43:17.687 INFO:teuthology.orchestra.run.smithi050.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-26T06:43:17.687 INFO:teuthology.orchestra.run.smithi050.stdout:max_osd 12 2023-10-26T06:43:17.687 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 up in weight 1 up_from 9 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6802/4270342949,v1:172.21.15.50:6803/4270342949] [v2:172.21.15.50:6804/4270342949,v1:172.21.15.50:6805/4270342949] exists,up cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7 2023-10-26T06:43:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 up in weight 1 up_from 14 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6800/2294493733,v1:172.21.15.125:6801/2294493733] [v2:172.21.15.125:6802/2294493733,v1:172.21.15.125:6803/2294493733] exists,up c0dee837-e527-4d2c-a2b7-6be86efb66bb 2023-10-26T06:43:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 up in weight 1 up_from 19 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/3455493796,v1:172.21.15.153:6801/3455493796] [v2:172.21.15.153:6802/3455493796,v1:172.21.15.153:6803/3455493796] exists,up 9e6a6b09-22ef-4586-af08-5d4a22e70fb4 2023-10-26T06:43:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6810/2387269481,v1:172.21.15.50:6811/2387269481] [v2:172.21.15.50:6812/2387269481,v1:172.21.15.50:6813/2387269481] exists,up 13dce44a-ed55-4e67-9a10-1d728d5481e3 2023-10-26T06:43:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 up in weight 1 up_from 34 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6808/1302238589,v1:172.21.15.125:6809/1302238589] [v2:172.21.15.125:6810/1302238589,v1:172.21.15.125:6811/1302238589] exists,up 3204503f-f6de-43fa-a3cb-f4d7e5213c4f 2023-10-26T06:43:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 up in weight 1 up_from 39 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/2001551915,v1:172.21.15.153:6809/2001551915] [v2:172.21.15.153:6810/2001551915,v1:172.21.15.153:6811/2001551915] exists,up 8da6ddc7-6f23-4f38-972e-57bac47dfd40 2023-10-26T06:43:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6818/3555167697,v1:172.21.15.50:6819/3555167697] [v2:172.21.15.50:6820/3555167697,v1:172.21.15.50:6821/3555167697] exists,up a6b0ab31-fd81-4000-945c-064c4d303b22 2023-10-26T06:43:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 up in weight 1 up_from 52 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6816/3807250109,v1:172.21.15.125:6817/3807250109] [v2:172.21.15.125:6818/3807250109,v1:172.21.15.125:6819/3807250109] exists,up 7657f951-0ca2-4e41-adfd-ff76ea7c65eb 2023-10-26T06:43:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 up in weight 1 up_from 59 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/3815055379,v1:172.21.15.153:6817/3815055379] [v2:172.21.15.153:6818/3815055379,v1:172.21.15.153:6819/3815055379] exists,up 863809b1-9944-4b1a-8e37-a8c0ce125f5c 2023-10-26T06:43:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 up in weight 1 up_from 67 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6826/2403450797,v1:172.21.15.50:6827/2403450797] [v2:172.21.15.50:6828/2403450797,v1:172.21.15.50:6829/2403450797] exists,up 238027b3-5f4d-49a2-be84-e1b201ef5db3 2023-10-26T06:43:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 up in weight 1 up_from 72 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6824/4125267059,v1:172.21.15.125:6825/4125267059] [v2:172.21.15.125:6826/4125267059,v1:172.21.15.125:6827/4125267059] exists,up f1dfbdc7-aa84-41c3-a312-1e0b72311863 2023-10-26T06:43:17.689 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 up in weight 1 up_from 79 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6824/356376297,v1:172.21.15.153:6825/356376297] [v2:172.21.15.153:6826/356376297,v1:172.21.15.153:6827/356376297] exists,up f3c32b99-ba7b-41b0-82b8-f3c139e5c21a 2023-10-26T06:43:17.690 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.a [2,11] 2023-10-26T06:43:17.690 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.f [8,11] 2023-10-26T06:43:17.690 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.1 [4,9] 2023-10-26T06:43:17.690 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.2 [3,9] 2023-10-26T06:43:17.690 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.2c [4,9] 2023-10-26T06:43:17.691 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/1314120136 expires 2023-10-27T06:35:29.545969+0000 2023-10-26T06:43:17.691 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2911133373 expires 2023-10-27T06:34:16.859427+0000 2023-10-26T06:43:17.691 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/1503297701 expires 2023-10-27T06:34:16.859427+0000 2023-10-26T06:43:17.691 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/1314120136 expires 2023-10-27T06:35:29.545969+0000 2023-10-26T06:43:17.691 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2663349310 expires 2023-10-27T06:35:29.545969+0000 2023-10-26T06:43:17.692 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1124107424 expires 2023-10-27T06:34:16.859427+0000 2023-10-26T06:43:17.692 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/2908802913 expires 2023-10-27T06:33:49.700512+0000 2023-10-26T06:43:17.692 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/3300695880 expires 2023-10-27T06:33:49.700512+0000 2023-10-26T06:43:17.692 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/366874467 expires 2023-10-27T06:33:49.700512+0000 2023-10-26T06:43:17.692 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/1503297701 expires 2023-10-27T06:34:16.859427+0000 2023-10-26T06:43:17.692 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/2908802913 expires 2023-10-27T06:33:49.700512+0000 2023-10-26T06:43:17.693 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/998830555 expires 2023-10-27T06:33:49.700512+0000 2023-10-26T06:43:17.693 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/4014613334 expires 2023-10-27T06:35:29.545969+0000 2023-10-26T06:43:17.693 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2617197618 expires 2023-10-27T06:35:29.545969+0000 2023-10-26T06:43:17.693 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1905106945 expires 2023-10-27T06:34:16.859427+0000 2023-10-26T06:43:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.684+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99cc0a1550 msgr2=0x7f99cc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.684+0000 7f99e7e61700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99cc0a1550 0x7f99cc0a3a10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00b2e0 tx=0x7f99dc005fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.684+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 msgr2=0x7f99e019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.684+0000 7f99e7e61700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 0x7f99e019ce80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e9a0 tx=0x7f99d000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 shutdown_connections 2023-10-26T06:43:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99cc0a1550 0x7f99cc0a3a10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99e01057c0 0x7f99e0196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99e01008a0 0x7f99e019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 --2- 172.21.15.50:0/609169085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99e0101260 0x7f99e019ce80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 >> 172.21.15.50:0/609169085 conn(0x7f99e00779e0 msgr2=0x7f99e00fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 shutdown_connections 2023-10-26T06:43:17.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:17.685+0000 7f99e7e61700 1 -- 172.21.15.50:0/609169085 wait complete. 2023-10-26T06:43:18.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:17 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/609169085' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-26T06:43:18.143 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-26T06:43:18.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:18.192 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:17 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/609169085' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-26T06:43:18.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:17 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/609169085' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-26T06:43:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 -- 172.21.15.50:0/3587303877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241066b0 msgr2=0x7fac24106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 --2- 172.21.15.50:0/3587303877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241066b0 0x7fac24106a90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fac14009990 tx=0x7fac14009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 -- 172.21.15.50:0/3587303877 shutdown_connections 2023-10-26T06:43:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 --2- 172.21.15.50:0/3587303877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac24101060 0x7fac2410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 --2- 172.21.15.50:0/3587303877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241066b0 0x7fac24106a90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 --2- 172.21.15.50:0/3587303877 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac241006a0 0x7fac24100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 -- 172.21.15.50:0/3587303877 >> 172.21.15.50:0/3587303877 conn(0x7fac240fc1d0 msgr2=0x7fac240fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 -- 172.21.15.50:0/3587303877 shutdown_connections 2023-10-26T06:43:18.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.399+0000 7fac29bff700 1 -- 172.21.15.50:0/3587303877 wait complete. 2023-10-26T06:43:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.400+0000 7fac29bff700 1 Processor -- start 2023-10-26T06:43:18.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 -- start start 2023-10-26T06:43:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 0x7fac2419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac24101060 0x7fac2419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac241066b0 0x7fac24196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24196fe0 con 0x7fac241006a0 2023-10-26T06:43:18.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24197150 con 0x7fac24101060 2023-10-26T06:43:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.401+0000 7fac29bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24197310 con 0x7fac241066b0 2023-10-26T06:43:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 0x7fac2419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 0x7fac2419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40960/0 (socket says 172.21.15.50:40960) 2023-10-26T06:43:18.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 -- 172.21.15.50:0/1508374672 learned_addr learned my addr 172.21.15.50:0/1508374672 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac22ffd700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac24101060 0x7fac2419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac23fff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac241066b0 0x7fac24196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 -- 172.21.15.50:0/1508374672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac241066b0 msgr2=0x7fac24196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac241066b0 0x7fac24196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 -- 172.21.15.50:0/1508374672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac24101060 msgr2=0x7fac2419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac24101060 0x7fac2419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 -- 172.21.15.50:0/1508374672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140095f0 con 0x7fac241006a0 2023-10-26T06:43:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac23fff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac241066b0 0x7fac24196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac22ffd700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac24101060 0x7fac2419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac237fe700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 0x7fac2419c800 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fac14005910 tx=0x7fac14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.402+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1401d070 con 0x7fac241006a0 2023-10-26T06:43:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.403+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac24197590 con 0x7fac241006a0 2023-10-26T06:43:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.403+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac14022470 con 0x7fac241006a0 2023-10-26T06:43:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.403+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14017650 con 0x7fac241006a0 2023-10-26T06:43:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.403+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac241a37f0 con 0x7fac241006a0 2023-10-26T06:43:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.404+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24108ca0 con 0x7fac241006a0 2023-10-26T06:43:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.406+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fac140225e0 con 0x7fac241006a0 2023-10-26T06:43:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.407+0000 7fac20ff9700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fac0c0a14d0 0x7fac0c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.407+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fac140ce590 con 0x7fac241006a0 2023-10-26T06:43:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.407+0000 7fac22ffd700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fac0c0a14d0 0x7fac0c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.408+0000 7fac22ffd700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fac0c0a14d0 0x7fac0c0a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac24197af0 tx=0x7fac18009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:18.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.409+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fac14097c10 con 0x7fac241006a0 2023-10-26T06:43:18.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.621+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac24101de0 con 0x7fac241006a0 2023-10-26T06:43:18.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.623+0000 7fac20ff9700 1 -- 172.21.15.50:0/1508374672 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7fac1409b230 con 0x7fac241006a0 2023-10-26T06:43:18.625 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:18.625 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fac0c0a14d0 msgr2=0x7fac0c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fac0c0a14d0 0x7fac0c0a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac24197af0 tx=0x7fac18009260 comp rx=0 tx=0).stop 2023-10-26T06:43:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 msgr2=0x7fac2419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 0x7fac2419c800 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fac14005910 tx=0x7fac14004730 comp rx=0 tx=0).stop 2023-10-26T06:43:18.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 shutdown_connections 2023-10-26T06:43:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fac0c0a14d0 0x7fac0c0a3990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac241066b0 0x7fac24196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac241006a0 0x7fac2419c800 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 --2- 172.21.15.50:0/1508374672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac24101060 0x7fac2419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 >> 172.21.15.50:0/1508374672 conn(0x7fac240fc1d0 msgr2=0x7fac240fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:18.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 shutdown_connections 2023-10-26T06:43:18.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.625+0000 7fac29bff700 1 -- 172.21.15.50:0/1508374672 wait complete. 2023-10-26T06:43:18.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:43:18.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:43:18.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 -- 172.21.15.50:0/1516127772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc100720 msgr2=0x7f83bc100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 --2- 172.21.15.50:0/1516127772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc100720 0x7f83bc100ba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009990 tx=0x7f83ac009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 -- 172.21.15.50:0/1516127772 shutdown_connections 2023-10-26T06:43:18.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 --2- 172.21.15.50:0/1516127772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83bc1010e0 0x7f83bc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 --2- 172.21.15.50:0/1516127772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 0x7f83bc106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 --2- 172.21.15.50:0/1516127772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc100720 0x7f83bc100ba0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 -- 172.21.15.50:0/1516127772 >> 172.21.15.50:0/1516127772 conn(0x7f83bc0fc1b0 msgr2=0x7f83bc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:18.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 -- 172.21.15.50:0/1516127772 shutdown_connections 2023-10-26T06:43:18.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.855+0000 7f83c3fff700 1 -- 172.21.15.50:0/1516127772 wait complete. 2023-10-26T06:43:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.856+0000 7f83c3fff700 1 Processor -- start 2023-10-26T06:43:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.856+0000 7f83c3fff700 1 -- start start 2023-10-26T06:43:18.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83bc100720 0x7f83bc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 0x7f83bc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 0x7f83bc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1a4fd0 con 0x7f83bc106730 2023-10-26T06:43:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c3fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1a5140 con 0x7f83bc1010e0 2023-10-26T06:43:18.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1a5300 con 0x7f83bc100720 2023-10-26T06:43:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 0x7f83bc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 0x7f83bc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 0x7f83bc073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:50948/0 (socket says 172.21.15.50:50948) 2023-10-26T06:43:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 -- 172.21.15.50:0/2924143922 learned_addr learned my addr 172.21.15.50:0/2924143922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:18.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c1d9b700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83bc100720 0x7f83bc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 -- 172.21.15.50:0/2924143922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83bc100720 msgr2=0x7f83bc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83bc100720 0x7f83bc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 -- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 msgr2=0x7f83bc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:18.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 0x7f83bc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c159a700 1 -- 172.21.15.50:0/2924143922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009520 con 0x7f83bc1010e0 2023-10-26T06:43:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.857+0000 7f83c259c700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 0x7f83bc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.858+0000 7f83c159a700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 0x7f83bc073030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.858+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac01d070 con 0x7f83bc1010e0 2023-10-26T06:43:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.858+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac0095f0 con 0x7f83bc1010e0 2023-10-26T06:43:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.858+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83ac022470 con 0x7f83bc1010e0 2023-10-26T06:43:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.858+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac017650 con 0x7f83bc1010e0 2023-10-26T06:43:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.858+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc1a5920 con 0x7f83bc1010e0 2023-10-26T06:43:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.859+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc108d40 con 0x7f83bc1010e0 2023-10-26T06:43:18.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.861+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f83ac0225e0 con 0x7f83bc1010e0 2023-10-26T06:43:18.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.862+0000 7f83b2ffd700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83a80a14d0 0x7f83a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:18.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.862+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f83ac0ce200 con 0x7f83bc1010e0 2023-10-26T06:43:18.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.862+0000 7f83c1d9b700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83a80a14d0 0x7f83a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:18.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.863+0000 7f83c1d9b700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83a80a14d0 0x7f83a80a3990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009d70 tx=0x7f83b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:18.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:18.865+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83ac097820 con 0x7f83bc1010e0 2023-10-26T06:43:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:18 smithi050 ceph-mon[94997]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-26T06:43:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:18 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1508374672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.078+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83bc073fd0 con 0x7f83bc1010e0 2023-10-26T06:43:19.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.078+0000 7f83b2ffd700 1 -- 172.21.15.50:0/2924143922 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83ac027020 con 0x7f83bc1010e0 2023-10-26T06:43:19.080 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:43:19.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83a80a14d0 msgr2=0x7f83a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83a80a14d0 0x7f83a80a3990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009d70 tx=0x7f83b8009260 comp rx=0 tx=0).stop 2023-10-26T06:43:19.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 msgr2=0x7f83bc073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 0x7f83bc073030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac005740 comp rx=0 tx=0).stop 2023-10-26T06:43:19.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 shutdown_connections 2023-10-26T06:43:19.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f83a80a14d0 0x7f83a80a3990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83bc106730 0x7f83bc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83bc100720 0x7f83bc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 --2- 172.21.15.50:0/2924143922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83bc1010e0 0x7f83bc073030 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 >> 172.21.15.50:0/2924143922 conn(0x7f83bc0fc1b0 msgr2=0x7f83bc0fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:19.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 shutdown_connections 2023-10-26T06:43:19.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.081+0000 7f83c3fff700 1 -- 172.21.15.50:0/2924143922 wait complete. 2023-10-26T06:43:19.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:43:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:18 smithi125 ceph-mon[130643]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-26T06:43:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:18 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1508374672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:18 smithi153 ceph-mon[131657]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-10-26T06:43:19.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:18 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1508374672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 -- 172.21.15.50:0/4108210949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c10cf60 msgr2=0x7f2a2c10f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 --2- 172.21.15.50:0/4108210949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c10f3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009f90 tx=0x7f2a2400b330 comp rx=0 tx=0).stop 2023-10-26T06:43:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 -- 172.21.15.50:0/4108210949 shutdown_connections 2023-10-26T06:43:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 --2- 172.21.15.50:0/4108210949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c10f3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 --2- 172.21.15.50:0/4108210949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c072c20 0x7f2a2c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 --2- 172.21.15.50:0/4108210949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 0x7f2a2c10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 -- 172.21.15.50:0/4108210949 >> 172.21.15.50:0/4108210949 conn(0x7f2a2c0fc1b0 msgr2=0x7f2a2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 -- 172.21.15.50:0/4108210949 shutdown_connections 2023-10-26T06:43:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.308+0000 7f2a319ff700 1 -- 172.21.15.50:0/4108210949 wait complete. 2023-10-26T06:43:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.309+0000 7f2a319ff700 1 Processor -- start 2023-10-26T06:43:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.309+0000 7f2a319ff700 1 -- start start 2023-10-26T06:43:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a319ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c072c20 0x7f2a2c198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a319ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 0x7f2a2c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a319ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c19d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a319ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c19de30 con 0x7f2a2c10cf60 2023-10-26T06:43:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a319ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c19dfa0 con 0x7f2a2c072c20 2023-10-26T06:43:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a319ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c19e160 con 0x7f2a2c073540 2023-10-26T06:43:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c19d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c072c20 0x7f2a2c198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c19d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40982/0 (socket says 172.21.15.50:40982) 2023-10-26T06:43:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c072c20 0x7f2a2c198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:50964/0 (socket says 172.21.15.50:50964) 2023-10-26T06:43:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a2a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 0x7f2a2c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.310+0000 7f2a2affd700 1 -- 172.21.15.50:0/923908423 learned_addr learned my addr 172.21.15.50:0/923908423 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2b7fe700 1 -- 172.21.15.50:0/923908423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 msgr2=0x7f2a2c199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2b7fe700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 0x7f2a2c199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2b7fe700 1 -- 172.21.15.50:0/923908423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c072c20 msgr2=0x7f2a2c198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2b7fe700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c072c20 0x7f2a2c198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2b7fe700 1 -- 172.21.15.50:0/923908423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24009c40 con 0x7f2a2c10cf60 2023-10-26T06:43:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2a7fc700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 0x7f2a2c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a2b7fe700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c19d7f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400b6c0 tx=0x7f2a240094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400e040 con 0x7f2a2c10cf60 2023-10-26T06:43:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c19e3e0 con 0x7f2a2c10cf60 2023-10-26T06:43:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a2401b450 con 0x7f2a2c10cf60 2023-10-26T06:43:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240052a0 con 0x7f2a2c10cf60 2023-10-26T06:43:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.311+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c1a5c80 con 0x7f2a2c10cf60 2023-10-26T06:43:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.312+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c108170 con 0x7f2a2c10cf60 2023-10-26T06:43:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.314+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2a2401b5c0 con 0x7f2a2c10cf60 2023-10-26T06:43:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.316+0000 7f2a309fd700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a140a14d0 0x7f2a140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.316+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2a240cdfa0 con 0x7f2a2c10cf60 2023-10-26T06:43:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.316+0000 7f2a2affd700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a140a14d0 0x7f2a140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.317+0000 7f2a2affd700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a140a14d0 0x7f2a140a3990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005950 tx=0x7f2a1c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.320+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2a240975c0 con 0x7f2a2c10cf60 2023-10-26T06:43:19.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.531+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a2c19a210 con 0x7f2a2c10cf60 2023-10-26T06:43:19.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.532+0000 7f2a309fd700 1 -- 172.21.15.50:0/923908423 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a2409abe0 con 0x7f2a2c10cf60 2023-10-26T06:43:19.534 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:43:19.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a140a14d0 msgr2=0x7f2a140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a140a14d0 0x7f2a140a3990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005950 tx=0x7f2a1c009310 comp rx=0 tx=0).stop 2023-10-26T06:43:19.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 msgr2=0x7f2a2c19d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c19d7f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400b6c0 tx=0x7f2a240094b0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 shutdown_connections 2023-10-26T06:43:19.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2a140a14d0 0x7f2a140a3990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a2c10cf60 0x7f2a2c19d7f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c072c20 0x7f2a2c198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 --2- 172.21.15.50:0/923908423 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c073540 0x7f2a2c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 >> 172.21.15.50:0/923908423 conn(0x7f2a2c0fc1b0 msgr2=0x7f2a2c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:19.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 shutdown_connections 2023-10-26T06:43:19.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.534+0000 7f2a319ff700 1 -- 172.21.15.50:0/923908423 wait complete. 2023-10-26T06:43:19.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:43:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 -- 172.21.15.50:0/2809568588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 msgr2=0x7fd7dc10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/2809568588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 0x7fd7dc10d5f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b0a0 tx=0x7fd7d400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 -- 172.21.15.50:0/2809568588 shutdown_connections 2023-10-26T06:43:19.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/2809568588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 0x7fd7dc10d5f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/2809568588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7dc106730 0x7fd7dc106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/2809568588 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc100720 0x7fd7dc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 -- 172.21.15.50:0/2809568588 >> 172.21.15.50:0/2809568588 conn(0x7fd7dc0fc1b0 msgr2=0x7fd7dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 -- 172.21.15.50:0/2809568588 shutdown_connections 2023-10-26T06:43:19.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.761+0000 7fd7e31ff700 1 -- 172.21.15.50:0/2809568588 wait complete. 2023-10-26T06:43:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 Processor -- start 2023-10-26T06:43:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 -- start start 2023-10-26T06:43:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7dc100720 0x7fd7dc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 0x7fd7dc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 0x7fd7dc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1a4f90 con 0x7fd7dc1010e0 2023-10-26T06:43:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1a5100 con 0x7fd7dc106730 2023-10-26T06:43:19.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.762+0000 7fd7e31ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1a52c0 con 0x7fd7dc100720 2023-10-26T06:43:19.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 0x7fd7dc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 0x7fd7dc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e0f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7dc100720 0x7fd7dc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 0x7fd7dc073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:50990/0 (socket says 172.21.15.50:50990) 2023-10-26T06:43:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 -- 172.21.15.50:0/3406574902 learned_addr learned my addr 172.21.15.50:0/3406574902 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:19.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 -- 172.21.15.50:0/3406574902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7dc100720 msgr2=0x7fd7dc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7dc100720 0x7fd7dc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 -- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 msgr2=0x7fd7dc073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 0x7fd7dc073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 -- 172.21.15.50:0/3406574902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009520 con 0x7fd7dc106730 2023-10-26T06:43:19.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.763+0000 7fd7e179c700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 0x7fd7dc073570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b070 tx=0x7fd7d40077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.764+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400e040 con 0x7fd7dc106730 2023-10-26T06:43:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.764+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7d40094c0 con 0x7fd7dc106730 2023-10-26T06:43:19.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.764+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d4009d00 con 0x7fd7dc106730 2023-10-26T06:43:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.764+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40043a0 con 0x7fd7dc106730 2023-10-26T06:43:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.764+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc1a5880 con 0x7fd7dc106730 2023-10-26T06:43:19.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.765+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc108d20 con 0x7fd7dc106730 2023-10-26T06:43:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.766+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd7d4004500 con 0x7fd7dc106730 2023-10-26T06:43:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.768+0000 7fd7d9ffb700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7cc0a1550 0x7fd7cc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.768+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd7d40cdc00 con 0x7fd7dc106730 2023-10-26T06:43:19.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.768+0000 7fd7e0f9b700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7cc0a1550 0x7fd7cc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:19.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.769+0000 7fd7e0f9b700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7cc0a1550 0x7fd7cc0a3a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009be0 tx=0x7fd7d0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:19.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.772+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7d4097220 con 0x7fd7dc106730 2023-10-26T06:43:19.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.985+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7dc073fd0 con 0x7fd7dc106730 2023-10-26T06:43:19.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.986+0000 7fd7d9ffb700 1 -- 172.21.15.50:0/3406574902 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7d409a840 con 0x7fd7dc106730 2023-10-26T06:43:19.988 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:43:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7cc0a1550 msgr2=0x7fd7cc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7cc0a1550 0x7fd7cc0a3a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009be0 tx=0x7fd7d0009260 comp rx=0 tx=0).stop 2023-10-26T06:43:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 msgr2=0x7fd7dc073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 0x7fd7dc073570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400b070 tx=0x7fd7d40077f0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 shutdown_connections 2023-10-26T06:43:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7cc0a1550 0x7fd7cc0a3a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7dc106730 0x7fd7dc073570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7dc100720 0x7fd7dc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 --2- 172.21.15.50:0/3406574902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7dc1010e0 0x7fd7dc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:19.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 >> 172.21.15.50:0/3406574902 conn(0x7fd7dc0fc1b0 msgr2=0x7fd7dc0fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 shutdown_connections 2023-10-26T06:43:19.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:19.989+0000 7fd7e31ff700 1 -- 172.21.15.50:0/3406574902 wait complete. 2023-10-26T06:43:20.008 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:19 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2924143922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.008 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:19 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/923908423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:43:20.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:19 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2924143922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:19 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/923908423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 -- 172.21.15.50:0/1671364330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 msgr2=0x7f198c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 --2- 172.21.15.50:0/1671364330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c106940 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f19880099c0 tx=0x7f1988009cd0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 -- 172.21.15.50:0/1671364330 shutdown_connections 2023-10-26T06:43:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 --2- 172.21.15.50:0/1671364330 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f198c100e60 0x7f198c10d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 --2- 172.21.15.50:0/1671364330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c106940 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 --2- 172.21.15.50:0/1671364330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198c1004a0 0x7f198c100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 -- 172.21.15.50:0/1671364330 >> 172.21.15.50:0/1671364330 conn(0x7f198c0fbfb0 msgr2=0x7f198c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 -- 172.21.15.50:0/1671364330 shutdown_connections 2023-10-26T06:43:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.214+0000 7f199339d700 1 -- 172.21.15.50:0/1671364330 wait complete. 2023-10-26T06:43:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.215+0000 7f199339d700 1 Processor -- start 2023-10-26T06:43:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 -- start start 2023-10-26T06:43:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198c1004a0 0x7f198c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f198c100e60 0x7f198c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c198f90 con 0x7f198c106560 2023-10-26T06:43:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c199100 con 0x7f198c100e60 2023-10-26T06:43:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199339d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1992c0 con 0x7f198c1004a0 2023-10-26T06:43:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f1992b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f1992b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41026/0 (socket says 172.21.15.50:41026) 2023-10-26T06:43:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f1992b9c700 1 -- 172.21.15.50:0/900983944 learned_addr learned my addr 172.21.15.50:0/900983944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f1991b9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f198c100e60 0x7f198c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.216+0000 7f199239b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198c1004a0 0x7f198c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f1992b9c700 1 -- 172.21.15.50:0/900983944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198c1004a0 msgr2=0x7f198c19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f1992b9c700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198c1004a0 0x7f198c19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f1992b9c700 1 -- 172.21.15.50:0/900983944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f198c100e60 msgr2=0x7f198c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f1992b9c700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f198c100e60 0x7f198c19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f1992b9c700 1 -- 172.21.15.50:0/900983944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880095f0 con 0x7f198c106560 2023-10-26T06:43:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f1992b9c700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c198930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f198400ef30 tx=0x7f198400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984018070 con 0x7f198c106560 2023-10-26T06:43:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f198400f040 con 0x7f198c106560 2023-10-26T06:43:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c199540 con 0x7f198c106560 2023-10-26T06:43:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400cd00 con 0x7f198c106560 2023-10-26T06:43:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.217+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c1a57f0 con 0x7f198c106560 2023-10-26T06:43:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.218+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c101bc0 con 0x7f198c106560 2023-10-26T06:43:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.220+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f1984003a00 con 0x7f198c106560 2023-10-26T06:43:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.221+0000 7f19837fe700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f19780a1550 0x7f19780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.222+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f19840cc950 con 0x7f198c106560 2023-10-26T06:43:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.222+0000 7f199239b700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f19780a1550 0x7f19780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.222+0000 7f199239b700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f19780a1550 0x7f19780a3a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1988009990 tx=0x7f1988019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.226+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1984095f70 con 0x7f198c106560 2023-10-26T06:43:20.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:19 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2924143922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:19 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/923908423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.482+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f198c0673e0 con 0x7f198c106560 2023-10-26T06:43:20.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.482+0000 7f19837fe700 1 -- 172.21.15.50:0/900983944 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7f1984099590 con 0x7f198c106560 2023-10-26T06:43:20.484 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:20.484 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:43:20.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f19780a1550 msgr2=0x7f19780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f19780a1550 0x7f19780a3a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1988009990 tx=0x7f1988019040 comp rx=0 tx=0).stop 2023-10-26T06:43:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 msgr2=0x7f198c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c198930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f198400ef30 tx=0x7f198400c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 shutdown_connections 2023-10-26T06:43:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f19780a1550 0x7f19780a3a10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f198c106560 0x7f198c198930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f198c1004a0 0x7f198c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 --2- 172.21.15.50:0/900983944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f198c100e60 0x7f198c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 >> 172.21.15.50:0/900983944 conn(0x7f198c0fbfb0 msgr2=0x7f198c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:20.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 shutdown_connections 2023-10-26T06:43:20.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.485+0000 7f199339d700 1 -- 172.21.15.50:0/900983944 wait complete. 2023-10-26T06:43:20.489 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:43:20.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 -- 172.21.15.50:0/2334055537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41006a0 msgr2=0x7f03e4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/2334055537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41006a0 0x7f03e4100b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009990 tx=0x7f03d4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 -- 172.21.15.50:0/2334055537 shutdown_connections 2023-10-26T06:43:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/2334055537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03e4101060 0x7f03e410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/2334055537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03e41066b0 0x7f03e4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/2334055537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41006a0 0x7f03e4100b20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 -- 172.21.15.50:0/2334055537 >> 172.21.15.50:0/2334055537 conn(0x7f03e40fc170 msgr2=0x7f03e40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 -- 172.21.15.50:0/2334055537 shutdown_connections 2023-10-26T06:43:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.710+0000 7f03ec1ff700 1 -- 172.21.15.50:0/2334055537 wait complete. 2023-10-26T06:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.711+0000 7f03ec1ff700 1 Processor -- start 2023-10-26T06:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.711+0000 7f03ec1ff700 1 -- start start 2023-10-26T06:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.711+0000 7f03ec1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03e41006a0 0x7f03e419e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ec1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03e4101060 0x7f03e419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ec1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 0x7f03e4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ec1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41991c0 con 0x7f03e41066b0 2023-10-26T06:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ec1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4199330 con 0x7f03e41006a0 2023-10-26T06:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ec1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41994f0 con 0x7f03e4101060 2023-10-26T06:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 0x7f03e4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 0x7f03e4198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41050/0 (socket says 172.21.15.50:41050) 2023-10-26T06:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 -- 172.21.15.50:0/3794064689 learned_addr learned my addr 172.21.15.50:0/3794064689 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03e9f9b700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03e41006a0 0x7f03e419e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03e979a700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03e4101060 0x7f03e419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 -- 172.21.15.50:0/3794064689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03e4101060 msgr2=0x7f03e419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03e4101060 0x7f03e419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 -- 172.21.15.50:0/3794064689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03e41006a0 msgr2=0x7f03e419e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03e41006a0 0x7f03e419e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 -- 172.21.15.50:0/3794064689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40095f0 con 0x7f03e41066b0 2023-10-26T06:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.712+0000 7f03ea79c700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 0x7f03e4198b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00ef30 tx=0x7f03dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:20.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.713+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc018070 con 0x7f03e41066b0 2023-10-26T06:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.713+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03dc00f040 con 0x7f03e41066b0 2023-10-26T06:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.713+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e4199770 con 0x7f03e41066b0 2023-10-26T06:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.713+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00cd00 con 0x7f03e41066b0 2023-10-26T06:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.713+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e41a59d0 con 0x7f03e41066b0 2023-10-26T06:43:20.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.714+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e4101de0 con 0x7f03e41066b0 2023-10-26T06:43:20.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.716+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f03dc003a00 con 0x7f03e41066b0 2023-10-26T06:43:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.717+0000 7f03daffd700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03d00a1550 0x7f03d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.717+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f03dc0cc8f0 con 0x7f03e41066b0 2023-10-26T06:43:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.717+0000 7f03e9f9b700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03d00a1550 0x7f03d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:20.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.718+0000 7f03e9f9b700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03d00a1550 0x7f03d00a3a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009be0 tx=0x7f03e0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:20.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.721+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03dc095f70 con 0x7f03e41066b0 2023-10-26T06:43:20.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:20 smithi050 ceph-mon[94997]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:20.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:20 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3406574902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:20.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:20 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/900983944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.937+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03e40674e0 con 0x7f03e41066b0 2023-10-26T06:43:20.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.939+0000 7f03daffd700 1 -- 172.21.15.50:0/3794064689 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7f03dc099590 con 0x7f03e41066b0 2023-10-26T06:43:20.940 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:20.941 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03d00a1550 msgr2=0x7f03d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03d00a1550 0x7f03d00a3a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009be0 tx=0x7f03e0009260 comp rx=0 tx=0).stop 2023-10-26T06:43:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 msgr2=0x7f03e4198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 0x7f03e4198b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00ef30 tx=0x7f03dc00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 shutdown_connections 2023-10-26T06:43:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03d00a1550 0x7f03d00a3a10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e41066b0 0x7f03e4198b60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03e41006a0 0x7f03e419e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 --2- 172.21.15.50:0/3794064689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03e4101060 0x7f03e419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 >> 172.21.15.50:0/3794064689 conn(0x7f03e40fc170 msgr2=0x7f03e40fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 shutdown_connections 2023-10-26T06:43:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:20.941+0000 7f03ec1ff700 1 -- 172.21.15.50:0/3794064689 wait complete. 2023-10-26T06:43:20.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:43:20.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:43:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.168+0000 7fdfaa39d700 1 -- 172.21.15.50:0/2722104282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 msgr2=0x7fdfa4100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.168+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/2722104282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4100a50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf940099c0 tx=0x7fdf94009cd0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 -- 172.21.15.50:0/2722104282 shutdown_connections 2023-10-26T06:43:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/2722104282 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfa4100f90 0x7fdfa410d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/2722104282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfa4106690 0x7fdfa4106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/2722104282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4100a50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 -- 172.21.15.50:0/2722104282 >> 172.21.15.50:0/2722104282 conn(0x7fdfa40fc0c0 msgr2=0x7fdfa40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 -- 172.21.15.50:0/2722104282 shutdown_connections 2023-10-26T06:43:21.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.169+0000 7fdfaa39d700 1 -- 172.21.15.50:0/2722104282 wait complete. 2023-10-26T06:43:21.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:20 smithi125 ceph-mon[130643]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:21.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:20 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3406574902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:21.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:20 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/900983944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 Processor -- start 2023-10-26T06:43:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 -- start start 2023-10-26T06:43:21.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfa4100f90 0x7fdfa4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfa4106690 0x7fdfa4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa41a4df0 con 0x7fdfa41005d0 2023-10-26T06:43:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa41a4f60 con 0x7fdfa4106690 2023-10-26T06:43:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfaa39d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa41a5120 con 0x7fdfa4100f90 2023-10-26T06:43:21.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.170+0000 7fdfa939b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41066/0 (socket says 172.21.15.50:41066) 2023-10-26T06:43:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 -- 172.21.15.50:0/3587746649 learned_addr learned my addr 172.21.15.50:0/3587746649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa8b9a700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfa4100f90 0x7fdfa4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa9b9c700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfa4106690 0x7fdfa4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 -- 172.21.15.50:0/3587746649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfa4100f90 msgr2=0x7fdfa4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfa4100f90 0x7fdfa4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 -- 172.21.15.50:0/3587746649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfa4106690 msgr2=0x7fdfa4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfa4106690 0x7fdfa4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 -- 172.21.15.50:0/3587746649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940095f0 con 0x7fdfa41005d0 2023-10-26T06:43:21.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdfa939b700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4072af0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e9a0 tx=0x7fdfa000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0009790 con 0x7fdfa41005d0 2023-10-26T06:43:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfa000cbd0 con 0x7fdfa41005d0 2023-10-26T06:43:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.171+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0018680 con 0x7fdfa41005d0 2023-10-26T06:43:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.172+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa41a5400 con 0x7fdfa41005d0 2023-10-26T06:43:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.172+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa41a5890 con 0x7fdfa41005d0 2023-10-26T06:43:21.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.173+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa4108b30 con 0x7fdfa41005d0 2023-10-26T06:43:21.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.175+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdfa000cd40 con 0x7fdfa41005d0 2023-10-26T06:43:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.176+0000 7fdf9a7fc700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdf900a14d0 0x7fdf900a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.176+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdfa0014070 con 0x7fdfa41005d0 2023-10-26T06:43:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.176+0000 7fdfa8b9a700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdf900a14d0 0x7fdf900a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.177+0000 7fdfa8b9a700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdf900a14d0 0x7fdf900a3990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009990 tx=0x7fdf94005ab0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:21.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.180+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdfa0052100 con 0x7fdfa41005d0 2023-10-26T06:43:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:20 smithi153 ceph-mon[131657]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:20 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3406574902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:21.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:20 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/900983944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:21.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.393+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfa4073fd0 con 0x7fdfa41005d0 2023-10-26T06:43:21.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.394+0000 7fdf9a7fc700 1 -- 172.21.15.50:0/3587746649 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfa0096660 con 0x7fdfa41005d0 2023-10-26T06:43:21.395 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:43:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdf900a14d0 msgr2=0x7fdf900a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdf900a14d0 0x7fdf900a3990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009990 tx=0x7fdf94005ab0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 msgr2=0x7fdfa4072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4072af0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e9a0 tx=0x7fdfa000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 shutdown_connections 2023-10-26T06:43:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdf900a14d0 0x7fdf900a3990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfa4106690 0x7fdfa4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfa41005d0 0x7fdfa4072af0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 --2- 172.21.15.50:0/3587746649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfa4100f90 0x7fdfa4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 >> 172.21.15.50:0/3587746649 conn(0x7fdfa40fc0c0 msgr2=0x7fdfa40fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:21.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 shutdown_connections 2023-10-26T06:43:21.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.396+0000 7fdfaa39d700 1 -- 172.21.15.50:0/3587746649 wait complete. 2023-10-26T06:43:21.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:43:21.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 -- 172.21.15.50:0/1676992430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33481010e0 msgr2=0x7f334810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 --2- 172.21.15.50:0/1676992430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33481010e0 0x7f334810d5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f334000b0a0 tx=0x7f334000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 -- 172.21.15.50:0/1676992430 shutdown_connections 2023-10-26T06:43:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 --2- 172.21.15.50:0/1676992430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33481010e0 0x7f334810d5f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 --2- 172.21.15.50:0/1676992430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3348106730 0x7f3348106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 --2- 172.21.15.50:0/1676992430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 -- 172.21.15.50:0/1676992430 >> 172.21.15.50:0/1676992430 conn(0x7f33480fc1b0 msgr2=0x7f33480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 -- 172.21.15.50:0/1676992430 shutdown_connections 2023-10-26T06:43:21.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.623+0000 7f334e9ff700 1 -- 172.21.15.50:0/1676992430 wait complete. 2023-10-26T06:43:21.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.624+0000 7f334e9ff700 1 Processor -- start 2023-10-26T06:43:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.624+0000 7f334e9ff700 1 -- start start 2023-10-26T06:43:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.624+0000 7f334e9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f334e9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33481010e0 0x7f3348199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f334e9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3348106730 0x7f334819c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f334e9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334819cb60 con 0x7f3348100720 2023-10-26T06:43:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f334e9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334819ccd0 con 0x7f3348106730 2023-10-26T06:43:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f334e9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334819ce90 con 0x7f33481010e0 2023-10-26T06:43:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41080/0 (socket says 172.21.15.50:41080) 2023-10-26T06:43:21.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 -- 172.21.15.50:0/2204791621 learned_addr learned my addr 172.21.15.50:0/2204791621 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f334cf9c700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3348106730 0x7f334819c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f33477fe700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33481010e0 0x7f3348199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 -- 172.21.15.50:0/2204791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33481010e0 msgr2=0x7f3348199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33481010e0 0x7f3348199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 -- 172.21.15.50:0/2204791621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3348106730 msgr2=0x7f334819c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3348106730 0x7f334819c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 -- 172.21.15.50:0/2204791621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340009d00 con 0x7f3348100720 2023-10-26T06:43:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.625+0000 7f3347fff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348198d30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f333800e9a0 tx=0x7f333800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.626+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338009790 con 0x7f3348100720 2023-10-26T06:43:21.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.626+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334819d170 con 0x7f3348100720 2023-10-26T06:43:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.626+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f333800cbd0 con 0x7f3348100720 2023-10-26T06:43:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.626+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338018680 con 0x7f3348100720 2023-10-26T06:43:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.626+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33481a5ad0 con 0x7f3348100720 2023-10-26T06:43:21.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.627+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348101e60 con 0x7f3348100720 2023-10-26T06:43:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.629+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f333800cd40 con 0x7f3348100720 2023-10-26T06:43:21.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.630+0000 7f33457fa700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f33300a14d0 0x7f33300a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.630+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3338014070 con 0x7f3348100720 2023-10-26T06:43:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.630+0000 7f33477fe700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f33300a14d0 0x7f33300a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:21.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.631+0000 7f33477fe700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f33300a14d0 0x7f33300a3990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f334819a240 tx=0x7f333c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:21.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.634+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3338052100 con 0x7f3348100720 2023-10-26T06:43:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.853+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33481106f0 con 0x7f3348100720 2023-10-26T06:43:21.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.854+0000 7f33457fa700 1 -- 172.21.15.50:0/2204791621 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33380965d0 con 0x7f3348100720 2023-10-26T06:43:21.856 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:43:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.856+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f33300a14d0 msgr2=0x7f33300a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.856+0000 7f334e9ff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f33300a14d0 0x7f33300a3990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f334819a240 tx=0x7f333c009260 comp rx=0 tx=0).stop 2023-10-26T06:43:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.856+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 msgr2=0x7f3348198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.856+0000 7f334e9ff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348198d30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f333800e9a0 tx=0x7f333800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.856+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 shutdown_connections 2023-10-26T06:43:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.856+0000 7f334e9ff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f33300a14d0 0x7f33300a3990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.857+0000 7f334e9ff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3348106730 0x7f334819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.857+0000 7f334e9ff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3348100720 0x7f3348198d30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.857+0000 7f334e9ff700 1 --2- 172.21.15.50:0/2204791621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33481010e0 0x7f3348199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.857+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 >> 172.21.15.50:0/2204791621 conn(0x7f33480fc1b0 msgr2=0x7f3348072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.857+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 shutdown_connections 2023-10-26T06:43:21.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:21.857+0000 7f334e9ff700 1 -- 172.21.15.50:0/2204791621 wait complete. 2023-10-26T06:43:21.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:43:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3794064689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3587746649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:22.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 -- 172.21.15.50:0/1880923953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6054106730 msgr2=0x7f6054106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 --2- 172.21.15.50:0/1880923953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6054106730 0x7f6054106b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6044009990 tx=0x7f6044009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 -- 172.21.15.50:0/1880923953 shutdown_connections 2023-10-26T06:43:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 --2- 172.21.15.50:0/1880923953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60541010e0 0x7f605410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 --2- 172.21.15.50:0/1880923953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6054106730 0x7f6054106b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 --2- 172.21.15.50:0/1880923953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6054100720 0x7f6054100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 -- 172.21.15.50:0/1880923953 >> 172.21.15.50:0/1880923953 conn(0x7f60540fc1b0 msgr2=0x7f60540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:22.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 -- 172.21.15.50:0/1880923953 shutdown_connections 2023-10-26T06:43:22.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.086+0000 7f60599ff700 1 -- 172.21.15.50:0/1880923953 wait complete. 2023-10-26T06:43:22.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.087+0000 7f60599ff700 1 Processor -- start 2023-10-26T06:43:22.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 -- start start 2023-10-26T06:43:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6054100720 0x7f605419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 0x7f605419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6054106730 0x7f6054198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054199200 con 0x7f60541010e0 2023-10-26T06:43:22.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054199370 con 0x7f6054106730 2023-10-26T06:43:22.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60599ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054199530 con 0x7f6054100720 2023-10-26T06:43:22.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f604bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 0x7f605419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f604bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 0x7f605419efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41106/0 (socket says 172.21.15.50:41106) 2023-10-26T06:43:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f604bfff700 1 -- 172.21.15.50:0/2618345197 learned_addr learned my addr 172.21.15.50:0/2618345197 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f6052ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6054100720 0x7f605419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.088+0000 7f60537fe700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6054106730 0x7f6054198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f604bfff700 1 -- 172.21.15.50:0/2618345197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6054100720 msgr2=0x7f605419ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f604bfff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6054100720 0x7f605419ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f604bfff700 1 -- 172.21.15.50:0/2618345197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6054106730 msgr2=0x7f6054198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f604bfff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6054106730 0x7f6054198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f604bfff700 1 -- 172.21.15.50:0/2618345197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440095f0 con 0x7f60541010e0 2023-10-26T06:43:22.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f604bfff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 0x7f605419efb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e9a0 tx=0x7f603c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:22.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c009790 con 0x7f60541010e0 2023-10-26T06:43:22.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603c010430 con 0x7f60541010e0 2023-10-26T06:43:22.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c018680 con 0x7f60541010e0 2023-10-26T06:43:22.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6054199810 con 0x7f60541010e0 2023-10-26T06:43:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.089+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60541a5a60 con 0x7f60541010e0 2023-10-26T06:43:22.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.090+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6054101e60 con 0x7f60541010e0 2023-10-26T06:43:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.092+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f603c0105a0 con 0x7f60541010e0 2023-10-26T06:43:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.094+0000 7f60589fd700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60400a14d0 0x7f60400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.094+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f603c014070 con 0x7f60541010e0 2023-10-26T06:43:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.095+0000 7f6052ffd700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60400a14d0 0x7f60400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.095+0000 7f6052ffd700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60400a14d0 0x7f60400a3990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f604400b2e0 tx=0x7f6044005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:22.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.097+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f603c052100 con 0x7f60541010e0 2023-10-26T06:43:22.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3794064689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:22.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3587746649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:22.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3794064689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3587746649' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:22.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.309+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6054110690 con 0x7f60541010e0 2023-10-26T06:43:22.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.309+0000 7f60589fd700 1 -- 172.21.15.50:0/2618345197 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f603c096570 con 0x7f60541010e0 2023-10-26T06:43:22.311 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:43:22.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.311+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60400a14d0 msgr2=0x7f60400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.311+0000 7f60599ff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60400a14d0 0x7f60400a3990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f604400b2e0 tx=0x7f6044005fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.311+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 msgr2=0x7f605419efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.311+0000 7f60599ff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 0x7f605419efb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e9a0 tx=0x7f603c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 shutdown_connections 2023-10-26T06:43:22.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60400a14d0 0x7f60400a3990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6054106730 0x7f6054198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6054100720 0x7f605419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 --2- 172.21.15.50:0/2618345197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60541010e0 0x7f605419efb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 >> 172.21.15.50:0/2618345197 conn(0x7f60540fc1b0 msgr2=0x7f605410be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:22.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 shutdown_connections 2023-10-26T06:43:22.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.312+0000 7f60599ff700 1 -- 172.21.15.50:0/2618345197 wait complete. 2023-10-26T06:43:22.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:43:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 -- 172.21.15.50:0/3771206134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3964073540 msgr2=0x7f396410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 --2- 172.21.15.50:0/3771206134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3964073540 0x7f396410c9a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39580098f0 tx=0x7f3958009c00 comp rx=0 tx=0).stop 2023-10-26T06:43:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 -- 172.21.15.50:0/3771206134 shutdown_connections 2023-10-26T06:43:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 --2- 172.21.15.50:0/3771206134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f396410cee0 0x7f396410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 --2- 172.21.15.50:0/3771206134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964072c20 0x7f3964073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 --2- 172.21.15.50:0/3771206134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3964073540 0x7f396410c9a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.536+0000 7f39695ff700 1 -- 172.21.15.50:0/3771206134 >> 172.21.15.50:0/3771206134 conn(0x7f39640fc170 msgr2=0x7f39640fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.537+0000 7f39695ff700 1 -- 172.21.15.50:0/3771206134 shutdown_connections 2023-10-26T06:43:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.537+0000 7f39695ff700 1 -- 172.21.15.50:0/3771206134 wait complete. 2023-10-26T06:43:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.538+0000 7f39695ff700 1 Processor -- start 2023-10-26T06:43:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.538+0000 7f39695ff700 1 -- start start 2023-10-26T06:43:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39695ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3964072c20 0x7f3964198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39695ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964073540 0x7f3964199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39695ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 0x7f396419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39695ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396419dd30 con 0x7f396410cee0 2023-10-26T06:43:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39695ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396419dea0 con 0x7f3964073540 2023-10-26T06:43:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39695ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396419e060 con 0x7f3964072c20 2023-10-26T06:43:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 0x7f396419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 0x7f396419d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41122/0 (socket says 172.21.15.50:41122) 2023-10-26T06:43:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39627fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964073540 0x7f3964199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39637fe700 1 -- 172.21.15.50:0/4080461763 learned_addr learned my addr 172.21.15.50:0/4080461763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f3962ffd700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3964072c20 0x7f3964198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39627fc700 1 -- 172.21.15.50:0/4080461763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3964072c20 msgr2=0x7f3964198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39627fc700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3964072c20 0x7f3964198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39627fc700 1 -- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 msgr2=0x7f396419d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39627fc700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 0x7f396419d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39627fc700 1 -- 172.21.15.50:0/4080461763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540095f0 con 0x7f3964073540 2023-10-26T06:43:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.539+0000 7f39637fe700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 0x7f396419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.540+0000 7f39627fc700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964073540 0x7f3964199350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3958009fd0 tx=0x7f395800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.540+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395801c070 con 0x7f3964073540 2023-10-26T06:43:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.540+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3958009520 con 0x7f3964073540 2023-10-26T06:43:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.540+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f395800baa0 con 0x7f3964073540 2023-10-26T06:43:22.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.540+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580038e0 con 0x7f3964073540 2023-10-26T06:43:22.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.540+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39641a59a0 con 0x7f3964073540 2023-10-26T06:43:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.541+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39641080f0 con 0x7f3964073540 2023-10-26T06:43:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.543+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3958020030 con 0x7f3964073540 2023-10-26T06:43:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.545+0000 7f394bfff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f394c0a14d0 0x7f394c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.545+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f39580cde50 con 0x7f3964073540 2023-10-26T06:43:22.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.545+0000 7f3962ffd700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f394c0a14d0 0x7f394c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:22.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.545+0000 7f3962ffd700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f394c0a14d0 0x7f394c0a3990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3954005fd0 tx=0x7f3954009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:22.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.547+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3958097470 con 0x7f3964073540 2023-10-26T06:43:22.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.808+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f396419a110 con 0x7f3964073540 2023-10-26T06:43:22.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.810+0000 7f394bfff700 1 -- 172.21.15.50:0/4080461763 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7f395809aa90 con 0x7f3964073540 2023-10-26T06:43:22.811 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:22.812 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:43:22.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f394c0a14d0 msgr2=0x7f394c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f394c0a14d0 0x7f394c0a3990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3954005fd0 tx=0x7f3954009310 comp rx=0 tx=0).stop 2023-10-26T06:43:22.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964073540 msgr2=0x7f3964199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:22.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964073540 0x7f3964199350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3958009fd0 tx=0x7f395800fa00 comp rx=0 tx=0).stop 2023-10-26T06:43:22.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 shutdown_connections 2023-10-26T06:43:22.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f394c0a14d0 0x7f394c0a3990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396410cee0 0x7f396419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3964072c20 0x7f3964198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 --2- 172.21.15.50:0/4080461763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3964073540 0x7f3964199350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:22.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 >> 172.21.15.50:0/4080461763 conn(0x7f39640fc170 msgr2=0x7f39640fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:22.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 shutdown_connections 2023-10-26T06:43:22.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:22.812+0000 7f39695ff700 1 -- 172.21.15.50:0/4080461763 wait complete. 2023-10-26T06:43:22.816 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:43:22.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:22 smithi050 ceph-mon[94997]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:43:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2204791621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2618345197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 -- 172.21.15.50:0/4126967521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac101060 msgr2=0x7f21ac10d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 --2- 172.21.15.50:0/4126967521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac101060 0x7f21ac10d570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f21a400b0a0 tx=0x7f21a400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 -- 172.21.15.50:0/4126967521 shutdown_connections 2023-10-26T06:43:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 --2- 172.21.15.50:0/4126967521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac101060 0x7f21ac10d570 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 --2- 172.21.15.50:0/4126967521 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1066b0 0x7f21ac106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 --2- 172.21.15.50:0/4126967521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac1006a0 0x7f21ac100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 -- 172.21.15.50:0/4126967521 >> 172.21.15.50:0/4126967521 conn(0x7f21ac0fc170 msgr2=0x7f21ac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 -- 172.21.15.50:0/4126967521 shutdown_connections 2023-10-26T06:43:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.043+0000 7f21b35ff700 1 -- 172.21.15.50:0/4126967521 wait complete. 2023-10-26T06:43:23.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.044+0000 7f21b35ff700 1 Processor -- start 2023-10-26T06:43:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 -- start start 2023-10-26T06:43:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 0x7f21ac072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac101060 0x7f21ac073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac1066b0 0x7f21ac073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1a4ec0 con 0x7f21ac1066b0 2023-10-26T06:43:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1a5030 con 0x7f21ac1006a0 2023-10-26T06:43:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b35ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac1a51f0 con 0x7f21ac101060 2023-10-26T06:43:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b139b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 0x7f21ac072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b1b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac1066b0 0x7f21ac073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b139b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 0x7f21ac072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51122/0 (socket says 172.21.15.50:51122) 2023-10-26T06:43:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.045+0000 7f21b139b700 1 -- 172.21.15.50:0/2848376553 learned_addr learned my addr 172.21.15.50:0/2848376553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b0b9a700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac101060 0x7f21ac073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b1b9c700 1 -- 172.21.15.50:0/2848376553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac101060 msgr2=0x7f21ac073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b1b9c700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac101060 0x7f21ac073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b1b9c700 1 -- 172.21.15.50:0/2848376553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 msgr2=0x7f21ac072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b1b9c700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 0x7f21ac072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b1b9c700 1 -- 172.21.15.50:0/2848376553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009d00 con 0x7f21ac1066b0 2023-10-26T06:43:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b139b700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 0x7f21ac072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b1b9c700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac1066b0 0x7f21ac073590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f21a400b070 tx=0x7f21a40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400e040 con 0x7f21ac1066b0 2023-10-26T06:43:23.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21a4004e60 con 0x7f21ac1066b0 2023-10-26T06:43:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac1a5470 con 0x7f21ac1066b0 2023-10-26T06:43:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.046+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4005040 con 0x7f21ac1066b0 2023-10-26T06:43:23.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.047+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac1a5940 con 0x7f21ac1066b0 2023-10-26T06:43:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.047+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac108cc0 con 0x7f21ac1066b0 2023-10-26T06:43:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.049+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f21a401d470 con 0x7f21ac1066b0 2023-10-26T06:43:23.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.051+0000 7f21a27fc700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f21980a1550 0x7f21980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.051+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f21a40ce1a0 con 0x7f21ac1066b0 2023-10-26T06:43:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.051+0000 7f21b139b700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f21980a1550 0x7f21980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.051+0000 7f21b139b700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f21980a1550 0x7f21980a3a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21a8011550 tx=0x7f21a8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.055+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f21a40977c0 con 0x7f21ac1066b0 2023-10-26T06:43:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:22 smithi125 ceph-mon[130643]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:43:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:22 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2204791621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:22 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2618345197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:22 smithi153 ceph-mon[131657]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:43:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:22 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2204791621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:22 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2618345197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.268+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21ac073fd0 con 0x7f21ac1066b0 2023-10-26T06:43:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.270+0000 7f21a27fc700 1 -- 172.21.15.50:0/2848376553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7f21a409ade0 con 0x7f21ac1066b0 2023-10-26T06:43:23.272 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:23.272 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:23.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f21980a1550 msgr2=0x7f21980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f21980a1550 0x7f21980a3a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21a8011550 tx=0x7f21a8009260 comp rx=0 tx=0).stop 2023-10-26T06:43:23.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac1066b0 msgr2=0x7f21ac073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac1066b0 0x7f21ac073590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f21a400b070 tx=0x7f21a40077f0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 shutdown_connections 2023-10-26T06:43:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f21980a1550 0x7f21980a3a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ac1066b0 0x7f21ac073590 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21ac1006a0 0x7f21ac072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 --2- 172.21.15.50:0/2848376553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21ac101060 0x7f21ac073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 >> 172.21.15.50:0/2848376553 conn(0x7f21ac0fc170 msgr2=0x7f21ac0fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 shutdown_connections 2023-10-26T06:43:23.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.272+0000 7f21b35ff700 1 -- 172.21.15.50:0/2848376553 wait complete. 2023-10-26T06:43:23.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-26T06:41:30.489106+0000', 'modified': '2023-10-26T06:41:35.994192+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24740, 'mds_1': 24709, 'mds_2': 24694}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24665': {'gid': 24665, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.125:6835/3214904167', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6834', 'nonce': 3214904167}, {'type': 'v1', 'addr': '172.21.15.125:6835', 'nonce': 3214904167}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24682': {'gid': 24682, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/2747210301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 2747210301}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 2747210301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24692': {'gid': 24692, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.125:6837/2652114750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6836', 'nonce': 2652114750}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 2652114750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24694': {'gid': 24694, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.153:6837/3558298736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 3558298736}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 3558298736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24709': {'gid': 24709, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.153:6839/1756575060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1756575060}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1756575060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24740': {'gid': 24740, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6839/1086282741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6838', 'nonce': 1086282741}, {'type': 'v1', 'addr': '172.21.15.125:6839', 'nonce': 1086282741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-26T06:43:23.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-26T06:43:23.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-26T06:43:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 -- 172.21.15.50:0/3749699435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c1006a0 msgr2=0x7f510c100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 --2- 172.21.15.50:0/3749699435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c1006a0 0x7f510c100b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5100009990 tx=0x7f5100009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 -- 172.21.15.50:0/3749699435 shutdown_connections 2023-10-26T06:43:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 --2- 172.21.15.50:0/3749699435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c101060 0x7f510c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 --2- 172.21.15.50:0/3749699435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f510c1066b0 0x7f510c106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 --2- 172.21.15.50:0/3749699435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c1006a0 0x7f510c100b20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 -- 172.21.15.50:0/3749699435 >> 172.21.15.50:0/3749699435 conn(0x7f510c0fc170 msgr2=0x7f510c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 -- 172.21.15.50:0/3749699435 shutdown_connections 2023-10-26T06:43:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.499+0000 7f51121ff700 1 -- 172.21.15.50:0/3749699435 wait complete. 2023-10-26T06:43:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.500+0000 7f51121ff700 1 Processor -- start 2023-10-26T06:43:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.500+0000 7f51121ff700 1 -- start start 2023-10-26T06:43:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f51121ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 0x7f510c107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f51121ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c101060 0x7f510c107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f51121ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f510c1066b0 0x7f510c107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f51121ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c1a9340 con 0x7f510c1006a0 2023-10-26T06:43:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f51121ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c1a9480 con 0x7f510c101060 2023-10-26T06:43:23.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f51121ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c1a95f0 con 0x7f510c1066b0 2023-10-26T06:43:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f510b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 0x7f510c107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f510b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 0x7f510c107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41146/0 (socket says 172.21.15.50:41146) 2023-10-26T06:43:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f510b7fe700 1 -- 172.21.15.50:0/142870781 learned_addr learned my addr 172.21.15.50:0/142870781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f510affd700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c101060 0x7f510c107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.501+0000 7f510bfff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f510c1066b0 0x7f510c107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510affd700 1 -- 172.21.15.50:0/142870781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f510c1066b0 msgr2=0x7f510c107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510affd700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f510c1066b0 0x7f510c107fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510affd700 1 -- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 msgr2=0x7f510c107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510affd700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 0x7f510c107560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510affd700 1 -- 172.21.15.50:0/142870781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000095f0 con 0x7f510c101060 2023-10-26T06:43:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510b7fe700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 0x7f510c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f510affd700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c101060 0x7f510c107aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5100000c00 tx=0x7f5100004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f5108ff9700 1 -- 172.21.15.50:0/142870781 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510001d070 con 0x7f510c101060 2023-10-26T06:43:23.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f5108ff9700 1 -- 172.21.15.50:0/142870781 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5100021410 con 0x7f510c101060 2023-10-26T06:43:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c1a9870 con 0x7f510c101060 2023-10-26T06:43:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f5108ff9700 1 -- 172.21.15.50:0/142870781 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100017650 con 0x7f510c101060 2023-10-26T06:43:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.502+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c1a9da0 con 0x7f510c101060 2023-10-26T06:43:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.507+0000 7f5108ff9700 1 -- 172.21.15.50:0/142870781 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5100021580 con 0x7f510c101060 2023-10-26T06:43:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 Processor -- start 2023-10-26T06:43:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 -- start start 2023-10-26T06:43:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 0x55cced318f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced3194b0 0x55cced313040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced313a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced286690 con 0x55cced318b90 2023-10-26T06:43:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced26cc10 con 0x55cced313580 2023-10-26T06:43:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced26a530 con 0x55cced3194b0 2023-10-26T06:43:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f510bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 0x55cced318f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f510bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 0x55cced318f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41160/0 (socket says 172.21.15.50:41160) 2023-10-26T06:43:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f510bfff700 1 -- 172.21.15.50:0/2591710371 learned_addr learned my addr 172.21.15.50:0/2591710371 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.508+0000 7f510b7fe700 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced3194b0 0x55cced313040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510affd700 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced313a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510bfff700 1 -- 172.21.15.50:0/2591710371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced3194b0 msgr2=0x55cced313040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510bfff700 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced3194b0 0x55cced313040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510bfff700 1 -- 172.21.15.50:0/2591710371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 msgr2=0x55cced313a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510bfff700 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced313a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510bfff700 1 -- 172.21.15.50:0/2591710371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cced2233a0 con 0x55cced318b90 2023-10-26T06:43:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f5108ff9700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f50f40a1550 0x7f50f40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510bfff700 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 0x55cced318f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5104011680 tx=0x7f5104009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d547055afe6e7c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f5108ff9700 1 -- 172.21.15.50:0/142870781 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f51000cdfc0 con 0x7f510c101060 2023-10-26T06:43:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f510b7fe700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f50f40a1550 0x7f50f40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.509+0000 7f50f1ffb700 1 -- 172.21.15.50:0/2591710371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400e040 con 0x55cced318b90 2023-10-26T06:43:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f50f1ffb700 1 -- 172.21.15.50:0/2591710371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f510400f040 con 0x55cced318b90 2023-10-26T06:43:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f50f1ffb700 1 -- 172.21.15.50:0/2591710371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104004860 con 0x55cced318b90 2023-10-26T06:43:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2591710371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 msgr2=0x55cced318f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f510b7fe700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f50f40a1550 0x7f50f40a3a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cced30ea20 tx=0x7f50fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 0x55cced318f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5104011680 tx=0x7f5104009920 comp rx=0 tx=0).stop 2023-10-26T06:43:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2591710371 shutdown_connections 2023-10-26T06:43:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced313a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced318b90 0x55cced318f70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2591710371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced3194b0 0x55cced313040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2591710371 >> 172.21.15.50:0/2591710371 conn(0x55cced2876d0 msgr2=0x55cced30db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2591710371 shutdown_connections 2023-10-26T06:43:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.510+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2591710371 wait complete. 2023-10-26T06:43:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.511+0000 7f5125ba3b80 1 -- start start 2023-10-26T06:43:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.511+0000 7f5125ba3b80 1 Processor -- start 2023-10-26T06:43:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced31cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced265e20 con 0x55cced3194b0 2023-10-26T06:43:23.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced2026c0 con 0x55cced318b90 2023-10-26T06:43:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced202360 con 0x55cced313580 2023-10-26T06:43:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f5125ba3b80 10 client.0 _ll_register_callbacks cb 0x55cced14ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41168/0 (socket says 172.21.15.50:41168) 2023-10-26T06:43:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 -- 172.21.15.50:0/2967891489 learned_addr learned my addr 172.21.15.50:0/2967891489 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510affd700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced31cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 -- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 msgr2=0x55cced31c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 -- 172.21.15.50:0/2967891489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 msgr2=0x55cced31cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced31cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510bfff700 1 -- 172.21.15.50:0/2967891489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5104011330 con 0x55cced3194b0 2023-10-26T06:43:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.512+0000 7f510b7fe700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f510bfff700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31d260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f510400b010 tx=0x7f5104009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02fe259ceadebdf server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f50eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:43:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f50eaffd700 1 -- 172.21.15.50:0/2967891489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400e070 con 0x55cced3194b0 2023-10-26T06:43:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f50eaffd700 1 -- 172.21.15.50:0/2967891489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5104003c10 con 0x55cced3194b0 2023-10-26T06:43:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cced26aea0 con 0x55cced3194b0 2023-10-26T06:43:23.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f50eaffd700 1 -- 172.21.15.50:0/2967891489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5104004920 con 0x55cced3194b0 2023-10-26T06:43:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f5125ba3b80 10 client.15324 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.513+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55cced090d90 con 0x55cced3194b0 2023-10-26T06:43:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f50eaffd700 1 -- 172.21.15.50:0/2967891489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cced26aea0 con 0x55cced3194b0 2023-10-26T06:43:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f50eaffd700 1 -- 172.21.15.50:0/2967891489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f510402f020 con 0x55cced3194b0 2023-10-26T06:43:23.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f5125ba3b80 10 client.15324 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f5125ba3b80 10 client.15324 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-26T06:43:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f5125ba3b80 20 client.15324 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced32ce20 0x55cced32b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f5125ba3b80 4 client.15324 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:43:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cced2e2860 con 0x55cced32ce20 2023-10-26T06:43:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.514+0000 7f510b7fe700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced32ce20 0x55cced32b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.515+0000 7f510b7fe700 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced32ce20 0x55cced32b990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e3c524a5b8cac2c server_cookie=f8bf79c4e2acd33c in_seq=0 out_seq=0 2023-10-26T06:43:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.515+0000 7f50eaffd700 10 client.15324 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:43:23.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f50eaffd700 1 -- 172.21.15.50:0/2967891489 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cced2e2860 con 0x55cced32ce20 2023-10-26T06:43:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f50eaffd700 10 client.15324 handle_command_reply: tid=0 2023-10-26T06:43:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 client.15324 shutdown 2023-10-26T06:43:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 msgr2=0x55cced31d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31d260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f510400b010 tx=0x7f5104009510 comp rx=0 tx=0).stop 2023-10-26T06:43:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 shutdown_connections 2023-10-26T06:43:23.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced32ce20 0x55cced32b990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31d260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f50eaffd700 0 client.15324 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:43:23.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2967891489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced31cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 >> 172.21.15.50:0/2967891489 conn(0x55cced2876d0 msgr2=0x55cced312030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 shutdown_connections 2023-10-26T06:43:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2967891489 wait complete. 2023-10-26T06:43:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.516+0000 7f5125ba3b80 20 client.15324 trim_cache size 0 max 16384 2023-10-26T06:43:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 Processor -- start 2023-10-26T06:43:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 -- start start 2023-10-26T06:43:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced316d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced0e68d0 con 0x55cced3194b0 2023-10-26T06:43:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced21d720 con 0x55cced318b90 2023-10-26T06:43:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced2670b0 con 0x55cced313580 2023-10-26T06:43:23.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f510bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f510bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41180/0 (socket says 172.21.15.50:41180) 2023-10-26T06:43:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f510bfff700 1 -- 172.21.15.50:0/1542919866 learned_addr learned my addr 172.21.15.50:0/1542919866 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f510b7fe700 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.535+0000 7f510affd700 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced316d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510bfff700 1 -- 172.21.15.50:0/1542919866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 msgr2=0x55cced31b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510bfff700 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510bfff700 1 -- 172.21.15.50:0/1542919866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 msgr2=0x55cced316d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510bfff700 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced316d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510bfff700 1 -- 172.21.15.50:0/1542919866 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cced079c10 con 0x55cced3194b0 2023-10-26T06:43:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510b7fe700 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f510bfff700 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31cd30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5104000f80 tx=0x7f5104011600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577085985ae507df server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f50f27fc700 1 -- 172.21.15.50:0/1542919866 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400e040 con 0x55cced3194b0 2023-10-26T06:43:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f50f27fc700 1 -- 172.21.15.50:0/1542919866 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5104027630 con 0x55cced3194b0 2023-10-26T06:43:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.536+0000 7f50f27fc700 1 -- 172.21.15.50:0/1542919866 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040278e0 con 0x55cced3194b0 2023-10-26T06:43:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 -- 172.21.15.50:0/1542919866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 msgr2=0x55cced31cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31cd30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5104000f80 tx=0x7f5104011600 comp rx=0 tx=0).stop 2023-10-26T06:43:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 -- 172.21.15.50:0/1542919866 shutdown_connections 2023-10-26T06:43:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31cd30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced313580 0x55cced31b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/1542919866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced318b90 0x55cced316d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 -- 172.21.15.50:0/1542919866 >> 172.21.15.50:0/1542919866 conn(0x55cced2876d0 msgr2=0x55cced316660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 -- 172.21.15.50:0/1542919866 shutdown_connections 2023-10-26T06:43:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 -- 172.21.15.50:0/1542919866 wait complete. 2023-10-26T06:43:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.537+0000 7f5125ba3b80 1 -- start start 2023-10-26T06:43:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 Processor -- start 2023-10-26T06:43:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced31d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 0x55cced31bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced31c7a0 con 0x55cced3194b0 2023-10-26T06:43:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced31c910 con 0x55cced313580 2023-10-26T06:43:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cced31cad0 con 0x55cced318b90 2023-10-26T06:43:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f5125ba3b80 10 client.0 _ll_register_callbacks cb 0x55cced14ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f510affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 0x55cced31bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f510affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 0x55cced31bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34754/0 (socket says 172.21.15.50:34754) 2023-10-26T06:43:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f510b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced31d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f510affd700 1 -- 172.21.15.50:0/2640335327 learned_addr learned my addr 172.21.15.50:0/2640335327 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.538+0000 7f510bfff700 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f510affd700 1 -- 172.21.15.50:0/2640335327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 msgr2=0x55cced31d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f510affd700 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced31d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f510affd700 1 -- 172.21.15.50:0/2640335327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 msgr2=0x55cced31c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f510affd700 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f510affd700 1 -- 172.21.15.50:0/2640335327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc0112f0 con 0x55cced318b90 2023-10-26T06:43:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f510affd700 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 0x55cced31bd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51000977a0 tx=0x7f5100021b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bf4f8e1b02c5821 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f50eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:43:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f50eaffd700 1 -- 172.21.15.50:0/2640335327 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000a1040 con 0x55cced318b90 2023-10-26T06:43:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f510400f040 con 0x55cced318b90 2023-10-26T06:43:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.539+0000 7f50eaffd700 1 -- 172.21.15.50:0/2640335327 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f510009b9a0 con 0x55cced318b90 2023-10-26T06:43:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f50eaffd700 1 -- 172.21.15.50:0/2640335327 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51000b3020 con 0x55cced318b90 2023-10-26T06:43:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 10 client.25342 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55cced090d90 con 0x55cced318b90 2023-10-26T06:43:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f50eaffd700 1 -- 172.21.15.50:0/2640335327 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51000b7020 con 0x55cced318b90 2023-10-26T06:43:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f50eaffd700 1 -- 172.21.15.50:0/2640335327 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f510009a790 con 0x55cced318b90 2023-10-26T06:43:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 10 client.25342 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 10 client.25342 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-26T06:43:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 20 client.25342 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced385460 0x55cced3818b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 4 client.25342 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-26T06:43:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cced25ee00 con 0x55cced385460 2023-10-26T06:43:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.540+0000 7f510b7fe700 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced385460 0x55cced3818b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f510b7fe700 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced385460 0x55cced3818b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d6ab0c6194d901 server_cookie=bbd857a18163c70e in_seq=0 out_seq=0 2023-10-26T06:43:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f50eaffd700 10 client.25342 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:43:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f50eaffd700 1 -- 172.21.15.50:0/2640335327 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55cced25ee00 con 0x55cced385460 2023-10-26T06:43:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f50eaffd700 10 client.25342 handle_command_reply: tid=0 2023-10-26T06:43:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 client.25342 shutdown 2023-10-26T06:43:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 msgr2=0x55cced31bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 0x55cced31bd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51000977a0 tx=0x7f5100021b40 comp rx=0 tx=0).stop 2023-10-26T06:43:23.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 shutdown_connections 2023-10-26T06:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55cced385460 0x55cced3818b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cced3194b0 0x55cced31c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cced313580 0x55cced31d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 --2- 172.21.15.50:0/2640335327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cced318b90 0x55cced31bd20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f50eaffd700 0 client.25342 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.541+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 >> 172.21.15.50:0/2640335327 conn(0x55cced2876d0 msgr2=0x55cced307460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 shutdown_connections 2023-10-26T06:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f5125ba3b80 1 -- 172.21.15.50:0/2640335327 wait complete. 2023-10-26T06:43:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f5125ba3b80 20 client.25342 trim_cache size 0 max 16384 2023-10-26T06:43:23.558 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:43:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:43:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2023-10-26T06:43:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24694, 2023-10-26T06:43:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-26T06:43:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-26T06:43:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-26T06:43:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 108.55637448, 2023-10-26T06:43:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-10-26T06:43:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 86, 2023-10-26T06:43:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 84, 2023-10-26T06:43:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 132.53880149899999 2023-10-26T06:43:23.560 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:43:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f50f40a1550 msgr2=0x7f50f40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f50f40a1550 0x7f50f40a3a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cced30ea20 tx=0x7f50fc009260 comp rx=0 tx=0).stop 2023-10-26T06:43:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c101060 msgr2=0x7f510c107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c101060 0x7f510c107aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5100000c00 tx=0x7f5100004730 comp rx=0 tx=0).stop 2023-10-26T06:43:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 shutdown_connections 2023-10-26T06:43:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f50f40a1550 0x7f50f40a3a10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f510c1066b0 0x7f510c107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f510c1006a0 0x7f510c107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 --2- 172.21.15.50:0/142870781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f510c101060 0x7f510c107aa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.542+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 >> 172.21.15.50:0/142870781 conn(0x7f510c0fc170 msgr2=0x7f510c072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.543+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 shutdown_connections 2023-10-26T06:43:23.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.543+0000 7f51121ff700 1 -- 172.21.15.50:0/142870781 wait complete. 2023-10-26T06:43:23.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-26T06:43:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 -- 172.21.15.50:0/2057675719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 msgr2=0x7f82b8106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 --2- 172.21.15.50:0/2057675719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8106a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009990 tx=0x7f82ac009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 -- 172.21.15.50:0/2057675719 shutdown_connections 2023-10-26T06:43:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 --2- 172.21.15.50:0/2057675719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b8101060 0x7f82b810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 --2- 172.21.15.50:0/2057675719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8106a90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 --2- 172.21.15.50:0/2057675719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b81006a0 0x7f82b8100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 -- 172.21.15.50:0/2057675719 >> 172.21.15.50:0/2057675719 conn(0x7f82b80fc170 msgr2=0x7f82b80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 -- 172.21.15.50:0/2057675719 shutdown_connections 2023-10-26T06:43:23.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.769+0000 7f82befff700 1 -- 172.21.15.50:0/2057675719 wait complete. 2023-10-26T06:43:23.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.770+0000 7f82befff700 1 Processor -- start 2023-10-26T06:43:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.770+0000 7f82befff700 1 -- start start 2023-10-26T06:43:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82befff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b81006a0 0x7f82b819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82befff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b8101060 0x7f82b819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82befff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82befff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8199190 con 0x7f82b81066b0 2023-10-26T06:43:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82befff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8199300 con 0x7f82b8101060 2023-10-26T06:43:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82befff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b81994c0 con 0x7f82b81006a0 2023-10-26T06:43:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41202/0 (socket says 172.21.15.50:41202) 2023-10-26T06:43:23.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b81006a0 0x7f82b819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 -- 172.21.15.50:0/225755469 learned_addr learned my addr 172.21.15.50:0/225755469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82b7fff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b8101060 0x7f82b819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 -- 172.21.15.50:0/225755469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b81006a0 msgr2=0x7f82b819ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b81006a0 0x7f82b819ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 -- 172.21.15.50:0/225755469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b8101060 msgr2=0x7f82b819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b8101060 0x7f82b819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82bd59c700 1 -- 172.21.15.50:0/225755469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0095f0 con 0x7f82b81066b0 2023-10-26T06:43:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.771+0000 7f82b7fff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b8101060 0x7f82b819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:23.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.772+0000 7f82bd59c700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8198b30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82b000ef30 tx=0x7f82b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.772+0000 7f82b5ffb700 1 -- 172.21.15.50:0/225755469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0018070 con 0x7f82b81066b0 2023-10-26T06:43:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.772+0000 7f82b5ffb700 1 -- 172.21.15.50:0/225755469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82b000f040 con 0x7f82b81066b0 2023-10-26T06:43:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.772+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b8199740 con 0x7f82b81066b0 2023-10-26T06:43:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.772+0000 7f82b5ffb700 1 -- 172.21.15.50:0/225755469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000cdb0 con 0x7f82b81066b0 2023-10-26T06:43:23.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.772+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b81a59f0 con 0x7f82b81066b0 2023-10-26T06:43:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.777+0000 7f82b5ffb700 1 -- 172.21.15.50:0/225755469 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f82b0003a00 con 0x7f82b81066b0 2023-10-26T06:43:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 Processor -- start 2023-10-26T06:43:23.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 -- start start 2023-10-26T06:43:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 0x55e6938d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82b5ffb700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f82a80a14d0 0x7f82a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d34b0 0x55e6938cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938cd580 0x55e6938cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e693840690 con 0x55e6938d34b0 2023-10-26T06:43:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e693826c10 con 0x55e6938d2b90 2023-10-26T06:43:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82d2956b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e693824530 con 0x55e6938cd580 2023-10-26T06:43:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82b5ffb700 1 -- 172.21.15.50:0/225755469 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f82b00cc990 con 0x7f82b81066b0 2023-10-26T06:43:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82bcd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 0x55e6938d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82b7fff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f82a80a14d0 0x7f82a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82bcd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 0x55e6938d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51206/0 (socket says 172.21.15.50:51206) 2023-10-26T06:43:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.778+0000 7f82bcd9b700 1 -- 172.21.15.50:0/374136998 learned_addr learned my addr 172.21.15.50:0/374136998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938cd580 0x55e6938cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82b7fff700 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d34b0 0x55e6938cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 -- 172.21.15.50:0/374136998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 msgr2=0x55e6938d2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 0x55e6938d2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 -- 172.21.15.50:0/374136998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d34b0 msgr2=0x55e6938cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d34b0 0x55e6938cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 -- 172.21.15.50:0/374136998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6937dd3a0 con 0x55e6938cd580 2023-10-26T06:43:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 0x55e6938d2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82bd59c700 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938cd580 0x55e6938cda00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82b000ef00 tx=0x7f82b00959e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc97b243a41628e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82b7fff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f82a80a14d0 0x7f82a80a3990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55e6938c8a20 tx=0x7f82a4009630 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82a2ffd700 1 -- 172.21.15.50:0/374136998 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0099630 con 0x55e6938cd580 2023-10-26T06:43:23.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82a2ffd700 1 -- 172.21.15.50:0/374136998 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82b00b9040 con 0x55e6938cd580 2023-10-26T06:43:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.779+0000 7f82a2ffd700 1 -- 172.21.15.50:0/374136998 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b009a3d0 con 0x55e6938cd580 2023-10-26T06:43:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 -- 172.21.15.50:0/374136998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938cd580 msgr2=0x55e6938cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938cd580 0x55e6938cda00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f82b000ef00 tx=0x7f82b00959e0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 -- 172.21.15.50:0/374136998 shutdown_connections 2023-10-26T06:43:23.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938cd580 0x55e6938cda00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938d2b90 0x55e6938d2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 --2- 172.21.15.50:0/374136998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d34b0 0x55e6938cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 -- 172.21.15.50:0/374136998 >> 172.21.15.50:0/374136998 conn(0x55e6938416d0 msgr2=0x55e6938c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 -- 172.21.15.50:0/374136998 shutdown_connections 2023-10-26T06:43:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.780+0000 7f82d2956b80 1 -- 172.21.15.50:0/374136998 wait complete. 2023-10-26T06:43:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 -- start start 2023-10-26T06:43:23.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 Processor -- start 2023-10-26T06:43:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69381fe20 con 0x55e6938d2b90 2023-10-26T06:43:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.781+0000 7f82d2956b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6937bc6c0 con 0x55e6938cd580 2023-10-26T06:43:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82d2956b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6937bc360 con 0x55e6938d34b0 2023-10-26T06:43:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82d2956b80 10 client.0 _ll_register_callbacks cb 0x55e693706a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:23.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41210/0 (socket says 172.21.15.50:41210) 2023-10-26T06:43:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 -- 172.21.15.50:0/206165551 learned_addr learned my addr 172.21.15.50:0/206165551 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82bd59c700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 -- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 msgr2=0x55e6938d7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 -- 172.21.15.50:0/206165551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 msgr2=0x55e6938d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.782+0000 7f82b7fff700 1 -- 172.21.15.50:0/206165551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b810de70 con 0x55e6938d2b90 2023-10-26T06:43:23.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f82b7fff700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d6d50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f82a4010930 tx=0x7f82a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1d0406ad753d2a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f8297fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:43:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f8297fff700 1 -- 172.21.15.50:0/206165551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4020750 con 0x55e6938d2b90 2023-10-26T06:43:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f8297fff700 1 -- 172.21.15.50:0/206165551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f82a40208b0 con 0x55e6938d2b90 2023-10-26T06:43:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e693824ea0 con 0x55e6938d2b90 2023-10-26T06:43:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f8297fff700 1 -- 172.21.15.50:0/206165551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a4020ab0 con 0x55e6938d2b90 2023-10-26T06:43:23.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f82d2956b80 10 client.15342 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f82b81a59f0 con 0x55e6938d2b90 2023-10-26T06:43:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f8297fff700 1 -- 172.21.15.50:0/206165551 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e693824ea0 con 0x55e6938d2b90 2023-10-26T06:43:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.783+0000 7f8297fff700 1 -- 172.21.15.50:0/206165551 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82a4011440 con 0x55e6938d2b90 2023-10-26T06:43:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82d2956b80 10 client.15342 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:23.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82d2956b80 10 client.15342 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-26T06:43:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82d2956b80 20 client.15342 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82d2956b80 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e6938e6f60 0x55e6938e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82d2956b80 4 client.15342 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:43:23.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e69389c860 con 0x55e6938e6f60 2023-10-26T06:43:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e6938e6f60 0x55e6938e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.784+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e6938e6f60 0x55e6938e59f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=278a58ea397e1d7f server_cookie=eb58cb0c7795daa8 in_seq=0 out_seq=0 2023-10-26T06:43:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f8297fff700 10 client.15342 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:43:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f8297fff700 1 -- 172.21.15.50:0/206165551 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e69389c860 con 0x55e6938e6f60 2023-10-26T06:43:23.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f8297fff700 10 client.15342 handle_command_reply: tid=0 2023-10-26T06:43:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f82d2956b80 1 client.15342 shutdown 2023-10-26T06:43:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 msgr2=0x55e6938d6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f82d2956b80 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d6d50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f82a4010930 tx=0x7f82a40047c0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 shutdown_connections 2023-10-26T06:43:23.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f82d2956b80 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.785+0000 7f82d2956b80 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e6938e6f60 0x55e6938e59f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f82d2956b80 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f82d2956b80 1 --2- 172.21.15.50:0/206165551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d6d50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f8297fff700 0 client.15342 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:43:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 >> 172.21.15.50:0/206165551 conn(0x55e6938416d0 msgr2=0x55e6938cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 shutdown_connections 2023-10-26T06:43:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f82d2956b80 1 -- 172.21.15.50:0/206165551 wait complete. 2023-10-26T06:43:23.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.786+0000 7f82d2956b80 20 client.15342 trim_cache size 0 max 16384 2023-10-26T06:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 Processor -- start 2023-10-26T06:43:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 -- start start 2023-10-26T06:43:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938e6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6936a08d0 con 0x55e6938d2b90 2023-10-26T06:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69389c860 con 0x55e6938cd580 2023-10-26T06:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.804+0000 7f82d2956b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e693824ea0 con 0x55e6938d34b0 2023-10-26T06:43:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938ef8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41226/0 (socket says 172.21.15.50:41226) 2023-10-26T06:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 -- 172.21.15.50:0/1741276259 learned_addr learned my addr 172.21.15.50:0/1741276259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82bd59c700 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 -- 172.21.15.50:0/1741276259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 msgr2=0x55e6938d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 -- 172.21.15.50:0/1741276259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 msgr2=0x55e6938e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938e6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 -- 172.21.15.50:0/1741276259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69364ad90 con 0x55e6938d2b90 2023-10-26T06:43:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82b7fff700 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938ef8d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82a400a010 tx=0x7f82a4010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607ac50936523acf server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82a37fe700 1 -- 172.21.15.50:0/1741276259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4009700 con 0x55e6938d2b90 2023-10-26T06:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82a37fe700 1 -- 172.21.15.50:0/1741276259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a4011440 con 0x55e6938d2b90 2023-10-26T06:43:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.805+0000 7f82a37fe700 1 -- 172.21.15.50:0/1741276259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40209b0 con 0x55e6938d2b90 2023-10-26T06:43:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 -- 172.21.15.50:0/1741276259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 msgr2=0x55e6938ef8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938ef8d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82a400a010 tx=0x7f82a4010fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 -- 172.21.15.50:0/1741276259 shutdown_connections 2023-10-26T06:43:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 --2- 172.21.15.50:0/1741276259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938ef8d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 -- 172.21.15.50:0/1741276259 >> 172.21.15.50:0/1741276259 conn(0x55e6938416d0 msgr2=0x55e6938e59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 -- 172.21.15.50:0/1741276259 shutdown_connections 2023-10-26T06:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.806+0000 7f82d2956b80 1 -- 172.21.15.50:0/1741276259 wait complete. 2023-10-26T06:43:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 -- start start 2023-10-26T06:43:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 Processor -- start 2023-10-26T06:43:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69393a990 con 0x55e6938d2b90 2023-10-26T06:43:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69393aad0 con 0x55e6938cd580 2023-10-26T06:43:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69393ac90 con 0x55e6938d34b0 2023-10-26T06:43:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82d2956b80 10 client.0 _ll_register_callbacks cb 0x55e693706a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.807+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41228/0 (socket says 172.21.15.50:41228) 2023-10-26T06:43:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 -- 172.21.15.50:0/431744034 learned_addr learned my addr 172.21.15.50:0/431744034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82bd59c700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 -- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 msgr2=0x55e6938d8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 -- 172.21.15.50:0/431744034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 msgr2=0x55e6938d7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 -- 172.21.15.50:0/431744034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b81a59f0 con 0x55e6938d2b90 2023-10-26T06:43:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82b7fff700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d8530 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f82a4012480 tx=0x7f82a40118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac858874b36fcd54 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:23.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f8297fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:43:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f8297fff700 1 -- 172.21.15.50:0/431744034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4009700 con 0x55e6938d2b90 2023-10-26T06:43:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82b00b9040 con 0x55e6938d2b90 2023-10-26T06:43:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.808+0000 7f8297fff700 1 -- 172.21.15.50:0/431744034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f82a4005250 con 0x55e6938d2b90 2023-10-26T06:43:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f8297fff700 1 -- 172.21.15.50:0/431744034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a4005410 con 0x55e6938d2b90 2023-10-26T06:43:23.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 10 client.15348 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55e693633c10 con 0x55e6938d2b90 2023-10-26T06:43:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f8297fff700 1 -- 172.21.15.50:0/431744034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82b00b9040 con 0x55e6938d2b90 2023-10-26T06:43:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f8297fff700 1 -- 172.21.15.50:0/431744034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82a40047a0 con 0x55e6938d2b90 2023-10-26T06:43:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 10 client.15348 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:23.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 10 client.15348 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-26T06:43:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 20 client.15348 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e69393fc20 0x55e69393c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 4 client.15348 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-26T06:43:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.809+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e693818e00 con 0x55e69393fc20 2023-10-26T06:43:23.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.810+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e69393fc20 0x55e69393c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.810+0000 7f82bcd9b700 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e69393fc20 0x55e69393c0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85e0c30f36cb6434 server_cookie=c266894b29e86893 in_seq=0 out_seq=0 2023-10-26T06:43:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f8297fff700 10 client.15348 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:43:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f8297fff700 1 -- 172.21.15.50:0/431744034 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e693818e00 con 0x55e69393fc20 2023-10-26T06:43:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f8297fff700 10 client.15348 handle_command_reply: tid=0 2023-10-26T06:43:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 client.15348 shutdown 2023-10-26T06:43:23.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 msgr2=0x55e6938d8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d8530 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f82a4012480 tx=0x7f82a40118a0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 shutdown_connections 2023-10-26T06:43:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e6938d34b0 0x55e6938d8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e69393fc20 0x55e69393c0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e6938cd580 0x55e6938d7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 --2- 172.21.15.50:0/431744034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e6938d2b90 0x55e6938d8530 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f8297fff700 0 client.15348 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:43:23.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 >> 172.21.15.50:0/431744034 conn(0x55e6938416d0 msgr2=0x55e6938d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 shutdown_connections 2023-10-26T06:43:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 1 -- 172.21.15.50:0/431744034 wait complete. 2023-10-26T06:43:23.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.811+0000 7f82d2956b80 20 client.15348 trim_cache size 0 max 16384 2023-10-26T06:43:23.831 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:43:23.832 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:43:23.832 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2023-10-26T06:43:23.832 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24709, 2023-10-26T06:43:23.832 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-26T06:43:23.832 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-26T06:43:23.833 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-26T06:43:23.833 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 109.829739582, 2023-10-26T06:43:23.833 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-10-26T06:43:23.833 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 86, 2023-10-26T06:43:23.834 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 84, 2023-10-26T06:43:23.834 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 128.15976219699999 2023-10-26T06:43:23.834 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:43:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f82a80a14d0 msgr2=0x7f82a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f82a80a14d0 0x7f82a80a3990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55e6938c8a20 tx=0x7f82a4009630 comp rx=0 tx=0).stop 2023-10-26T06:43:23.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 msgr2=0x7f82b8198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8198b30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82b000ef30 tx=0x7f82b000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 shutdown_connections 2023-10-26T06:43:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f82a80a14d0 0x7f82a80a3990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82b81066b0 0x7f82b8198b30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b81006a0 0x7f82b819ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 --2- 172.21.15.50:0/225755469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82b8101060 0x7f82b819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 >> 172.21.15.50:0/225755469 conn(0x7f82b80fc170 msgr2=0x7f82b810be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 shutdown_connections 2023-10-26T06:43:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:23.812+0000 7f82befff700 1 -- 172.21.15.50:0/225755469 wait complete. 2023-10-26T06:43:23.838 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:23 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4080461763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:23.838 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:23 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2848376553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:23.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-26T06:43:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 -- 172.21.15.50:0/2452860042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c1066b0 msgr2=0x7f363c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 --2- 172.21.15.50:0/2452860042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c1066b0 0x7f363c106a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f362c009990 tx=0x7f362c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 -- 172.21.15.50:0/2452860042 shutdown_connections 2023-10-26T06:43:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 --2- 172.21.15.50:0/2452860042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f363c101060 0x7f363c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 --2- 172.21.15.50:0/2452860042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c1066b0 0x7f363c106a90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 --2- 172.21.15.50:0/2452860042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f363c1006a0 0x7f363c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 -- 172.21.15.50:0/2452860042 >> 172.21.15.50:0/2452860042 conn(0x7f363c0fc170 msgr2=0x7f363c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 -- 172.21.15.50:0/2452860042 shutdown_connections 2023-10-26T06:43:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.043+0000 7f36413ff700 1 -- 172.21.15.50:0/2452860042 wait complete. 2023-10-26T06:43:24.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.044+0000 7f36413ff700 1 Processor -- start 2023-10-26T06:43:24.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.044+0000 7f36413ff700 1 -- start start 2023-10-26T06:43:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.044+0000 7f36413ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f363c1006a0 0x7f363c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36413ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 0x7f363c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36413ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f363c1066b0 0x7f363c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36413ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c199140 con 0x7f363c101060 2023-10-26T06:43:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36413ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1992b0 con 0x7f363c1006a0 2023-10-26T06:43:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36413ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c199470 con 0x7f363c1066b0 2023-10-26T06:43:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 0x7f363c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 0x7f363c19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37402/0 (socket says 172.21.15.50:37402) 2023-10-26T06:43:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f363b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f363c1066b0 0x7f363c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 -- 172.21.15.50:0/97700801 learned_addr learned my addr 172.21.15.50:0/97700801 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f363affd700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f363c1006a0 0x7f363c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 -- 172.21.15.50:0/97700801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f363c1066b0 msgr2=0x7f363c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f363c1066b0 0x7f363c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 -- 172.21.15.50:0/97700801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f363c1006a0 msgr2=0x7f363c19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f363c1006a0 0x7f363c19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 -- 172.21.15.50:0/97700801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0095f0 con 0x7f363c101060 2023-10-26T06:43:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.045+0000 7f36327fc700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 0x7f363c19eef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f362400e9a0 tx=0x7f362400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.046+0000 7f3638ff9700 1 -- 172.21.15.50:0/97700801 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624009790 con 0x7f363c101060 2023-10-26T06:43:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.046+0000 7f3638ff9700 1 -- 172.21.15.50:0/97700801 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3624010430 con 0x7f363c101060 2023-10-26T06:43:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.046+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c199750 con 0x7f363c101060 2023-10-26T06:43:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.046+0000 7f3638ff9700 1 -- 172.21.15.50:0/97700801 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624018680 con 0x7f363c101060 2023-10-26T06:43:24.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.046+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c1a59a0 con 0x7f363c101060 2023-10-26T06:43:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.049+0000 7f3638ff9700 1 -- 172.21.15.50:0/97700801 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f36240105a0 con 0x7f363c101060 2023-10-26T06:43:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.050+0000 7f3654d13b80 1 Processor -- start 2023-10-26T06:43:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.050+0000 7f3638ff9700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36280a14d0 0x7f36280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 -- start start 2023-10-26T06:43:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3638ff9700 1 -- 172.21.15.50:0/97700801 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3624014070 con 0x7f363c101060 2023-10-26T06:43:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f363b7fe700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36280a14d0 0x7f36280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bc0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81b33690 con 0x559e81bc64b0 2023-10-26T06:43:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81b19c10 con 0x559e81bc5b90 2023-10-26T06:43:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f3654d13b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81b17530 con 0x559e81bc0580 2023-10-26T06:43:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f363affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f36327fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bc0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f363b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f363affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:52354/0 (socket says 172.21.15.50:52354) 2023-10-26T06:43:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.051+0000 7f363affd700 1 -- 172.21.15.50:0/4237273461 learned_addr learned my addr 172.21.15.50:0/4237273461 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f363b7fe700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36280a14d0 0x7f36280a3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f363400f590 tx=0x7f363400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36327fc700 1 -- 172.21.15.50:0/4237273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 msgr2=0x559e81bc0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36327fc700 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36327fc700 1 -- 172.21.15.50:0/4237273461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 msgr2=0x559e81bc5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36327fc700 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36327fc700 1 -- 172.21.15.50:0/4237273461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e81ad03a0 con 0x559e81bc64b0 2023-10-26T06:43:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f363affd700 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:24.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36327fc700 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bc0040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f362400e970 tx=0x7f3624099c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a2e3cedba98127 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36317fa700 1 -- 172.21.15.50:0/4237273461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362409e170 con 0x559e81bc64b0 2023-10-26T06:43:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36317fa700 1 -- 172.21.15.50:0/4237273461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f362409a230 con 0x559e81bc64b0 2023-10-26T06:43:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.052+0000 7f36317fa700 1 -- 172.21.15.50:0/4237273461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624099980 con 0x559e81bc64b0 2023-10-26T06:43:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 -- 172.21.15.50:0/4237273461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 msgr2=0x559e81bc0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bc0040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f362400e970 tx=0x7f3624099c80 comp rx=0 tx=0).stop 2023-10-26T06:43:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 -- 172.21.15.50:0/4237273461 shutdown_connections 2023-10-26T06:43:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 --2- 172.21.15.50:0/4237273461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bc0040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 -- 172.21.15.50:0/4237273461 >> 172.21.15.50:0/4237273461 conn(0x559e81b346d0 msgr2=0x559e81bbab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 -- 172.21.15.50:0/4237273461 shutdown_connections 2023-10-26T06:43:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.053+0000 7f3654d13b80 1 -- 172.21.15.50:0/4237273461 wait complete. 2023-10-26T06:43:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.054+0000 7f3654d13b80 1 -- start start 2023-10-26T06:43:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.054+0000 7f3654d13b80 1 Processor -- start 2023-10-26T06:43:24.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81b12e20 con 0x559e81bc64b0 2023-10-26T06:43:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81aaf6c0 con 0x559e81bc5b90 2023-10-26T06:43:24.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81aaf360 con 0x559e81bc0580 2023-10-26T06:43:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f3654d13b80 10 client.0 _ll_register_callbacks cb 0x559e819f9a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f36327fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37420/0 (socket says 172.21.15.50:37420) 2023-10-26T06:43:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f36327fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:52364/0 (socket says 172.21.15.50:52364) 2023-10-26T06:43:24.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363b7fe700 1 -- 172.21.15.50:0/3136512824 learned_addr learned my addr 172.21.15.50:0/3136512824 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363affd700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363b7fe700 1 -- 172.21.15.50:0/3136512824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 msgr2=0x559e81bc9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363b7fe700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.055+0000 7f363b7fe700 1 -- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 msgr2=0x559e81bc9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f363b7fe700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f363b7fe700 1 -- 172.21.15.50:0/3136512824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c10de70 con 0x559e81bc64b0 2023-10-26T06:43:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f363affd700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f36327fc700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f363b7fe700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bca2d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3634017f40 tx=0x7f3634004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6c9256b2452ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:24.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f36227fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:43:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f36227fc700 1 -- 172.21.15.50:0/3136512824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363400e040 con 0x559e81bc64b0 2023-10-26T06:43:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f36227fc700 1 -- 172.21.15.50:0/3136512824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3634009230 con 0x559e81bc64b0 2023-10-26T06:43:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e81b17ea0 con 0x559e81bc64b0 2023-10-26T06:43:24.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f36227fc700 1 -- 172.21.15.50:0/3136512824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3634015e50 con 0x559e81bc64b0 2023-10-26T06:43:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f3654d13b80 10 client.15360 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.056+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f363c1a59a0 con 0x559e81bc64b0 2023-10-26T06:43:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f36227fc700 1 -- 172.21.15.50:0/3136512824 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559e81b17ea0 con 0x559e81bc64b0 2023-10-26T06:43:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f36227fc700 1 -- 172.21.15.50:0/3136512824 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f363401f050 con 0x559e81bc64b0 2023-10-26T06:43:24.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f3654d13b80 10 client.15360 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f3654d13b80 10 client.15360 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-26T06:43:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f3654d13b80 20 client.15360 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f3654d13b80 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81bda000 0x559e81bd8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f3654d13b80 4 client.15360 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:43:24.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e81b8f860 con 0x559e81bda000 2023-10-26T06:43:24.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.057+0000 7f363affd700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81bda000 0x559e81bd8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.058+0000 7f363affd700 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81bda000 0x559e81bd8aa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b2fc2742c50e540 server_cookie=cd128c2045144417 in_seq=0 out_seq=0 2023-10-26T06:43:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.058+0000 7f36227fc700 10 client.15360 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.058+0000 7f36227fc700 1 -- 172.21.15.50:0/3136512824 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559e81b8f860 con 0x559e81bda000 2023-10-26T06:43:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.058+0000 7f36227fc700 10 client.15360 handle_command_reply: tid=0 2023-10-26T06:43:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 client.15360 shutdown 2023-10-26T06:43:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 msgr2=0x559e81bca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bca2d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3634017f40 tx=0x7f3634004ad0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 shutdown_connections 2023-10-26T06:43:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81bda000 0x559e81bd8aa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bca2d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81bc9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f36227fc700 0 client.15360 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 --2- 172.21.15.50:0/3136512824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81bc9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 >> 172.21.15.50:0/3136512824 conn(0x559e81b346d0 msgr2=0x559e81bbf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 shutdown_connections 2023-10-26T06:43:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 1 -- 172.21.15.50:0/3136512824 wait complete. 2023-10-26T06:43:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.059+0000 7f3654d13b80 20 client.15360 trim_cache size 0 max 16384 2023-10-26T06:43:24.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 Processor -- start 2023-10-26T06:43:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 -- start start 2023-10-26T06:43:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81be2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 0x559e81bc5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc64b0 0x559e81bc3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e819938d0 con 0x559e81bc5b90 2023-10-26T06:43:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81b140b0 con 0x559e81bc64b0 2023-10-26T06:43:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f3654d13b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81b0ef10 con 0x559e81bc0580 2023-10-26T06:43:24.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f36327fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 0x559e81bc5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f36327fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 0x559e81bc5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37430/0 (socket says 172.21.15.50:37430) 2023-10-26T06:43:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.078+0000 7f36327fc700 1 -- 172.21.15.50:0/1317038222 learned_addr learned my addr 172.21.15.50:0/1317038222 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f363affd700 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81be2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f363b7fe700 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc64b0 0x559e81bc3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f36327fc700 1 -- 172.21.15.50:0/1317038222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 msgr2=0x559e81be2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f36327fc700 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81be2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f36327fc700 1 -- 172.21.15.50:0/1317038222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc64b0 msgr2=0x559e81bc3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f36327fc700 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc64b0 0x559e81bc3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f36327fc700 1 -- 172.21.15.50:0/1317038222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8193dd90 con 0x559e81bc5b90 2023-10-26T06:43:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f363b7fe700 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc64b0 0x559e81bc3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f36327fc700 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 0x559e81bc5070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3624096ca0 tx=0x7f362409a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c96a5807a86a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f3631ffb700 1 -- 172.21.15.50:0/1317038222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240b6070 con 0x559e81bc5b90 2023-10-26T06:43:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f3631ffb700 1 -- 172.21.15.50:0/1317038222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f362409e170 con 0x559e81bc5b90 2023-10-26T06:43:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.079+0000 7f3631ffb700 1 -- 172.21.15.50:0/1317038222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240b82c0 con 0x559e81bc5b90 2023-10-26T06:43:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 -- 172.21.15.50:0/1317038222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 msgr2=0x559e81bc5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 0x559e81bc5070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3624096ca0 tx=0x7f362409a000 comp rx=0 tx=0).stop 2023-10-26T06:43:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 -- 172.21.15.50:0/1317038222 shutdown_connections 2023-10-26T06:43:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc64b0 0x559e81bc3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81be2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1317038222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc5b90 0x559e81bc5070 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 -- 172.21.15.50:0/1317038222 >> 172.21.15.50:0/1317038222 conn(0x559e81b346d0 msgr2=0x559e81bc4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 -- 172.21.15.50:0/1317038222 shutdown_connections 2023-10-26T06:43:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 -- 172.21.15.50:0/1317038222 wait complete. 2023-10-26T06:43:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.080+0000 7f3654d13b80 1 -- start start 2023-10-26T06:43:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 Processor -- start 2023-10-26T06:43:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81c25c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81c261c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bde940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81bdef10 con 0x559e81bc64b0 2023-10-26T06:43:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81bdf080 con 0x559e81bc5b90 2023-10-26T06:43:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e81bdf240 con 0x559e81bc0580 2023-10-26T06:43:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f3654d13b80 10 client.0 _ll_register_callbacks cb 0x559e819f9a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f363affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81c25c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f363b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bde940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f363affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81c25c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37878/0 (socket says 172.21.15.50:37878) 2023-10-26T06:43:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f363affd700 1 -- 172.21.15.50:0/1216062139 learned_addr learned my addr 172.21.15.50:0/1216062139 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.081+0000 7f36327fc700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81c261c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363affd700 1 -- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 msgr2=0x559e81c261c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363affd700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81c261c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363affd700 1 -- 172.21.15.50:0/1216062139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 msgr2=0x559e81bde940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363affd700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bde940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363affd700 1 -- 172.21.15.50:0/1216062139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e81ad03a0 con 0x559e81bc0580 2023-10-26T06:43:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363b7fe700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bde940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f363affd700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81c25c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f362c000c00 tx=0x7f362c0055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f487df4a36a3028 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f36227fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:43:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f36227fc700 1 -- 172.21.15.50:0/1216062139 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c01d050 con 0x559e81bc0580 2023-10-26T06:43:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f362409a230 con 0x559e81bc0580 2023-10-26T06:43:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f36227fc700 1 -- 172.21.15.50:0/1216062139 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f362c00bcc0 con 0x559e81bc0580 2023-10-26T06:43:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.082+0000 7f36227fc700 1 -- 172.21.15.50:0/1216062139 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f362c029070 con 0x559e81bc0580 2023-10-26T06:43:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 10 client.25378 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x559e81926c10 con 0x559e81bc0580 2023-10-26T06:43:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f36227fc700 1 -- 172.21.15.50:0/1216062139 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f362409a230 con 0x559e81bc0580 2023-10-26T06:43:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f36227fc700 1 -- 172.21.15.50:0/1216062139 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f362c0173f0 con 0x559e81bc0580 2023-10-26T06:43:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 10 client.25378 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 10 client.25378 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-26T06:43:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 20 client.25378 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81c32890 0x559e81c2ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 4 client.25378 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-26T06:43:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e81b0be00 con 0x559e81c32890 2023-10-26T06:43:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.083+0000 7f36327fc700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81c32890 0x559e81c2ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f36327fc700 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81c32890 0x559e81c2ecd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7edb421dde38410a server_cookie=7448d5e762850af1 in_seq=0 out_seq=0 2023-10-26T06:43:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f36227fc700 10 client.25378 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f36227fc700 1 -- 172.21.15.50:0/1216062139 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x559e81b0be00 con 0x559e81c32890 2023-10-26T06:43:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f36227fc700 10 client.25378 handle_command_reply: tid=0 2023-10-26T06:43:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 client.25378 shutdown 2023-10-26T06:43:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 msgr2=0x559e81c25c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81c25c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f362c000c00 tx=0x7f362c0055f0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 shutdown_connections 2023-10-26T06:43:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559e81c32890 0x559e81c2ecd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559e81bc64b0 0x559e81bde940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f36227fc700 0 client.25378 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:24.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559e81bc0580 0x559e81c25c80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 --2- 172.21.15.50:0/1216062139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559e81bc5b90 0x559e81c261c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.084+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 >> 172.21.15.50:0/1216062139 conn(0x559e81b346d0 msgr2=0x559e81bc4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 shutdown_connections 2023-10-26T06:43:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f3654d13b80 1 -- 172.21.15.50:0/1216062139 wait complete. 2023-10-26T06:43:24.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f3654d13b80 20 client.25378 trim_cache size 0 max 16384 2023-10-26T06:43:24.102 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:43:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "6f658e7e-73c9-11ee-8db9-212e2dc638e7", 2023-10-26T06:43:24.102 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-10-26T06:43:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24740, 2023-10-26T06:43:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-10-26T06:43:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-10-26T06:43:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-10-26T06:43:24.103 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 113.126664053, 2023-10-26T06:43:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-10-26T06:43:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 86, 2023-10-26T06:43:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 84, 2023-10-26T06:43:24.104 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 119.66822349 2023-10-26T06:43:24.104 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:43:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36280a14d0 msgr2=0x7f36280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36280a14d0 0x7f36280a3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f363400f590 tx=0x7f363400b040 comp rx=0 tx=0).stop 2023-10-26T06:43:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 msgr2=0x7f363c19eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 0x7f363c19eef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f362400e9a0 tx=0x7f362400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 shutdown_connections 2023-10-26T06:43:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f36280a14d0 0x7f36280a3990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f363c1066b0 0x7f363c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f363c1006a0 0x7f363c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 --2- 172.21.15.50:0/97700801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f363c101060 0x7f363c19eef0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:24.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 >> 172.21.15.50:0/97700801 conn(0x7f363c0fc170 msgr2=0x7f363c10be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.085+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 shutdown_connections 2023-10-26T06:43:24.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:24.086+0000 7f36413ff700 1 -- 172.21.15.50:0/97700801 wait complete. 2023-10-26T06:43:24.108 INFO:teuthology.run_tasks:Running task kclient... 2023-10-26T06:43:24.147 INFO:tasks.kclient:Mounting kernel clients... 2023-10-26T06:43:24.147 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-26T06:43:24.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:24.148 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-26T06:43:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:23 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4080461763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:23 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2848376553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:24.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:24.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-26T06:43:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:23 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4080461763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:23 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2848376553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-10-26T06:43:24.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:43:24.310 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-10-26T06:43:24.310 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-26T06:43:24.311 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:24.311 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph fs ls 2023-10-26T06:43:25.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:24 smithi050 ceph-mon[94997]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:25.054 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:43:25.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:24 smithi125 ceph-mon[130643]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:25.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:24 smithi153 ceph-mon[131657]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:26.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1103768675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e141057c0 msgr2=0x7f7e14105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1103768675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e141057c0 0x7f7e14105ba0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009990 tx=0x7f7e08009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1103768675 shutdown_connections 2023-10-26T06:43:26.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1103768675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e14101260 0x7f7e1410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1103768675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e141057c0 0x7f7e14105ba0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1103768675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 0x7f7e14100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1103768675 >> 172.21.15.50:0/1103768675 conn(0x7f7e140779e0 msgr2=0x7f7e14077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1103768675 shutdown_connections 2023-10-26T06:43:26.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.686+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1103768675 wait complete. 2023-10-26T06:43:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.687+0000 7f7e1ac20700 1 Processor -- start 2023-10-26T06:43:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 -- start start 2023-10-26T06:43:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 0x7f7e14198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 0x7f7e14199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:26.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e141057c0 0x7f7e1419d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:26.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419dd20 con 0x7f7e14101260 2023-10-26T06:43:26.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419de90 con 0x7f7e141008a0 2023-10-26T06:43:26.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e1ac20700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419e050 con 0x7f7e141057c0 2023-10-26T06:43:26.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 0x7f7e14199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:26.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 0x7f7e14199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37464/0 (socket says 172.21.15.50:37464) 2023-10-26T06:43:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e189bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 0x7f7e14198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e13fff700 1 -- 172.21.15.50:0/1698550642 learned_addr learned my addr 172.21.15.50:0/1698550642 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.688+0000 7f7e191bd700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e141057c0 0x7f7e1419d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e13fff700 1 -- 172.21.15.50:0/1698550642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e141057c0 msgr2=0x7f7e1419d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e13fff700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e141057c0 0x7f7e1419d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e13fff700 1 -- 172.21.15.50:0/1698550642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 msgr2=0x7f7e14198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e13fff700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 0x7f7e14198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e13fff700 1 -- 172.21.15.50:0/1698550642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080095f0 con 0x7f7e14101260 2023-10-26T06:43:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e189bc700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 0x7f7e14198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e13fff700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 0x7f7e14199360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9a0 tx=0x7f7e0000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:26.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00009790 con 0x7f7e14101260 2023-10-26T06:43:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e00010430 con 0x7f7e14101260 2023-10-26T06:43:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00018680 con 0x7f7e14101260 2023-10-26T06:43:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.689+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1419e330 con 0x7f7e14101260 2023-10-26T06:43:26.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.690+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e141a5b90 con 0x7f7e14101260 2023-10-26T06:43:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.691+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e14101f30 con 0x7f7e14101260 2023-10-26T06:43:26.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.692+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7e000105a0 con 0x7f7e14101260 2023-10-26T06:43:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.694+0000 7f7e11ffb700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e040a14d0 0x7f7e040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.694+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7e00014070 con 0x7f7e14101260 2023-10-26T06:43:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.694+0000 7f7e189bc700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e040a14d0 0x7f7e040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.695+0000 7f7e189bc700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e040a14d0 0x7f7e040a3990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7e08006010 tx=0x7f7e08005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:26.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.698+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e00052100 con 0x7f7e14101260 2023-10-26T06:43:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.954+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7e14110710 con 0x7f7e14101260 2023-10-26T06:43:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.954+0000 7f7e11ffb700 1 -- 172.21.15.50:0/1698550642 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7e00096570 con 0x7f7e14101260 2023-10-26T06:43:26.957 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-26T06:43:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.956+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e040a14d0 msgr2=0x7f7e040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.956+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e040a14d0 0x7f7e040a3990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7e08006010 tx=0x7f7e08005960 comp rx=0 tx=0).stop 2023-10-26T06:43:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.956+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 msgr2=0x7f7e14199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.956+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 0x7f7e14199360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9a0 tx=0x7f7e0000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 shutdown_connections 2023-10-26T06:43:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7e040a14d0 0x7f7e040a3990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e141057c0 0x7f7e1419d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e141008a0 0x7f7e14198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 --2- 172.21.15.50:0/1698550642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e14101260 0x7f7e14199360 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 >> 172.21.15.50:0/1698550642 conn(0x7f7e140779e0 msgr2=0x7f7e1410ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 shutdown_connections 2023-10-26T06:43:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:26.957+0000 7f7e1ac20700 1 -- 172.21.15.50:0/1698550642 wait complete. 2023-10-26T06:43:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:26 smithi050 ceph-mon[94997]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:43:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:26 smithi125 ceph-mon[130643]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:43:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:26 smithi153 ceph-mon[131657]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:43:27.547 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-26T06:43:27.547 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-26T06:43:27.547 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-10-26T06:43:27.548 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-26T06:43:27.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:27.548 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-26T06:43:27.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-26T06:43:27.549 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-26T06:43:27.549 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-26T06:43:27.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:27.549 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-10-26T06:43:27.595 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-26T06:43:27.595 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-26T06:43:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-10-26T06:43:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-26T06:43:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-10-26T06:43:27.596 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-26T06:43:27.596 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-26T06:43:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-10-26T06:43:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-10-26T06:43:27.597 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-26T06:43:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-10-26T06:43:27.597 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-10-26T06:43:27.597 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-26T06:43:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-10-26T06:43:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-10-26T06:43:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-26T06:43:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 41605sec preferred_lft 41605sec 2023-10-26T06:43:27.598 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-10-26T06:43:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-10-26T06:43:27.599 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-26T06:43:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-10-26T06:43:27.599 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-10-26T06:43:27.600 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-26T06:43:27.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:27.601 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-26T06:43:27.601 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-26T06:43:27.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-10-26T06:43:27.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-10-26T06:43:27.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-10-26T06:43:27.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-26T06:43:27.603 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-26T06:43:27.985 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:27 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1698550642' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-26T06:43:28.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:28.088 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-26T06:43:28.163 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-10-26T06:43:28.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:28.167 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-10-26T06:43:28.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:27 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1698550642' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-26T06:43:28.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:27 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1698550642' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-26T06:43:28.235 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-10-26T06:43:28.236 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-26T06:43:28.236 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-26T06:43:28.236 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-26T06:43:28.236 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-26T06:43:28.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:28.237 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-26T06:43:28.237 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-26T06:43:28.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-26T06:43:28.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-26T06:43:28.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-26T06:43:28.238 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-26T06:43:28.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:28 smithi050 ceph-mon[94997]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:43:28.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:28.949 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-26T06:43:28.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:28.995 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-10-26T06:43:29.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:29.080 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-26T06:43:29.080 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-26T06:43:29.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-26T06:43:29.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-26T06:43:29.081 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-26T06:43:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:28 smithi125 ceph-mon[130643]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:43:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:28 smithi153 ceph-mon[131657]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:43:29.268 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-26T06:43:29.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:29.269 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-26T06:43:29.269 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-26T06:43:29.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-26T06:43:29.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-26T06:43:29.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-26T06:43:29.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-26T06:43:29.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-26T06:43:29.271 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-26T06:43:29.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:29.555 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-10-26T06:43:29.555 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-10-26T06:43:29.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-10-26T06:43:29.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-10-26T06:43:29.556 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-10-26T06:43:29.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-26T06:43:29.736 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:29.782 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-26T06:43:29.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-26T06:43:29.783 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:29.866 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-26T06:43:29.867 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-26T06:43:29.867 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a 2023-10-26T06:43:29.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:29.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2023-10-26T06:43:30.028 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2023-10-26T06:43:30.029 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2023-10-26T06:43:30.029 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-26T06:43:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2023-10-26T06:43:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2023-10-26T06:43:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2023-10-26T06:43:30.497 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.125:6789,172.21.15.153:6789" 2023-10-26T06:43:30.497 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.125:6789,172.21.15.153:6789:/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a 2023-10-26T06:43:30.497 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=6f658e7e-73c9-11ee-8db9-212e2dc638e7" will pass to kernel 2023-10-26T06:43:30.502 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-26T06:43:30.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:30.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:30.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:30.577 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-26T06:43:30.678 INFO:teuthology.orchestra.run.smithi050.stdout:client15375 2023-10-26T06:43:30.679 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:43:30.679 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-26T06:43:30.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:30.725 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-26T06:43:30.852 INFO:teuthology.orchestra.run.smithi050.stdout:client15375 2023-10-26T06:43:30.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:30.853 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-26T06:43:30.940 INFO:teuthology.orchestra.run.smithi050.stdout:client15375 2023-10-26T06:43:30.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:43:30.941 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7.client15375/status') 2023-10-26T06:43:31.047 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:30 smithi050 ceph-mon[94997]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:31.053 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.15375 (3)192.168.0.1:0/3895706375 2023-10-26T06:43:31.053 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2023-10-26T06:43:31.054 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2023-10-26T06:43:31.054 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2023-10-26T06:43:31.054 INFO:teuthology.orchestra.run.smithi050.stderr:70 bytes copied, 5.5488e-05 s, 1.3 MB/s 2023-10-26T06:43:31.056 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-26T06:43:31.068 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-26T06:43:31.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:30 smithi125 ceph-mon[130643]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:30 smithi153 ceph-mon[131657]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:43:31.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 -- 172.21.15.50:0/2599568547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0318101060 msgr2=0x7f031810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 --2- 172.21.15.50:0/2599568547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0318101060 0x7f031810d570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f031000b0a0 tx=0x7f031000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 -- 172.21.15.50:0/2599568547 shutdown_connections 2023-10-26T06:43:31.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 --2- 172.21.15.50:0/2599568547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0318101060 0x7f031810d570 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 --2- 172.21.15.50:0/2599568547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03181066b0 0x7f0318106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 --2- 172.21.15.50:0/2599568547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03181006a0 0x7f0318100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 -- 172.21.15.50:0/2599568547 >> 172.21.15.50:0/2599568547 conn(0x7f03180fc1d0 msgr2=0x7f03180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 -- 172.21.15.50:0/2599568547 shutdown_connections 2023-10-26T06:43:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.284+0000 7f031d3ff700 1 -- 172.21.15.50:0/2599568547 wait complete. 2023-10-26T06:43:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.285+0000 7f031d3ff700 1 Processor -- start 2023-10-26T06:43:31.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.285+0000 7f031d3ff700 1 -- start start 2023-10-26T06:43:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.285+0000 7f031d3ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03181006a0 0x7f0318072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.285+0000 7f031d3ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 0x7f0318073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.285+0000 7f031d3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 0x7f0318073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.285+0000 7f031d3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181a4ee0 con 0x7f03181066b0 2023-10-26T06:43:31.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f031d3ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181a5050 con 0x7f0318101060 2023-10-26T06:43:31.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f031d3ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181a5210 con 0x7f03181006a0 2023-10-26T06:43:31.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 0x7f0318073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f030ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 0x7f0318073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f030ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 0x7f0318073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:52432/0 (socket says 172.21.15.50:52432) 2023-10-26T06:43:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 0x7f0318073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37484/0 (socket says 172.21.15.50:37484) 2023-10-26T06:43:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f030ffff700 1 -- 172.21.15.50:0/552318645 learned_addr learned my addr 172.21.15.50:0/552318645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f0316ffd700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03181006a0 0x7f0318072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 -- 172.21.15.50:0/552318645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03181006a0 msgr2=0x7f0318072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03181006a0 0x7f0318072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 -- 172.21.15.50:0/552318645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 msgr2=0x7f0318073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 0x7f0318073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f03177fe700 1 -- 172.21.15.50:0/552318645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308009520 con 0x7f03181066b0 2023-10-26T06:43:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.286+0000 7f030ffff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 0x7f0318073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.287+0000 7f03177fe700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 0x7f0318073590 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f031000b070 tx=0x7f03100077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.287+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000e040 con 0x7f03181066b0 2023-10-26T06:43:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.287+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0310004e60 con 0x7f03181066b0 2023-10-26T06:43:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.287+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310005040 con 0x7f03181066b0 2023-10-26T06:43:31.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.287+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0310009d00 con 0x7f03181066b0 2023-10-26T06:43:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.287+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03181a5780 con 0x7f03181066b0 2023-10-26T06:43:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.288+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0318108cc0 con 0x7f03181066b0 2023-10-26T06:43:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.290+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f031001d470 con 0x7f03181066b0 2023-10-26T06:43:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.291+0000 7f0314ff9700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03040a1550 0x7f03040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.291+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f03100ce1a0 con 0x7f03181066b0 2023-10-26T06:43:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.292+0000 7f0316ffd700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03040a1550 0x7f03040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.292+0000 7f0316ffd700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03040a1550 0x7f03040a3a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0308009d70 tx=0x7f0308009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:31.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.295+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03100977c0 con 0x7f03181066b0 2023-10-26T06:43:31.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.513+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0318073fd0 con 0x7f03181066b0 2023-10-26T06:43:31.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.515+0000 7f0314ff9700 1 -- 172.21.15.50:0/552318645 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7f031009ade0 con 0x7f03181066b0 2023-10-26T06:43:31.517 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:31.517 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:31.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03040a1550 msgr2=0x7f03040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03040a1550 0x7f03040a3a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0308009d70 tx=0x7f0308009260 comp rx=0 tx=0).stop 2023-10-26T06:43:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 msgr2=0x7f0318073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 0x7f0318073590 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f031000b070 tx=0x7f03100077f0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 shutdown_connections 2023-10-26T06:43:31.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f03040a1550 0x7f03040a3a10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03181066b0 0x7f0318073590 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03181006a0 0x7f0318072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 --2- 172.21.15.50:0/552318645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0318101060 0x7f0318073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 >> 172.21.15.50:0/552318645 conn(0x7f03180fc1d0 msgr2=0x7f03180fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:31.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 shutdown_connections 2023-10-26T06:43:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.518+0000 7f031d3ff700 1 -- 172.21.15.50:0/552318645 wait complete. 2023-10-26T06:43:31.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:43:31.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:43:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 -- 172.21.15.50:0/2207519471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14105b30 msgr2=0x7f5a1410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 --2- 172.21.15.50:0/2207519471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14105b30 0x7f5a1410d540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00b0d0 tx=0x7f5a0c00b3e0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 -- 172.21.15.50:0/2207519471 shutdown_connections 2023-10-26T06:43:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 --2- 172.21.15.50:0/2207519471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14105b30 0x7f5a1410d540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 --2- 172.21.15.50:0/2207519471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14067d40 0x7f5a14068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 --2- 172.21.15.50:0/2207519471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a14105170 0x7f5a141055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 -- 172.21.15.50:0/2207519471 >> 172.21.15.50:0/2207519471 conn(0x7f5a140767f0 msgr2=0x7f5a14076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 -- 172.21.15.50:0/2207519471 shutdown_connections 2023-10-26T06:43:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.747+0000 7f5a189ff700 1 -- 172.21.15.50:0/2207519471 wait complete. 2023-10-26T06:43:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.749+0000 7f5a189ff700 1 Processor -- start 2023-10-26T06:43:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.749+0000 7f5a189ff700 1 -- start start 2023-10-26T06:43:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a189ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 0x7f5a1419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a189ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14105170 0x7f5a1419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a189ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a14105b30 0x7f5a14196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a189ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14197180 con 0x7f5a14067d40 2023-10-26T06:43:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a189ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141972f0 con 0x7f5a14105170 2023-10-26T06:43:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a189ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141974b0 con 0x7f5a14105b30 2023-10-26T06:43:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 0x7f5a1419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 0x7f5a1419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37506/0 (socket says 172.21.15.50:37506) 2023-10-26T06:43:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 -- 172.21.15.50:0/1247067564 learned_addr learned my addr 172.21.15.50:0/1247067564 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a0bfff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14105170 0x7f5a1419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a12d9d700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a14105b30 0x7f5a14196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 -- 172.21.15.50:0/1247067564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a14105b30 msgr2=0x7f5a14196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a14105b30 0x7f5a14196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 -- 172.21.15.50:0/1247067564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14105170 msgr2=0x7f5a1419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14105170 0x7f5a1419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.750+0000 7f5a1259c700 1 -- 172.21.15.50:0/1247067564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009d00 con 0x7f5a14067d40 2023-10-26T06:43:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.751+0000 7f5a1259c700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 0x7f5a1419c9f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400e9a0 tx=0x7f5a0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.751+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04009790 con 0x7f5a14067d40 2023-10-26T06:43:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.751+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a04010430 con 0x7f5a14067d40 2023-10-26T06:43:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.751+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a14197790 con 0x7f5a14067d40 2023-10-26T06:43:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.751+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04018680 con 0x7f5a14067d40 2023-10-26T06:43:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.751+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a141a39e0 con 0x7f5a14067d40 2023-10-26T06:43:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.752+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14108c20 con 0x7f5a14067d40 2023-10-26T06:43:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.754+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5a040105a0 con 0x7f5a14067d40 2023-10-26T06:43:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.756+0000 7f5a0b7fe700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5a000a14d0 0x7f5a000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.756+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5a04014070 con 0x7f5a14067d40 2023-10-26T06:43:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.756+0000 7f5a0bfff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5a000a14d0 0x7f5a000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.757+0000 7f5a0bfff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5a000a14d0 0x7f5a000a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a14197ce0 tx=0x7f59fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.760+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5a04052100 con 0x7f5a14067d40 2023-10-26T06:43:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.973+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a14197fe0 con 0x7f5a14067d40 2023-10-26T06:43:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.974+0000 7f5a0b7fe700 1 -- 172.21.15.50:0/1247067564 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a04096570 con 0x7f5a14067d40 2023-10-26T06:43:31.976 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:43:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5a000a14d0 msgr2=0x7f5a000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5a000a14d0 0x7f5a000a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a14197ce0 tx=0x7f59fc009260 comp rx=0 tx=0).stop 2023-10-26T06:43:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 msgr2=0x7f5a1419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 0x7f5a1419c9f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400e9a0 tx=0x7f5a0400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 shutdown_connections 2023-10-26T06:43:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5a000a14d0 0x7f5a000a3990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a14105b30 0x7f5a14196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a14067d40 0x7f5a1419c9f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 --2- 172.21.15.50:0/1247067564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a14105170 0x7f5a1419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 >> 172.21.15.50:0/1247067564 conn(0x7f5a140767f0 msgr2=0x7f5a140fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.976+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 shutdown_connections 2023-10-26T06:43:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:31.977+0000 7f5a189ff700 1 -- 172.21.15.50:0/1247067564 wait complete. 2023-10-26T06:43:31.994 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:31 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/552318645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:31.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:43:32.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:31 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/552318645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 -- 172.21.15.50:0/3874408947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc1010e0 msgr2=0x7f26fc10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 --2- 172.21.15.50:0/3874408947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc1010e0 0x7f26fc10d5f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f26f400b0a0 tx=0x7f26f400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 -- 172.21.15.50:0/3874408947 shutdown_connections 2023-10-26T06:43:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 --2- 172.21.15.50:0/3874408947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc1010e0 0x7f26fc10d5f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 --2- 172.21.15.50:0/3874408947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc106730 0x7f26fc106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 --2- 172.21.15.50:0/3874408947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 0x7f26fc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 -- 172.21.15.50:0/3874408947 >> 172.21.15.50:0/3874408947 conn(0x7f26fc0fc1b0 msgr2=0x7f26fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:32.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 -- 172.21.15.50:0/3874408947 shutdown_connections 2023-10-26T06:43:32.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.203+0000 7f27033ff700 1 -- 172.21.15.50:0/3874408947 wait complete. 2023-10-26T06:43:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.204+0000 7f27033ff700 1 Processor -- start 2023-10-26T06:43:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.204+0000 7f27033ff700 1 -- start start 2023-10-26T06:43:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f27033ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 0x7f26fc107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f27033ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc1010e0 0x7f26fc107b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f27033ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc106730 0x7f26fc1080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f27033ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc1a9350 con 0x7f26fc106730 2023-10-26T06:43:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f27033ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc1a9490 con 0x7f26fc100720 2023-10-26T06:43:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f27033ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc1a9600 con 0x7f26fc1010e0 2023-10-26T06:43:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f270099a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc1010e0 0x7f26fc107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f270199c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc106730 0x7f26fc1080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f270099a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc1010e0 0x7f26fc107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:37970/0 (socket says 172.21.15.50:37970) 2023-10-26T06:43:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f270099a700 1 -- 172.21.15.50:0/289437648 learned_addr learned my addr 172.21.15.50:0/289437648 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.205+0000 7f270119b700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 0x7f26fc107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270199c700 1 -- 172.21.15.50:0/289437648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc1010e0 msgr2=0x7f26fc107b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270199c700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc1010e0 0x7f26fc107b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270199c700 1 -- 172.21.15.50:0/289437648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 msgr2=0x7f26fc107650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270199c700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 0x7f26fc107650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270199c700 1 -- 172.21.15.50:0/289437648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4009d00 con 0x7f26fc106730 2023-10-26T06:43:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270119b700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 0x7f26fc107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f270199c700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc106730 0x7f26fc1080d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26f400b070 tx=0x7f26f40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400e040 con 0x7f26fc106730 2023-10-26T06:43:32.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f4004e60 con 0x7f26fc106730 2023-10-26T06:43:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4005040 con 0x7f26fc106730 2023-10-26T06:43:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc1a9880 con 0x7f26fc106730 2023-10-26T06:43:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.206+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc1a9d00 con 0x7f26fc106730 2023-10-26T06:43:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.207+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc101e60 con 0x7f26fc106730 2023-10-26T06:43:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.209+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f26f401d470 con 0x7f26fc106730 2023-10-26T06:43:32.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.211+0000 7f26f27fc700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1550 0x7f26e80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.211+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f26f40ce960 con 0x7f26fc106730 2023-10-26T06:43:32.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.211+0000 7f270119b700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1550 0x7f26e80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.212+0000 7f270119b700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1550 0x7f26e80a3a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009fd0 tx=0x7f26f8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:32.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.213+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f26f4098000 con 0x7f26fc106730 2023-10-26T06:43:32.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:31 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/552318645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.425+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26fc1106f0 con 0x7f26fc106730 2023-10-26T06:43:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.426+0000 7f26f27fc700 1 -- 172.21.15.50:0/289437648 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26f409b620 con 0x7f26fc106730 2023-10-26T06:43:32.428 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:43:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1550 msgr2=0x7f26e80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1550 0x7f26e80a3a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009fd0 tx=0x7f26f8009260 comp rx=0 tx=0).stop 2023-10-26T06:43:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc106730 msgr2=0x7f26fc1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc106730 0x7f26fc1080d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f26f400b070 tx=0x7f26f40077f0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 shutdown_connections 2023-10-26T06:43:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1550 0x7f26e80a3a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26fc106730 0x7f26fc1080d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26fc100720 0x7f26fc107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 --2- 172.21.15.50:0/289437648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26fc1010e0 0x7f26fc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.428+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 >> 172.21.15.50:0/289437648 conn(0x7f26fc0fc1b0 msgr2=0x7f26fc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.429+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 shutdown_connections 2023-10-26T06:43:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.429+0000 7f27033ff700 1 -- 172.21.15.50:0/289437648 wait complete. 2023-10-26T06:43:32.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:43:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1142410966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 msgr2=0x7f0ad8068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1142410966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8068120 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40099c0 tx=0x7f0ad4009cd0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1142410966 shutdown_connections 2023-10-26T06:43:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1142410966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ad8105b30 0x7f0ad810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1142410966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8068120 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1142410966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 0x7f0ad81055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1142410966 >> 172.21.15.50:0/1142410966 conn(0x7f0ad80767f0 msgr2=0x7f0ad8076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:32.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1142410966 shutdown_connections 2023-10-26T06:43:32.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.655+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1142410966 wait complete. 2023-10-26T06:43:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.656+0000 7f0ae01ff700 1 Processor -- start 2023-10-26T06:43:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 -- start start 2023-10-26T06:43:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 0x7f0ad8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ad8105b30 0x7f0ad819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819dd00 con 0x7f0ad8067d40 2023-10-26T06:43:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819de70 con 0x7f0ad8105170 2023-10-26T06:43:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ae01ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819e030 con 0x7f0ad8105b30 2023-10-26T06:43:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0addf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0addf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37536/0 (socket says 172.21.15.50:37536) 2023-10-26T06:43:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0addf9b700 1 -- 172.21.15.50:0/1619915413 learned_addr learned my addr 172.21.15.50:0/1619915413 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0add79a700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 0x7f0ad8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.657+0000 7f0ade79c700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ad8105b30 0x7f0ad819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0addf9b700 1 -- 172.21.15.50:0/1619915413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ad8105b30 msgr2=0x7f0ad819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0addf9b700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ad8105b30 0x7f0ad819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0addf9b700 1 -- 172.21.15.50:0/1619915413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 msgr2=0x7f0ad8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0addf9b700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 0x7f0ad8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0addf9b700 1 -- 172.21.15.50:0/1619915413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40095f0 con 0x7f0ad8067d40 2023-10-26T06:43:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0add79a700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 0x7f0ad8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0addf9b700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8198de0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4005b40 tx=0x7f0ad400b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad401d070 con 0x7f0ad8067d40 2023-10-26T06:43:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad819e2b0 con 0x7f0ad8067d40 2023-10-26T06:43:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ad400be00 con 0x7f0ad8067d40 2023-10-26T06:43:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400fb00 con 0x7f0ad8067d40 2023-10-26T06:43:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.658+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81a5b50 con 0x7f0ad8067d40 2023-10-26T06:43:32.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.659+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8101e40 con 0x7f0ad8067d40 2023-10-26T06:43:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.661+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0ad402b440 con 0x7f0ad8067d40 2023-10-26T06:43:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.663+0000 7f0aceffd700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ac40a14d0 0x7f0ac40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:32.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.663+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0ad40cda40 con 0x7f0ad8067d40 2023-10-26T06:43:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.663+0000 7f0add79a700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ac40a14d0 0x7f0ac40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.663+0000 7f0add79a700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ac40a14d0 0x7f0ac40a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0ad819a330 tx=0x7f0ac8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.666+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ad4097060 con 0x7f0ad8067d40 2023-10-26T06:43:32.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.883+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ad819a0e0 con 0x7f0ad8067d40 2023-10-26T06:43:32.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.883+0000 7f0aceffd700 1 -- 172.21.15.50:0/1619915413 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ad409a680 con 0x7f0ad8067d40 2023-10-26T06:43:32.885 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:43:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ac40a14d0 msgr2=0x7f0ac40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ac40a14d0 0x7f0ac40a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0ad819a330 tx=0x7f0ac8009260 comp rx=0 tx=0).stop 2023-10-26T06:43:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 msgr2=0x7f0ad8198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8198de0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4005b40 tx=0x7f0ad400b9c0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 shutdown_connections 2023-10-26T06:43:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f0ac40a14d0 0x7f0ac40a3990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ad8105b30 0x7f0ad819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ad8067d40 0x7f0ad8198de0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 --2- 172.21.15.50:0/1619915413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ad8105170 0x7f0ad8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 >> 172.21.15.50:0/1619915413 conn(0x7f0ad80767f0 msgr2=0x7f0ad8100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 shutdown_connections 2023-10-26T06:43:32.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:32.886+0000 7f0ae01ff700 1 -- 172.21.15.50:0/1619915413 wait complete. 2023-10-26T06:43:32.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 -- 172.21.15.50:0/3925484720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1066b0 msgr2=0x7f596c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 --2- 172.21.15.50:0/3925484720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1066b0 0x7f596c106a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5968009990 tx=0x7f5968009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 -- 172.21.15.50:0/3925484720 shutdown_connections 2023-10-26T06:43:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 --2- 172.21.15.50:0/3925484720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 --2- 172.21.15.50:0/3925484720 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1066b0 0x7f596c106a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 --2- 172.21.15.50:0/3925484720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1006a0 0x7f596c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 -- 172.21.15.50:0/3925484720 >> 172.21.15.50:0/3925484720 conn(0x7f596c0fc170 msgr2=0x7f596c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:33.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 -- 172.21.15.50:0/3925484720 shutdown_connections 2023-10-26T06:43:33.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.111+0000 7f59743ff700 1 -- 172.21.15.50:0/3925484720 wait complete. 2023-10-26T06:43:33.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.112+0000 7f59743ff700 1 Processor -- start 2023-10-26T06:43:33.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.112+0000 7f59743ff700 1 -- start start 2023-10-26T06:43:33.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f59743ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1006a0 0x7f596c19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f59743ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f59743ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1066b0 0x7f596c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f59743ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c199170 con 0x7f596c101060 2023-10-26T06:43:33.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f59743ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c1992e0 con 0x7f596c1006a0 2023-10-26T06:43:33.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f59743ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c1994a0 con 0x7f596c1066b0 2023-10-26T06:43:33.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597219b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1006a0 0x7f596c19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37554/0 (socket says 172.21.15.50:37554) 2023-10-26T06:43:33.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 -- 172.21.15.50:0/2777125778 learned_addr learned my addr 172.21.15.50:0/2777125778 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:33.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597299c700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1066b0 0x7f596c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 -- 172.21.15.50:0/2777125778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1066b0 msgr2=0x7f596c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1066b0 0x7f596c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 -- 172.21.15.50:0/2777125778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1006a0 msgr2=0x7f596c19e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1006a0 0x7f596c19e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597199a700 1 -- 172.21.15.50:0/2777125778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680095f0 con 0x7f596c101060 2023-10-26T06:43:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597219b700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1006a0 0x7f596c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.113+0000 7f597299c700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1066b0 0x7f596c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.114+0000 7f597199a700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c19ef20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e9a0 tx=0x7f595c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.114+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c009790 con 0x7f596c101060 2023-10-26T06:43:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.114+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c199780 con 0x7f596c101060 2023-10-26T06:43:33.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.114+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f595c00cbd0 con 0x7f596c101060 2023-10-26T06:43:33.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.114+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c018680 con 0x7f596c101060 2023-10-26T06:43:33.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.114+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c1a59d0 con 0x7f596c101060 2023-10-26T06:43:33.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.115+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c101de0 con 0x7f596c101060 2023-10-26T06:43:33.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.117+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f595c00cd40 con 0x7f596c101060 2023-10-26T06:43:33.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.118+0000 7f59637fe700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59580a14d0 0x7f59580a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.119+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f595c014070 con 0x7f596c101060 2023-10-26T06:43:33.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.119+0000 7f597219b700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59580a14d0 0x7f59580a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.119+0000 7f597219b700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59580a14d0 0x7f59580a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5968006010 tx=0x7f596800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:33.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.121+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f595c096910 con 0x7f596c101060 2023-10-26T06:43:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:32 smithi125 ceph-mon[130643]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:32 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1247067564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:33.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:32 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/289437648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:32 smithi153 ceph-mon[131657]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:32 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1247067564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:32 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/289437648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:32 smithi050 ceph-mon[94997]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:43:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:32 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1247067564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:32 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/289437648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.336+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f596c067530 con 0x7f596c101060 2023-10-26T06:43:33.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.337+0000 7f59637fe700 1 -- 172.21.15.50:0/2777125778 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7f595c099f30 con 0x7f596c101060 2023-10-26T06:43:33.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:33.339 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:33.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59580a14d0 msgr2=0x7f59580a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59580a14d0 0x7f59580a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5968006010 tx=0x7f596800b260 comp rx=0 tx=0).stop 2023-10-26T06:43:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 msgr2=0x7f596c19ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c19ef20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e9a0 tx=0x7f595c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 shutdown_connections 2023-10-26T06:43:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f59580a14d0 0x7f59580a3990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f596c1066b0 0x7f596c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f596c1006a0 0x7f596c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 --2- 172.21.15.50:0/2777125778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f596c101060 0x7f596c19ef20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 >> 172.21.15.50:0/2777125778 conn(0x7f596c0fc170 msgr2=0x7f596c10be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 shutdown_connections 2023-10-26T06:43:33.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.340+0000 7f59743ff700 1 -- 172.21.15.50:0/2777125778 wait complete. 2023-10-26T06:43:33.361 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:43:33.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:43:33.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 -- 172.21.15.50:0/796366043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c1010d0 msgr2=0x7f6a0c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 --2- 172.21.15.50:0/796366043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c1010d0 0x7f6a0c10d5e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b0a0 tx=0x7f6a0400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 -- 172.21.15.50:0/796366043 shutdown_connections 2023-10-26T06:43:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 --2- 172.21.15.50:0/796366043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c1010d0 0x7f6a0c10d5e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 --2- 172.21.15.50:0/796366043 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a0c106720 0x7f6a0c106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 --2- 172.21.15.50:0/796366043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c100710 0x7f6a0c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 -- 172.21.15.50:0/796366043 >> 172.21.15.50:0/796366043 conn(0x7f6a0c0fc200 msgr2=0x7f6a0c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 -- 172.21.15.50:0/796366043 shutdown_connections 2023-10-26T06:43:33.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.568+0000 7f6a10bff700 1 -- 172.21.15.50:0/796366043 wait complete. 2023-10-26T06:43:33.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.569+0000 7f6a10bff700 1 Processor -- start 2023-10-26T06:43:33.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.569+0000 7f6a10bff700 1 -- start start 2023-10-26T06:43:33.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a10bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c100710 0x7f6a0c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a10bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a0c1010d0 0x7f6a0c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a10bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 0x7f6a0c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a10bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1a4f50 con 0x7f6a0c106720 2023-10-26T06:43:33.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a10bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1a50c0 con 0x7f6a0c1010d0 2023-10-26T06:43:33.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a10bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1a5280 con 0x7f6a0c100710 2023-10-26T06:43:33.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 0x7f6a0c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 0x7f6a0c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37558/0 (socket says 172.21.15.50:37558) 2023-10-26T06:43:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 -- 172.21.15.50:0/3224161821 learned_addr learned my addr 172.21.15.50:0/3224161821 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a09d9b700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a0c1010d0 0x7f6a0c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0a59c700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c100710 0x7f6a0c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 -- 172.21.15.50:0/3224161821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c100710 msgr2=0x7f6a0c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c100710 0x7f6a0c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 -- 172.21.15.50:0/3224161821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a0c1010d0 msgr2=0x7f6a0c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a0c1010d0 0x7f6a0c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.570+0000 7f6a0ad9d700 1 -- 172.21.15.50:0/3224161821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009d00 con 0x7f6a0c106720 2023-10-26T06:43:33.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.571+0000 7f6a0ad9d700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 0x7f6a0c073570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b070 tx=0x7f6a040077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.571+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400e040 con 0x7f6a0c106720 2023-10-26T06:43:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.571+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a040094c0 con 0x7f6a0c106720 2023-10-26T06:43:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.571+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c1a5500 con 0x7f6a0c106720 2023-10-26T06:43:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.571+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040043a0 con 0x7f6a0c106720 2023-10-26T06:43:33.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.571+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c1a59d0 con 0x7f6a0c106720 2023-10-26T06:43:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.572+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c108d30 con 0x7f6a0c106720 2023-10-26T06:43:33.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.574+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6a04004500 con 0x7f6a0c106720 2023-10-26T06:43:33.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.575+0000 7f69fb7fe700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69f40a1550 0x7f69f40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:33.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.576+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a040cdc00 con 0x7f6a0c106720 2023-10-26T06:43:33.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.576+0000 7f6a0a59c700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69f40a1550 0x7f69f40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:33.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.576+0000 7f6a0a59c700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69f40a1550 0x7f69f40a3a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009be0 tx=0x7f69fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:33.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.579+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a04097220 con 0x7f6a0c106720 2023-10-26T06:43:33.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.791+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a0c073f80 con 0x7f6a0c106720 2023-10-26T06:43:33.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.792+0000 7f69fb7fe700 1 -- 172.21.15.50:0/3224161821 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a0409a840 con 0x7f6a0c106720 2023-10-26T06:43:33.794 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:43:33.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69f40a1550 msgr2=0x7f69f40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69f40a1550 0x7f69f40a3a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009be0 tx=0x7f69fc009260 comp rx=0 tx=0).stop 2023-10-26T06:43:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 msgr2=0x7f6a0c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:33.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 0x7f6a0c073570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b070 tx=0x7f6a040077f0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 shutdown_connections 2023-10-26T06:43:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69f40a1550 0x7f69f40a3a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a0c106720 0x7f6a0c073570 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a0c100710 0x7f6a0c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 --2- 172.21.15.50:0/3224161821 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a0c1010d0 0x7f6a0c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.794+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 >> 172.21.15.50:0/3224161821 conn(0x7f6a0c0fc200 msgr2=0x7f6a0c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:33.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.795+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 shutdown_connections 2023-10-26T06:43:33.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:33.795+0000 7f6a10bff700 1 -- 172.21.15.50:0/3224161821 wait complete. 2023-10-26T06:43:33.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:43:34.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/1981263540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e810cf60 msgr2=0x7fc5e810f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/1981263540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e810cf60 0x7fc5e810f3d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000b0a0 tx=0x7fc5e000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/1981263540 shutdown_connections 2023-10-26T06:43:34.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/1981263540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e810cf60 0x7fc5e810f3d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/1981263540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e8072c20 0x7fc5e8073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/1981263540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 0x7fc5e810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/1981263540 >> 172.21.15.50:0/1981263540 conn(0x7fc5e80fc1b0 msgr2=0x7fc5e80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/1981263540 shutdown_connections 2023-10-26T06:43:34.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.023+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/1981263540 wait complete. 2023-10-26T06:43:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.024+0000 7fc5ef1ff700 1 Processor -- start 2023-10-26T06:43:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.024+0000 7fc5ef1ff700 1 -- start start 2023-10-26T06:43:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ef1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 0x7fc5e8198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ef1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 0x7fc5e81994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ef1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e810cf60 0x7fc5e819d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ef1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e819de40 con 0x7fc5e8072c20 2023-10-26T06:43:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ef1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e819dfb0 con 0x7fc5e8073540 2023-10-26T06:43:34.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ef1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e819e170 con 0x7fc5e810cf60 2023-10-26T06:43:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ecf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 0x7fc5e8198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ecf9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 0x7fc5e8198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33704/0 (socket says 172.21.15.50:33704) 2023-10-26T06:43:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ecf9b700 1 -- 172.21.15.50:0/393662882 learned_addr learned my addr 172.21.15.50:0/393662882 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5e7fff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 0x7fc5e81994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ed79c700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e810cf60 0x7fc5e819d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.025+0000 7fc5ecf9b700 1 -- 172.21.15.50:0/393662882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e810cf60 msgr2=0x7fc5e819d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ecf9b700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e810cf60 0x7fc5e819d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ecf9b700 1 -- 172.21.15.50:0/393662882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 msgr2=0x7fc5e81994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ecf9b700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 0x7fc5e81994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ecf9b700 1 -- 172.21.15.50:0/393662882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4009520 con 0x7fc5e8072c20 2023-10-26T06:43:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5e7fff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 0x7fc5e81994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ecf9b700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 0x7fc5e8198f70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00e9a0 tx=0x7fc5dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc009790 con 0x7fc5e8072c20 2023-10-26T06:43:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5dc010430 con 0x7fc5e8072c20 2023-10-26T06:43:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e0009d00 con 0x7fc5e8072c20 2023-10-26T06:43:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc018680 con 0x7fc5e8072c20 2023-10-26T06:43:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.026+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e81a5ab0 con 0x7fc5e8072c20 2023-10-26T06:43:34.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.027+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e8108170 con 0x7fc5e8072c20 2023-10-26T06:43:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.029+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc5dc0105a0 con 0x7fc5e8072c20 2023-10-26T06:43:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.031+0000 7fc5e5ffb700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc5d80a14d0 0x7fc5d80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.031+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc5dc014070 con 0x7fc5e8072c20 2023-10-26T06:43:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.031+0000 7fc5e7fff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc5d80a14d0 0x7fc5d80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.032+0000 7fc5e7fff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc5d80a14d0 0x7fc5d80a3990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc5e819a470 tx=0x7fc5d4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:34.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.034+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc5dc052100 con 0x7fc5e8072c20 2023-10-26T06:43:34.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:33 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1619915413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:34.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:33 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2777125778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:34.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:33 smithi125 ceph-mon[130643]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:33 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1619915413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:33 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2777125778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:34.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:33 smithi153 ceph-mon[131657]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:34.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.251+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5e819a220 con 0x7fc5e8072c20 2023-10-26T06:43:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.252+0000 7fc5e5ffb700 1 -- 172.21.15.50:0/393662882 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5dc0d0030 con 0x7fc5e8072c20 2023-10-26T06:43:34.253 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:43:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc5d80a14d0 msgr2=0x7fc5d80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc5d80a14d0 0x7fc5d80a3990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc5e819a470 tx=0x7fc5d4009260 comp rx=0 tx=0).stop 2023-10-26T06:43:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 msgr2=0x7fc5e8198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 0x7fc5e8198f70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00e9a0 tx=0x7fc5dc00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 shutdown_connections 2023-10-26T06:43:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fc5d80a14d0 0x7fc5d80a3990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5e810cf60 0x7fc5e819d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e8072c20 0x7fc5e8198f70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 --2- 172.21.15.50:0/393662882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5e8073540 0x7fc5e81994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 >> 172.21.15.50:0/393662882 conn(0x7fc5e80fc1b0 msgr2=0x7fc5e80fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 shutdown_connections 2023-10-26T06:43:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.254+0000 7fc5ef1ff700 1 -- 172.21.15.50:0/393662882 wait complete. 2023-10-26T06:43:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:33 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1619915413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:33 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2777125778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:33 smithi050 ceph-mon[94997]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2023-10-26T06:43:34.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:43:34.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 -- 172.21.15.50:0/14222753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 msgr2=0x7fed68106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 --2- 172.21.15.50:0/14222753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68106b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fed58009990 tx=0x7fed58009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 -- 172.21.15.50:0/14222753 shutdown_connections 2023-10-26T06:43:34.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 --2- 172.21.15.50:0/14222753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed681010e0 0x7fed6810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 --2- 172.21.15.50:0/14222753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68106b10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 --2- 172.21.15.50:0/14222753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed68100720 0x7fed68100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 -- 172.21.15.50:0/14222753 >> 172.21.15.50:0/14222753 conn(0x7fed680fc1b0 msgr2=0x7fed680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:34.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 -- 172.21.15.50:0/14222753 shutdown_connections 2023-10-26T06:43:34.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.483+0000 7fed6dfff700 1 -- 172.21.15.50:0/14222753 wait complete. 2023-10-26T06:43:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.484+0000 7fed6dfff700 1 Processor -- start 2023-10-26T06:43:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.484+0000 7fed6dfff700 1 -- start start 2023-10-26T06:43:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed6dfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed68100720 0x7fed6819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed6dfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed681010e0 0x7fed6819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed6dfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed6dfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed68199340 con 0x7fed68106730 2023-10-26T06:43:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed6dfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed681994b0 con 0x7fed68100720 2023-10-26T06:43:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed6dfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed68199670 con 0x7fed681010e0 2023-10-26T06:43:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33732/0 (socket says 172.21.15.50:33732) 2023-10-26T06:43:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 -- 172.21.15.50:0/2806787236 learned_addr learned my addr 172.21.15.50:0/2806787236 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed677fe700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed68100720 0x7fed6819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed5ffff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed681010e0 0x7fed6819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 -- 172.21.15.50:0/2806787236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed681010e0 msgr2=0x7fed6819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed681010e0 0x7fed6819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 -- 172.21.15.50:0/2806787236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed68100720 msgr2=0x7fed6819ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed68100720 0x7fed6819ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.485+0000 7fed67fff700 1 -- 172.21.15.50:0/2806787236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580095f0 con 0x7fed68106730 2023-10-26T06:43:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.486+0000 7fed67fff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68198b70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fed6000ef30 tx=0x7fed6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.486+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60018070 con 0x7fed68106730 2023-10-26T06:43:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.486+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed6000f040 con 0x7fed68106730 2023-10-26T06:43:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.486+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed681998f0 con 0x7fed68106730 2023-10-26T06:43:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.486+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed681a5a50 con 0x7fed68106730 2023-10-26T06:43:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.486+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6000cd00 con 0x7fed68106730 2023-10-26T06:43:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.487+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed68101e60 con 0x7fed68106730 2023-10-26T06:43:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.489+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fed60003a00 con 0x7fed68106730 2023-10-26T06:43:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.491+0000 7fed657fa700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fed540a14d0 0x7fed540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.491+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fed600cd2d0 con 0x7fed68106730 2023-10-26T06:43:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.491+0000 7fed677fe700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fed540a14d0 0x7fed540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.491+0000 7fed677fe700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fed540a14d0 0x7fed540a3990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed58006010 tx=0x7fed5800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.493+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fed600968f0 con 0x7fed68106730 2023-10-26T06:43:34.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.708+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed68199fe0 con 0x7fed68106730 2023-10-26T06:43:34.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.708+0000 7fed657fa700 1 -- 172.21.15.50:0/2806787236 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed60099f10 con 0x7fed68106730 2023-10-26T06:43:34.710 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:43:34.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fed540a14d0 msgr2=0x7fed540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fed540a14d0 0x7fed540a3990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed58006010 tx=0x7fed5800b260 comp rx=0 tx=0).stop 2023-10-26T06:43:34.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 msgr2=0x7fed68198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68198b70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fed6000ef30 tx=0x7fed6000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 shutdown_connections 2023-10-26T06:43:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fed540a14d0 0x7fed540a3990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed68106730 0x7fed68198b70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed68100720 0x7fed6819ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 --2- 172.21.15.50:0/2806787236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed681010e0 0x7fed6819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.710+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 >> 172.21.15.50:0/2806787236 conn(0x7fed680fc1b0 msgr2=0x7fed6810bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.711+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 shutdown_connections 2023-10-26T06:43:34.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.711+0000 7fed6dfff700 1 -- 172.21.15.50:0/2806787236 wait complete. 2023-10-26T06:43:34.731 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-26T06:43:34.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:43:34.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 -- 172.21.15.50:0/463066223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 msgr2=0x7fa970106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 --2- 172.21.15.50:0/463066223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970106a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa960009990 tx=0x7fa960009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 -- 172.21.15.50:0/463066223 shutdown_connections 2023-10-26T06:43:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 --2- 172.21.15.50:0/463066223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 --2- 172.21.15.50:0/463066223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970106a90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 --2- 172.21.15.50:0/463066223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9701006a0 0x7fa970100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 -- 172.21.15.50:0/463066223 >> 172.21.15.50:0/463066223 conn(0x7fa9700fc170 msgr2=0x7fa9700fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:34.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.936+0000 7fa9753ff700 1 -- 172.21.15.50:0/463066223 shutdown_connections 2023-10-26T06:43:34.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.937+0000 7fa9753ff700 1 -- 172.21.15.50:0/463066223 wait complete. 2023-10-26T06:43:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.937+0000 7fa9753ff700 1 Processor -- start 2023-10-26T06:43:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 -- start start 2023-10-26T06:43:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9701006a0 0x7fa97019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970196f60 con 0x7fa9701066b0 2023-10-26T06:43:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701970d0 con 0x7fa9701006a0 2023-10-26T06:43:34.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa9753ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970197290 con 0x7fa970101060 2023-10-26T06:43:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa96f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa96e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa96e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:46722/0 (socket says 172.21.15.50:46722) 2023-10-26T06:43:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa96e7fc700 1 -- 172.21.15.50:0/201692049 learned_addr learned my addr 172.21.15.50:0/201692049 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.938+0000 7fa96effd700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9701006a0 0x7fa97019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96f7fe700 1 -- 172.21.15.50:0/201692049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 msgr2=0x7fa97019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96f7fe700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96f7fe700 1 -- 172.21.15.50:0/201692049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9701006a0 msgr2=0x7fa97019c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96f7fe700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9701006a0 0x7fa97019c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:34.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96f7fe700 1 -- 172.21.15.50:0/201692049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600095f0 con 0x7fa9701066b0 2023-10-26T06:43:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96e7fc700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa96f7fe700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970196900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa968007f10 tx=0x7fa96800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968004db0 con 0x7fa9701066b0 2023-10-26T06:43:34.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa96800f040 con 0x7fa9701066b0 2023-10-26T06:43:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970197570 con 0x7fa9701066b0 2023-10-26T06:43:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968005990 con 0x7fa9701066b0 2023-10-26T06:43:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.939+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9701a37c0 con 0x7fa9701066b0 2023-10-26T06:43:34.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.940+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa970108ca0 con 0x7fa9701066b0 2023-10-26T06:43:34.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.942+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa96800db20 con 0x7fa9701066b0 2023-10-26T06:43:34.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.944+0000 7fa957fff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9580a1550 0x7fa9580a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:34.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.944+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa9680cc5c0 con 0x7fa9701066b0 2023-10-26T06:43:34.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.944+0000 7fa96effd700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9580a1550 0x7fa9580a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:34.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.945+0000 7fa96effd700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9580a1550 0x7fa9580a3a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa96000b2e0 tx=0x7fa960005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:34.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:34.948+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa96804f100 con 0x7fa9701066b0 2023-10-26T06:43:35.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:34 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3224161821' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:34 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/393662882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:34 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2806787236' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:34 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3224161821' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:34 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/393662882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:34 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2806787236' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.207+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa970101de0 con 0x7fa9701066b0 2023-10-26T06:43:35.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.208+0000 7fa957fff700 1 -- 172.21.15.50:0/201692049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7fa968095b50 con 0x7fa9701066b0 2023-10-26T06:43:35.209 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:35.210 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:43:35.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.210+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9580a1550 msgr2=0x7fa9580a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.210+0000 7fa9753ff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9580a1550 0x7fa9580a3a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa96000b2e0 tx=0x7fa960005fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.210+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 msgr2=0x7fa970196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.210+0000 7fa9753ff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970196900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa968007f10 tx=0x7fa96800d3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 shutdown_connections 2023-10-26T06:43:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9580a1550 0x7fa9580a3a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9701066b0 0x7fa970196900 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9701006a0 0x7fa97019c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 --2- 172.21.15.50:0/201692049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa970101060 0x7fa97019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 >> 172.21.15.50:0/201692049 conn(0x7fa9700fc170 msgr2=0x7fa9700fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 shutdown_connections 2023-10-26T06:43:35.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.211+0000 7fa9753ff700 1 -- 172.21.15.50:0/201692049 wait complete. 2023-10-26T06:43:35.215 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:43:35.231 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-26T06:43:35.232 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-26T06:43:35.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-26T06:43:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:34 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3224161821' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:34 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/393662882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:34 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2806787236' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:35.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 -- 172.21.15.50:0/2722761737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08073540 msgr2=0x7fce0810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/2722761737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08073540 0x7fce0810c9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80098f0 tx=0x7fcdf8009c00 comp rx=0 tx=0).stop 2023-10-26T06:43:35.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 -- 172.21.15.50:0/2722761737 shutdown_connections 2023-10-26T06:43:35.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/2722761737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce0810cee0 0x7fce0810f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/2722761737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08072c20 0x7fce08073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/2722761737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08073540 0x7fce0810c9a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 -- 172.21.15.50:0/2722761737 >> 172.21.15.50:0/2722761737 conn(0x7fce080fc170 msgr2=0x7fce080fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 -- 172.21.15.50:0/2722761737 shutdown_connections 2023-10-26T06:43:35.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.436+0000 7fce0f3ff700 1 -- 172.21.15.50:0/2722761737 wait complete. 2023-10-26T06:43:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.437+0000 7fce0f3ff700 1 Processor -- start 2023-10-26T06:43:35.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.437+0000 7fce0f3ff700 1 -- start start 2023-10-26T06:43:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.437+0000 7fce0f3ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce08072c20 0x7fce08198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.437+0000 7fce0f3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 0x7fce08199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0f3ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce0810cee0 0x7fce0819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0f3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0819dd60 con 0x7fce08073540 2023-10-26T06:43:35.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0f3ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0819ded0 con 0x7fce0810cee0 2023-10-26T06:43:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0f3ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0819e090 con 0x7fce08072c20 2023-10-26T06:43:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 0x7fce08199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 0x7fce08199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33750/0 (socket says 172.21.15.50:33750) 2023-10-26T06:43:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 -- 172.21.15.50:0/455510255 learned_addr learned my addr 172.21.15.50:0/455510255 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:35.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0d19b700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce08072c20 0x7fce08198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0d99c700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce0810cee0 0x7fce0819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 -- 172.21.15.50:0/455510255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce08072c20 msgr2=0x7fce08198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce08072c20 0x7fce08198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 -- 172.21.15.50:0/455510255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce0810cee0 msgr2=0x7fce0819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce0810cee0 0x7fce0819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 -- 172.21.15.50:0/455510255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040095f0 con 0x7fce08073540 2023-10-26T06:43:35.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0d99c700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce0810cee0 0x7fce0819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:43:35.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.438+0000 7fce0c99a700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 0x7fce08199380 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800fa00 tx=0x7fcdf800fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:35.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.439+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf801c070 con 0x7fce08073540 2023-10-26T06:43:35.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.439+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdf800bb20 con 0x7fce08073540 2023-10-26T06:43:35.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.439+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf8009520 con 0x7fce08073540 2023-10-26T06:43:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.439+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8004930 con 0x7fce08073540 2023-10-26T06:43:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.439+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce081a59d0 con 0x7fce08073540 2023-10-26T06:43:35.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.440+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce081080f0 con 0x7fce08073540 2023-10-26T06:43:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.442+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fcdf8020070 con 0x7fce08073540 2023-10-26T06:43:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.444+0000 7fcdfe7fc700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdf40a14d0 0x7fcdf40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.444+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcdf80cda50 con 0x7fce08073540 2023-10-26T06:43:35.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.444+0000 7fce0d19b700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdf40a14d0 0x7fcdf40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.445+0000 7fce0d19b700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdf40a14d0 0x7fcdf40a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fce04005fd0 tx=0x7fce04009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:35.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.448+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcdf8097070 con 0x7fce08073540 2023-10-26T06:43:35.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.659+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce0819a140 con 0x7fcdf40a14d0 2023-10-26T06:43:35.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.671+0000 7fcdfe7fc700 1 -- 172.21.15.50:0/455510255 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344779 (secure 0 0 0) 0x7fce0819a140 con 0x7fcdf40a14d0 2023-10-26T06:43:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:35.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdf40a14d0 msgr2=0x7fcdf40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdf40a14d0 0x7fcdf40a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fce04005fd0 tx=0x7fce04009310 comp rx=0 tx=0).stop 2023-10-26T06:43:35.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 msgr2=0x7fce08199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 0x7fce08199380 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800fa00 tx=0x7fcdf800fa30 comp rx=0 tx=0).stop 2023-10-26T06:43:35.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 shutdown_connections 2023-10-26T06:43:35.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcdf40a14d0 0x7fcdf40a3990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce0810cee0 0x7fce0819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce08072c20 0x7fce08198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 --2- 172.21.15.50:0/455510255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce08073540 0x7fce08199380 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.675+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 >> 172.21.15.50:0/455510255 conn(0x7fce080fc170 msgr2=0x7fce080fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:35.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.676+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 shutdown_connections 2023-10-26T06:43:35.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.676+0000 7fce0f3ff700 1 -- 172.21.15.50:0/455510255 wait complete. 2023-10-26T06:43:35.683 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:43:35.696 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2023-10-26T06:43:35.654278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654796,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":865,"num_read_kb":550,"num_write":343,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":780,"ondisk_log_size":780,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337348,"kb_used_data":13156,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604476,"statfs":{"total":1151940427776,"available":1151594983424,"internally_reserved":0,"allocated":13471744,"data_stored":7506538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002833"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681407+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:42:59.681407+0000","last_peered":"2023-10-26T06:42:59.681407+0000","last_clean":"2023-10-26T06:42:59.681407+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:42:59.681407+0000","last_undegraded":"2023-10-26T06:42:59.681407+0000","last_fullsized":"2023-10-26T06:42:59.681407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679637+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:42:59.679637+0000","last_peered":"2023-10-26T06:42:59.679637+0000","last_clean":"2023-10-26T06:42:59.679637+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:42:59.679637+0000","last_undegraded":"2023-10-26T06:42:59.679637+0000","last_fullsized":"2023-10-26T06:42:59.679637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683490+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:42:59.683490+0000","last_peered":"2023-10-26T06:42:59.683490+0000","last_clean":"2023-10-26T06:42:59.683490+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:42:59.683490+0000","last_undegraded":"2023-10-26T06:42:59.683490+0000","last_fullsized":"2023-10-26T06:42:59.683490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670012+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:42:59.670012+0000","last_peered":"2023-10-26T06:42:59.670012+0000","last_clean":"2023-10-26T06:42:59.670012+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:42:59.670012+0000","last_undegraded":"2023-10-26T06:42:59.670012+0000","last_fullsized":"2023-10-26T06:42:59.670012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.665576+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:42:59.665576+0000","last_peered":"2023-10-26T06:42:59.665576+0000","last_clean":"2023-10-26T06:42:59.665576+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:42:59.665576+0000","last_undegraded":"2023-10-26T06:42:59.665576+0000","last_fullsized":"2023-10-26T06:42:59.665576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675234+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:42:59.675234+0000","last_peered":"2023-10-26T06:42:59.675234+0000","last_clean":"2023-10-26T06:42:59.675234+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:42:59.675234+0000","last_undegraded":"2023-10-26T06:42:59.675234+0000","last_fullsized":"2023-10-26T06:42:59.675234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674781+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:42:59.674781+0000","last_peered":"2023-10-26T06:42:59.674781+0000","last_clean":"2023-10-26T06:42:59.674781+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:42:59.674781+0000","last_undegraded":"2023-10-26T06:42:59.674781+0000","last_fullsized":"2023-10-26T06:42:59.674781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675444+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:42:59.675444+0000","last_peered":"2023-10-26T06:42:59.675444+0000","last_clean":"2023-10-26T06:42:59.675444+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:42:59.675444+0000","last_undegraded":"2023-10-26T06:42:59.675444+0000","last_fullsized":"2023-10-26T06:42:59.675444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677812+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:42:59.677812+0000","last_peered":"2023-10-26T06:42:59.677812+0000","last_clean":"2023-10-26T06:42:59.677812+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:42:59.677812+0000","last_undegraded":"2023-10-26T06:42:59.677812+0000","last_fullsized":"2023-10-26T06:42:59.677812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676371+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:42:59.676371+0000","last_peered":"2023-10-26T06:42:59.676371+0000","last_clean":"2023-10-26T06:42:59.676371+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:42:59.676371+0000","last_undegraded":"2023-10-26T06:42:59.676371+0000","last_fullsized":"2023-10-26T06:42:59.676371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683292+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:42:59.683292+0000","last_peered":"2023-10-26T06:42:59.683292+0000","last_clean":"2023-10-26T06:42:59.683292+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:42:59.683292+0000","last_undegraded":"2023-10-26T06:42:59.683292+0000","last_fullsized":"2023-10-26T06:42:59.683292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679169+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:42:59.679169+0000","last_peered":"2023-10-26T06:42:59.679169+0000","last_clean":"2023-10-26T06:42:59.679169+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:42:59.679169+0000","last_undegraded":"2023-10-26T06:42:59.679169+0000","last_fullsized":"2023-10-26T06:42:59.679169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674878+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:42:59.674878+0000","last_peered":"2023-10-26T06:42:59.674878+0000","last_clean":"2023-10-26T06:42:59.674878+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:42:59.674878+0000","last_undegraded":"2023-10-26T06:42:59.674878+0000","last_fullsized":"2023-10-26T06:42:59.674878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678209+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:42:59.678209+0000","last_peered":"2023-10-26T06:42:59.678209+0000","last_clean":"2023-10-26T06:42:59.678209+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:42:59.678209+0000","last_undegraded":"2023-10-26T06:42:59.678209+0000","last_fullsized":"2023-10-26T06:42:59.678209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679859+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:42:59.679859+0000","last_peered":"2023-10-26T06:42:59.679859+0000","last_clean":"2023-10-26T06:42:59.679859+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:42:59.679859+0000","last_undegraded":"2023-10-26T06:42:59.679859+0000","last_fullsized":"2023-10-26T06:42:59.679859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681260+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:42:59.681260+0000","last_peered":"2023-10-26T06:42:59.681260+0000","last_clean":"2023-10-26T06:42:59.681260+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:42:59.681260+0000","last_undegraded":"2023-10-26T06:42:59.681260+0000","last_fullsized":"2023-10-26T06:42:59.681260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681584+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:42:59.681584+0000","last_peered":"2023-10-26T06:42:59.681584+0000","last_clean":"2023-10-26T06:42:59.681584+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:42:59.681584+0000","last_undegraded":"2023-10-26T06:42:59.681584+0000","last_fullsized":"2023-10-26T06:42:59.681584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678043+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:42:59.678043+0000","last_peered":"2023-10-26T06:42:59.678043+0000","last_clean":"2023-10-26T06:42:59.678043+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:42:59.678043+0000","last_undegraded":"2023-10-26T06:42:59.678043+0000","last_fullsized":"2023-10-26T06:42:59.678043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674053+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:42:59.674053+0000","last_peered":"2023-10-26T06:42:59.674053+0000","last_clean":"2023-10-26T06:42:59.674053+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:42:59.674053+0000","last_undegraded":"2023-10-26T06:42:59.674053+0000","last_fullsized":"2023-10-26T06:42:59.674053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.701211+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:42:29.701211+0000","last_peered":"2023-10-26T06:42:29.701211+0000","last_clean":"2023-10-26T06:42:29.701211+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:42:29.701211+0000","last_undegraded":"2023-10-26T06:42:29.701211+0000","last_fullsized":"2023-10-26T06:42:29.701211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675424+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:42:59.675424+0000","last_peered":"2023-10-26T06:42:59.675424+0000","last_clean":"2023-10-26T06:42:59.675424+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:42:59.675424+0000","last_undegraded":"2023-10-26T06:42:59.675424+0000","last_fullsized":"2023-10-26T06:42:59.675424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.708496+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:42:30.708496+0000","last_peered":"2023-10-26T06:42:30.708496+0000","last_clean":"2023-10-26T06:42:30.708496+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:42:30.708496+0000","last_undegraded":"2023-10-26T06:42:30.708496+0000","last_fullsized":"2023-10-26T06:42:30.708496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683632+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:42:59.683632+0000","last_peered":"2023-10-26T06:42:59.683632+0000","last_clean":"2023-10-26T06:42:59.683632+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:42:59.683632+0000","last_undegraded":"2023-10-26T06:42:59.683632+0000","last_fullsized":"2023-10-26T06:42:59.683632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704769+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:42:29.704769+0000","last_peered":"2023-10-26T06:42:29.704769+0000","last_clean":"2023-10-26T06:42:29.704769+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:42:29.704769+0000","last_undegraded":"2023-10-26T06:42:29.704769+0000","last_fullsized":"2023-10-26T06:42:29.704769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682510+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:42:59.682510+0000","last_peered":"2023-10-26T06:42:59.682510+0000","last_clean":"2023-10-26T06:42:59.682510+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:42:59.682510+0000","last_undegraded":"2023-10-26T06:42:59.682510+0000","last_fullsized":"2023-10-26T06:42:59.682510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704515+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:42:29.704515+0000","last_peered":"2023-10-26T06:42:29.704515+0000","last_clean":"2023-10-26T06:42:29.704515+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:42:29.704515+0000","last_undegraded":"2023-10-26T06:42:29.704515+0000","last_fullsized":"2023-10-26T06:42:29.704515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680895+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:42:59.680895+0000","last_peered":"2023-10-26T06:42:59.680895+0000","last_clean":"2023-10-26T06:42:59.680895+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:42:59.680895+0000","last_undegraded":"2023-10-26T06:42:59.680895+0000","last_fullsized":"2023-10-26T06:42:59.680895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:30.169890+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:43:30.169890+0000","last_peered":"2023-10-26T06:43:30.169890+0000","last_clean":"2023-10-26T06:43:30.169890+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:43:30.169890+0000","last_undegraded":"2023-10-26T06:43:30.169890+0000","last_fullsized":"2023-10-26T06:43:30.169890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":938,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.666937+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:42:59.666937+0000","last_peered":"2023-10-26T06:42:59.666937+0000","last_clean":"2023-10-26T06:42:59.666937+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:42:59.666937+0000","last_undegraded":"2023-10-26T06:42:59.666937+0000","last_fullsized":"2023-10-26T06:42:59.666937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698424+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:42:29.698424+0000","last_peered":"2023-10-26T06:42:29.698424+0000","last_clean":"2023-10-26T06:42:29.698424+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:42:29.698424+0000","last_undegraded":"2023-10-26T06:42:29.698424+0000","last_fullsized":"2023-10-26T06:42:29.698424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679061+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:42:59.679061+0000","last_peered":"2023-10-26T06:42:59.679061+0000","last_clean":"2023-10-26T06:42:59.679061+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:42:59.679061+0000","last_undegraded":"2023-10-26T06:42:59.679061+0000","last_fullsized":"2023-10-26T06:42:59.679061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706715+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:42:29.706715+0000","last_peered":"2023-10-26T06:42:29.706715+0000","last_clean":"2023-10-26T06:42:29.706715+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:42:29.706715+0000","last_undegraded":"2023-10-26T06:42:29.706715+0000","last_fullsized":"2023-10-26T06:42:29.706715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670469+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:42:59.670469+0000","last_peered":"2023-10-26T06:42:59.670469+0000","last_clean":"2023-10-26T06:42:59.670469+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:42:59.670469+0000","last_undegraded":"2023-10-26T06:42:59.670469+0000","last_fullsized":"2023-10-26T06:42:59.670469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699672+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:42:29.699672+0000","last_peered":"2023-10-26T06:42:29.699672+0000","last_clean":"2023-10-26T06:42:29.699672+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:42:29.699672+0000","last_undegraded":"2023-10-26T06:42:29.699672+0000","last_fullsized":"2023-10-26T06:42:29.699672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670726+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:42:59.670726+0000","last_peered":"2023-10-26T06:42:59.670726+0000","last_clean":"2023-10-26T06:42:59.670726+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:42:59.670726+0000","last_undegraded":"2023-10-26T06:42:59.670726+0000","last_fullsized":"2023-10-26T06:42:59.670726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":136,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:31.170757+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:43:31.170757+0000","last_peered":"2023-10-26T06:43:31.170757+0000","last_clean":"2023-10-26T06:43:31.170757+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:43:31.170757+0000","last_undegraded":"2023-10-26T06:43:31.170757+0000","last_fullsized":"2023-10-26T06:43:31.170757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680606+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:42:59.680606+0000","last_peered":"2023-10-26T06:42:59.680606+0000","last_clean":"2023-10-26T06:42:59.680606+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:42:59.680606+0000","last_undegraded":"2023-10-26T06:42:59.680606+0000","last_fullsized":"2023-10-26T06:42:59.680606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947188+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:42:29.947188+0000","last_peered":"2023-10-26T06:42:29.947188+0000","last_clean":"2023-10-26T06:42:29.947188+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:42:29.947188+0000","last_undegraded":"2023-10-26T06:42:29.947188+0000","last_fullsized":"2023-10-26T06:42:29.947188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681798+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:42:59.681798+0000","last_peered":"2023-10-26T06:42:59.681798+0000","last_clean":"2023-10-26T06:42:59.681798+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:42:59.681798+0000","last_undegraded":"2023-10-26T06:42:59.681798+0000","last_fullsized":"2023-10-26T06:42:59.681798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699839+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:42:29.699839+0000","last_peered":"2023-10-26T06:42:29.699839+0000","last_clean":"2023-10-26T06:42:29.699839+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:42:29.699839+0000","last_undegraded":"2023-10-26T06:42:29.699839+0000","last_fullsized":"2023-10-26T06:42:29.699839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.684240+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:42:59.684240+0000","last_peered":"2023-10-26T06:42:59.684240+0000","last_clean":"2023-10-26T06:42:59.684240+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:42:59.684240+0000","last_undegraded":"2023-10-26T06:42:59.684240+0000","last_fullsized":"2023-10-26T06:42:59.684240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":291,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:32.172697+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:43:32.172697+0000","last_peered":"2023-10-26T06:43:32.172697+0000","last_clean":"2023-10-26T06:43:32.172697+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:43:32.172697+0000","last_undegraded":"2023-10-26T06:43:32.172697+0000","last_fullsized":"2023-10-26T06:43:32.172697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59725,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":244,"num_read_kb":180,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.659585+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:42:59.659585+0000","last_peered":"2023-10-26T06:42:59.659585+0000","last_clean":"2023-10-26T06:42:59.659585+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:42:59.659585+0000","last_undegraded":"2023-10-26T06:42:59.659585+0000","last_fullsized":"2023-10-26T06:42:59.659585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705196+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:42:29.705196+0000","last_peered":"2023-10-26T06:42:29.705196+0000","last_clean":"2023-10-26T06:42:29.705196+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:42:29.705196+0000","last_undegraded":"2023-10-26T06:42:29.705196+0000","last_fullsized":"2023-10-26T06:42:29.705196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675892+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:42:59.675892+0000","last_peered":"2023-10-26T06:42:59.675892+0000","last_clean":"2023-10-26T06:42:59.675892+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:42:59.675892+0000","last_undegraded":"2023-10-26T06:42:59.675892+0000","last_fullsized":"2023-10-26T06:42:59.675892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699304+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:42:29.699304+0000","last_peered":"2023-10-26T06:42:29.699304+0000","last_clean":"2023-10-26T06:42:29.699304+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:42:29.699304+0000","last_undegraded":"2023-10-26T06:42:29.699304+0000","last_fullsized":"2023-10-26T06:42:29.699304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676366+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:42:59.676366+0000","last_peered":"2023-10-26T06:42:59.676366+0000","last_clean":"2023-10-26T06:42:59.676366+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:42:59.676366+0000","last_undegraded":"2023-10-26T06:42:59.676366+0000","last_fullsized":"2023-10-26T06:42:59.676366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":143,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:33.182703+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:43:33.182703+0000","last_peered":"2023-10-26T06:43:33.182703+0000","last_clean":"2023-10-26T06:43:33.182703+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:43:33.182703+0000","last_undegraded":"2023-10-26T06:43:33.182703+0000","last_fullsized":"2023-10-26T06:43:33.182703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674567+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:42:59.674567+0000","last_peered":"2023-10-26T06:42:59.674567+0000","last_clean":"2023-10-26T06:42:59.674567+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:42:59.674567+0000","last_undegraded":"2023-10-26T06:42:59.674567+0000","last_fullsized":"2023-10-26T06:42:59.674567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703869+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:42:29.703869+0000","last_peered":"2023-10-26T06:42:29.703869+0000","last_clean":"2023-10-26T06:42:29.703869+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:42:29.703869+0000","last_undegraded":"2023-10-26T06:42:29.703869+0000","last_fullsized":"2023-10-26T06:42:29.703869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680375+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:42:59.680375+0000","last_peered":"2023-10-26T06:42:59.680375+0000","last_clean":"2023-10-26T06:42:59.680375+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:42:59.680375+0000","last_undegraded":"2023-10-26T06:42:59.680375+0000","last_fullsized":"2023-10-26T06:42:59.680375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.714855+0000","last_change":"2023-10-26T06:42:30.714354+0000","last_active":"2023-10-26T06:42:30.714855+0000","last_peered":"2023-10-26T06:42:30.714855+0000","last_clean":"2023-10-26T06:42:30.714855+0000","last_became_active":"2023-10-26T06:42:30.709396+0000","last_became_peered":"2023-10-26T06:42:30.709396+0000","last_unstale":"2023-10-26T06:42:30.714855+0000","last_undegraded":"2023-10-26T06:42:30.714855+0000","last_fullsized":"2023-10-26T06:42:30.714855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:04:20.594879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679151+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:42:59.679151+0000","last_peered":"2023-10-26T06:42:59.679151+0000","last_clean":"2023-10-26T06:42:59.679151+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:42:59.679151+0000","last_undegraded":"2023-10-26T06:42:59.679151+0000","last_fullsized":"2023-10-26T06:42:59.679151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700656+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:42:29.700656+0000","last_peered":"2023-10-26T06:42:29.700656+0000","last_clean":"2023-10-26T06:42:29.700656+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:42:29.700656+0000","last_undegraded":"2023-10-26T06:42:29.700656+0000","last_fullsized":"2023-10-26T06:42:29.700656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677816+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:42:59.677816+0000","last_peered":"2023-10-26T06:42:59.677816+0000","last_clean":"2023-10-26T06:42:59.677816+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:42:59.677816+0000","last_undegraded":"2023-10-26T06:42:59.677816+0000","last_fullsized":"2023-10-26T06:42:59.677816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946991+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:42:29.946991+0000","last_peered":"2023-10-26T06:42:29.946991+0000","last_clean":"2023-10-26T06:42:29.946991+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:42:29.946991+0000","last_undegraded":"2023-10-26T06:42:29.946991+0000","last_fullsized":"2023-10-26T06:42:29.946991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676992+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:42:59.676992+0000","last_peered":"2023-10-26T06:42:59.676992+0000","last_clean":"2023-10-26T06:42:59.676992+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:42:59.676992+0000","last_undegraded":"2023-10-26T06:42:59.676992+0000","last_fullsized":"2023-10-26T06:42:59.676992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679172+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:42:59.679172+0000","last_peered":"2023-10-26T06:42:59.679172+0000","last_clean":"2023-10-26T06:42:59.679172+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:42:59.679172+0000","last_undegraded":"2023-10-26T06:42:59.679172+0000","last_fullsized":"2023-10-26T06:42:59.679172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":135,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:29.175762+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:43:29.175762+0000","last_peered":"2023-10-26T06:43:29.175762+0000","last_clean":"2023-10-26T06:43:29.175762+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:43:29.175762+0000","last_undegraded":"2023-10-26T06:43:29.175762+0000","last_fullsized":"2023-10-26T06:43:29.175762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680667+0000","last_change":"2023-10-26T06:42:30.709009+0000","last_active":"2023-10-26T06:42:59.680667+0000","last_peered":"2023-10-26T06:42:59.680667+0000","last_clean":"2023-10-26T06:42:59.680667+0000","last_became_active":"2023-10-26T06:42:30.708638+0000","last_became_peered":"2023-10-26T06:42:30.708638+0000","last_unstale":"2023-10-26T06:42:59.680667+0000","last_undegraded":"2023-10-26T06:42:59.680667+0000","last_fullsized":"2023-10-26T06:42:59.680667+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:53:48.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.706370+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:42:30.706370+0000","last_peered":"2023-10-26T06:42:30.706370+0000","last_clean":"2023-10-26T06:42:30.706370+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:42:30.706370+0000","last_undegraded":"2023-10-26T06:42:30.706370+0000","last_fullsized":"2023-10-26T06:42:30.706370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.179608+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:42:31.179608+0000","last_peered":"2023-10-26T06:42:31.179608+0000","last_clean":"2023-10-26T06:42:31.179608+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:42:31.179608+0000","last_undegraded":"2023-10-26T06:42:31.179608+0000","last_fullsized":"2023-10-26T06:42:31.179608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.664946+0000","last_change":"2023-10-26T06:42:30.706066+0000","last_active":"2023-10-26T06:42:59.664946+0000","last_peered":"2023-10-26T06:42:59.664946+0000","last_clean":"2023-10-26T06:42:59.664946+0000","last_became_active":"2023-10-26T06:42:30.705682+0000","last_became_peered":"2023-10-26T06:42:30.705682+0000","last_unstale":"2023-10-26T06:42:59.664946+0000","last_undegraded":"2023-10-26T06:42:59.664946+0000","last_fullsized":"2023-10-26T06:42:59.664946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:40:13.366566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.179688+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:42:31.179688+0000","last_peered":"2023-10-26T06:42:31.179688+0000","last_clean":"2023-10-26T06:42:31.179688+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:42:31.179688+0000","last_undegraded":"2023-10-26T06:42:31.179688+0000","last_fullsized":"2023-10-26T06:42:31.179688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704685+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:42:29.704685+0000","last_peered":"2023-10-26T06:42:29.704685+0000","last_clean":"2023-10-26T06:42:29.704685+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:42:29.704685+0000","last_undegraded":"2023-10-26T06:42:29.704685+0000","last_fullsized":"2023-10-26T06:42:29.704685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670286+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:42:59.670286+0000","last_peered":"2023-10-26T06:42:59.670286+0000","last_clean":"2023-10-26T06:42:59.670286+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:42:59.670286+0000","last_undegraded":"2023-10-26T06:42:59.670286+0000","last_fullsized":"2023-10-26T06:42:59.670286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.702331+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:42:30.702331+0000","last_peered":"2023-10-26T06:42:30.702331+0000","last_clean":"2023-10-26T06:42:30.702331+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:42:30.702331+0000","last_undegraded":"2023-10-26T06:42:30.702331+0000","last_fullsized":"2023-10-26T06:42:30.702331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.671656+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:42:59.671656+0000","last_peered":"2023-10-26T06:42:59.671656+0000","last_clean":"2023-10-26T06:42:59.671656+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:42:59.671656+0000","last_undegraded":"2023-10-26T06:42:59.671656+0000","last_fullsized":"2023-10-26T06:42:59.671656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704776+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:42:29.704776+0000","last_peered":"2023-10-26T06:42:29.704776+0000","last_clean":"2023-10-26T06:42:29.704776+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:42:29.704776+0000","last_undegraded":"2023-10-26T06:42:29.704776+0000","last_fullsized":"2023-10-26T06:42:29.704776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681857+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:42:59.681857+0000","last_peered":"2023-10-26T06:42:59.681857+0000","last_clean":"2023-10-26T06:42:59.681857+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:42:59.681857+0000","last_undegraded":"2023-10-26T06:42:59.681857+0000","last_fullsized":"2023-10-26T06:42:59.681857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703873+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:42:29.703873+0000","last_peered":"2023-10-26T06:42:29.703873+0000","last_clean":"2023-10-26T06:42:29.703873+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:42:29.703873+0000","last_undegraded":"2023-10-26T06:42:29.703873+0000","last_fullsized":"2023-10-26T06:42:29.703873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.654116+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:42:59.654116+0000","last_peered":"2023-10-26T06:42:59.654116+0000","last_clean":"2023-10-26T06:42:59.654116+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:42:59.654116+0000","last_undegraded":"2023-10-26T06:42:59.654116+0000","last_fullsized":"2023-10-26T06:42:59.654116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698478+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:42:29.698478+0000","last_peered":"2023-10-26T06:42:29.698478+0000","last_clean":"2023-10-26T06:42:29.698478+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:42:29.698478+0000","last_undegraded":"2023-10-26T06:42:29.698478+0000","last_fullsized":"2023-10-26T06:42:29.698478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.673792+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:42:59.673792+0000","last_peered":"2023-10-26T06:42:59.673792+0000","last_clean":"2023-10-26T06:42:59.673792+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:42:59.673792+0000","last_undegraded":"2023-10-26T06:42:59.673792+0000","last_fullsized":"2023-10-26T06:42:59.673792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.717232+0000","last_change":"2023-10-26T06:42:30.716756+0000","last_active":"2023-10-26T06:42:30.717232+0000","last_peered":"2023-10-26T06:42:30.717232+0000","last_clean":"2023-10-26T06:42:30.717232+0000","last_became_active":"2023-10-26T06:42:30.709797+0000","last_became_peered":"2023-10-26T06:42:30.709797+0000","last_unstale":"2023-10-26T06:42:30.717232+0000","last_undegraded":"2023-10-26T06:42:30.717232+0000","last_fullsized":"2023-10-26T06:42:30.717232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:54.345261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683233+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:42:59.683233+0000","last_peered":"2023-10-26T06:42:59.683233+0000","last_clean":"2023-10-26T06:42:59.683233+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:42:59.683233+0000","last_undegraded":"2023-10-26T06:42:59.683233+0000","last_fullsized":"2023-10-26T06:42:59.683233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704002+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:42:29.704002+0000","last_peered":"2023-10-26T06:42:29.704002+0000","last_clean":"2023-10-26T06:42:29.704002+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:42:29.704002+0000","last_undegraded":"2023-10-26T06:42:29.704002+0000","last_fullsized":"2023-10-26T06:42:29.704002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683749+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:42:59.683749+0000","last_peered":"2023-10-26T06:42:59.683749+0000","last_clean":"2023-10-26T06:42:59.683749+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:42:59.683749+0000","last_undegraded":"2023-10-26T06:42:59.683749+0000","last_fullsized":"2023-10-26T06:42:59.683749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705370+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:42:29.705370+0000","last_peered":"2023-10-26T06:42:29.705370+0000","last_clean":"2023-10-26T06:42:29.705370+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:42:29.705370+0000","last_undegraded":"2023-10-26T06:42:29.705370+0000","last_fullsized":"2023-10-26T06:42:29.705370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683429+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:42:59.683429+0000","last_peered":"2023-10-26T06:42:59.683429+0000","last_clean":"2023-10-26T06:42:59.683429+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:42:59.683429+0000","last_undegraded":"2023-10-26T06:42:59.683429+0000","last_fullsized":"2023-10-26T06:42:59.683429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699564+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:42:29.699564+0000","last_peered":"2023-10-26T06:42:29.699564+0000","last_clean":"2023-10-26T06:42:29.699564+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:42:29.699564+0000","last_undegraded":"2023-10-26T06:42:29.699564+0000","last_fullsized":"2023-10-26T06:42:29.699564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679441+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:42:59.679441+0000","last_peered":"2023-10-26T06:42:59.679441+0000","last_clean":"2023-10-26T06:42:59.679441+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:42:59.679441+0000","last_undegraded":"2023-10-26T06:42:59.679441+0000","last_fullsized":"2023-10-26T06:42:59.679441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706318+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:42:29.706318+0000","last_peered":"2023-10-26T06:42:29.706318+0000","last_clean":"2023-10-26T06:42:29.706318+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:42:29.706318+0000","last_undegraded":"2023-10-26T06:42:29.706318+0000","last_fullsized":"2023-10-26T06:42:29.706318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.671147+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:42:59.671147+0000","last_peered":"2023-10-26T06:42:59.671147+0000","last_clean":"2023-10-26T06:42:59.671147+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:42:59.671147+0000","last_undegraded":"2023-10-26T06:42:59.671147+0000","last_fullsized":"2023-10-26T06:42:59.671147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.669446+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:42:59.669446+0000","last_peered":"2023-10-26T06:42:59.669446+0000","last_clean":"2023-10-26T06:42:59.669446+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:42:59.669446+0000","last_undegraded":"2023-10-26T06:42:59.669446+0000","last_fullsized":"2023-10-26T06:42:59.669446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678407+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:42:59.678407+0000","last_peered":"2023-10-26T06:42:59.678407+0000","last_clean":"2023-10-26T06:42:59.678407+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:42:59.678407+0000","last_undegraded":"2023-10-26T06:42:59.678407+0000","last_fullsized":"2023-10-26T06:42:59.678407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677343+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:42:59.677343+0000","last_peered":"2023-10-26T06:42:59.677343+0000","last_clean":"2023-10-26T06:42:59.677343+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:42:59.677343+0000","last_undegraded":"2023-10-26T06:42:59.677343+0000","last_fullsized":"2023-10-26T06:42:59.677343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682413+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:42:59.682413+0000","last_peered":"2023-10-26T06:42:59.682413+0000","last_clean":"2023-10-26T06:42:59.682413+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:42:59.682413+0000","last_undegraded":"2023-10-26T06:42:59.682413+0000","last_fullsized":"2023-10-26T06:42:59.682413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680960+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:42:59.680960+0000","last_peered":"2023-10-26T06:42:59.680960+0000","last_clean":"2023-10-26T06:42:59.680960+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:42:59.680960+0000","last_undegraded":"2023-10-26T06:42:59.680960+0000","last_fullsized":"2023-10-26T06:42:59.680960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.668540+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:42:59.668540+0000","last_peered":"2023-10-26T06:42:59.668540+0000","last_clean":"2023-10-26T06:42:59.668540+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:42:59.668540+0000","last_undegraded":"2023-10-26T06:42:59.668540+0000","last_fullsized":"2023-10-26T06:42:59.668540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680578+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:42:59.680578+0000","last_peered":"2023-10-26T06:42:59.680578+0000","last_clean":"2023-10-26T06:42:59.680578+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:42:59.680578+0000","last_undegraded":"2023-10-26T06:42:59.680578+0000","last_fullsized":"2023-10-26T06:42:59.680578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.666939+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:42:59.666939+0000","last_peered":"2023-10-26T06:42:59.666939+0000","last_clean":"2023-10-26T06:42:59.666939+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:42:59.666939+0000","last_undegraded":"2023-10-26T06:42:59.666939+0000","last_fullsized":"2023-10-26T06:42:59.666939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674902+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:42:59.674902+0000","last_peered":"2023-10-26T06:42:59.674902+0000","last_clean":"2023-10-26T06:42:59.674902+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:42:59.674902+0000","last_undegraded":"2023-10-26T06:42:59.674902+0000","last_fullsized":"2023-10-26T06:42:59.674902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677285+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:42:59.677285+0000","last_peered":"2023-10-26T06:42:59.677285+0000","last_clean":"2023-10-26T06:42:59.677285+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:42:59.677285+0000","last_undegraded":"2023-10-26T06:42:59.677285+0000","last_fullsized":"2023-10-26T06:42:59.677285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683019+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:42:59.683019+0000","last_peered":"2023-10-26T06:42:59.683019+0000","last_clean":"2023-10-26T06:42:59.683019+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:42:59.683019+0000","last_undegraded":"2023-10-26T06:42:59.683019+0000","last_fullsized":"2023-10-26T06:42:59.683019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682770+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:42:59.682770+0000","last_peered":"2023-10-26T06:42:59.682770+0000","last_clean":"2023-10-26T06:42:59.682770+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:42:59.682770+0000","last_undegraded":"2023-10-26T06:42:59.682770+0000","last_fullsized":"2023-10-26T06:42:59.682770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.667579+0000","last_change":"2023-10-26T06:42:30.708612+0000","last_active":"2023-10-26T06:42:59.667579+0000","last_peered":"2023-10-26T06:42:59.667579+0000","last_clean":"2023-10-26T06:42:59.667579+0000","last_became_active":"2023-10-26T06:42:30.707927+0000","last_became_peered":"2023-10-26T06:42:30.707927+0000","last_unstale":"2023-10-26T06:42:59.667579+0000","last_undegraded":"2023-10-26T06:42:59.667579+0000","last_fullsized":"2023-10-26T06:42:59.667579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:59:10.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64182,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":729,"num_read_kb":431,"num_write":160,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":197925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416422,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437}]},{"osd":1,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79200000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.874,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.878}]},{"osd":7,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94599999999999995,"5min":0.998,"15min":0.998},"last":0.89500000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.877}]},{"osd":9,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.95799999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81499999999999995,"15min":0.81599999999999995},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":0.96799999999999997,"5min":1.079,"15min":1.079},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.026,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.86099999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1113974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61199999999999999,"15min":0.59699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.63400000000000001,"15min":0.66600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.872,"15min":0.872},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.89200000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82499999999999996,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"min":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.745}]},{"osd":11,"last update":"Thu Oct 26 06:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98499999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.879}]}]},{"osd":9,"up_from":67,"seq":287762808877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86599999999999999,"5min":2.016,"15min":2.016},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":7.2320000000000002,"5min":7.2320000000000002,"15min":7.2320000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.83799999999999997,"15min":0.86199999999999999},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":1.859,"15min":1.859},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.53200000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.752}]},{"osd":3,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.65900000000000003,"15min":0.69299999999999995},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.048,"5min":1.605,"15min":1.605},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5289999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78400000000000003,"15min":0.82799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.74399999999999999,"5min":1.331,"15min":1.331},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2030000000000001,"5min":1.776,"15min":1.776},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.91800000000000004,"15min":0.95599999999999996},"min":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.05,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.83999999999999997,"15min":0.88200000000000001},"min":{"1min":0.57099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.92600000000000005,"15min":0.97399999999999998},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5640000000000001,"5min":1.901,"15min":1.901},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.873,"15min":0.94099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3560000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.89100000000000001,"15min":0.93400000000000005},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2430000000000001,"5min":1.835,"15min":1.835},"last":0.629},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.998,"15min":1.0329999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.494,"5min":2.093,"15min":2.093},"last":0.64800000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.0269999999999999,"15min":1.0669999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.419,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.034,"15min":1.02},"min":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":0.876}]},{"osd":10,"last update":"Thu Oct 26 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.458,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.141,"15min":1.2709999999999999},"min":{"1min":0.60099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3220000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.89900000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":462696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81799999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.56899999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.42099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.38,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.749}]},{"osd":3,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.73799999999999999,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0109999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63600000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84999999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.65400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.48599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.95099999999999996,"5min":1.766,"15min":1.766},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.68500000000000005},"min":{"1min":0.64700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0389999999999999,"5min":1.087,"15min":1.087},"last":1.028},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":0.93400000000000005},"min":{"1min":0.60699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.101,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.63700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.405,"15min":1.405},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80200000000000005,"15min":0.78200000000000003},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.78100000000000003,"15min":0.755},"min":{"1min":0.68799999999999994,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98699999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.70799999999999996},"min":{"1min":0.61599999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.002,"5min":1.45,"15min":1.45},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58299999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.075,"15min":1.075},"last":0.94499999999999995}]},{"osd":11,"last update":"Thu Oct 26 06:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.877}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1055110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.434,"15min":0.40699999999999997},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58199999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.81999999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.374,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.47999999999999998},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.36699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.625,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.752}]},{"osd":6,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.995,"15min":0.995},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.61099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.996,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.68600000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.65000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":1.204,"15min":1.204},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Oct 26 06:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.91900000000000004,"5min":0.998,"15min":0.998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.66600000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92800000000000005,"5min":1.002,"15min":1.002},"last":0.80100000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.77600000000000002,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":6.9100000000000001,"5min":6.9100000000000001,"15min":6.9100000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.73999999999999999,"15min":0.68300000000000005},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66600000000000004,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.78400000000000003,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.78800000000000003,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":3.3900000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.76500000000000001},"min":{"1min":0.56200000000000006,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.65300000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0449999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98099999999999998,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.81200000000000006}]},{"osd":8,"last update":"Thu Oct 26 06:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.876,"15min":0.85099999999999998},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.88300000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.65300000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.151,"5min":1.792,"15min":1.792},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86799999999999999,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.24,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.94299999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.94999999999999996,"15min":0.91800000000000004},"min":{"1min":0.68100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0329999999999999,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.028,"15min":0.998},"min":{"1min":0.78600000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.0760000000000001,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.86099999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":521705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53900000000000003,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.52500000000000002},"min":{"1min":0.49099999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.89300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.433},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.46100000000000002},"min":{"1min":0.374,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.55800000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.63700000000000001},"min":{"1min":0.59699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Oct 26 06:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.56799999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69099999999999995,"15min":0.66200000000000003},"min":{"1min":0.57099999999999995,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66900000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.64800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Oct 26 06:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89700000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.747},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79500000000000004,"15min":0.79400000000000004},"min":{"1min":0.66500000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96799999999999997,"5min":1.085,"15min":1.085},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.76100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":463458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":0.79200000000000004,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.34599999999999997,"15min":0.34399999999999997},"max":{"1min":17.193000000000001,"5min":17.193000000000001,"15min":17.193000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.6539999999999999,"5min":0.872,"15min":0.65200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":20.82,"5min":20.82,"15min":20.82},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":0.95899999999999996,"15min":0.70099999999999996},"min":{"1min":0.56399999999999995,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":22.111999999999998,"5min":22.111999999999998,"15min":22.111999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.8260000000000001,"5min":0.96799999999999997,"15min":0.72199999999999998},"min":{"1min":0.53000000000000003,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":22.158000000000001,"5min":22.158000000000001,"15min":22.158000000000001},"last":0.88}]},{"osd":3,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":0.89200000000000002,"15min":0.69599999999999995},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":22.945,"5min":22.945,"15min":22.945},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.722,"5min":0.93600000000000005,"15min":0.71799999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":20.875,"5min":20.875,"15min":20.875},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.5269999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.79200000000000004,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Oct 26 06:43:03 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":0.93300000000000005,"15min":0.76200000000000001},"min":{"1min":0.55500000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":20.550999999999998,"5min":20.550999999999998,"15min":20.550999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.85399999999999998,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92100000000000004,"15min":0.93000000000000005},"min":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.599,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92700000000000005,"15min":0.93600000000000005},"min":{"1min":0.63600000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.63900000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:43:03 2023","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":1.141,"15min":1.0429999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":20.364000000000001,"5min":20.364000000000001,"15min":20.364000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.972,"5min":1.1679999999999999,"15min":1.052},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":22.722999999999999,"5min":22.722999999999999,"15min":22.722999999999999},"last":0.91400000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:43:24 2023","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":1.2,"15min":1.0800000000000001},"min":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.1719999999999999,"15min":1.054},"min":{"1min":0.66400000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":20.780000000000001,"5min":20.780000000000001,"15min":20.780000000000001},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.97799999999999998,"15min":0.98599999999999999},"min":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.411,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82599999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":522739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81599999999999995,"5min":2.3119999999999998,"15min":2.371},"last":0.498}]},{"osd":1,"last update":"Thu Oct 26 06:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.83699999999999997,"5min":1.21,"15min":1.21},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.622}]},{"osd":3,"last update":"Thu Oct 26 06:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.85199999999999998,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.044,"15min":1.044},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.56599999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.61399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91700000000000004,"5min":1.093,"15min":1.093},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79600000000000004,"15min":0.79300000000000004},"min":{"1min":0.69899999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.024,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.81599999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76600000000000001,"15min":0.73299999999999998},"min":{"1min":0.64400000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.72899999999999998},"min":{"1min":0.65100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":462510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48599999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.38},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.44500000000000001},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74399999999999999,"5min":1.097,"15min":1.097},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70899999999999996,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.048,"15min":1.048},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.65100000000000002},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.745,"15min":0.66400000000000003},"min":{"1min":0.55400000000000005,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95699999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93799999999999994,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.746}]},{"osd":5,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.69699999999999995},"min":{"1min":0.61499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93899999999999995,"5min":1.196,"15min":1.196},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.66900000000000004},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.1830000000000001,"5min":1.258,"15min":1.258},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.79000000000000004},"min":{"1min":0.61699999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1020000000000001,"5min":1.361,"15min":1.361},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76500000000000001,"15min":0.70999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83799999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.0009999999999999,"15min":1.0469999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.419,"15min":1.419},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.89800000000000002,"15min":0.93799999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.278,"5min":1.292,"15min":1.292},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.018,"15min":1.075},"min":{"1min":0.73599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.69099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.431,"15min":1.431},"last":0.85799999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.877}]}]},{"osd":4,"up_from":34,"seq":146028888134,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":463155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.36699999999999999},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42599999999999999,"15min":0.38400000000000001},"min":{"1min":0.33400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64900000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.501}]},{"osd":2,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93100000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.84499999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81799999999999995,"5min":1.863,"15min":1.863},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66300000000000003,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67700000000000005,"15min":0.64000000000000001},"min":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.91900000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.91700000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.81499999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.82699999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90000000000000002,"5min":1.246,"15min":1.246},"last":0.85899999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.036,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88},{"interface":"front","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.044,"15min":1.044},"last":0.89300000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.82899999999999996,"15min":0.82699999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.92900000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1053616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82099999999999995,"5min":5.819,"15min":5.819},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55200000000000005,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.32900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.57399999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.374}]},{"osd":3,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.56999999999999995},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":5.835,"15min":5.835},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.59299999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.52700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":1.167,"15min":1.167},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.60499999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65700000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:43:35.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-26T06:43:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.942+0000 7f70127ff700 1 -- 172.21.15.50:0/4186070797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c1066b0 msgr2=0x7f700c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.942+0000 7f70127ff700 1 --2- 172.21.15.50:0/4186070797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c1066b0 0x7f700c106a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009990 tx=0x7f6ffc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 -- 172.21.15.50:0/4186070797 shutdown_connections 2023-10-26T06:43:35.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 --2- 172.21.15.50:0/4186070797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c101060 0x7f700c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 --2- 172.21.15.50:0/4186070797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c1066b0 0x7f700c106a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 --2- 172.21.15.50:0/4186070797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 0x7f700c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 -- 172.21.15.50:0/4186070797 >> 172.21.15.50:0/4186070797 conn(0x7f700c0fc170 msgr2=0x7f700c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 -- 172.21.15.50:0/4186070797 shutdown_connections 2023-10-26T06:43:35.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.943+0000 7f70127ff700 1 -- 172.21.15.50:0/4186070797 wait complete. 2023-10-26T06:43:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 Processor -- start 2023-10-26T06:43:35.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 -- start start 2023-10-26T06:43:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 0x7f700c19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 0x7f700c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c1066b0 0x7f700c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c199170 con 0x7f700c101060 2023-10-26T06:43:35.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c1992e0 con 0x7f700c1006a0 2023-10-26T06:43:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.944+0000 7f70127ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c1994a0 con 0x7f700c1066b0 2023-10-26T06:43:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 0x7f700c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 0x7f700c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33774/0 (socket says 172.21.15.50:33774) 2023-10-26T06:43:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 -- 172.21.15.50:0/4266504525 learned_addr learned my addr 172.21.15.50:0/4266504525 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:35.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700bfff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 0x7f700c19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f7010d9c700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c1066b0 0x7f700c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 -- 172.21.15.50:0/4266504525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c1066b0 msgr2=0x7f700c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c1066b0 0x7f700c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 -- 172.21.15.50:0/4266504525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 msgr2=0x7f700c19e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:35.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 0x7f700c19e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:35.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 -- 172.21.15.50:0/4266504525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc0095f0 con 0x7f700c101060 2023-10-26T06:43:35.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f7010d9c700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c1066b0 0x7f700c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700bfff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 0x7f700c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f700b7fe700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 0x7f700c19ef20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f700000e9a0 tx=0x7f700000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.945+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000009790 con 0x7f700c101060 2023-10-26T06:43:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.946+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f700000cbd0 con 0x7f700c101060 2023-10-26T06:43:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.946+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c199780 con 0x7f700c101060 2023-10-26T06:43:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.946+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000018680 con 0x7f700c101060 2023-10-26T06:43:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.946+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c1a59d0 con 0x7f700c101060 2023-10-26T06:43:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.947+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c101de0 con 0x7f700c101060 2023-10-26T06:43:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.949+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f700000cd40 con 0x7f700c101060 2023-10-26T06:43:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.950+0000 7f70097fa700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ff40a1550 0x7f6ff40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.950+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7000014070 con 0x7f700c101060 2023-10-26T06:43:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.950+0000 7f700bfff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ff40a1550 0x7f6ff40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.951+0000 7f700bfff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ff40a1550 0x7f6ff40a3a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00b2e0 tx=0x7f6ffc005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:35.954+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7000052100 con 0x7f700c101060 2023-10-26T06:43:36.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:35 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/201692049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:36.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:35 smithi050 ceph-mon[94997]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2023-10-26T06:43:36.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:35 smithi050 ceph-mon[94997]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:36.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.160+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f700c110620 con 0x7f6ff40a1550 2023-10-26T06:43:36.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:35 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/201692049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:36.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:35 smithi125 ceph-mon[130643]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2023-10-26T06:43:36.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:35 smithi125 ceph-mon[130643]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:36.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.172+0000 7f70097fa700 1 -- 172.21.15.50:0/4266504525 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344779 (secure 0 0 0) 0x7f700c110620 con 0x7f6ff40a1550 2023-10-26T06:43:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.176+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ff40a1550 msgr2=0x7f6ff40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.176+0000 7f70127ff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ff40a1550 0x7f6ff40a3a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00b2e0 tx=0x7f6ffc005fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.176+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 msgr2=0x7f700c19ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.176+0000 7f70127ff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 0x7f700c19ef20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f700000e9a0 tx=0x7f700000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 shutdown_connections 2023-10-26T06:43:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ff40a1550 0x7f6ff40a3a10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f700c1066b0 0x7f700c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f700c1006a0 0x7f700c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 --2- 172.21.15.50:0/4266504525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f700c101060 0x7f700c19ef20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 >> 172.21.15.50:0/4266504525 conn(0x7f700c0fc170 msgr2=0x7f700c0fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:36.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 shutdown_connections 2023-10-26T06:43:36.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.177+0000 7f70127ff700 1 -- 172.21.15.50:0/4266504525 wait complete. 2023-10-26T06:43:36.183 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:43:36.197 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2023-10-26T06:43:35.654278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654796,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":865,"num_read_kb":550,"num_write":343,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":780,"ondisk_log_size":780,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337348,"kb_used_data":13156,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604476,"statfs":{"total":1151940427776,"available":1151594983424,"internally_reserved":0,"allocated":13471744,"data_stored":7506538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002833"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681407+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:42:59.681407+0000","last_peered":"2023-10-26T06:42:59.681407+0000","last_clean":"2023-10-26T06:42:59.681407+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:42:59.681407+0000","last_undegraded":"2023-10-26T06:42:59.681407+0000","last_fullsized":"2023-10-26T06:42:59.681407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679637+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:42:59.679637+0000","last_peered":"2023-10-26T06:42:59.679637+0000","last_clean":"2023-10-26T06:42:59.679637+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:42:59.679637+0000","last_undegraded":"2023-10-26T06:42:59.679637+0000","last_fullsized":"2023-10-26T06:42:59.679637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683490+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:42:59.683490+0000","last_peered":"2023-10-26T06:42:59.683490+0000","last_clean":"2023-10-26T06:42:59.683490+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:42:59.683490+0000","last_undegraded":"2023-10-26T06:42:59.683490+0000","last_fullsized":"2023-10-26T06:42:59.683490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670012+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:42:59.670012+0000","last_peered":"2023-10-26T06:42:59.670012+0000","last_clean":"2023-10-26T06:42:59.670012+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:42:59.670012+0000","last_undegraded":"2023-10-26T06:42:59.670012+0000","last_fullsized":"2023-10-26T06:42:59.670012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.665576+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:42:59.665576+0000","last_peered":"2023-10-26T06:42:59.665576+0000","last_clean":"2023-10-26T06:42:59.665576+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:42:59.665576+0000","last_undegraded":"2023-10-26T06:42:59.665576+0000","last_fullsized":"2023-10-26T06:42:59.665576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675234+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:42:59.675234+0000","last_peered":"2023-10-26T06:42:59.675234+0000","last_clean":"2023-10-26T06:42:59.675234+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:42:59.675234+0000","last_undegraded":"2023-10-26T06:42:59.675234+0000","last_fullsized":"2023-10-26T06:42:59.675234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674781+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:42:59.674781+0000","last_peered":"2023-10-26T06:42:59.674781+0000","last_clean":"2023-10-26T06:42:59.674781+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:42:59.674781+0000","last_undegraded":"2023-10-26T06:42:59.674781+0000","last_fullsized":"2023-10-26T06:42:59.674781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675444+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:42:59.675444+0000","last_peered":"2023-10-26T06:42:59.675444+0000","last_clean":"2023-10-26T06:42:59.675444+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:42:59.675444+0000","last_undegraded":"2023-10-26T06:42:59.675444+0000","last_fullsized":"2023-10-26T06:42:59.675444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677812+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:42:59.677812+0000","last_peered":"2023-10-26T06:42:59.677812+0000","last_clean":"2023-10-26T06:42:59.677812+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:42:59.677812+0000","last_undegraded":"2023-10-26T06:42:59.677812+0000","last_fullsized":"2023-10-26T06:42:59.677812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676371+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:42:59.676371+0000","last_peered":"2023-10-26T06:42:59.676371+0000","last_clean":"2023-10-26T06:42:59.676371+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:42:59.676371+0000","last_undegraded":"2023-10-26T06:42:59.676371+0000","last_fullsized":"2023-10-26T06:42:59.676371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683292+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:42:59.683292+0000","last_peered":"2023-10-26T06:42:59.683292+0000","last_clean":"2023-10-26T06:42:59.683292+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:42:59.683292+0000","last_undegraded":"2023-10-26T06:42:59.683292+0000","last_fullsized":"2023-10-26T06:42:59.683292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679169+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:42:59.679169+0000","last_peered":"2023-10-26T06:42:59.679169+0000","last_clean":"2023-10-26T06:42:59.679169+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:42:59.679169+0000","last_undegraded":"2023-10-26T06:42:59.679169+0000","last_fullsized":"2023-10-26T06:42:59.679169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674878+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:42:59.674878+0000","last_peered":"2023-10-26T06:42:59.674878+0000","last_clean":"2023-10-26T06:42:59.674878+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:42:59.674878+0000","last_undegraded":"2023-10-26T06:42:59.674878+0000","last_fullsized":"2023-10-26T06:42:59.674878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678209+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:42:59.678209+0000","last_peered":"2023-10-26T06:42:59.678209+0000","last_clean":"2023-10-26T06:42:59.678209+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:42:59.678209+0000","last_undegraded":"2023-10-26T06:42:59.678209+0000","last_fullsized":"2023-10-26T06:42:59.678209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679859+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:42:59.679859+0000","last_peered":"2023-10-26T06:42:59.679859+0000","last_clean":"2023-10-26T06:42:59.679859+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:42:59.679859+0000","last_undegraded":"2023-10-26T06:42:59.679859+0000","last_fullsized":"2023-10-26T06:42:59.679859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681260+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:42:59.681260+0000","last_peered":"2023-10-26T06:42:59.681260+0000","last_clean":"2023-10-26T06:42:59.681260+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:42:59.681260+0000","last_undegraded":"2023-10-26T06:42:59.681260+0000","last_fullsized":"2023-10-26T06:42:59.681260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681584+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:42:59.681584+0000","last_peered":"2023-10-26T06:42:59.681584+0000","last_clean":"2023-10-26T06:42:59.681584+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:42:59.681584+0000","last_undegraded":"2023-10-26T06:42:59.681584+0000","last_fullsized":"2023-10-26T06:42:59.681584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678043+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:42:59.678043+0000","last_peered":"2023-10-26T06:42:59.678043+0000","last_clean":"2023-10-26T06:42:59.678043+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:42:59.678043+0000","last_undegraded":"2023-10-26T06:42:59.678043+0000","last_fullsized":"2023-10-26T06:42:59.678043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674053+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:42:59.674053+0000","last_peered":"2023-10-26T06:42:59.674053+0000","last_clean":"2023-10-26T06:42:59.674053+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:42:59.674053+0000","last_undegraded":"2023-10-26T06:42:59.674053+0000","last_fullsized":"2023-10-26T06:42:59.674053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.701211+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:42:29.701211+0000","last_peered":"2023-10-26T06:42:29.701211+0000","last_clean":"2023-10-26T06:42:29.701211+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:42:29.701211+0000","last_undegraded":"2023-10-26T06:42:29.701211+0000","last_fullsized":"2023-10-26T06:42:29.701211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675424+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:42:59.675424+0000","last_peered":"2023-10-26T06:42:59.675424+0000","last_clean":"2023-10-26T06:42:59.675424+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:42:59.675424+0000","last_undegraded":"2023-10-26T06:42:59.675424+0000","last_fullsized":"2023-10-26T06:42:59.675424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.708496+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:42:30.708496+0000","last_peered":"2023-10-26T06:42:30.708496+0000","last_clean":"2023-10-26T06:42:30.708496+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:42:30.708496+0000","last_undegraded":"2023-10-26T06:42:30.708496+0000","last_fullsized":"2023-10-26T06:42:30.708496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683632+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:42:59.683632+0000","last_peered":"2023-10-26T06:42:59.683632+0000","last_clean":"2023-10-26T06:42:59.683632+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:42:59.683632+0000","last_undegraded":"2023-10-26T06:42:59.683632+0000","last_fullsized":"2023-10-26T06:42:59.683632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704769+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:42:29.704769+0000","last_peered":"2023-10-26T06:42:29.704769+0000","last_clean":"2023-10-26T06:42:29.704769+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:42:29.704769+0000","last_undegraded":"2023-10-26T06:42:29.704769+0000","last_fullsized":"2023-10-26T06:42:29.704769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682510+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:42:59.682510+0000","last_peered":"2023-10-26T06:42:59.682510+0000","last_clean":"2023-10-26T06:42:59.682510+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:42:59.682510+0000","last_undegraded":"2023-10-26T06:42:59.682510+0000","last_fullsized":"2023-10-26T06:42:59.682510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704515+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:42:29.704515+0000","last_peered":"2023-10-26T06:42:29.704515+0000","last_clean":"2023-10-26T06:42:29.704515+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:42:29.704515+0000","last_undegraded":"2023-10-26T06:42:29.704515+0000","last_fullsized":"2023-10-26T06:42:29.704515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680895+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:42:59.680895+0000","last_peered":"2023-10-26T06:42:59.680895+0000","last_clean":"2023-10-26T06:42:59.680895+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:42:59.680895+0000","last_undegraded":"2023-10-26T06:42:59.680895+0000","last_fullsized":"2023-10-26T06:42:59.680895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:30.169890+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:43:30.169890+0000","last_peered":"2023-10-26T06:43:30.169890+0000","last_clean":"2023-10-26T06:43:30.169890+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:43:30.169890+0000","last_undegraded":"2023-10-26T06:43:30.169890+0000","last_fullsized":"2023-10-26T06:43:30.169890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":938,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.666937+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:42:59.666937+0000","last_peered":"2023-10-26T06:42:59.666937+0000","last_clean":"2023-10-26T06:42:59.666937+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:42:59.666937+0000","last_undegraded":"2023-10-26T06:42:59.666937+0000","last_fullsized":"2023-10-26T06:42:59.666937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698424+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:42:29.698424+0000","last_peered":"2023-10-26T06:42:29.698424+0000","last_clean":"2023-10-26T06:42:29.698424+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:42:29.698424+0000","last_undegraded":"2023-10-26T06:42:29.698424+0000","last_fullsized":"2023-10-26T06:42:29.698424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679061+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:42:59.679061+0000","last_peered":"2023-10-26T06:42:59.679061+0000","last_clean":"2023-10-26T06:42:59.679061+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:42:59.679061+0000","last_undegraded":"2023-10-26T06:42:59.679061+0000","last_fullsized":"2023-10-26T06:42:59.679061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706715+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:42:29.706715+0000","last_peered":"2023-10-26T06:42:29.706715+0000","last_clean":"2023-10-26T06:42:29.706715+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:42:29.706715+0000","last_undegraded":"2023-10-26T06:42:29.706715+0000","last_fullsized":"2023-10-26T06:42:29.706715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670469+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:42:59.670469+0000","last_peered":"2023-10-26T06:42:59.670469+0000","last_clean":"2023-10-26T06:42:59.670469+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:42:59.670469+0000","last_undegraded":"2023-10-26T06:42:59.670469+0000","last_fullsized":"2023-10-26T06:42:59.670469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699672+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:42:29.699672+0000","last_peered":"2023-10-26T06:42:29.699672+0000","last_clean":"2023-10-26T06:42:29.699672+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:42:29.699672+0000","last_undegraded":"2023-10-26T06:42:29.699672+0000","last_fullsized":"2023-10-26T06:42:29.699672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670726+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:42:59.670726+0000","last_peered":"2023-10-26T06:42:59.670726+0000","last_clean":"2023-10-26T06:42:59.670726+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:42:59.670726+0000","last_undegraded":"2023-10-26T06:42:59.670726+0000","last_fullsized":"2023-10-26T06:42:59.670726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":136,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:31.170757+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:43:31.170757+0000","last_peered":"2023-10-26T06:43:31.170757+0000","last_clean":"2023-10-26T06:43:31.170757+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:43:31.170757+0000","last_undegraded":"2023-10-26T06:43:31.170757+0000","last_fullsized":"2023-10-26T06:43:31.170757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680606+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:42:59.680606+0000","last_peered":"2023-10-26T06:42:59.680606+0000","last_clean":"2023-10-26T06:42:59.680606+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:42:59.680606+0000","last_undegraded":"2023-10-26T06:42:59.680606+0000","last_fullsized":"2023-10-26T06:42:59.680606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947188+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:42:29.947188+0000","last_peered":"2023-10-26T06:42:29.947188+0000","last_clean":"2023-10-26T06:42:29.947188+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:42:29.947188+0000","last_undegraded":"2023-10-26T06:42:29.947188+0000","last_fullsized":"2023-10-26T06:42:29.947188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681798+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:42:59.681798+0000","last_peered":"2023-10-26T06:42:59.681798+0000","last_clean":"2023-10-26T06:42:59.681798+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:42:59.681798+0000","last_undegraded":"2023-10-26T06:42:59.681798+0000","last_fullsized":"2023-10-26T06:42:59.681798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699839+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:42:29.699839+0000","last_peered":"2023-10-26T06:42:29.699839+0000","last_clean":"2023-10-26T06:42:29.699839+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:42:29.699839+0000","last_undegraded":"2023-10-26T06:42:29.699839+0000","last_fullsized":"2023-10-26T06:42:29.699839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.684240+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:42:59.684240+0000","last_peered":"2023-10-26T06:42:59.684240+0000","last_clean":"2023-10-26T06:42:59.684240+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:42:59.684240+0000","last_undegraded":"2023-10-26T06:42:59.684240+0000","last_fullsized":"2023-10-26T06:42:59.684240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":291,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:32.172697+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:43:32.172697+0000","last_peered":"2023-10-26T06:43:32.172697+0000","last_clean":"2023-10-26T06:43:32.172697+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:43:32.172697+0000","last_undegraded":"2023-10-26T06:43:32.172697+0000","last_fullsized":"2023-10-26T06:43:32.172697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59725,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":244,"num_read_kb":180,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.659585+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:42:59.659585+0000","last_peered":"2023-10-26T06:42:59.659585+0000","last_clean":"2023-10-26T06:42:59.659585+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:42:59.659585+0000","last_undegraded":"2023-10-26T06:42:59.659585+0000","last_fullsized":"2023-10-26T06:42:59.659585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705196+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:42:29.705196+0000","last_peered":"2023-10-26T06:42:29.705196+0000","last_clean":"2023-10-26T06:42:29.705196+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:42:29.705196+0000","last_undegraded":"2023-10-26T06:42:29.705196+0000","last_fullsized":"2023-10-26T06:42:29.705196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675892+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:42:59.675892+0000","last_peered":"2023-10-26T06:42:59.675892+0000","last_clean":"2023-10-26T06:42:59.675892+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:42:59.675892+0000","last_undegraded":"2023-10-26T06:42:59.675892+0000","last_fullsized":"2023-10-26T06:42:59.675892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699304+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:42:29.699304+0000","last_peered":"2023-10-26T06:42:29.699304+0000","last_clean":"2023-10-26T06:42:29.699304+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:42:29.699304+0000","last_undegraded":"2023-10-26T06:42:29.699304+0000","last_fullsized":"2023-10-26T06:42:29.699304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676366+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:42:59.676366+0000","last_peered":"2023-10-26T06:42:59.676366+0000","last_clean":"2023-10-26T06:42:59.676366+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:42:59.676366+0000","last_undegraded":"2023-10-26T06:42:59.676366+0000","last_fullsized":"2023-10-26T06:42:59.676366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":143,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:33.182703+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:43:33.182703+0000","last_peered":"2023-10-26T06:43:33.182703+0000","last_clean":"2023-10-26T06:43:33.182703+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:43:33.182703+0000","last_undegraded":"2023-10-26T06:43:33.182703+0000","last_fullsized":"2023-10-26T06:43:33.182703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674567+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:42:59.674567+0000","last_peered":"2023-10-26T06:42:59.674567+0000","last_clean":"2023-10-26T06:42:59.674567+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:42:59.674567+0000","last_undegraded":"2023-10-26T06:42:59.674567+0000","last_fullsized":"2023-10-26T06:42:59.674567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703869+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:42:29.703869+0000","last_peered":"2023-10-26T06:42:29.703869+0000","last_clean":"2023-10-26T06:42:29.703869+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:42:29.703869+0000","last_undegraded":"2023-10-26T06:42:29.703869+0000","last_fullsized":"2023-10-26T06:42:29.703869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680375+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:42:59.680375+0000","last_peered":"2023-10-26T06:42:59.680375+0000","last_clean":"2023-10-26T06:42:59.680375+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:42:59.680375+0000","last_undegraded":"2023-10-26T06:42:59.680375+0000","last_fullsized":"2023-10-26T06:42:59.680375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.714855+0000","last_change":"2023-10-26T06:42:30.714354+0000","last_active":"2023-10-26T06:42:30.714855+0000","last_peered":"2023-10-26T06:42:30.714855+0000","last_clean":"2023-10-26T06:42:30.714855+0000","last_became_active":"2023-10-26T06:42:30.709396+0000","last_became_peered":"2023-10-26T06:42:30.709396+0000","last_unstale":"2023-10-26T06:42:30.714855+0000","last_undegraded":"2023-10-26T06:42:30.714855+0000","last_fullsized":"2023-10-26T06:42:30.714855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:04:20.594879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679151+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:42:59.679151+0000","last_peered":"2023-10-26T06:42:59.679151+0000","last_clean":"2023-10-26T06:42:59.679151+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:42:59.679151+0000","last_undegraded":"2023-10-26T06:42:59.679151+0000","last_fullsized":"2023-10-26T06:42:59.679151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700656+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:42:29.700656+0000","last_peered":"2023-10-26T06:42:29.700656+0000","last_clean":"2023-10-26T06:42:29.700656+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:42:29.700656+0000","last_undegraded":"2023-10-26T06:42:29.700656+0000","last_fullsized":"2023-10-26T06:42:29.700656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677816+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:42:59.677816+0000","last_peered":"2023-10-26T06:42:59.677816+0000","last_clean":"2023-10-26T06:42:59.677816+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:42:59.677816+0000","last_undegraded":"2023-10-26T06:42:59.677816+0000","last_fullsized":"2023-10-26T06:42:59.677816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946991+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:42:29.946991+0000","last_peered":"2023-10-26T06:42:29.946991+0000","last_clean":"2023-10-26T06:42:29.946991+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:42:29.946991+0000","last_undegraded":"2023-10-26T06:42:29.946991+0000","last_fullsized":"2023-10-26T06:42:29.946991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676992+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:42:59.676992+0000","last_peered":"2023-10-26T06:42:59.676992+0000","last_clean":"2023-10-26T06:42:59.676992+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:42:59.676992+0000","last_undegraded":"2023-10-26T06:42:59.676992+0000","last_fullsized":"2023-10-26T06:42:59.676992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679172+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:42:59.679172+0000","last_peered":"2023-10-26T06:42:59.679172+0000","last_clean":"2023-10-26T06:42:59.679172+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:42:59.679172+0000","last_undegraded":"2023-10-26T06:42:59.679172+0000","last_fullsized":"2023-10-26T06:42:59.679172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":135,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:29.175762+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:43:29.175762+0000","last_peered":"2023-10-26T06:43:29.175762+0000","last_clean":"2023-10-26T06:43:29.175762+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:43:29.175762+0000","last_undegraded":"2023-10-26T06:43:29.175762+0000","last_fullsized":"2023-10-26T06:43:29.175762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680667+0000","last_change":"2023-10-26T06:42:30.709009+0000","last_active":"2023-10-26T06:42:59.680667+0000","last_peered":"2023-10-26T06:42:59.680667+0000","last_clean":"2023-10-26T06:42:59.680667+0000","last_became_active":"2023-10-26T06:42:30.708638+0000","last_became_peered":"2023-10-26T06:42:30.708638+0000","last_unstale":"2023-10-26T06:42:59.680667+0000","last_undegraded":"2023-10-26T06:42:59.680667+0000","last_fullsized":"2023-10-26T06:42:59.680667+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:53:48.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.706370+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:42:30.706370+0000","last_peered":"2023-10-26T06:42:30.706370+0000","last_clean":"2023-10-26T06:42:30.706370+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:42:30.706370+0000","last_undegraded":"2023-10-26T06:42:30.706370+0000","last_fullsized":"2023-10-26T06:42:30.706370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.179608+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:42:31.179608+0000","last_peered":"2023-10-26T06:42:31.179608+0000","last_clean":"2023-10-26T06:42:31.179608+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:42:31.179608+0000","last_undegraded":"2023-10-26T06:42:31.179608+0000","last_fullsized":"2023-10-26T06:42:31.179608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.664946+0000","last_change":"2023-10-26T06:42:30.706066+0000","last_active":"2023-10-26T06:42:59.664946+0000","last_peered":"2023-10-26T06:42:59.664946+0000","last_clean":"2023-10-26T06:42:59.664946+0000","last_became_active":"2023-10-26T06:42:30.705682+0000","last_became_peered":"2023-10-26T06:42:30.705682+0000","last_unstale":"2023-10-26T06:42:59.664946+0000","last_undegraded":"2023-10-26T06:42:59.664946+0000","last_fullsized":"2023-10-26T06:42:59.664946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:40:13.366566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.179688+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:42:31.179688+0000","last_peered":"2023-10-26T06:42:31.179688+0000","last_clean":"2023-10-26T06:42:31.179688+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:42:31.179688+0000","last_undegraded":"2023-10-26T06:42:31.179688+0000","last_fullsized":"2023-10-26T06:42:31.179688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704685+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:42:29.704685+0000","last_peered":"2023-10-26T06:42:29.704685+0000","last_clean":"2023-10-26T06:42:29.704685+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:42:29.704685+0000","last_undegraded":"2023-10-26T06:42:29.704685+0000","last_fullsized":"2023-10-26T06:42:29.704685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670286+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:42:59.670286+0000","last_peered":"2023-10-26T06:42:59.670286+0000","last_clean":"2023-10-26T06:42:59.670286+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:42:59.670286+0000","last_undegraded":"2023-10-26T06:42:59.670286+0000","last_fullsized":"2023-10-26T06:42:59.670286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.702331+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:42:30.702331+0000","last_peered":"2023-10-26T06:42:30.702331+0000","last_clean":"2023-10-26T06:42:30.702331+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:42:30.702331+0000","last_undegraded":"2023-10-26T06:42:30.702331+0000","last_fullsized":"2023-10-26T06:42:30.702331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.671656+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:42:59.671656+0000","last_peered":"2023-10-26T06:42:59.671656+0000","last_clean":"2023-10-26T06:42:59.671656+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:42:59.671656+0000","last_undegraded":"2023-10-26T06:42:59.671656+0000","last_fullsized":"2023-10-26T06:42:59.671656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704776+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:42:29.704776+0000","last_peered":"2023-10-26T06:42:29.704776+0000","last_clean":"2023-10-26T06:42:29.704776+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:42:29.704776+0000","last_undegraded":"2023-10-26T06:42:29.704776+0000","last_fullsized":"2023-10-26T06:42:29.704776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681857+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:42:59.681857+0000","last_peered":"2023-10-26T06:42:59.681857+0000","last_clean":"2023-10-26T06:42:59.681857+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:42:59.681857+0000","last_undegraded":"2023-10-26T06:42:59.681857+0000","last_fullsized":"2023-10-26T06:42:59.681857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703873+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:42:29.703873+0000","last_peered":"2023-10-26T06:42:29.703873+0000","last_clean":"2023-10-26T06:42:29.703873+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:42:29.703873+0000","last_undegraded":"2023-10-26T06:42:29.703873+0000","last_fullsized":"2023-10-26T06:42:29.703873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.654116+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:42:59.654116+0000","last_peered":"2023-10-26T06:42:59.654116+0000","last_clean":"2023-10-26T06:42:59.654116+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:42:59.654116+0000","last_undegraded":"2023-10-26T06:42:59.654116+0000","last_fullsized":"2023-10-26T06:42:59.654116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698478+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:42:29.698478+0000","last_peered":"2023-10-26T06:42:29.698478+0000","last_clean":"2023-10-26T06:42:29.698478+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:42:29.698478+0000","last_undegraded":"2023-10-26T06:42:29.698478+0000","last_fullsized":"2023-10-26T06:42:29.698478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.673792+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:42:59.673792+0000","last_peered":"2023-10-26T06:42:59.673792+0000","last_clean":"2023-10-26T06:42:59.673792+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:42:59.673792+0000","last_undegraded":"2023-10-26T06:42:59.673792+0000","last_fullsized":"2023-10-26T06:42:59.673792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.717232+0000","last_change":"2023-10-26T06:42:30.716756+0000","last_active":"2023-10-26T06:42:30.717232+0000","last_peered":"2023-10-26T06:42:30.717232+0000","last_clean":"2023-10-26T06:42:30.717232+0000","last_became_active":"2023-10-26T06:42:30.709797+0000","last_became_peered":"2023-10-26T06:42:30.709797+0000","last_unstale":"2023-10-26T06:42:30.717232+0000","last_undegraded":"2023-10-26T06:42:30.717232+0000","last_fullsized":"2023-10-26T06:42:30.717232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:54.345261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683233+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:42:59.683233+0000","last_peered":"2023-10-26T06:42:59.683233+0000","last_clean":"2023-10-26T06:42:59.683233+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:42:59.683233+0000","last_undegraded":"2023-10-26T06:42:59.683233+0000","last_fullsized":"2023-10-26T06:42:59.683233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704002+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:42:29.704002+0000","last_peered":"2023-10-26T06:42:29.704002+0000","last_clean":"2023-10-26T06:42:29.704002+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:42:29.704002+0000","last_undegraded":"2023-10-26T06:42:29.704002+0000","last_fullsized":"2023-10-26T06:42:29.704002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683749+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:42:59.683749+0000","last_peered":"2023-10-26T06:42:59.683749+0000","last_clean":"2023-10-26T06:42:59.683749+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:42:59.683749+0000","last_undegraded":"2023-10-26T06:42:59.683749+0000","last_fullsized":"2023-10-26T06:42:59.683749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705370+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:42:29.705370+0000","last_peered":"2023-10-26T06:42:29.705370+0000","last_clean":"2023-10-26T06:42:29.705370+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:42:29.705370+0000","last_undegraded":"2023-10-26T06:42:29.705370+0000","last_fullsized":"2023-10-26T06:42:29.705370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683429+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:42:59.683429+0000","last_peered":"2023-10-26T06:42:59.683429+0000","last_clean":"2023-10-26T06:42:59.683429+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:42:59.683429+0000","last_undegraded":"2023-10-26T06:42:59.683429+0000","last_fullsized":"2023-10-26T06:42:59.683429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699564+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:42:29.699564+0000","last_peered":"2023-10-26T06:42:29.699564+0000","last_clean":"2023-10-26T06:42:29.699564+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:42:29.699564+0000","last_undegraded":"2023-10-26T06:42:29.699564+0000","last_fullsized":"2023-10-26T06:42:29.699564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679441+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:42:59.679441+0000","last_peered":"2023-10-26T06:42:59.679441+0000","last_clean":"2023-10-26T06:42:59.679441+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:42:59.679441+0000","last_undegraded":"2023-10-26T06:42:59.679441+0000","last_fullsized":"2023-10-26T06:42:59.679441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706318+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:42:29.706318+0000","last_peered":"2023-10-26T06:42:29.706318+0000","last_clean":"2023-10-26T06:42:29.706318+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:42:29.706318+0000","last_undegraded":"2023-10-26T06:42:29.706318+0000","last_fullsized":"2023-10-26T06:42:29.706318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.671147+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:42:59.671147+0000","last_peered":"2023-10-26T06:42:59.671147+0000","last_clean":"2023-10-26T06:42:59.671147+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:42:59.671147+0000","last_undegraded":"2023-10-26T06:42:59.671147+0000","last_fullsized":"2023-10-26T06:42:59.671147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.669446+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:42:59.669446+0000","last_peered":"2023-10-26T06:42:59.669446+0000","last_clean":"2023-10-26T06:42:59.669446+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:42:59.669446+0000","last_undegraded":"2023-10-26T06:42:59.669446+0000","last_fullsized":"2023-10-26T06:42:59.669446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678407+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:42:59.678407+0000","last_peered":"2023-10-26T06:42:59.678407+0000","last_clean":"2023-10-26T06:42:59.678407+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:42:59.678407+0000","last_undegraded":"2023-10-26T06:42:59.678407+0000","last_fullsized":"2023-10-26T06:42:59.678407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677343+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:42:59.677343+0000","last_peered":"2023-10-26T06:42:59.677343+0000","last_clean":"2023-10-26T06:42:59.677343+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:42:59.677343+0000","last_undegraded":"2023-10-26T06:42:59.677343+0000","last_fullsized":"2023-10-26T06:42:59.677343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682413+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:42:59.682413+0000","last_peered":"2023-10-26T06:42:59.682413+0000","last_clean":"2023-10-26T06:42:59.682413+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:42:59.682413+0000","last_undegraded":"2023-10-26T06:42:59.682413+0000","last_fullsized":"2023-10-26T06:42:59.682413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680960+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:42:59.680960+0000","last_peered":"2023-10-26T06:42:59.680960+0000","last_clean":"2023-10-26T06:42:59.680960+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:42:59.680960+0000","last_undegraded":"2023-10-26T06:42:59.680960+0000","last_fullsized":"2023-10-26T06:42:59.680960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.668540+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:42:59.668540+0000","last_peered":"2023-10-26T06:42:59.668540+0000","last_clean":"2023-10-26T06:42:59.668540+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:42:59.668540+0000","last_undegraded":"2023-10-26T06:42:59.668540+0000","last_fullsized":"2023-10-26T06:42:59.668540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680578+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:42:59.680578+0000","last_peered":"2023-10-26T06:42:59.680578+0000","last_clean":"2023-10-26T06:42:59.680578+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:42:59.680578+0000","last_undegraded":"2023-10-26T06:42:59.680578+0000","last_fullsized":"2023-10-26T06:42:59.680578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.666939+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:42:59.666939+0000","last_peered":"2023-10-26T06:42:59.666939+0000","last_clean":"2023-10-26T06:42:59.666939+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:42:59.666939+0000","last_undegraded":"2023-10-26T06:42:59.666939+0000","last_fullsized":"2023-10-26T06:42:59.666939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674902+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:42:59.674902+0000","last_peered":"2023-10-26T06:42:59.674902+0000","last_clean":"2023-10-26T06:42:59.674902+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:42:59.674902+0000","last_undegraded":"2023-10-26T06:42:59.674902+0000","last_fullsized":"2023-10-26T06:42:59.674902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677285+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:42:59.677285+0000","last_peered":"2023-10-26T06:42:59.677285+0000","last_clean":"2023-10-26T06:42:59.677285+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:42:59.677285+0000","last_undegraded":"2023-10-26T06:42:59.677285+0000","last_fullsized":"2023-10-26T06:42:59.677285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683019+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:42:59.683019+0000","last_peered":"2023-10-26T06:42:59.683019+0000","last_clean":"2023-10-26T06:42:59.683019+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:42:59.683019+0000","last_undegraded":"2023-10-26T06:42:59.683019+0000","last_fullsized":"2023-10-26T06:42:59.683019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682770+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:42:59.682770+0000","last_peered":"2023-10-26T06:42:59.682770+0000","last_clean":"2023-10-26T06:42:59.682770+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:42:59.682770+0000","last_undegraded":"2023-10-26T06:42:59.682770+0000","last_fullsized":"2023-10-26T06:42:59.682770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.667579+0000","last_change":"2023-10-26T06:42:30.708612+0000","last_active":"2023-10-26T06:42:59.667579+0000","last_peered":"2023-10-26T06:42:59.667579+0000","last_clean":"2023-10-26T06:42:59.667579+0000","last_became_active":"2023-10-26T06:42:30.707927+0000","last_became_peered":"2023-10-26T06:42:30.707927+0000","last_unstale":"2023-10-26T06:42:59.667579+0000","last_undegraded":"2023-10-26T06:42:59.667579+0000","last_fullsized":"2023-10-26T06:42:59.667579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:59:10.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64182,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":729,"num_read_kb":431,"num_write":160,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":197925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416422,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437}]},{"osd":1,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79200000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.874,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.878}]},{"osd":7,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94599999999999995,"5min":0.998,"15min":0.998},"last":0.89500000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.877}]},{"osd":9,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.95799999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81499999999999995,"15min":0.81599999999999995},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":0.96799999999999997,"5min":1.079,"15min":1.079},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.026,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.86099999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1113974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61199999999999999,"15min":0.59699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.63400000000000001,"15min":0.66600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.872,"15min":0.872},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.89200000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82499999999999996,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"min":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.745}]},{"osd":11,"last update":"Thu Oct 26 06:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98499999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.879}]}]},{"osd":9,"up_from":67,"seq":287762808877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86599999999999999,"5min":2.016,"15min":2.016},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":7.2320000000000002,"5min":7.2320000000000002,"15min":7.2320000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.83799999999999997,"15min":0.86199999999999999},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":1.859,"15min":1.859},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.53200000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.752}]},{"osd":3,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.65900000000000003,"15min":0.69299999999999995},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.048,"5min":1.605,"15min":1.605},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5289999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78400000000000003,"15min":0.82799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.74399999999999999,"5min":1.331,"15min":1.331},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2030000000000001,"5min":1.776,"15min":1.776},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.91800000000000004,"15min":0.95599999999999996},"min":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.05,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.83999999999999997,"15min":0.88200000000000001},"min":{"1min":0.57099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.92600000000000005,"15min":0.97399999999999998},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5640000000000001,"5min":1.901,"15min":1.901},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.873,"15min":0.94099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3560000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.89100000000000001,"15min":0.93400000000000005},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2430000000000001,"5min":1.835,"15min":1.835},"last":0.629},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.998,"15min":1.0329999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.494,"5min":2.093,"15min":2.093},"last":0.64800000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.0269999999999999,"15min":1.0669999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.419,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.034,"15min":1.02},"min":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":0.876}]},{"osd":10,"last update":"Thu Oct 26 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.458,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.141,"15min":1.2709999999999999},"min":{"1min":0.60099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3220000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.89900000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":462696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81799999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.56899999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.42099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.38,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.749}]},{"osd":3,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.73799999999999999,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0109999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63600000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84999999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.65400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.48599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.95099999999999996,"5min":1.766,"15min":1.766},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.68500000000000005},"min":{"1min":0.64700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0389999999999999,"5min":1.087,"15min":1.087},"last":1.028},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":0.93400000000000005},"min":{"1min":0.60699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.101,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.63700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.405,"15min":1.405},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80200000000000005,"15min":0.78200000000000003},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.78100000000000003,"15min":0.755},"min":{"1min":0.68799999999999994,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98699999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.70799999999999996},"min":{"1min":0.61599999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.002,"5min":1.45,"15min":1.45},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58299999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.075,"15min":1.075},"last":0.94499999999999995}]},{"osd":11,"last update":"Thu Oct 26 06:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.877}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1055110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.434,"15min":0.40699999999999997},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58199999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.81999999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.374,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.47999999999999998},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.36699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.625,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.752}]},{"osd":6,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.995,"15min":0.995},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.61099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.996,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.68600000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.65000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":1.204,"15min":1.204},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Oct 26 06:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.91900000000000004,"5min":0.998,"15min":0.998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.66600000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92800000000000005,"5min":1.002,"15min":1.002},"last":0.80100000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.77600000000000002,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":6.9100000000000001,"5min":6.9100000000000001,"15min":6.9100000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.73999999999999999,"15min":0.68300000000000005},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66600000000000004,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.78400000000000003,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.78800000000000003,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":3.3900000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.76500000000000001},"min":{"1min":0.56200000000000006,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.65300000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0449999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98099999999999998,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.81200000000000006}]},{"osd":8,"last update":"Thu Oct 26 06:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.876,"15min":0.85099999999999998},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.88300000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.65300000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.151,"5min":1.792,"15min":1.792},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86799999999999999,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.24,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.94299999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.94999999999999996,"15min":0.91800000000000004},"min":{"1min":0.68100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0329999999999999,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.028,"15min":0.998},"min":{"1min":0.78600000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.0760000000000001,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.86099999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":521705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53900000000000003,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.52500000000000002},"min":{"1min":0.49099999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.89300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.433},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.46100000000000002},"min":{"1min":0.374,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.55800000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.63700000000000001},"min":{"1min":0.59699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Oct 26 06:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.56799999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69099999999999995,"15min":0.66200000000000003},"min":{"1min":0.57099999999999995,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66900000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.64800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Oct 26 06:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89700000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.747},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79500000000000004,"15min":0.79400000000000004},"min":{"1min":0.66500000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96799999999999997,"5min":1.085,"15min":1.085},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.76100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":463458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":0.79200000000000004,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.34599999999999997,"15min":0.34399999999999997},"max":{"1min":17.193000000000001,"5min":17.193000000000001,"15min":17.193000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.6539999999999999,"5min":0.872,"15min":0.65200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":20.82,"5min":20.82,"15min":20.82},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":0.95899999999999996,"15min":0.70099999999999996},"min":{"1min":0.56399999999999995,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":22.111999999999998,"5min":22.111999999999998,"15min":22.111999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.8260000000000001,"5min":0.96799999999999997,"15min":0.72199999999999998},"min":{"1min":0.53000000000000003,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":22.158000000000001,"5min":22.158000000000001,"15min":22.158000000000001},"last":0.88}]},{"osd":3,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":0.89200000000000002,"15min":0.69599999999999995},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":22.945,"5min":22.945,"15min":22.945},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.722,"5min":0.93600000000000005,"15min":0.71799999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":20.875,"5min":20.875,"15min":20.875},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.5269999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.79200000000000004,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Oct 26 06:43:03 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":0.93300000000000005,"15min":0.76200000000000001},"min":{"1min":0.55500000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":20.550999999999998,"5min":20.550999999999998,"15min":20.550999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.85399999999999998,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92100000000000004,"15min":0.93000000000000005},"min":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.599,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92700000000000005,"15min":0.93600000000000005},"min":{"1min":0.63600000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.63900000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:43:03 2023","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":1.141,"15min":1.0429999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":20.364000000000001,"5min":20.364000000000001,"15min":20.364000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.972,"5min":1.1679999999999999,"15min":1.052},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":22.722999999999999,"5min":22.722999999999999,"15min":22.722999999999999},"last":0.91400000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:43:24 2023","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":1.2,"15min":1.0800000000000001},"min":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.1719999999999999,"15min":1.054},"min":{"1min":0.66400000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":20.780000000000001,"5min":20.780000000000001,"15min":20.780000000000001},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.97799999999999998,"15min":0.98599999999999999},"min":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.411,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82599999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":522739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81599999999999995,"5min":2.3119999999999998,"15min":2.371},"last":0.498}]},{"osd":1,"last update":"Thu Oct 26 06:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.83699999999999997,"5min":1.21,"15min":1.21},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.622}]},{"osd":3,"last update":"Thu Oct 26 06:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.85199999999999998,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.044,"15min":1.044},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.56599999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.61399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91700000000000004,"5min":1.093,"15min":1.093},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79600000000000004,"15min":0.79300000000000004},"min":{"1min":0.69899999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.024,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.81599999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76600000000000001,"15min":0.73299999999999998},"min":{"1min":0.64400000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.72899999999999998},"min":{"1min":0.65100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":462510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48599999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.38},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.44500000000000001},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74399999999999999,"5min":1.097,"15min":1.097},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70899999999999996,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.048,"15min":1.048},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.65100000000000002},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.745,"15min":0.66400000000000003},"min":{"1min":0.55400000000000005,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95699999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93799999999999994,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.746}]},{"osd":5,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.69699999999999995},"min":{"1min":0.61499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93899999999999995,"5min":1.196,"15min":1.196},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.66900000000000004},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.1830000000000001,"5min":1.258,"15min":1.258},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.79000000000000004},"min":{"1min":0.61699999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1020000000000001,"5min":1.361,"15min":1.361},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76500000000000001,"15min":0.70999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83799999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.0009999999999999,"15min":1.0469999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.419,"15min":1.419},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.89800000000000002,"15min":0.93799999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.278,"5min":1.292,"15min":1.292},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.018,"15min":1.075},"min":{"1min":0.73599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.69099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.431,"15min":1.431},"last":0.85799999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.877}]}]},{"osd":4,"up_from":34,"seq":146028888134,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":463155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.36699999999999999},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42599999999999999,"15min":0.38400000000000001},"min":{"1min":0.33400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64900000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.501}]},{"osd":2,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93100000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.84499999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81799999999999995,"5min":1.863,"15min":1.863},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66300000000000003,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67700000000000005,"15min":0.64000000000000001},"min":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.91900000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.91700000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.81499999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.82699999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90000000000000002,"5min":1.246,"15min":1.246},"last":0.85899999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.036,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88},{"interface":"front","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.044,"15min":1.044},"last":0.89300000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.82899999999999996,"15min":0.82699999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.92900000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1053616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82099999999999995,"5min":5.819,"15min":5.819},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55200000000000005,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.32900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.57399999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.374}]},{"osd":3,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.56999999999999995},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":5.835,"15min":5.835},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.59299999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.52700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":1.167,"15min":1.167},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.60499999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65700000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:43:36.205 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-26T06:43:36.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-26T06:43:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:35 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/201692049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:35 smithi153 ceph-mon[131657]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2023-10-26T06:43:36.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:35 smithi153 ceph-mon[131657]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 -- 172.21.15.50:0/3057469857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 msgr2=0x7fb584106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3057469857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb584106a90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb574009990 tx=0x7fb574009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 -- 172.21.15.50:0/3057469857 shutdown_connections 2023-10-26T06:43:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3057469857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb584101060 0x7fb58410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3057469857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb584106a90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3057469857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5841006a0 0x7fb584100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 -- 172.21.15.50:0/3057469857 >> 172.21.15.50:0/3057469857 conn(0x7fb5840fc1d0 msgr2=0x7fb5840fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:36.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.440+0000 7fb5889ff700 1 -- 172.21.15.50:0/3057469857 shutdown_connections 2023-10-26T06:43:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.441+0000 7fb5889ff700 1 -- 172.21.15.50:0/3057469857 wait complete. 2023-10-26T06:43:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.441+0000 7fb5889ff700 1 Processor -- start 2023-10-26T06:43:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 -- start start 2023-10-26T06:43:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5841006a0 0x7fb584198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584101060 0x7fb584199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb58419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419cb30 con 0x7fb5841066b0 2023-10-26T06:43:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419cca0 con 0x7fb5841006a0 2023-10-26T06:43:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb5889ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58419ce60 con 0x7fb584101060 2023-10-26T06:43:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb57bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584101060 0x7fb584199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb58259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5841006a0 0x7fb584198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb582d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb58419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb57bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584101060 0x7fb584199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:46758/0 (socket says 172.21.15.50:46758) 2023-10-26T06:43:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.442+0000 7fb57bfff700 1 -- 172.21.15.50:0/3407129630 learned_addr learned my addr 172.21.15.50:0/3407129630 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb582d9d700 1 -- 172.21.15.50:0/3407129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584101060 msgr2=0x7fb584199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb582d9d700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584101060 0x7fb584199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb582d9d700 1 -- 172.21.15.50:0/3407129630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5841006a0 msgr2=0x7fb584198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb582d9d700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5841006a0 0x7fb584198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb582d9d700 1 -- 172.21.15.50:0/3407129630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740095f0 con 0x7fb5841066b0 2023-10-26T06:43:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb582d9d700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb58419c530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00efc0 tx=0x7fb57c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c018070 con 0x7fb5841066b0 2023-10-26T06:43:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb57c00f040 con 0x7fb5841066b0 2023-10-26T06:43:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58419d0e0 con 0x7fb5841066b0 2023-10-26T06:43:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00cd40 con 0x7fb5841066b0 2023-10-26T06:43:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.443+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5841a5aa0 con 0x7fb5841066b0 2023-10-26T06:43:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.444+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb584101de0 con 0x7fb5841066b0 2023-10-26T06:43:36.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.446+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb57c003a00 con 0x7fb5841066b0 2023-10-26T06:43:36.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.448+0000 7fb57b7fe700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5700a1550 0x7fb5700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.448+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb57c0cc880 con 0x7fb5841066b0 2023-10-26T06:43:36.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.448+0000 7fb58259c700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5700a1550 0x7fb5700a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.449+0000 7fb58259c700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5700a1550 0x7fb5700a3a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b2e0 tx=0x7fb574005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:36.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.452+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb57c095f00 con 0x7fb5841066b0 2023-10-26T06:43:36.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.659+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb584110620 con 0x7fb5700a1550 2023-10-26T06:43:36.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.670+0000 7fb57b7fe700 1 -- 172.21.15.50:0/3407129630 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344779 (secure 0 0 0) 0x7fb584110620 con 0x7fb5700a1550 2023-10-26T06:43:36.676 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5700a1550 msgr2=0x7fb5700a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5700a1550 0x7fb5700a3a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b2e0 tx=0x7fb574005fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 msgr2=0x7fb58419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb58419c530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00efc0 tx=0x7fb57c00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 shutdown_connections 2023-10-26T06:43:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5700a1550 0x7fb5700a3a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5841066b0 0x7fb58419c530 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5841006a0 0x7fb584198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 --2- 172.21.15.50:0/3407129630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb584101060 0x7fb584199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 >> 172.21.15.50:0/3407129630 conn(0x7fb5840fc1d0 msgr2=0x7fb58410be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 shutdown_connections 2023-10-26T06:43:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.675+0000 7fb5889ff700 1 -- 172.21.15.50:0/3407129630 wait complete. 2023-10-26T06:43:36.681 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-10-26T06:43:36.695 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2023-10-26T06:43:35.654278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654796,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":865,"num_read_kb":550,"num_write":343,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":780,"ondisk_log_size":780,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337348,"kb_used_data":13156,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604476,"statfs":{"total":1151940427776,"available":1151594983424,"internally_reserved":0,"allocated":13471744,"data_stored":7506538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002833"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681407+0000","last_change":"2023-10-26T06:41:30.957489+0000","last_active":"2023-10-26T06:42:59.681407+0000","last_peered":"2023-10-26T06:42:59.681407+0000","last_clean":"2023-10-26T06:42:59.681407+0000","last_became_active":"2023-10-26T06:41:30.957197+0000","last_became_peered":"2023-10-26T06:41:30.957197+0000","last_unstale":"2023-10-26T06:42:59.681407+0000","last_undegraded":"2023-10-26T06:42:59.681407+0000","last_fullsized":"2023-10-26T06:42:59.681407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:59:16.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679637+0000","last_change":"2023-10-26T06:41:30.960542+0000","last_active":"2023-10-26T06:42:59.679637+0000","last_peered":"2023-10-26T06:42:59.679637+0000","last_clean":"2023-10-26T06:42:59.679637+0000","last_became_active":"2023-10-26T06:41:30.958325+0000","last_became_peered":"2023-10-26T06:41:30.958325+0000","last_unstale":"2023-10-26T06:42:59.679637+0000","last_undegraded":"2023-10-26T06:42:59.679637+0000","last_fullsized":"2023-10-26T06:42:59.679637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:41:15.958981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683490+0000","last_change":"2023-10-26T06:41:30.958575+0000","last_active":"2023-10-26T06:42:59.683490+0000","last_peered":"2023-10-26T06:42:59.683490+0000","last_clean":"2023-10-26T06:42:59.683490+0000","last_became_active":"2023-10-26T06:41:30.956636+0000","last_became_peered":"2023-10-26T06:41:30.956636+0000","last_unstale":"2023-10-26T06:42:59.683490+0000","last_undegraded":"2023-10-26T06:42:59.683490+0000","last_fullsized":"2023-10-26T06:42:59.683490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:59:57.232161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670012+0000","last_change":"2023-10-26T06:41:30.950626+0000","last_active":"2023-10-26T06:42:59.670012+0000","last_peered":"2023-10-26T06:42:59.670012+0000","last_clean":"2023-10-26T06:42:59.670012+0000","last_became_active":"2023-10-26T06:41:30.949918+0000","last_became_peered":"2023-10-26T06:41:30.949918+0000","last_unstale":"2023-10-26T06:42:59.670012+0000","last_undegraded":"2023-10-26T06:42:59.670012+0000","last_fullsized":"2023-10-26T06:42:59.670012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:49.839424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.665576+0000","last_change":"2023-10-26T06:41:30.958172+0000","last_active":"2023-10-26T06:42:59.665576+0000","last_peered":"2023-10-26T06:42:59.665576+0000","last_clean":"2023-10-26T06:42:59.665576+0000","last_became_active":"2023-10-26T06:41:30.957860+0000","last_became_peered":"2023-10-26T06:41:30.957860+0000","last_unstale":"2023-10-26T06:42:59.665576+0000","last_undegraded":"2023-10-26T06:42:59.665576+0000","last_fullsized":"2023-10-26T06:42:59.665576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:07:40.625361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675234+0000","last_change":"2023-10-26T06:41:30.947699+0000","last_active":"2023-10-26T06:42:59.675234+0000","last_peered":"2023-10-26T06:42:59.675234+0000","last_clean":"2023-10-26T06:42:59.675234+0000","last_became_active":"2023-10-26T06:41:30.947373+0000","last_became_peered":"2023-10-26T06:41:30.947373+0000","last_unstale":"2023-10-26T06:42:59.675234+0000","last_undegraded":"2023-10-26T06:42:59.675234+0000","last_fullsized":"2023-10-26T06:42:59.675234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:22:26.833505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674781+0000","last_change":"2023-10-26T06:41:30.950957+0000","last_active":"2023-10-26T06:42:59.674781+0000","last_peered":"2023-10-26T06:42:59.674781+0000","last_clean":"2023-10-26T06:42:59.674781+0000","last_became_active":"2023-10-26T06:41:30.950636+0000","last_became_peered":"2023-10-26T06:41:30.950636+0000","last_unstale":"2023-10-26T06:42:59.674781+0000","last_undegraded":"2023-10-26T06:42:59.674781+0000","last_fullsized":"2023-10-26T06:42:59.674781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:00.735773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675444+0000","last_change":"2023-10-26T06:41:30.952286+0000","last_active":"2023-10-26T06:42:59.675444+0000","last_peered":"2023-10-26T06:42:59.675444+0000","last_clean":"2023-10-26T06:42:59.675444+0000","last_became_active":"2023-10-26T06:41:30.951815+0000","last_became_peered":"2023-10-26T06:41:30.951815+0000","last_unstale":"2023-10-26T06:42:59.675444+0000","last_undegraded":"2023-10-26T06:42:59.675444+0000","last_fullsized":"2023-10-26T06:42:59.675444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:27:22.745891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677812+0000","last_change":"2023-10-26T06:41:30.945835+0000","last_active":"2023-10-26T06:42:59.677812+0000","last_peered":"2023-10-26T06:42:59.677812+0000","last_clean":"2023-10-26T06:42:59.677812+0000","last_became_active":"2023-10-26T06:41:30.945515+0000","last_became_peered":"2023-10-26T06:41:30.945515+0000","last_unstale":"2023-10-26T06:42:59.677812+0000","last_undegraded":"2023-10-26T06:42:59.677812+0000","last_fullsized":"2023-10-26T06:42:59.677812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:54:14.391140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676371+0000","last_change":"2023-10-26T06:41:30.951776+0000","last_active":"2023-10-26T06:42:59.676371+0000","last_peered":"2023-10-26T06:42:59.676371+0000","last_clean":"2023-10-26T06:42:59.676371+0000","last_became_active":"2023-10-26T06:41:30.951438+0000","last_became_peered":"2023-10-26T06:41:30.951438+0000","last_unstale":"2023-10-26T06:42:59.676371+0000","last_undegraded":"2023-10-26T06:42:59.676371+0000","last_fullsized":"2023-10-26T06:42:59.676371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:50:40.855899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683292+0000","last_change":"2023-10-26T06:41:30.951617+0000","last_active":"2023-10-26T06:42:59.683292+0000","last_peered":"2023-10-26T06:42:59.683292+0000","last_clean":"2023-10-26T06:42:59.683292+0000","last_became_active":"2023-10-26T06:41:30.951274+0000","last_became_peered":"2023-10-26T06:41:30.951274+0000","last_unstale":"2023-10-26T06:42:59.683292+0000","last_undegraded":"2023-10-26T06:42:59.683292+0000","last_fullsized":"2023-10-26T06:42:59.683292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:17:20.643833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679169+0000","last_change":"2023-10-26T06:41:30.950435+0000","last_active":"2023-10-26T06:42:59.679169+0000","last_peered":"2023-10-26T06:42:59.679169+0000","last_clean":"2023-10-26T06:42:59.679169+0000","last_became_active":"2023-10-26T06:41:30.949525+0000","last_became_peered":"2023-10-26T06:41:30.949525+0000","last_unstale":"2023-10-26T06:42:59.679169+0000","last_undegraded":"2023-10-26T06:42:59.679169+0000","last_fullsized":"2023-10-26T06:42:59.679169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:44:21.621741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674878+0000","last_change":"2023-10-26T06:41:30.956100+0000","last_active":"2023-10-26T06:42:59.674878+0000","last_peered":"2023-10-26T06:42:59.674878+0000","last_clean":"2023-10-26T06:42:59.674878+0000","last_became_active":"2023-10-26T06:41:30.955745+0000","last_became_peered":"2023-10-26T06:41:30.955745+0000","last_unstale":"2023-10-26T06:42:59.674878+0000","last_undegraded":"2023-10-26T06:42:59.674878+0000","last_fullsized":"2023-10-26T06:42:59.674878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:22:54.529373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678209+0000","last_change":"2023-10-26T06:41:30.958333+0000","last_active":"2023-10-26T06:42:59.678209+0000","last_peered":"2023-10-26T06:42:59.678209+0000","last_clean":"2023-10-26T06:42:59.678209+0000","last_became_active":"2023-10-26T06:41:30.957001+0000","last_became_peered":"2023-10-26T06:41:30.957001+0000","last_unstale":"2023-10-26T06:42:59.678209+0000","last_undegraded":"2023-10-26T06:42:59.678209+0000","last_fullsized":"2023-10-26T06:42:59.678209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:37.855333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679859+0000","last_change":"2023-10-26T06:41:30.956997+0000","last_active":"2023-10-26T06:42:59.679859+0000","last_peered":"2023-10-26T06:42:59.679859+0000","last_clean":"2023-10-26T06:42:59.679859+0000","last_became_active":"2023-10-26T06:41:30.956526+0000","last_became_peered":"2023-10-26T06:41:30.956526+0000","last_unstale":"2023-10-26T06:42:59.679859+0000","last_undegraded":"2023-10-26T06:42:59.679859+0000","last_fullsized":"2023-10-26T06:42:59.679859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:18:50.563423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681260+0000","last_change":"2023-10-26T06:41:30.957971+0000","last_active":"2023-10-26T06:42:59.681260+0000","last_peered":"2023-10-26T06:42:59.681260+0000","last_clean":"2023-10-26T06:42:59.681260+0000","last_became_active":"2023-10-26T06:41:30.957149+0000","last_became_peered":"2023-10-26T06:41:30.957149+0000","last_unstale":"2023-10-26T06:42:59.681260+0000","last_undegraded":"2023-10-26T06:42:59.681260+0000","last_fullsized":"2023-10-26T06:42:59.681260+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:03.587771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681584+0000","last_change":"2023-10-26T06:41:30.957427+0000","last_active":"2023-10-26T06:42:59.681584+0000","last_peered":"2023-10-26T06:42:59.681584+0000","last_clean":"2023-10-26T06:42:59.681584+0000","last_became_active":"2023-10-26T06:41:30.957123+0000","last_became_peered":"2023-10-26T06:41:30.957123+0000","last_unstale":"2023-10-26T06:42:59.681584+0000","last_undegraded":"2023-10-26T06:42:59.681584+0000","last_fullsized":"2023-10-26T06:42:59.681584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:31:43.538734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678043+0000","last_change":"2023-10-26T06:41:30.950926+0000","last_active":"2023-10-26T06:42:59.678043+0000","last_peered":"2023-10-26T06:42:59.678043+0000","last_clean":"2023-10-26T06:42:59.678043+0000","last_became_active":"2023-10-26T06:41:30.950507+0000","last_became_peered":"2023-10-26T06:41:30.950507+0000","last_unstale":"2023-10-26T06:42:59.678043+0000","last_undegraded":"2023-10-26T06:42:59.678043+0000","last_fullsized":"2023-10-26T06:42:59.678043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:21:52.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674053+0000","last_change":"2023-10-26T06:41:30.961220+0000","last_active":"2023-10-26T06:42:59.674053+0000","last_peered":"2023-10-26T06:42:59.674053+0000","last_clean":"2023-10-26T06:42:59.674053+0000","last_became_active":"2023-10-26T06:41:30.960944+0000","last_became_peered":"2023-10-26T06:41:30.960944+0000","last_unstale":"2023-10-26T06:42:59.674053+0000","last_undegraded":"2023-10-26T06:42:59.674053+0000","last_fullsized":"2023-10-26T06:42:59.674053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:52:09.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.701211+0000","last_change":"2023-10-26T06:41:29.957340+0000","last_active":"2023-10-26T06:42:29.701211+0000","last_peered":"2023-10-26T06:42:29.701211+0000","last_clean":"2023-10-26T06:42:29.701211+0000","last_became_active":"2023-10-26T06:41:29.956072+0000","last_became_peered":"2023-10-26T06:41:29.956072+0000","last_unstale":"2023-10-26T06:42:29.701211+0000","last_undegraded":"2023-10-26T06:42:29.701211+0000","last_fullsized":"2023-10-26T06:42:29.701211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:50:29.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675424+0000","last_change":"2023-10-26T06:41:30.950580+0000","last_active":"2023-10-26T06:42:59.675424+0000","last_peered":"2023-10-26T06:42:59.675424+0000","last_clean":"2023-10-26T06:42:59.675424+0000","last_became_active":"2023-10-26T06:41:30.950296+0000","last_became_peered":"2023-10-26T06:41:30.950296+0000","last_unstale":"2023-10-26T06:42:59.675424+0000","last_undegraded":"2023-10-26T06:42:59.675424+0000","last_fullsized":"2023-10-26T06:42:59.675424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:09:12.114518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.708496+0000","last_change":"2023-10-26T06:41:29.962939+0000","last_active":"2023-10-26T06:42:30.708496+0000","last_peered":"2023-10-26T06:42:30.708496+0000","last_clean":"2023-10-26T06:42:30.708496+0000","last_became_active":"2023-10-26T06:41:29.962609+0000","last_became_peered":"2023-10-26T06:41:29.962609+0000","last_unstale":"2023-10-26T06:42:30.708496+0000","last_undegraded":"2023-10-26T06:42:30.708496+0000","last_fullsized":"2023-10-26T06:42:30.708496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:26.865896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683632+0000","last_change":"2023-10-26T06:41:30.953683+0000","last_active":"2023-10-26T06:42:59.683632+0000","last_peered":"2023-10-26T06:42:59.683632+0000","last_clean":"2023-10-26T06:42:59.683632+0000","last_became_active":"2023-10-26T06:41:30.952953+0000","last_became_peered":"2023-10-26T06:41:30.952953+0000","last_unstale":"2023-10-26T06:42:59.683632+0000","last_undegraded":"2023-10-26T06:42:59.683632+0000","last_fullsized":"2023-10-26T06:42:59.683632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:05:44.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704769+0000","last_change":"2023-10-26T06:41:29.963045+0000","last_active":"2023-10-26T06:42:29.704769+0000","last_peered":"2023-10-26T06:42:29.704769+0000","last_clean":"2023-10-26T06:42:29.704769+0000","last_became_active":"2023-10-26T06:41:29.962696+0000","last_became_peered":"2023-10-26T06:41:29.962696+0000","last_unstale":"2023-10-26T06:42:29.704769+0000","last_undegraded":"2023-10-26T06:42:29.704769+0000","last_fullsized":"2023-10-26T06:42:29.704769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:05:27.607036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682510+0000","last_change":"2023-10-26T06:41:30.955072+0000","last_active":"2023-10-26T06:42:59.682510+0000","last_peered":"2023-10-26T06:42:59.682510+0000","last_clean":"2023-10-26T06:42:59.682510+0000","last_became_active":"2023-10-26T06:41:30.954796+0000","last_became_peered":"2023-10-26T06:41:30.954796+0000","last_unstale":"2023-10-26T06:42:59.682510+0000","last_undegraded":"2023-10-26T06:42:59.682510+0000","last_fullsized":"2023-10-26T06:42:59.682510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:55:35.095774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704515+0000","last_change":"2023-10-26T06:41:29.960876+0000","last_active":"2023-10-26T06:42:29.704515+0000","last_peered":"2023-10-26T06:42:29.704515+0000","last_clean":"2023-10-26T06:42:29.704515+0000","last_became_active":"2023-10-26T06:41:29.960435+0000","last_became_peered":"2023-10-26T06:41:29.960435+0000","last_unstale":"2023-10-26T06:42:29.704515+0000","last_undegraded":"2023-10-26T06:42:29.704515+0000","last_fullsized":"2023-10-26T06:42:29.704515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:41.107772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680895+0000","last_change":"2023-10-26T06:41:30.951269+0000","last_active":"2023-10-26T06:42:59.680895+0000","last_peered":"2023-10-26T06:42:59.680895+0000","last_clean":"2023-10-26T06:42:59.680895+0000","last_became_active":"2023-10-26T06:41:30.950917+0000","last_became_peered":"2023-10-26T06:41:30.950917+0000","last_unstale":"2023-10-26T06:42:59.680895+0000","last_undegraded":"2023-10-26T06:42:59.680895+0000","last_fullsized":"2023-10-26T06:42:59.680895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:25:05.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:30.169890+0000","last_change":"2023-10-26T06:41:29.962378+0000","last_active":"2023-10-26T06:43:30.169890+0000","last_peered":"2023-10-26T06:43:30.169890+0000","last_clean":"2023-10-26T06:43:30.169890+0000","last_became_active":"2023-10-26T06:41:29.962083+0000","last_became_peered":"2023-10-26T06:41:29.962083+0000","last_unstale":"2023-10-26T06:43:30.169890+0000","last_undegraded":"2023-10-26T06:43:30.169890+0000","last_fullsized":"2023-10-26T06:43:30.169890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:27.856946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":938,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.666937+0000","last_change":"2023-10-26T06:41:30.951126+0000","last_active":"2023-10-26T06:42:59.666937+0000","last_peered":"2023-10-26T06:42:59.666937+0000","last_clean":"2023-10-26T06:42:59.666937+0000","last_became_active":"2023-10-26T06:41:30.949852+0000","last_became_peered":"2023-10-26T06:41:30.949852+0000","last_unstale":"2023-10-26T06:42:59.666937+0000","last_undegraded":"2023-10-26T06:42:59.666937+0000","last_fullsized":"2023-10-26T06:42:59.666937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:55:00.465064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698424+0000","last_change":"2023-10-26T06:41:29.963066+0000","last_active":"2023-10-26T06:42:29.698424+0000","last_peered":"2023-10-26T06:42:29.698424+0000","last_clean":"2023-10-26T06:42:29.698424+0000","last_became_active":"2023-10-26T06:41:29.962676+0000","last_became_peered":"2023-10-26T06:41:29.962676+0000","last_unstale":"2023-10-26T06:42:29.698424+0000","last_undegraded":"2023-10-26T06:42:29.698424+0000","last_fullsized":"2023-10-26T06:42:29.698424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:58:34.355112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679061+0000","last_change":"2023-10-26T06:41:30.959950+0000","last_active":"2023-10-26T06:42:59.679061+0000","last_peered":"2023-10-26T06:42:59.679061+0000","last_clean":"2023-10-26T06:42:59.679061+0000","last_became_active":"2023-10-26T06:41:30.959599+0000","last_became_peered":"2023-10-26T06:41:30.959599+0000","last_unstale":"2023-10-26T06:42:59.679061+0000","last_undegraded":"2023-10-26T06:42:59.679061+0000","last_fullsized":"2023-10-26T06:42:59.679061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:56:52.737385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706715+0000","last_change":"2023-10-26T06:41:29.953913+0000","last_active":"2023-10-26T06:42:29.706715+0000","last_peered":"2023-10-26T06:42:29.706715+0000","last_clean":"2023-10-26T06:42:29.706715+0000","last_became_active":"2023-10-26T06:41:29.953539+0000","last_became_peered":"2023-10-26T06:41:29.953539+0000","last_unstale":"2023-10-26T06:42:29.706715+0000","last_undegraded":"2023-10-26T06:42:29.706715+0000","last_fullsized":"2023-10-26T06:42:29.706715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:13:31.816249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670469+0000","last_change":"2023-10-26T06:41:30.947242+0000","last_active":"2023-10-26T06:42:59.670469+0000","last_peered":"2023-10-26T06:42:59.670469+0000","last_clean":"2023-10-26T06:42:59.670469+0000","last_became_active":"2023-10-26T06:41:30.946927+0000","last_became_peered":"2023-10-26T06:41:30.946927+0000","last_unstale":"2023-10-26T06:42:59.670469+0000","last_undegraded":"2023-10-26T06:42:59.670469+0000","last_fullsized":"2023-10-26T06:42:59.670469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:52:49.818399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699672+0000","last_change":"2023-10-26T06:41:29.961403+0000","last_active":"2023-10-26T06:42:29.699672+0000","last_peered":"2023-10-26T06:42:29.699672+0000","last_clean":"2023-10-26T06:42:29.699672+0000","last_became_active":"2023-10-26T06:41:29.961093+0000","last_became_peered":"2023-10-26T06:41:29.961093+0000","last_unstale":"2023-10-26T06:42:29.699672+0000","last_undegraded":"2023-10-26T06:42:29.699672+0000","last_fullsized":"2023-10-26T06:42:29.699672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:54:45.822091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670726+0000","last_change":"2023-10-26T06:41:30.948375+0000","last_active":"2023-10-26T06:42:59.670726+0000","last_peered":"2023-10-26T06:42:59.670726+0000","last_clean":"2023-10-26T06:42:59.670726+0000","last_became_active":"2023-10-26T06:41:30.947915+0000","last_became_peered":"2023-10-26T06:41:30.947915+0000","last_unstale":"2023-10-26T06:42:59.670726+0000","last_undegraded":"2023-10-26T06:42:59.670726+0000","last_fullsized":"2023-10-26T06:42:59.670726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:14:30.572714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":136,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:31.170757+0000","last_change":"2023-10-26T06:41:29.959945+0000","last_active":"2023-10-26T06:43:31.170757+0000","last_peered":"2023-10-26T06:43:31.170757+0000","last_clean":"2023-10-26T06:43:31.170757+0000","last_became_active":"2023-10-26T06:41:29.959635+0000","last_became_peered":"2023-10-26T06:41:29.959635+0000","last_unstale":"2023-10-26T06:43:31.170757+0000","last_undegraded":"2023-10-26T06:43:31.170757+0000","last_fullsized":"2023-10-26T06:43:31.170757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:29:35.257109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680606+0000","last_change":"2023-10-26T06:41:30.953306+0000","last_active":"2023-10-26T06:42:59.680606+0000","last_peered":"2023-10-26T06:42:59.680606+0000","last_clean":"2023-10-26T06:42:59.680606+0000","last_became_active":"2023-10-26T06:41:30.953057+0000","last_became_peered":"2023-10-26T06:41:30.953057+0000","last_unstale":"2023-10-26T06:42:59.680606+0000","last_undegraded":"2023-10-26T06:42:59.680606+0000","last_fullsized":"2023-10-26T06:42:59.680606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:14:29.588579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.947188+0000","last_change":"2023-10-26T06:41:29.956267+0000","last_active":"2023-10-26T06:42:29.947188+0000","last_peered":"2023-10-26T06:42:29.947188+0000","last_clean":"2023-10-26T06:42:29.947188+0000","last_became_active":"2023-10-26T06:41:29.955754+0000","last_became_peered":"2023-10-26T06:41:29.955754+0000","last_unstale":"2023-10-26T06:42:29.947188+0000","last_undegraded":"2023-10-26T06:42:29.947188+0000","last_fullsized":"2023-10-26T06:42:29.947188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:17:45.406626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681798+0000","last_change":"2023-10-26T06:41:30.959069+0000","last_active":"2023-10-26T06:42:59.681798+0000","last_peered":"2023-10-26T06:42:59.681798+0000","last_clean":"2023-10-26T06:42:59.681798+0000","last_became_active":"2023-10-26T06:41:30.958521+0000","last_became_peered":"2023-10-26T06:41:30.958521+0000","last_unstale":"2023-10-26T06:42:59.681798+0000","last_undegraded":"2023-10-26T06:42:59.681798+0000","last_fullsized":"2023-10-26T06:42:59.681798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:53.128025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699839+0000","last_change":"2023-10-26T06:41:29.965311+0000","last_active":"2023-10-26T06:42:29.699839+0000","last_peered":"2023-10-26T06:42:29.699839+0000","last_clean":"2023-10-26T06:42:29.699839+0000","last_became_active":"2023-10-26T06:41:29.964821+0000","last_became_peered":"2023-10-26T06:41:29.964821+0000","last_unstale":"2023-10-26T06:42:29.699839+0000","last_undegraded":"2023-10-26T06:42:29.699839+0000","last_fullsized":"2023-10-26T06:42:29.699839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:30:49.451302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.684240+0000","last_change":"2023-10-26T06:41:30.951123+0000","last_active":"2023-10-26T06:42:59.684240+0000","last_peered":"2023-10-26T06:42:59.684240+0000","last_clean":"2023-10-26T06:42:59.684240+0000","last_became_active":"2023-10-26T06:41:30.950830+0000","last_became_peered":"2023-10-26T06:41:30.950830+0000","last_unstale":"2023-10-26T06:42:59.684240+0000","last_undegraded":"2023-10-26T06:42:59.684240+0000","last_fullsized":"2023-10-26T06:42:59.684240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:11:17.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":291,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:32.172697+0000","last_change":"2023-10-26T06:41:29.962988+0000","last_active":"2023-10-26T06:43:32.172697+0000","last_peered":"2023-10-26T06:43:32.172697+0000","last_clean":"2023-10-26T06:43:32.172697+0000","last_became_active":"2023-10-26T06:41:29.962602+0000","last_became_peered":"2023-10-26T06:41:29.962602+0000","last_unstale":"2023-10-26T06:43:32.172697+0000","last_undegraded":"2023-10-26T06:43:32.172697+0000","last_fullsized":"2023-10-26T06:43:32.172697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:46:36.027228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59725,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":244,"num_read_kb":180,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.659585+0000","last_change":"2023-10-26T06:41:30.949632+0000","last_active":"2023-10-26T06:42:59.659585+0000","last_peered":"2023-10-26T06:42:59.659585+0000","last_clean":"2023-10-26T06:42:59.659585+0000","last_became_active":"2023-10-26T06:41:30.949347+0000","last_became_peered":"2023-10-26T06:41:30.949347+0000","last_unstale":"2023-10-26T06:42:59.659585+0000","last_undegraded":"2023-10-26T06:42:59.659585+0000","last_fullsized":"2023-10-26T06:42:59.659585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:05:04.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705196+0000","last_change":"2023-10-26T06:41:29.957719+0000","last_active":"2023-10-26T06:42:29.705196+0000","last_peered":"2023-10-26T06:42:29.705196+0000","last_clean":"2023-10-26T06:42:29.705196+0000","last_became_active":"2023-10-26T06:41:29.957339+0000","last_became_peered":"2023-10-26T06:41:29.957339+0000","last_unstale":"2023-10-26T06:42:29.705196+0000","last_undegraded":"2023-10-26T06:42:29.705196+0000","last_fullsized":"2023-10-26T06:42:29.705196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:16:33.049350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.675892+0000","last_change":"2023-10-26T06:41:30.960299+0000","last_active":"2023-10-26T06:42:59.675892+0000","last_peered":"2023-10-26T06:42:59.675892+0000","last_clean":"2023-10-26T06:42:59.675892+0000","last_became_active":"2023-10-26T06:41:30.959884+0000","last_became_peered":"2023-10-26T06:41:30.959884+0000","last_unstale":"2023-10-26T06:42:59.675892+0000","last_undegraded":"2023-10-26T06:42:59.675892+0000","last_fullsized":"2023-10-26T06:42:59.675892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:40.885221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699304+0000","last_change":"2023-10-26T06:41:29.963695+0000","last_active":"2023-10-26T06:42:29.699304+0000","last_peered":"2023-10-26T06:42:29.699304+0000","last_clean":"2023-10-26T06:42:29.699304+0000","last_became_active":"2023-10-26T06:41:29.963318+0000","last_became_peered":"2023-10-26T06:41:29.963318+0000","last_unstale":"2023-10-26T06:42:29.699304+0000","last_undegraded":"2023-10-26T06:42:29.699304+0000","last_fullsized":"2023-10-26T06:42:29.699304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:37.717222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676366+0000","last_change":"2023-10-26T06:41:30.960329+0000","last_active":"2023-10-26T06:42:59.676366+0000","last_peered":"2023-10-26T06:42:59.676366+0000","last_clean":"2023-10-26T06:42:59.676366+0000","last_became_active":"2023-10-26T06:41:30.959199+0000","last_became_peered":"2023-10-26T06:41:30.959199+0000","last_unstale":"2023-10-26T06:42:59.676366+0000","last_undegraded":"2023-10-26T06:42:59.676366+0000","last_fullsized":"2023-10-26T06:42:59.676366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:45:39.868505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":143,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:33.182703+0000","last_change":"2023-10-26T06:41:29.951768+0000","last_active":"2023-10-26T06:43:33.182703+0000","last_peered":"2023-10-26T06:43:33.182703+0000","last_clean":"2023-10-26T06:43:33.182703+0000","last_became_active":"2023-10-26T06:41:29.951396+0000","last_became_peered":"2023-10-26T06:41:29.951396+0000","last_unstale":"2023-10-26T06:43:33.182703+0000","last_undegraded":"2023-10-26T06:43:33.182703+0000","last_fullsized":"2023-10-26T06:43:33.182703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:09:24.072263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674567+0000","last_change":"2023-10-26T06:41:30.945503+0000","last_active":"2023-10-26T06:42:59.674567+0000","last_peered":"2023-10-26T06:42:59.674567+0000","last_clean":"2023-10-26T06:42:59.674567+0000","last_became_active":"2023-10-26T06:41:30.945211+0000","last_became_peered":"2023-10-26T06:41:30.945211+0000","last_unstale":"2023-10-26T06:42:59.674567+0000","last_undegraded":"2023-10-26T06:42:59.674567+0000","last_fullsized":"2023-10-26T06:42:59.674567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:02:52.754605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703869+0000","last_change":"2023-10-26T06:41:29.963001+0000","last_active":"2023-10-26T06:42:29.703869+0000","last_peered":"2023-10-26T06:42:29.703869+0000","last_clean":"2023-10-26T06:42:29.703869+0000","last_became_active":"2023-10-26T06:41:29.961355+0000","last_became_peered":"2023-10-26T06:41:29.961355+0000","last_unstale":"2023-10-26T06:42:29.703869+0000","last_undegraded":"2023-10-26T06:42:29.703869+0000","last_fullsized":"2023-10-26T06:42:29.703869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:02:17.694462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680375+0000","last_change":"2023-10-26T06:41:30.951298+0000","last_active":"2023-10-26T06:42:59.680375+0000","last_peered":"2023-10-26T06:42:59.680375+0000","last_clean":"2023-10-26T06:42:59.680375+0000","last_became_active":"2023-10-26T06:41:30.950953+0000","last_became_peered":"2023-10-26T06:41:30.950953+0000","last_unstale":"2023-10-26T06:42:59.680375+0000","last_undegraded":"2023-10-26T06:42:59.680375+0000","last_fullsized":"2023-10-26T06:42:59.680375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:22:50.660225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.714855+0000","last_change":"2023-10-26T06:42:30.714354+0000","last_active":"2023-10-26T06:42:30.714855+0000","last_peered":"2023-10-26T06:42:30.714855+0000","last_clean":"2023-10-26T06:42:30.714855+0000","last_became_active":"2023-10-26T06:42:30.709396+0000","last_became_peered":"2023-10-26T06:42:30.709396+0000","last_unstale":"2023-10-26T06:42:30.714855+0000","last_undegraded":"2023-10-26T06:42:30.714855+0000","last_fullsized":"2023-10-26T06:42:30.714855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:04:20.594879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679151+0000","last_change":"2023-10-26T06:41:30.946265+0000","last_active":"2023-10-26T06:42:59.679151+0000","last_peered":"2023-10-26T06:42:59.679151+0000","last_clean":"2023-10-26T06:42:59.679151+0000","last_became_active":"2023-10-26T06:41:30.945961+0000","last_became_peered":"2023-10-26T06:41:30.945961+0000","last_unstale":"2023-10-26T06:42:59.679151+0000","last_undegraded":"2023-10-26T06:42:59.679151+0000","last_fullsized":"2023-10-26T06:42:59.679151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:28:28.948903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.700656+0000","last_change":"2023-10-26T06:41:29.962849+0000","last_active":"2023-10-26T06:42:29.700656+0000","last_peered":"2023-10-26T06:42:29.700656+0000","last_clean":"2023-10-26T06:42:29.700656+0000","last_became_active":"2023-10-26T06:41:29.961777+0000","last_became_peered":"2023-10-26T06:41:29.961777+0000","last_unstale":"2023-10-26T06:42:29.700656+0000","last_undegraded":"2023-10-26T06:42:29.700656+0000","last_fullsized":"2023-10-26T06:42:29.700656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:00:12.896551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677816+0000","last_change":"2023-10-26T06:41:30.963676+0000","last_active":"2023-10-26T06:42:59.677816+0000","last_peered":"2023-10-26T06:42:59.677816+0000","last_clean":"2023-10-26T06:42:59.677816+0000","last_became_active":"2023-10-26T06:41:30.963264+0000","last_became_peered":"2023-10-26T06:41:30.963264+0000","last_unstale":"2023-10-26T06:42:59.677816+0000","last_undegraded":"2023-10-26T06:42:59.677816+0000","last_fullsized":"2023-10-26T06:42:59.677816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:03:01.211120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.946991+0000","last_change":"2023-10-26T06:41:29.953897+0000","last_active":"2023-10-26T06:42:29.946991+0000","last_peered":"2023-10-26T06:42:29.946991+0000","last_clean":"2023-10-26T06:42:29.946991+0000","last_became_active":"2023-10-26T06:41:29.953571+0000","last_became_peered":"2023-10-26T06:41:29.953571+0000","last_unstale":"2023-10-26T06:42:29.946991+0000","last_undegraded":"2023-10-26T06:42:29.946991+0000","last_fullsized":"2023-10-26T06:42:29.946991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T17:12:54.136409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.676992+0000","last_change":"2023-10-26T06:41:30.961259+0000","last_active":"2023-10-26T06:42:59.676992+0000","last_peered":"2023-10-26T06:42:59.676992+0000","last_clean":"2023-10-26T06:42:59.676992+0000","last_became_active":"2023-10-26T06:41:30.960564+0000","last_became_peered":"2023-10-26T06:41:30.960564+0000","last_unstale":"2023-10-26T06:42:59.676992+0000","last_undegraded":"2023-10-26T06:42:59.676992+0000","last_fullsized":"2023-10-26T06:42:59.676992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:25:32.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679172+0000","last_change":"2023-10-26T06:41:30.949301+0000","last_active":"2023-10-26T06:42:59.679172+0000","last_peered":"2023-10-26T06:42:59.679172+0000","last_clean":"2023-10-26T06:42:59.679172+0000","last_became_active":"2023-10-26T06:41:30.948985+0000","last_became_peered":"2023-10-26T06:41:30.948985+0000","last_unstale":"2023-10-26T06:42:59.679172+0000","last_undegraded":"2023-10-26T06:42:59.679172+0000","last_fullsized":"2023-10-26T06:42:59.679172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:27:28.920739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":135,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:43:29.175762+0000","last_change":"2023-10-26T06:41:29.965146+0000","last_active":"2023-10-26T06:43:29.175762+0000","last_peered":"2023-10-26T06:43:29.175762+0000","last_clean":"2023-10-26T06:43:29.175762+0000","last_became_active":"2023-10-26T06:41:29.963295+0000","last_became_peered":"2023-10-26T06:41:29.963295+0000","last_unstale":"2023-10-26T06:43:29.175762+0000","last_undegraded":"2023-10-26T06:43:29.175762+0000","last_fullsized":"2023-10-26T06:43:29.175762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:34:32.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680667+0000","last_change":"2023-10-26T06:42:30.709009+0000","last_active":"2023-10-26T06:42:59.680667+0000","last_peered":"2023-10-26T06:42:59.680667+0000","last_clean":"2023-10-26T06:42:59.680667+0000","last_became_active":"2023-10-26T06:42:30.708638+0000","last_became_peered":"2023-10-26T06:42:30.708638+0000","last_unstale":"2023-10-26T06:42:59.680667+0000","last_undegraded":"2023-10-26T06:42:59.680667+0000","last_fullsized":"2023-10-26T06:42:59.680667+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:53:48.634576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.706370+0000","last_change":"2023-10-26T06:41:29.952363+0000","last_active":"2023-10-26T06:42:30.706370+0000","last_peered":"2023-10-26T06:42:30.706370+0000","last_clean":"2023-10-26T06:42:30.706370+0000","last_became_active":"2023-10-26T06:41:29.951490+0000","last_became_peered":"2023-10-26T06:41:29.951490+0000","last_unstale":"2023-10-26T06:42:30.706370+0000","last_undegraded":"2023-10-26T06:42:30.706370+0000","last_fullsized":"2023-10-26T06:42:30.706370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:00:23.481092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.179608+0000","last_change":"2023-10-26T06:40:25.240423+0000","last_active":"2023-10-26T06:42:31.179608+0000","last_peered":"2023-10-26T06:42:31.179608+0000","last_clean":"2023-10-26T06:42:31.179608+0000","last_became_active":"2023-10-26T06:40:25.239995+0000","last_became_peered":"2023-10-26T06:40:25.239995+0000","last_unstale":"2023-10-26T06:42:31.179608+0000","last_undegraded":"2023-10-26T06:42:31.179608+0000","last_fullsized":"2023-10-26T06:42:31.179608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:37:16.154598+0000","last_clean_scrub_stamp":"2023-10-26T06:37:16.154598+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:53:32.330280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.664946+0000","last_change":"2023-10-26T06:42:30.706066+0000","last_active":"2023-10-26T06:42:59.664946+0000","last_peered":"2023-10-26T06:42:59.664946+0000","last_clean":"2023-10-26T06:42:59.664946+0000","last_became_active":"2023-10-26T06:42:30.705682+0000","last_became_peered":"2023-10-26T06:42:30.705682+0000","last_unstale":"2023-10-26T06:42:59.664946+0000","last_undegraded":"2023-10-26T06:42:59.664946+0000","last_fullsized":"2023-10-26T06:42:59.664946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:40:13.366566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:31.179688+0000","last_change":"2023-10-26T06:41:29.958178+0000","last_active":"2023-10-26T06:42:31.179688+0000","last_peered":"2023-10-26T06:42:31.179688+0000","last_clean":"2023-10-26T06:42:31.179688+0000","last_became_active":"2023-10-26T06:41:29.957833+0000","last_became_peered":"2023-10-26T06:41:29.957833+0000","last_unstale":"2023-10-26T06:42:31.179688+0000","last_undegraded":"2023-10-26T06:42:31.179688+0000","last_fullsized":"2023-10-26T06:42:31.179688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:34:01.582308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704685+0000","last_change":"2023-10-26T06:41:29.960653+0000","last_active":"2023-10-26T06:42:29.704685+0000","last_peered":"2023-10-26T06:42:29.704685+0000","last_clean":"2023-10-26T06:42:29.704685+0000","last_became_active":"2023-10-26T06:41:29.960240+0000","last_became_peered":"2023-10-26T06:41:29.960240+0000","last_unstale":"2023-10-26T06:42:29.704685+0000","last_undegraded":"2023-10-26T06:42:29.704685+0000","last_fullsized":"2023-10-26T06:42:29.704685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:06:24.204488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.670286+0000","last_change":"2023-10-26T06:41:30.954270+0000","last_active":"2023-10-26T06:42:59.670286+0000","last_peered":"2023-10-26T06:42:59.670286+0000","last_clean":"2023-10-26T06:42:59.670286+0000","last_became_active":"2023-10-26T06:41:30.953951+0000","last_became_peered":"2023-10-26T06:41:30.953951+0000","last_unstale":"2023-10-26T06:42:59.670286+0000","last_undegraded":"2023-10-26T06:42:59.670286+0000","last_fullsized":"2023-10-26T06:42:59.670286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:38:07.019930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.702331+0000","last_change":"2023-10-26T06:41:29.959287+0000","last_active":"2023-10-26T06:42:30.702331+0000","last_peered":"2023-10-26T06:42:30.702331+0000","last_clean":"2023-10-26T06:42:30.702331+0000","last_became_active":"2023-10-26T06:41:29.957536+0000","last_became_peered":"2023-10-26T06:41:29.957536+0000","last_unstale":"2023-10-26T06:42:30.702331+0000","last_undegraded":"2023-10-26T06:42:30.702331+0000","last_fullsized":"2023-10-26T06:42:30.702331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:08:27.189469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.671656+0000","last_change":"2023-10-26T06:41:30.946994+0000","last_active":"2023-10-26T06:42:59.671656+0000","last_peered":"2023-10-26T06:42:59.671656+0000","last_clean":"2023-10-26T06:42:59.671656+0000","last_became_active":"2023-10-26T06:41:30.946602+0000","last_became_peered":"2023-10-26T06:41:30.946602+0000","last_unstale":"2023-10-26T06:42:59.671656+0000","last_undegraded":"2023-10-26T06:42:59.671656+0000","last_fullsized":"2023-10-26T06:42:59.671656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:09:35.910675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704776+0000","last_change":"2023-10-26T06:41:29.957738+0000","last_active":"2023-10-26T06:42:29.704776+0000","last_peered":"2023-10-26T06:42:29.704776+0000","last_clean":"2023-10-26T06:42:29.704776+0000","last_became_active":"2023-10-26T06:41:29.956792+0000","last_became_peered":"2023-10-26T06:41:29.956792+0000","last_unstale":"2023-10-26T06:42:29.704776+0000","last_undegraded":"2023-10-26T06:42:29.704776+0000","last_fullsized":"2023-10-26T06:42:29.704776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T18:22:19.732042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.681857+0000","last_change":"2023-10-26T06:41:30.958652+0000","last_active":"2023-10-26T06:42:59.681857+0000","last_peered":"2023-10-26T06:42:59.681857+0000","last_clean":"2023-10-26T06:42:59.681857+0000","last_became_active":"2023-10-26T06:41:30.958136+0000","last_became_peered":"2023-10-26T06:41:30.958136+0000","last_unstale":"2023-10-26T06:42:59.681857+0000","last_undegraded":"2023-10-26T06:42:59.681857+0000","last_fullsized":"2023-10-26T06:42:59.681857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:06.324540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.703873+0000","last_change":"2023-10-26T06:41:29.955888+0000","last_active":"2023-10-26T06:42:29.703873+0000","last_peered":"2023-10-26T06:42:29.703873+0000","last_clean":"2023-10-26T06:42:29.703873+0000","last_became_active":"2023-10-26T06:41:29.955165+0000","last_became_peered":"2023-10-26T06:41:29.955165+0000","last_unstale":"2023-10-26T06:42:29.703873+0000","last_undegraded":"2023-10-26T06:42:29.703873+0000","last_fullsized":"2023-10-26T06:42:29.703873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:55:48.934169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.654116+0000","last_change":"2023-10-26T06:41:30.948943+0000","last_active":"2023-10-26T06:42:59.654116+0000","last_peered":"2023-10-26T06:42:59.654116+0000","last_clean":"2023-10-26T06:42:59.654116+0000","last_became_active":"2023-10-26T06:41:30.948612+0000","last_became_peered":"2023-10-26T06:41:30.948612+0000","last_unstale":"2023-10-26T06:42:59.654116+0000","last_undegraded":"2023-10-26T06:42:59.654116+0000","last_fullsized":"2023-10-26T06:42:59.654116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:30.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.698478+0000","last_change":"2023-10-26T06:41:29.952916+0000","last_active":"2023-10-26T06:42:29.698478+0000","last_peered":"2023-10-26T06:42:29.698478+0000","last_clean":"2023-10-26T06:42:29.698478+0000","last_became_active":"2023-10-26T06:41:29.952508+0000","last_became_peered":"2023-10-26T06:41:29.952508+0000","last_unstale":"2023-10-26T06:42:29.698478+0000","last_undegraded":"2023-10-26T06:42:29.698478+0000","last_fullsized":"2023-10-26T06:42:29.698478+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:02:46.239946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.673792+0000","last_change":"2023-10-26T06:41:30.957444+0000","last_active":"2023-10-26T06:42:59.673792+0000","last_peered":"2023-10-26T06:42:59.673792+0000","last_clean":"2023-10-26T06:42:59.673792+0000","last_became_active":"2023-10-26T06:41:30.957124+0000","last_became_peered":"2023-10-26T06:41:30.957124+0000","last_unstale":"2023-10-26T06:42:59.673792+0000","last_undegraded":"2023-10-26T06:42:59.673792+0000","last_fullsized":"2023-10-26T06:42:59.673792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:48:51.171905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:30.717232+0000","last_change":"2023-10-26T06:42:30.716756+0000","last_active":"2023-10-26T06:42:30.717232+0000","last_peered":"2023-10-26T06:42:30.717232+0000","last_clean":"2023-10-26T06:42:30.717232+0000","last_became_active":"2023-10-26T06:42:30.709797+0000","last_became_peered":"2023-10-26T06:42:30.709797+0000","last_unstale":"2023-10-26T06:42:30.717232+0000","last_undegraded":"2023-10-26T06:42:30.717232+0000","last_fullsized":"2023-10-26T06:42:30.717232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:54.345261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683233+0000","last_change":"2023-10-26T06:41:30.961174+0000","last_active":"2023-10-26T06:42:59.683233+0000","last_peered":"2023-10-26T06:42:59.683233+0000","last_clean":"2023-10-26T06:42:59.683233+0000","last_became_active":"2023-10-26T06:41:30.960717+0000","last_became_peered":"2023-10-26T06:41:30.960717+0000","last_unstale":"2023-10-26T06:42:59.683233+0000","last_undegraded":"2023-10-26T06:42:59.683233+0000","last_fullsized":"2023-10-26T06:42:59.683233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T12:58:11.447930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.704002+0000","last_change":"2023-10-26T06:41:29.962007+0000","last_active":"2023-10-26T06:42:29.704002+0000","last_peered":"2023-10-26T06:42:29.704002+0000","last_clean":"2023-10-26T06:42:29.704002+0000","last_became_active":"2023-10-26T06:41:29.961453+0000","last_became_peered":"2023-10-26T06:41:29.961453+0000","last_unstale":"2023-10-26T06:42:29.704002+0000","last_undegraded":"2023-10-26T06:42:29.704002+0000","last_fullsized":"2023-10-26T06:42:29.704002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:13:38.061932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683749+0000","last_change":"2023-10-26T06:41:30.962567+0000","last_active":"2023-10-26T06:42:59.683749+0000","last_peered":"2023-10-26T06:42:59.683749+0000","last_clean":"2023-10-26T06:42:59.683749+0000","last_became_active":"2023-10-26T06:41:30.962078+0000","last_became_peered":"2023-10-26T06:41:30.962078+0000","last_unstale":"2023-10-26T06:42:59.683749+0000","last_undegraded":"2023-10-26T06:42:59.683749+0000","last_fullsized":"2023-10-26T06:42:59.683749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:41:10.903260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.705370+0000","last_change":"2023-10-26T06:41:29.963229+0000","last_active":"2023-10-26T06:42:29.705370+0000","last_peered":"2023-10-26T06:42:29.705370+0000","last_clean":"2023-10-26T06:42:29.705370+0000","last_became_active":"2023-10-26T06:41:29.962906+0000","last_became_peered":"2023-10-26T06:41:29.962906+0000","last_unstale":"2023-10-26T06:42:29.705370+0000","last_undegraded":"2023-10-26T06:42:29.705370+0000","last_fullsized":"2023-10-26T06:42:29.705370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:48:12.812555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683429+0000","last_change":"2023-10-26T06:41:30.950025+0000","last_active":"2023-10-26T06:42:59.683429+0000","last_peered":"2023-10-26T06:42:59.683429+0000","last_clean":"2023-10-26T06:42:59.683429+0000","last_became_active":"2023-10-26T06:41:30.948060+0000","last_became_peered":"2023-10-26T06:41:30.948060+0000","last_unstale":"2023-10-26T06:42:59.683429+0000","last_undegraded":"2023-10-26T06:42:59.683429+0000","last_fullsized":"2023-10-26T06:42:59.683429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:51:27.402005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.699564+0000","last_change":"2023-10-26T06:41:29.964662+0000","last_active":"2023-10-26T06:42:29.699564+0000","last_peered":"2023-10-26T06:42:29.699564+0000","last_clean":"2023-10-26T06:42:29.699564+0000","last_became_active":"2023-10-26T06:41:29.964266+0000","last_became_peered":"2023-10-26T06:41:29.964266+0000","last_unstale":"2023-10-26T06:42:29.699564+0000","last_undegraded":"2023-10-26T06:42:29.699564+0000","last_fullsized":"2023-10-26T06:42:29.699564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:37:56.330712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.679441+0000","last_change":"2023-10-26T06:41:30.960094+0000","last_active":"2023-10-26T06:42:59.679441+0000","last_peered":"2023-10-26T06:42:59.679441+0000","last_clean":"2023-10-26T06:42:59.679441+0000","last_became_active":"2023-10-26T06:41:30.959785+0000","last_became_peered":"2023-10-26T06:41:30.959785+0000","last_unstale":"2023-10-26T06:42:59.679441+0000","last_undegraded":"2023-10-26T06:42:59.679441+0000","last_fullsized":"2023-10-26T06:42:59.679441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:48:01.727516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-26T06:42:29.706318+0000","last_change":"2023-10-26T06:41:29.964878+0000","last_active":"2023-10-26T06:42:29.706318+0000","last_peered":"2023-10-26T06:42:29.706318+0000","last_clean":"2023-10-26T06:42:29.706318+0000","last_became_active":"2023-10-26T06:41:29.963812+0000","last_became_peered":"2023-10-26T06:41:29.963812+0000","last_unstale":"2023-10-26T06:42:29.706318+0000","last_undegraded":"2023-10-26T06:42:29.706318+0000","last_fullsized":"2023-10-26T06:42:29.706318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:28.919654+0000","last_clean_scrub_stamp":"2023-10-26T06:41:28.919654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:39.861113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.671147+0000","last_change":"2023-10-26T06:41:30.949327+0000","last_active":"2023-10-26T06:42:59.671147+0000","last_peered":"2023-10-26T06:42:59.671147+0000","last_clean":"2023-10-26T06:42:59.671147+0000","last_became_active":"2023-10-26T06:41:30.948964+0000","last_became_peered":"2023-10-26T06:41:30.948964+0000","last_unstale":"2023-10-26T06:42:59.671147+0000","last_undegraded":"2023-10-26T06:42:59.671147+0000","last_fullsized":"2023-10-26T06:42:59.671147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:58:30.156948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.669446+0000","last_change":"2023-10-26T06:41:30.947059+0000","last_active":"2023-10-26T06:42:59.669446+0000","last_peered":"2023-10-26T06:42:59.669446+0000","last_clean":"2023-10-26T06:42:59.669446+0000","last_became_active":"2023-10-26T06:41:30.946769+0000","last_became_peered":"2023-10-26T06:41:30.946769+0000","last_unstale":"2023-10-26T06:42:59.669446+0000","last_undegraded":"2023-10-26T06:42:59.669446+0000","last_fullsized":"2023-10-26T06:42:59.669446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T16:12:06.378349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.678407+0000","last_change":"2023-10-26T06:41:30.952134+0000","last_active":"2023-10-26T06:42:59.678407+0000","last_peered":"2023-10-26T06:42:59.678407+0000","last_clean":"2023-10-26T06:42:59.678407+0000","last_became_active":"2023-10-26T06:41:30.951797+0000","last_became_peered":"2023-10-26T06:41:30.951797+0000","last_unstale":"2023-10-26T06:42:59.678407+0000","last_undegraded":"2023-10-26T06:42:59.678407+0000","last_fullsized":"2023-10-26T06:42:59.678407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:32.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677343+0000","last_change":"2023-10-26T06:41:30.960002+0000","last_active":"2023-10-26T06:42:59.677343+0000","last_peered":"2023-10-26T06:42:59.677343+0000","last_clean":"2023-10-26T06:42:59.677343+0000","last_became_active":"2023-10-26T06:41:30.959680+0000","last_became_peered":"2023-10-26T06:41:30.959680+0000","last_unstale":"2023-10-26T06:42:59.677343+0000","last_undegraded":"2023-10-26T06:42:59.677343+0000","last_fullsized":"2023-10-26T06:42:59.677343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:55:11.012011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682413+0000","last_change":"2023-10-26T06:41:30.965229+0000","last_active":"2023-10-26T06:42:59.682413+0000","last_peered":"2023-10-26T06:42:59.682413+0000","last_clean":"2023-10-26T06:42:59.682413+0000","last_became_active":"2023-10-26T06:41:30.964752+0000","last_became_peered":"2023-10-26T06:41:30.964752+0000","last_unstale":"2023-10-26T06:42:59.682413+0000","last_undegraded":"2023-10-26T06:42:59.682413+0000","last_fullsized":"2023-10-26T06:42:59.682413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:31:14.544352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680960+0000","last_change":"2023-10-26T06:41:30.963171+0000","last_active":"2023-10-26T06:42:59.680960+0000","last_peered":"2023-10-26T06:42:59.680960+0000","last_clean":"2023-10-26T06:42:59.680960+0000","last_became_active":"2023-10-26T06:41:30.961089+0000","last_became_peered":"2023-10-26T06:41:30.961089+0000","last_unstale":"2023-10-26T06:42:59.680960+0000","last_undegraded":"2023-10-26T06:42:59.680960+0000","last_fullsized":"2023-10-26T06:42:59.680960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:13:00.724095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.668540+0000","last_change":"2023-10-26T06:41:30.947253+0000","last_active":"2023-10-26T06:42:59.668540+0000","last_peered":"2023-10-26T06:42:59.668540+0000","last_clean":"2023-10-26T06:42:59.668540+0000","last_became_active":"2023-10-26T06:41:30.946966+0000","last_became_peered":"2023-10-26T06:41:30.946966+0000","last_unstale":"2023-10-26T06:42:59.668540+0000","last_undegraded":"2023-10-26T06:42:59.668540+0000","last_fullsized":"2023-10-26T06:42:59.668540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:30:41.580015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.680578+0000","last_change":"2023-10-26T06:41:30.951211+0000","last_active":"2023-10-26T06:42:59.680578+0000","last_peered":"2023-10-26T06:42:59.680578+0000","last_clean":"2023-10-26T06:42:59.680578+0000","last_became_active":"2023-10-26T06:41:30.950882+0000","last_became_peered":"2023-10-26T06:41:30.950882+0000","last_unstale":"2023-10-26T06:42:59.680578+0000","last_undegraded":"2023-10-26T06:42:59.680578+0000","last_fullsized":"2023-10-26T06:42:59.680578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T14:09:59.628125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.666939+0000","last_change":"2023-10-26T06:41:30.949299+0000","last_active":"2023-10-26T06:42:59.666939+0000","last_peered":"2023-10-26T06:42:59.666939+0000","last_clean":"2023-10-26T06:42:59.666939+0000","last_became_active":"2023-10-26T06:41:30.948839+0000","last_became_peered":"2023-10-26T06:41:30.948839+0000","last_unstale":"2023-10-26T06:42:59.666939+0000","last_undegraded":"2023-10-26T06:42:59.666939+0000","last_fullsized":"2023-10-26T06:42:59.666939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T13:20:48.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.674902+0000","last_change":"2023-10-26T06:41:30.953020+0000","last_active":"2023-10-26T06:42:59.674902+0000","last_peered":"2023-10-26T06:42:59.674902+0000","last_clean":"2023-10-26T06:42:59.674902+0000","last_became_active":"2023-10-26T06:41:30.952668+0000","last_became_peered":"2023-10-26T06:41:30.952668+0000","last_unstale":"2023-10-26T06:42:59.674902+0000","last_undegraded":"2023-10-26T06:42:59.674902+0000","last_fullsized":"2023-10-26T06:42:59.674902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:17:29.648265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.677285+0000","last_change":"2023-10-26T06:41:30.948416+0000","last_active":"2023-10-26T06:42:59.677285+0000","last_peered":"2023-10-26T06:42:59.677285+0000","last_clean":"2023-10-26T06:42:59.677285+0000","last_became_active":"2023-10-26T06:41:30.948100+0000","last_became_peered":"2023-10-26T06:41:30.948100+0000","last_unstale":"2023-10-26T06:42:59.677285+0000","last_undegraded":"2023-10-26T06:42:59.677285+0000","last_fullsized":"2023-10-26T06:42:59.677285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T15:11:44.704409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.683019+0000","last_change":"2023-10-26T06:41:30.949414+0000","last_active":"2023-10-26T06:42:59.683019+0000","last_peered":"2023-10-26T06:42:59.683019+0000","last_clean":"2023-10-26T06:42:59.683019+0000","last_became_active":"2023-10-26T06:41:30.949038+0000","last_became_peered":"2023-10-26T06:41:30.949038+0000","last_unstale":"2023-10-26T06:42:59.683019+0000","last_undegraded":"2023-10-26T06:42:59.683019+0000","last_fullsized":"2023-10-26T06:42:59.683019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:02:05.205599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.682770+0000","last_change":"2023-10-26T06:41:30.962215+0000","last_active":"2023-10-26T06:42:59.682770+0000","last_peered":"2023-10-26T06:42:59.682770+0000","last_clean":"2023-10-26T06:42:59.682770+0000","last_became_active":"2023-10-26T06:41:30.961400+0000","last_became_peered":"2023-10-26T06:41:30.961400+0000","last_unstale":"2023-10-26T06:42:59.682770+0000","last_undegraded":"2023-10-26T06:42:59.682770+0000","last_fullsized":"2023-10-26T06:42:59.682770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:07:46.355291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-26T06:42:59.667579+0000","last_change":"2023-10-26T06:42:30.708612+0000","last_active":"2023-10-26T06:42:59.667579+0000","last_peered":"2023-10-26T06:42:59.667579+0000","last_clean":"2023-10-26T06:42:59.667579+0000","last_became_active":"2023-10-26T06:42:30.707927+0000","last_became_peered":"2023-10-26T06:42:30.707927+0000","last_unstale":"2023-10-26T06:42:59.667579+0000","last_undegraded":"2023-10-26T06:42:59.667579+0000","last_fullsized":"2023-10-26T06:42:59.667579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-26T06:41:29.928608+0000","last_clean_scrub_stamp":"2023-10-26T06:41:29.928608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:59:10.386948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64182,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":729,"num_read_kb":431,"num_write":160,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":197925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416422,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74299999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437}]},{"osd":1,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79200000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77100000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 26 06:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.874,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.59399999999999997,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Oct 26 06:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.878}]},{"osd":7,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58699999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.94599999999999995,"5min":0.998,"15min":0.998},"last":0.89500000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.877}]},{"osd":9,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.95799999999999996}]},{"osd":10,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81499999999999995,"15min":0.81599999999999995},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":0.96799999999999997,"5min":1.079,"15min":1.079},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.026,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.86099999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1113974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61199999999999999,"15min":0.59699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.63400000000000001,"15min":0.66600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":0.872,"15min":0.872},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.628}]},{"osd":8,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.006,"15min":1.006},"last":0.89200000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82499999999999996,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81699999999999995,"15min":0.83299999999999996},"min":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.745}]},{"osd":11,"last update":"Thu Oct 26 06:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98499999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.879}]}]},{"osd":9,"up_from":67,"seq":287762808877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.59899999999999998,"15min":0.625},"min":{"1min":0.36099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.95399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86599999999999999,"5min":2.016,"15min":2.016},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":7.2320000000000002,"5min":7.2320000000000002,"15min":7.2320000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.83799999999999997,"15min":0.86199999999999999},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89600000000000002,"5min":1.859,"15min":1.859},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73199999999999998,"15min":0.755},"min":{"1min":0.53200000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.752}]},{"osd":3,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.65900000000000003,"15min":0.69299999999999995},"min":{"1min":0.39700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.048,"5min":1.605,"15min":1.605},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.47399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.5289999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78400000000000003,"15min":0.82799999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.74399999999999999,"5min":1.331,"15min":1.331},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2030000000000001,"5min":1.776,"15min":1.776},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.91800000000000004,"15min":0.95599999999999996},"min":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.05,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.83999999999999997,"15min":0.88200000000000001},"min":{"1min":0.57099999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.92600000000000005,"15min":0.97399999999999998},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5640000000000001,"5min":1.901,"15min":1.901},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.873,"15min":0.94099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3560000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.89100000000000001,"15min":0.93400000000000005},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2430000000000001,"5min":1.835,"15min":1.835},"last":0.629},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.998,"15min":1.0329999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.494,"5min":2.093,"15min":2.093},"last":0.64800000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.0269999999999999,"15min":1.0669999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.419,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.034,"15min":1.02},"min":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":0.876}]},{"osd":10,"last update":"Thu Oct 26 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.68400000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.458,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":1.141,"15min":1.2709999999999999},"min":{"1min":0.60099999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3220000000000001,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.89900000000000002}]}]},{"osd":8,"up_from":59,"seq":253403070514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":462696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81799999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.65700000000000003,"15min":0.64800000000000002},"min":{"1min":0.56899999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.42099999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.38,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.749}]},{"osd":3,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.73799999999999999,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0109999999999999,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63600000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84999999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.65400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":0.995},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.48599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.42499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.95099999999999996,"5min":1.766,"15min":1.766},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.68500000000000005},"min":{"1min":0.64700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0389999999999999,"5min":1.087,"15min":1.087},"last":1.028},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.88800000000000001,"15min":0.93400000000000005},"min":{"1min":0.60699999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.101,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Oct 26 06:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.63700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.497,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.405,"15min":1.405},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80200000000000005,"15min":0.78200000000000003},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.78100000000000003,"15min":0.755},"min":{"1min":0.68799999999999994,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98699999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.70799999999999996},"min":{"1min":0.61599999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.002,"5min":1.45,"15min":1.45},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58299999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.044,"5min":1.075,"15min":1.075},"last":0.94499999999999995}]},{"osd":11,"last update":"Thu Oct 26 06:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0189999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.877}]}]},{"osd":7,"up_from":52,"seq":223338299447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1055110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.372,"15min":0.372},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.435,"15min":0.41899999999999998},"min":{"1min":0.30499999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.434,"15min":0.40699999999999997},"min":{"1min":0.34300000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58199999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.81999999999999995,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77400000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.374,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.47999999999999998},"min":{"1min":0.40200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.63800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.36699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.625,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63800000000000001,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.752}]},{"osd":6,"last update":"Thu Oct 26 06:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71099999999999997},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78100000000000003,"5min":0.995,"15min":0.995},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.61099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.996,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.68600000000000005}]},{"osd":9,"last update":"Thu Oct 26 06:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.65000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63100000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":1.204,"15min":1.204},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Oct 26 06:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.91900000000000004,"5min":0.998,"15min":0.998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85299999999999998,"15min":0.85799999999999998},"min":{"1min":0.66600000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92800000000000005,"5min":1.002,"15min":1.002},"last":0.80100000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":462193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.496,"15min":0.46999999999999997},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":0.77600000000000002,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":6.9100000000000001,"5min":6.9100000000000001,"15min":6.9100000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.73999999999999999,"15min":0.68300000000000005},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66600000000000004,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":0.78400000000000003,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.78800000000000003,"15min":0.755},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":3.3900000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78600000000000003,"15min":0.76500000000000001},"min":{"1min":0.56200000000000006,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86499999999999999,"15min":0.82799999999999996},"min":{"1min":0.65300000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0449999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98099999999999998,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.81200000000000006}]},{"osd":8,"last update":"Thu Oct 26 06:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.876,"15min":0.85099999999999998},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.88300000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.91800000000000004},"min":{"1min":0.65300000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.151,"5min":1.792,"15min":1.792},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.86799999999999999,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.24,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.94299999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.94999999999999996,"15min":0.91800000000000004},"min":{"1min":0.68100000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0329999999999999,"5min":6.9790000000000001,"15min":6.9790000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.028,"15min":0.998},"min":{"1min":0.78600000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.0760000000000001,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":0.86099999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":521705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53900000000000003,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.56999999999999995,"15min":0.52500000000000002},"min":{"1min":0.49099999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.89300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.52600000000000002},"min":{"1min":0.44700000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Oct 26 06:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58799999999999997,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91200000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Oct 26 06:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.433},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.46100000000000002},"min":{"1min":0.374,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.55800000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Oct 26 06:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.63700000000000001},"min":{"1min":0.59699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Oct 26 06:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80400000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.77400000000000002}]},{"osd":8,"last update":"Thu Oct 26 06:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.56799999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69099999999999995,"15min":0.66200000000000003},"min":{"1min":0.57099999999999995,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66900000000000004}]},{"osd":9,"last update":"Thu Oct 26 06:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.64800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Oct 26 06:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89700000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.747},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79500000000000004,"15min":0.79400000000000004},"min":{"1min":0.66500000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96799999999999997,"5min":1.085,"15min":1.085},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.76100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":463458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 26 06:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":0.79200000000000004,"15min":0.63700000000000001},"min":{"1min":0.432,"5min":0.34599999999999997,"15min":0.34399999999999997},"max":{"1min":17.193000000000001,"5min":17.193000000000001,"15min":17.193000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.6539999999999999,"5min":0.872,"15min":0.65200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":20.82,"5min":20.82,"15min":20.82},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:43:21 2023","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":0.95899999999999996,"15min":0.70099999999999996},"min":{"1min":0.56399999999999995,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":22.111999999999998,"5min":22.111999999999998,"15min":22.111999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.8260000000000001,"5min":0.96799999999999997,"15min":0.72199999999999998},"min":{"1min":0.53000000000000003,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":22.158000000000001,"5min":22.158000000000001,"15min":22.158000000000001},"last":0.88}]},{"osd":3,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.387,"5min":2.387,"15min":2.387},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:43:13 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":0.89200000000000002,"15min":0.69599999999999995},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":22.945,"5min":22.945,"15min":22.945},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.722,"5min":0.93600000000000005,"15min":0.71799999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":20.875,"5min":20.875,"15min":20.875},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.71199999999999997},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.5269999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.79200000000000004,"15min":0.746},"min":{"1min":0.58899999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Oct 26 06:43:03 2023","interfaces":[{"interface":"back","average":{"1min":1.732,"5min":0.93300000000000005,"15min":0.76200000000000001},"min":{"1min":0.55500000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":20.550999999999998,"5min":20.550999999999998,"15min":20.550999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0629999999999999,"5min":0.85399999999999998,"15min":0.78800000000000003},"min":{"1min":0.53800000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84899999999999998,"15min":0.83799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 26 06:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92100000000000004,"15min":0.93000000000000005},"min":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.599,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92700000000000005,"15min":0.93600000000000005},"min":{"1min":0.63600000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.63900000000000001}]},{"osd":9,"last update":"Thu Oct 26 06:43:03 2023","interfaces":[{"interface":"back","average":{"1min":1.853,"5min":1.141,"15min":1.0429999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":20.364000000000001,"5min":20.364000000000001,"15min":20.364000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.972,"5min":1.1679999999999999,"15min":1.052},"min":{"1min":0.57399999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":22.722999999999999,"5min":22.722999999999999,"15min":22.722999999999999},"last":0.91400000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:43:24 2023","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":1.2,"15min":1.0800000000000001},"min":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":22.437999999999999,"5min":22.437999999999999,"15min":22.437999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.897,"5min":1.1719999999999999,"15min":1.054},"min":{"1min":0.66400000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":20.780000000000001,"5min":20.780000000000001,"15min":20.780000000000001},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.97799999999999998,"15min":0.98599999999999999},"min":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.411,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82599999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":522739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.74299999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81599999999999995,"5min":2.3119999999999998,"15min":2.371},"last":0.498}]},{"osd":1,"last update":"Thu Oct 26 06:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.83699999999999997,"5min":1.21,"15min":1.21},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81299999999999994,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.622}]},{"osd":3,"last update":"Thu Oct 26 06:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.61599999999999999,"15min":0.69099999999999995},"min":{"1min":0.45700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.85199999999999998,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.47599999999999998,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45100000000000001,"15min":0.41999999999999998},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Oct 26 06:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.044,"15min":1.044},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.56599999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Oct 26 06:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":1.012,"15min":1.012},"last":0.69499999999999995}]},{"osd":8,"last update":"Thu Oct 26 06:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64900000000000002}]},{"osd":9,"last update":"Thu Oct 26 06:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.61399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91700000000000004,"5min":1.093,"15min":1.093},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79600000000000004,"15min":0.79300000000000004},"min":{"1min":0.69899999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.024,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.81599999999999995}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76600000000000001,"15min":0.73299999999999998},"min":{"1min":0.64400000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0720000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.72899999999999998},"min":{"1min":0.65100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Oct 26 06:42:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":462510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48599999999999999,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.38},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.44500000000000001},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74399999999999999,"5min":1.097,"15min":1.097},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67200000000000004,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Oct 26 06:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70899999999999996,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97299999999999998,"5min":1.048,"15min":1.048},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.65100000000000002},"min":{"1min":0.433,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Oct 26 06:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.745,"15min":0.66400000000000003},"min":{"1min":0.55400000000000005,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95699999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.67400000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93799999999999994,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.746}]},{"osd":5,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75700000000000001,"15min":0.69699999999999995},"min":{"1min":0.61499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93899999999999995,"5min":1.196,"15min":1.196},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Oct 26 06:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.66900000000000004},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.1830000000000001,"5min":1.258,"15min":1.258},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1000000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.79000000000000004},"min":{"1min":0.61699999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1020000000000001,"5min":1.361,"15min":1.361},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76500000000000001,"15min":0.70999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83799999999999997}]},{"osd":8,"last update":"Thu Oct 26 06:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":1.0009999999999999,"15min":1.0469999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.419,"15min":1.419},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.89800000000000002,"15min":0.93799999999999994},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.278,"5min":1.292,"15min":1.292},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Oct 26 06:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.018,"15min":1.075},"min":{"1min":0.73599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1830000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.69099999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.431,"15min":1.431},"last":0.85799999999999998}]},{"osd":11,"last update":"Thu Oct 26 06:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.877}]}]},{"osd":4,"up_from":34,"seq":146028888134,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":463155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.50600000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80600000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.53200000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.872,"15min":0.872},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.36699999999999999},"min":{"1min":0.26300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59799999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42599999999999999,"15min":0.38400000000000001},"min":{"1min":0.33400000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64900000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.501}]},{"osd":2,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93100000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76800000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Oct 26 06:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.85399999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.84499999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.60099999999999998},"min":{"1min":0.45500000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.83199999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81799999999999995,"5min":1.863,"15min":1.863},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Oct 26 06:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66300000000000003,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67700000000000005,"15min":0.64000000000000001},"min":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89200000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Oct 26 06:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59599999999999997,"15min":0.57899999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.91900000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.91700000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.81499999999999995,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.82699999999999996}]},{"osd":9,"last update":"Thu Oct 26 06:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90000000000000002,"5min":1.246,"15min":1.246},"last":0.85899999999999999}]},{"osd":10,"last update":"Thu Oct 26 06:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76400000000000001,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.036,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88},{"interface":"front","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95599999999999996,"5min":1.044,"15min":1.044},"last":0.89300000000000002}]},{"osd":11,"last update":"Thu Oct 26 06:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.82899999999999996,"15min":0.82699999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.92900000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724608,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1560576,"data_stored":1053616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82099999999999995,"5min":5.819,"15min":5.819},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.55200000000000005,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.32900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.57399999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.374}]},{"osd":3,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.56999999999999995},"min":{"1min":0.40600000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":5.835,"15min":5.835},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Oct 26 06:42:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.59299999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Oct 26 06:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.52700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":1.167,"15min":1.167},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Oct 26 06:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Oct 26 06:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.432,"5min":0.378,"15min":0.378},"max":{"1min":0.92700000000000005,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Oct 26 06:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.57299999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.60499999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65700000000000003}]},{"osd":10,"last update":"Thu Oct 26 06:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76800000000000002,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-26T06:43:36.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 -- 172.21.15.50:0/963789303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa42410cee0 msgr2=0x7fa42410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 --2- 172.21.15.50:0/963789303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa42410cee0 0x7fa42410f350 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00b0a0 tx=0x7fa41c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 -- 172.21.15.50:0/963789303 shutdown_connections 2023-10-26T06:43:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 --2- 172.21.15.50:0/963789303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa42410cee0 0x7fa42410f350 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 --2- 172.21.15.50:0/963789303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa424072c20 0x7fa424073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 --2- 172.21.15.50:0/963789303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa424073540 0x7fa42410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 -- 172.21.15.50:0/963789303 >> 172.21.15.50:0/963789303 conn(0x7fa4240fc170 msgr2=0x7fa4240fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 -- 172.21.15.50:0/963789303 shutdown_connections 2023-10-26T06:43:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.940+0000 7fa42adff700 1 -- 172.21.15.50:0/963789303 wait complete. 2023-10-26T06:43:36.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.941+0000 7fa42adff700 1 Processor -- start 2023-10-26T06:43:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.941+0000 7fa42adff700 1 -- start start 2023-10-26T06:43:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42adff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa424072c20 0x7fa424198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42adff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 0x7fa424199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42adff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa42410cee0 0x7fa42419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42adff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42419ddb0 con 0x7fa424073540 2023-10-26T06:43:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42adff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42419df20 con 0x7fa424072c20 2023-10-26T06:43:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42adff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42419e0e0 con 0x7fa42410cee0 2023-10-26T06:43:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 0x7fa424199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 0x7fa424199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33802/0 (socket says 172.21.15.50:33802) 2023-10-26T06:43:36.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 -- 172.21.15.50:0/2813699347 learned_addr learned my addr 172.21.15.50:0/2813699347 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa428b9b700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa424072c20 0x7fa424198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa42939c700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa42410cee0 0x7fa42419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 -- 172.21.15.50:0/2813699347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa42410cee0 msgr2=0x7fa42419d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa42410cee0 0x7fa42419d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 -- 172.21.15.50:0/2813699347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa424072c20 msgr2=0x7fa424198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa424072c20 0x7fa424198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.942+0000 7fa423fff700 1 -- 172.21.15.50:0/2813699347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c009d00 con 0x7fa424073540 2023-10-26T06:43:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.943+0000 7fa423fff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 0x7fa424199420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa41000e9a0 tx=0x7fa41000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.943+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410009790 con 0x7fa424073540 2023-10-26T06:43:36.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.943+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa41000cbd0 con 0x7fa424073540 2023-10-26T06:43:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.943+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410018680 con 0x7fa424073540 2023-10-26T06:43:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.943+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42419e3c0 con 0x7fa424073540 2023-10-26T06:43:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.943+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4241a5c00 con 0x7fa424073540 2023-10-26T06:43:36.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.944+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4241080f0 con 0x7fa424073540 2023-10-26T06:43:36.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.946+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa41000cd40 con 0x7fa424073540 2023-10-26T06:43:36.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.948+0000 7fa421ffb700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4140a1550 0x7fa4140a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:36.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.949+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa410014070 con 0x7fa424073540 2023-10-26T06:43:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.949+0000 7fa428b9b700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4140a1550 0x7fa4140a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:36.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.949+0000 7fa428b9b700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4140a1550 0x7fa4140a3a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa418009c60 tx=0x7fa418009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:36.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:36.952+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa410052100 con 0x7fa424073540 2023-10-26T06:43:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:36 smithi050 ceph-mon[94997]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:36 smithi050 ceph-mon[94997]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.168+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4240742d0 con 0x7fa424073540 2023-10-26T06:43:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.170+0000 7fa421ffb700 1 -- 172.21.15.50:0/2813699347 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7fa410096530 con 0x7fa424073540 2023-10-26T06:43:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:37.172 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:36 smithi125 ceph-mon[130643]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:37.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:36 smithi125 ceph-mon[130643]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:37.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4140a1550 msgr2=0x7fa4140a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4140a1550 0x7fa4140a3a10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa418009c60 tx=0x7fa418009260 comp rx=0 tx=0).stop 2023-10-26T06:43:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 msgr2=0x7fa424199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 0x7fa424199420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa41000e9a0 tx=0x7fa41000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 shutdown_connections 2023-10-26T06:43:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4140a1550 0x7fa4140a3a10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa42410cee0 0x7fa42419d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa424072c20 0x7fa424198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 --2- 172.21.15.50:0/2813699347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa424073540 0x7fa424199420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 >> 172.21.15.50:0/2813699347 conn(0x7fa4240fc170 msgr2=0x7fa4240fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 shutdown_connections 2023-10-26T06:43:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.172+0000 7fa42adff700 1 -- 172.21.15.50:0/2813699347 wait complete. 2023-10-26T06:43:37.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:43:37.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:43:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:36 smithi153 ceph-mon[131657]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:36 smithi153 ceph-mon[131657]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-26T06:43:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 -- 172.21.15.50:0/1892417734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642810cf60 msgr2=0x7f642810f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 --2- 172.21.15.50:0/1892417734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642810cf60 0x7f642810f3d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f642000b0a0 tx=0x7f642000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 -- 172.21.15.50:0/1892417734 shutdown_connections 2023-10-26T06:43:37.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 --2- 172.21.15.50:0/1892417734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f642810cf60 0x7f642810f3d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 --2- 172.21.15.50:0/1892417734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6428072c20 0x7f6428073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 --2- 172.21.15.50:0/1892417734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6428073540 0x7f642810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 -- 172.21.15.50:0/1892417734 >> 172.21.15.50:0/1892417734 conn(0x7f64280fc1b0 msgr2=0x7f64280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:37.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 -- 172.21.15.50:0/1892417734 shutdown_connections 2023-10-26T06:43:37.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.400+0000 7f642dfff700 1 -- 172.21.15.50:0/1892417734 wait complete. 2023-10-26T06:43:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.401+0000 7f642dfff700 1 Processor -- start 2023-10-26T06:43:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.401+0000 7f642dfff700 1 -- start start 2023-10-26T06:43:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.401+0000 7f642dfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 0x7f6428198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f642dfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6428073540 0x7f6428199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f642dfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f642810cf60 0x7f642819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f642dfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642819de50 con 0x7f6428072c20 2023-10-26T06:43:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f642dfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642819dfc0 con 0x7f642810cf60 2023-10-26T06:43:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f642dfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642819e180 con 0x7f6428073540 2023-10-26T06:43:37.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 0x7f6428198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 0x7f6428198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33826/0 (socket says 172.21.15.50:33826) 2023-10-26T06:43:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 -- 172.21.15.50:0/4244230590 learned_addr learned my addr 172.21.15.50:0/4244230590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f6427fff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f642810cf60 0x7f642819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f641ffff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6428073540 0x7f6428199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 -- 172.21.15.50:0/4244230590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6428073540 msgr2=0x7f6428199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6428073540 0x7f6428199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 -- 172.21.15.50:0/4244230590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f642810cf60 msgr2=0x7f642819d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f642810cf60 0x7f642819d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 -- 172.21.15.50:0/4244230590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420009d00 con 0x7f6428072c20 2023-10-26T06:43:37.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.402+0000 7f64277fe700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 0x7f6428198f30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f641800e9a0 tx=0x7f641800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:37.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.403+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418009790 con 0x7f6428072c20 2023-10-26T06:43:37.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.403+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6418010430 con 0x7f6428072c20 2023-10-26T06:43:37.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.403+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642819e460 con 0x7f6428072c20 2023-10-26T06:43:37.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.403+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418018680 con 0x7f6428072c20 2023-10-26T06:43:37.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.403+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64281a5ca0 con 0x7f6428072c20 2023-10-26T06:43:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.404+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6428108170 con 0x7f6428072c20 2023-10-26T06:43:37.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.406+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f64180105a0 con 0x7f6428072c20 2023-10-26T06:43:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.409+0000 7f64257fa700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f64140a14d0 0x7f64140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.409+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6418014070 con 0x7f6428072c20 2023-10-26T06:43:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.409+0000 7f641ffff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f64140a14d0 0x7f64140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.409+0000 7f641ffff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f64140a14d0 0x7f64140a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f642819a480 tx=0x7f6410009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:37.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.411+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6418096760 con 0x7f6428072c20 2023-10-26T06:43:37.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.620+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f642819a230 con 0x7f6428072c20 2023-10-26T06:43:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.620+0000 7f64257fa700 1 -- 172.21.15.50:0/4244230590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64180260a0 con 0x7f6428072c20 2023-10-26T06:43:37.622 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:43:37.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f64140a14d0 msgr2=0x7f64140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f64140a14d0 0x7f64140a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f642819a480 tx=0x7f6410009260 comp rx=0 tx=0).stop 2023-10-26T06:43:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 msgr2=0x7f6428198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 0x7f6428198f30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f641800e9a0 tx=0x7f641800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 shutdown_connections 2023-10-26T06:43:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f64140a14d0 0x7f64140a3990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f642810cf60 0x7f642819d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6428072c20 0x7f6428198f30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 --2- 172.21.15.50:0/4244230590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6428073540 0x7f6428199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 >> 172.21.15.50:0/4244230590 conn(0x7f64280fc1b0 msgr2=0x7f64280fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 shutdown_connections 2023-10-26T06:43:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.623+0000 7f642dfff700 1 -- 172.21.15.50:0/4244230590 wait complete. 2023-10-26T06:43:37.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:43:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.850+0000 7f96789ff700 1 -- 172.21.15.50:0/3765967726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f967410cf60 msgr2=0x7f967410f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.850+0000 7f96789ff700 1 --2- 172.21.15.50:0/3765967726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f967410cf60 0x7f967410f3d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f966c00b0a0 tx=0x7f966c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.850+0000 7f96789ff700 1 -- 172.21.15.50:0/3765967726 shutdown_connections 2023-10-26T06:43:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.850+0000 7f96789ff700 1 --2- 172.21.15.50:0/3765967726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f967410cf60 0x7f967410f3d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.851+0000 7f96789ff700 1 --2- 172.21.15.50:0/3765967726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9674072c20 0x7f9674073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.851+0000 7f96789ff700 1 --2- 172.21.15.50:0/3765967726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9674073540 0x7f967410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.851+0000 7f96789ff700 1 -- 172.21.15.50:0/3765967726 >> 172.21.15.50:0/3765967726 conn(0x7f96740fc1b0 msgr2=0x7f96740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.851+0000 7f96789ff700 1 -- 172.21.15.50:0/3765967726 shutdown_connections 2023-10-26T06:43:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.851+0000 7f96789ff700 1 -- 172.21.15.50:0/3765967726 wait complete. 2023-10-26T06:43:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 Processor -- start 2023-10-26T06:43:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 -- start start 2023-10-26T06:43:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 0x7f9674198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9674073540 0x7f96741994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967410cf60 0x7f967419d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967419de40 con 0x7f9674072c20 2023-10-26T06:43:37.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967419dfb0 con 0x7f967410cf60 2023-10-26T06:43:37.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.852+0000 7f96789ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967419e170 con 0x7f9674073540 2023-10-26T06:43:37.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 0x7f9674198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f9671d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9674073540 0x7f96741994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 0x7f9674198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33842/0 (socket says 172.21.15.50:33842) 2023-10-26T06:43:37.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 -- 172.21.15.50:0/4204569670 learned_addr learned my addr 172.21.15.50:0/4204569670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:37.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f9672d9d700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967410cf60 0x7f967419d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 -- 172.21.15.50:0/4204569670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9674073540 msgr2=0x7f96741994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9674073540 0x7f96741994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 -- 172.21.15.50:0/4204569670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967410cf60 msgr2=0x7f967419d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:37.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967410cf60 0x7f967419d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:37.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 -- 172.21.15.50:0/4204569670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c009d00 con 0x7f9674072c20 2023-10-26T06:43:37.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f967259c700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 0x7f9674198f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f966400e9a0 tx=0x7f966400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:37.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.853+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664009790 con 0x7f9674072c20 2023-10-26T06:43:37.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.854+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967419e450 con 0x7f9674072c20 2023-10-26T06:43:37.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.854+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9664010430 con 0x7f9674072c20 2023-10-26T06:43:37.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.854+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664018680 con 0x7f9674072c20 2023-10-26T06:43:37.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.854+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96741a5c90 con 0x7f9674072c20 2023-10-26T06:43:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.855+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9674108170 con 0x7f9674072c20 2023-10-26T06:43:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.857+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f96640105a0 con 0x7f9674072c20 2023-10-26T06:43:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.858+0000 7f96637fe700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f965c0a14d0 0x7f965c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.858+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9664014070 con 0x7f9674072c20 2023-10-26T06:43:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.858+0000 7f9671d9b700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f965c0a14d0 0x7f965c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.859+0000 7f9671d9b700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f965c0a14d0 0x7f965c0a3990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f967419a470 tx=0x7f9668009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:37.862+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9664052100 con 0x7f9674072c20 2023-10-26T06:43:38.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:37 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2813699347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:38.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:37 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4244230590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:38.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:37 smithi050 ceph-mon[94997]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.076+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f967419a220 con 0x7f9674072c20 2023-10-26T06:43:38.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.076+0000 7f96637fe700 1 -- 172.21.15.50:0/4204569670 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96640d0030 con 0x7f9674072c20 2023-10-26T06:43:38.078 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:43:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.078+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f965c0a14d0 msgr2=0x7f965c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.078+0000 7f96789ff700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f965c0a14d0 0x7f965c0a3990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f967419a470 tx=0x7f9668009260 comp rx=0 tx=0).stop 2023-10-26T06:43:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.078+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 msgr2=0x7f9674198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.078+0000 7f96789ff700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 0x7f9674198f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f966400e9a0 tx=0x7f966400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 shutdown_connections 2023-10-26T06:43:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f965c0a14d0 0x7f965c0a3990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f967410cf60 0x7f967419d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9674072c20 0x7f9674198f70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 --2- 172.21.15.50:0/4204569670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9674073540 0x7f96741994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 >> 172.21.15.50:0/4204569670 conn(0x7f96740fc1b0 msgr2=0x7f96740fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:38.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 shutdown_connections 2023-10-26T06:43:38.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.079+0000 7f96789ff700 1 -- 172.21.15.50:0/4204569670 wait complete. 2023-10-26T06:43:38.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:43:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:37 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2813699347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:37 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4244230590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:38.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:37 smithi125 ceph-mon[130643]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:37 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2813699347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:37 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4244230590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:43:38.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:37 smithi153 ceph-mon[131657]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:43:38.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3631352321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 msgr2=0x7ff79c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3631352321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c100ba0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff790009990 tx=0x7ff790009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3631352321 shutdown_connections 2023-10-26T06:43:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3631352321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 0x7ff79c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3631352321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c106730 0x7ff79c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3631352321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c100ba0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3631352321 >> 172.21.15.50:0/3631352321 conn(0x7ff79c0fc1b0 msgr2=0x7ff79c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3631352321 shutdown_connections 2023-10-26T06:43:38.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.308+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3631352321 wait complete. 2023-10-26T06:43:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 Processor -- start 2023-10-26T06:43:38.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 -- start start 2023-10-26T06:43:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 0x7ff79c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c106730 0x7ff79c198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c199200 con 0x7ff79c100720 2023-10-26T06:43:38.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c199370 con 0x7ff79c1010e0 2023-10-26T06:43:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff7a13ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c199530 con 0x7ff79c106730 2023-10-26T06:43:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.309+0000 7ff79affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c19ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33864/0 (socket says 172.21.15.50:33864) 2023-10-26T06:43:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 -- 172.21.15.50:0/3200750153 learned_addr learned my addr 172.21.15.50:0/3200750153 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:38.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79b7fe700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c106730 0x7ff79c198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79a7fc700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 0x7ff79c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 -- 172.21.15.50:0/3200750153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c106730 msgr2=0x7ff79c198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c106730 0x7ff79c198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 -- 172.21.15.50:0/3200750153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 msgr2=0x7ff79c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 0x7ff79c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 -- 172.21.15.50:0/3200750153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900095f0 con 0x7ff79c100720 2023-10-26T06:43:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79a7fc700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 0x7ff79c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff79affd700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c19ea70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00e9a0 tx=0x7ff78c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c009790 con 0x7ff79c100720 2023-10-26T06:43:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff78c00cbd0 con 0x7ff79c100720 2023-10-26T06:43:38.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c018680 con 0x7ff79c100720 2023-10-26T06:43:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.310+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79c199810 con 0x7ff79c100720 2023-10-26T06:43:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.311+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c1a5a60 con 0x7ff79c100720 2023-10-26T06:43:38.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.311+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c101e60 con 0x7ff79c100720 2023-10-26T06:43:38.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.314+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff78c00cd40 con 0x7ff79c100720 2023-10-26T06:43:38.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.315+0000 7ff783fff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a1550 0x7ff7840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.315+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff78c014070 con 0x7ff79c100720 2023-10-26T06:43:38.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.315+0000 7ff79a7fc700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a1550 0x7ff7840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.316+0000 7ff79a7fc700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a1550 0x7ff7840a3a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff79000b2e0 tx=0x7ff790005c00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:38.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.317+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff78c096800 con 0x7ff79c100720 2023-10-26T06:43:38.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.533+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff79c199ff0 con 0x7ff79c100720 2023-10-26T06:43:38.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.534+0000 7ff783fff700 1 -- 172.21.15.50:0/3200750153 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff78c026020 con 0x7ff79c100720 2023-10-26T06:43:38.536 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:43:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.536+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a1550 msgr2=0x7ff7840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.536+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a1550 0x7ff7840a3a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff79000b2e0 tx=0x7ff790005c00 comp rx=0 tx=0).stop 2023-10-26T06:43:38.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.536+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 msgr2=0x7ff79c19ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.536+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c19ea70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00e9a0 tx=0x7ff78c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 shutdown_connections 2023-10-26T06:43:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff7840a1550 0x7ff7840a3a10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff79c106730 0x7ff79c198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff79c100720 0x7ff79c19ea70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 --2- 172.21.15.50:0/3200750153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79c1010e0 0x7ff79c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 >> 172.21.15.50:0/3200750153 conn(0x7ff79c0fc1b0 msgr2=0x7ff79c072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 shutdown_connections 2023-10-26T06:43:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.537+0000 7ff7a13ff700 1 -- 172.21.15.50:0/3200750153 wait complete. 2023-10-26T06:43:38.558 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:43:38.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 -- 172.21.15.50:0/176638558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac1066b0 msgr2=0x7f9aac106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/176638558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac1066b0 0x7f9aac106a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009990 tx=0x7f9aa0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 -- 172.21.15.50:0/176638558 shutdown_connections 2023-10-26T06:43:38.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/176638558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9aac101060 0x7f9aac10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/176638558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac1066b0 0x7f9aac106a90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/176638558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 0x7f9aac100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 -- 172.21.15.50:0/176638558 >> 172.21.15.50:0/176638558 conn(0x7f9aac0fc170 msgr2=0x7f9aac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:38.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 -- 172.21.15.50:0/176638558 shutdown_connections 2023-10-26T06:43:38.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.762+0000 7f9ab2fff700 1 -- 172.21.15.50:0/176638558 wait complete. 2023-10-26T06:43:38.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.763+0000 7f9ab2fff700 1 Processor -- start 2023-10-26T06:43:38.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.763+0000 7f9ab2fff700 1 -- start start 2023-10-26T06:43:38.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.763+0000 7f9ab2fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 0x7f9aac19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.763+0000 7f9ab2fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 0x7f9aac19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab2fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9aac1066b0 0x7f9aac198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab2fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac199160 con 0x7f9aac101060 2023-10-26T06:43:38.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab2fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac1992d0 con 0x7f9aac1066b0 2023-10-26T06:43:38.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab2fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac199490 con 0x7f9aac1006a0 2023-10-26T06:43:38.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 0x7f9aac19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 0x7f9aac19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33892/0 (socket says 172.21.15.50:33892) 2023-10-26T06:43:38.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 -- 172.21.15.50:0/4286429191 learned_addr learned my addr 172.21.15.50:0/4286429191 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:38.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab159c700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9aac1066b0 0x7f9aac198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab0d9b700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 0x7f9aac19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 -- 172.21.15.50:0/4286429191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 msgr2=0x7f9aac19e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 0x7f9aac19e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 -- 172.21.15.50:0/4286429191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9aac1066b0 msgr2=0x7f9aac198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9aac1066b0 0x7f9aac198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9aabfff700 1 -- 172.21.15.50:0/4286429191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00095f0 con 0x7f9aac101060 2023-10-26T06:43:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.764+0000 7f9ab0d9b700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 0x7f9aac19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.765+0000 7f9aabfff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 0x7f9aac19ef10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800e9a0 tx=0x7f9a9800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:38.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.765+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98009790 con 0x7f9aac101060 2023-10-26T06:43:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.765+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a9800cbd0 con 0x7f9aac101060 2023-10-26T06:43:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.765+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac199770 con 0x7f9aac101060 2023-10-26T06:43:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.765+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98018680 con 0x7f9aac101060 2023-10-26T06:43:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.765+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac1a59c0 con 0x7f9aac101060 2023-10-26T06:43:38.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.766+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac101de0 con 0x7f9aac101060 2023-10-26T06:43:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.768+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9a9800cd40 con 0x7f9aac101060 2023-10-26T06:43:38.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.769+0000 7f9aa9ffb700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9a9c0a14d0 0x7f9a9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.769+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9a98014070 con 0x7f9aac101060 2023-10-26T06:43:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.770+0000 7f9ab0d9b700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9a9c0a14d0 0x7f9a9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.770+0000 7f9ab0d9b700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9a9c0a14d0 0x7f9a9c0a3990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0006010 tx=0x7f9aa000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:38.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:38.773+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9a98052100 con 0x7f9aac101060 2023-10-26T06:43:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.040+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aac067530 con 0x7f9aac101060 2023-10-26T06:43:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.040+0000 7f9aa9ffb700 1 -- 172.21.15.50:0/4286429191 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7f9a98096660 con 0x7f9aac101060 2023-10-26T06:43:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:39.042 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:43:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9a9c0a14d0 msgr2=0x7f9a9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9a9c0a14d0 0x7f9a9c0a3990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0006010 tx=0x7f9aa000b260 comp rx=0 tx=0).stop 2023-10-26T06:43:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 msgr2=0x7f9aac19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 0x7f9aac19ef10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800e9a0 tx=0x7f9a9800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 shutdown_connections 2023-10-26T06:43:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9a9c0a14d0 0x7f9a9c0a3990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9aac1066b0 0x7f9aac198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9aac1006a0 0x7f9aac19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 --2- 172.21.15.50:0/4286429191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9aac101060 0x7f9aac19ef10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 >> 172.21.15.50:0/4286429191 conn(0x7f9aac0fc170 msgr2=0x7f9aac0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 shutdown_connections 2023-10-26T06:43:39.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.043+0000 7f9ab2fff700 1 -- 172.21.15.50:0/4286429191 wait complete. 2023-10-26T06:43:39.047 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:43:39.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:43:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:38 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4204569670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:38 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3200750153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:38 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4204569670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:38 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3200750153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:38 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4204569670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:43:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:38 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3200750153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:43:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 -- 172.21.15.50:0/2515475668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 msgr2=0x7fe10c106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2515475668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c106aa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009990 tx=0x7fe0fc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 -- 172.21.15.50:0/2515475668 shutdown_connections 2023-10-26T06:43:39.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2515475668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe10c067fa0 0x7fe10c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2515475668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c106aa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2515475668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c106fe0 0x7fe10c067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.267+0000 7fe1111ff700 1 -- 172.21.15.50:0/2515475668 >> 172.21.15.50:0/2515475668 conn(0x7fe10c076400 msgr2=0x7fe10c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.268+0000 7fe1111ff700 1 -- 172.21.15.50:0/2515475668 shutdown_connections 2023-10-26T06:43:39.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.268+0000 7fe1111ff700 1 -- 172.21.15.50:0/2515475668 wait complete. 2023-10-26T06:43:39.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 Processor -- start 2023-10-26T06:43:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 -- start start 2023-10-26T06:43:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 0x7fe10c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe10c106fe0 0x7fe10c1947a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c194e10 con 0x7fe10c067fa0 2023-10-26T06:43:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c194f80 con 0x7fe10c106fe0 2023-10-26T06:43:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe1111ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c195140 con 0x7fe10c1066c0 2023-10-26T06:43:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe10ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 0x7fe10c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe10ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 0x7fe10c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33906/0 (socket says 172.21.15.50:33906) 2023-10-26T06:43:39.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.269+0000 7fe10ad9d700 1 -- 172.21.15.50:0/2274774678 learned_addr learned my addr 172.21.15.50:0/2274774678 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10a59c700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10b59e700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe10c106fe0 0x7fe10c1947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10ad9d700 1 -- 172.21.15.50:0/2274774678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 msgr2=0x7fe10c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10ad9d700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10ad9d700 1 -- 172.21.15.50:0/2274774678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe10c106fe0 msgr2=0x7fe10c1947a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10ad9d700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe10c106fe0 0x7fe10c1947a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10ad9d700 1 -- 172.21.15.50:0/2274774678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009520 con 0x7fe10c067fa0 2023-10-26T06:43:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10a59c700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe10ad9d700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 0x7fe10c19a670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc005910 tx=0x7fe0fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc01d070 con 0x7fe10c067fa0 2023-10-26T06:43:39.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0095f0 con 0x7fe10c067fa0 2023-10-26T06:43:39.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0fc022470 con 0x7fe10c067fa0 2023-10-26T06:43:39.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.270+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc017650 con 0x7fe10c067fa0 2023-10-26T06:43:39.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.271+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c1a1480 con 0x7fe10c067fa0 2023-10-26T06:43:39.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.272+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c108bf0 con 0x7fe10c067fa0 2023-10-26T06:43:39.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.274+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe0fc0225e0 con 0x7fe10c067fa0 2023-10-26T06:43:39.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.275+0000 7fe0f3fff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0f40a1550 0x7fe0f40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.275+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe0fc0ce540 con 0x7fe10c067fa0 2023-10-26T06:43:39.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.275+0000 7fe10a59c700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0f40a1550 0x7fe0f40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.276+0000 7fe10a59c700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0f40a1550 0x7fe0f40a3a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe10c195bc0 tx=0x7fe100009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.277+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe0fc097b60 con 0x7fe10c067fa0 2023-10-26T06:43:39.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.489+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe10c101de0 con 0x7fe10c067fa0 2023-10-26T06:43:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.491+0000 7fe0f3fff700 1 -- 172.21.15.50:0/2274774678 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22750 (secure 0 0 0) 0x7fe0fc09b180 con 0x7fe10c067fa0 2023-10-26T06:43:39.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:43:39.493 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":86,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:42:30.695908+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:43:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0f40a1550 msgr2=0x7fe0f40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0f40a1550 0x7fe0f40a3a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe10c195bc0 tx=0x7fe100009260 comp rx=0 tx=0).stop 2023-10-26T06:43:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 msgr2=0x7fe10c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 0x7fe10c19a670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc005910 tx=0x7fe0fc004730 comp rx=0 tx=0).stop 2023-10-26T06:43:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 shutdown_connections 2023-10-26T06:43:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe0f40a1550 0x7fe0f40a3a10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe10c106fe0 0x7fe10c1947a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe10c067fa0 0x7fe10c19a670 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 --2- 172.21.15.50:0/2274774678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe10c1066c0 0x7fe10c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 >> 172.21.15.50:0/2274774678 conn(0x7fe10c076400 msgr2=0x7fe10c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 shutdown_connections 2023-10-26T06:43:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.494+0000 7fe1111ff700 1 -- 172.21.15.50:0/2274774678 wait complete. 2023-10-26T06:43:39.515 DEBUG:tasks.fwd_scrub:Yielding 2023-10-26T06:43:39.516 INFO:teuthology.run_tasks:Running task exec... 2023-10-26T06:43:39.541 INFO:teuthology.task.exec:Executing custom commands... 2023-10-26T06:43:39.542 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:43:39.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-26T06:43:39.543 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-26T06:43:39.543 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:43:39.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:43:39.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 -- 172.21.15.50:0/3620147589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 msgr2=0x7fdcd4103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 --2- 172.21.15.50:0/3620147589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd4103ac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009990 tx=0x7fdcc0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 -- 172.21.15.50:0/3620147589 shutdown_connections 2023-10-26T06:43:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 --2- 172.21.15.50:0/3620147589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4067b20 0x7fdcd4067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 --2- 172.21.15.50:0/3620147589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4105680 0x7fdcd4103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 --2- 172.21.15.50:0/3620147589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd4103ac0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.749+0000 7fdcdabff700 1 -- 172.21.15.50:0/3620147589 >> 172.21.15.50:0/3620147589 conn(0x7fdcd4076790 msgr2=0x7fdcd4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.750+0000 7fdcdabff700 1 -- 172.21.15.50:0/3620147589 shutdown_connections 2023-10-26T06:43:39.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.750+0000 7fdcdabff700 1 -- 172.21.15.50:0/3620147589 wait complete. 2023-10-26T06:43:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.751+0000 7fdcdabff700 1 Processor -- start 2023-10-26T06:43:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.751+0000 7fdcdabff700 1 -- start start 2023-10-26T06:43:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcdabff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4067b20 0x7fdcd419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcdabff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcdabff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4105680 0x7fdcd41a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcdabff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41a2090 con 0x7fdcd4103640 2023-10-26T06:43:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcdabff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41a2200 con 0x7fdcd4105680 2023-10-26T06:43:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcdabff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41a23c0 con 0x7fdcd4067b20 2023-10-26T06:43:39.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33922/0 (socket says 172.21.15.50:33922) 2023-10-26T06:43:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcd3fff700 1 -- 172.21.15.50:0/2245919782 learned_addr learned my addr 172.21.15.50:0/2245919782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcd899b700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4067b20 0x7fdcd419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.752+0000 7fdcd919c700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4105680 0x7fdcd41a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd3fff700 1 -- 172.21.15.50:0/2245919782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4067b20 msgr2=0x7fdcd419d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd3fff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4067b20 0x7fdcd419d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd3fff700 1 -- 172.21.15.50:0/2245919782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4105680 msgr2=0x7fdcd41a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd3fff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4105680 0x7fdcd41a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd3fff700 1 -- 172.21.15.50:0/2245919782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8009520 con 0x7fdcd4103640 2023-10-26T06:43:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd3fff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd419d6b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0000c00 tx=0x7fdcc0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc001d070 con 0x7fdcd4103640 2023-10-26T06:43:39.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcc0022470 con 0x7fdcd4103640 2023-10-26T06:43:39.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc00095f0 con 0x7fdcd4103640 2023-10-26T06:43:39.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0017650 con 0x7fdcd4103640 2023-10-26T06:43:39.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.753+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd41a9d00 con 0x7fdcd4103640 2023-10-26T06:43:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.754+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd40ffbe0 con 0x7fdcd4103640 2023-10-26T06:43:39.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.756+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdcc00225e0 con 0x7fdcd4103640 2023-10-26T06:43:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.758+0000 7fdcd1ffb700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc40a1550 0x7fdcc40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.758+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdcc00cdff0 con 0x7fdcd4103640 2023-10-26T06:43:39.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.759+0000 7fdcd899b700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc40a1550 0x7fdcc40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.759+0000 7fdcd899b700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc40a1550 0x7fdcc40a3a10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009d70 tx=0x7fdcc8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.760+0000 7f79995ff700 1 -- 172.21.15.50:0/4230674454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994111730 msgr2=0x7f7994113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.760+0000 7f79995ff700 1 --2- 172.21.15.50:0/4230674454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994111730 0x7f7994113b20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f798c009f90 tx=0x7f798c00b330 comp rx=0 tx=0).stop 2023-10-26T06:43:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.760+0000 7f79995ff700 1 -- 172.21.15.50:0/4230674454 shutdown_connections 2023-10-26T06:43:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.760+0000 7f79995ff700 1 --2- 172.21.15.50:0/4230674454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994111730 0x7f7994113b20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.760+0000 7f79995ff700 1 --2- 172.21.15.50:0/4230674454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7994072b90 0x7f7994072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.760+0000 7f79995ff700 1 --2- 172.21.15.50:0/4230674454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79940734b0 0x7f79941111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.761+0000 7f79995ff700 1 -- 172.21.15.50:0/4230674454 >> 172.21.15.50:0/4230674454 conn(0x7f79940fc1b0 msgr2=0x7f79940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.761+0000 7f79995ff700 1 -- 172.21.15.50:0/4230674454 shutdown_connections 2023-10-26T06:43:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.761+0000 7f79995ff700 1 -- 172.21.15.50:0/4230674454 wait complete. 2023-10-26T06:43:39.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 Processor -- start 2023-10-26T06:43:39.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 -- start start 2023-10-26T06:43:39.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 0x7f799419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79940734b0 0x7f799419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7994111730 0x7f79941a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a2310 con 0x7f79940734b0 2023-10-26T06:43:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a2480 con 0x7f7994072b90 2023-10-26T06:43:39.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79995ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a2640 con 0x7f7994111730 2023-10-26T06:43:39.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 0x7f799419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 0x7f799419d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51188/0 (socket says 172.21.15.50:51188) 2023-10-26T06:43:39.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f7992ffd700 1 -- 172.21.15.50:0/2257464804 learned_addr learned my addr 172.21.15.50:0/2257464804 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79937fe700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7994111730 0x7f79941a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.762+0000 7f79927fc700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79940734b0 0x7f799419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79937fe700 1 -- 172.21.15.50:0/2257464804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 msgr2=0x7f799419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79937fe700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 0x7f799419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79937fe700 1 -- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79940734b0 msgr2=0x7f799419d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79937fe700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79940734b0 0x7f799419d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79937fe700 1 -- 172.21.15.50:0/2257464804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c009c40 con 0x7f7994111730 2023-10-26T06:43:39.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f7992ffd700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 0x7f799419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79937fe700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7994111730 0x7f79941a1cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b6c0 tx=0x7f798c0094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f797bfff700 1 -- 172.21.15.50:0/2257464804 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00e040 con 0x7f7994111730 2023-10-26T06:43:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79941a28c0 con 0x7f7994111730 2023-10-26T06:43:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f797bfff700 1 -- 172.21.15.50:0/2257464804 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f798c007e10 con 0x7f7994111730 2023-10-26T06:43:39.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.763+0000 7f797bfff700 1 -- 172.21.15.50:0/2257464804 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c005040 con 0x7f7994111730 2023-10-26T06:43:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.764+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79941aa160 con 0x7f7994111730 2023-10-26T06:43:39.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.764+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdcc0097670 con 0x7fdcd4103640 2023-10-26T06:43:39.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.767+0000 7f797bfff700 1 -- 172.21.15.50:0/2257464804 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f798c00bcf0 con 0x7f7994111730 2023-10-26T06:43:39.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.769+0000 7f79ace78b80 1 Processor -- start 2023-10-26T06:43:39.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.769+0000 7f79ace78b80 1 -- start start 2023-10-26T06:43:39.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 0x55fac51f7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f797bfff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f797c0a14d0 0x7f797c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f797bfff700 1 -- 172.21.15.50:0/2257464804 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f798c0ce080 con 0x7f7994111730 2023-10-26T06:43:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f7580 0x55fac51f1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac51f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79ace78b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5164760 con 0x55fac51f6c60 2023-10-26T06:43:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79ace78b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac514ace0 con 0x55fac51f1650 2023-10-26T06:43:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79ace78b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5148600 con 0x55fac51f7580 2023-10-26T06:43:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79927fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 0x55fac51f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79927fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 0x55fac51f7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33942/0 (socket says 172.21.15.50:33942) 2023-10-26T06:43:39.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79927fc700 1 -- 172.21.15.50:0/859253544 learned_addr learned my addr 172.21.15.50:0/859253544 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f79927fc700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f797c0a14d0 0x7f797c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.770+0000 7f7992ffd700 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f7580 0x55fac51f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79937fe700 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac51f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79927fc700 1 -- 172.21.15.50:0/859253544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f7580 msgr2=0x55fac51f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79927fc700 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f7580 0x55fac51f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79927fc700 1 -- 172.21.15.50:0/859253544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 msgr2=0x55fac51f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79927fc700 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac51f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79927fc700 1 -- 172.21.15.50:0/859253544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fac5101470 con 0x55fac51f6c60 2023-10-26T06:43:39.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79937fe700 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac51f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:43:39.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.771+0000 7f79927fc700 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 0x55fac51f7040 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7988005d10 tx=0x7f7988011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45dd874a8e6f560 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.772+0000 7f79927fc700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f797c0a14d0 0x7f797c0a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f798800f6a0 tx=0x7f798801e000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.772+0000 7f79797fa700 1 -- 172.21.15.50:0/859253544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988011050 con 0x55fac51f6c60 2023-10-26T06:43:39.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.772+0000 7f79797fa700 1 -- 172.21.15.50:0/859253544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7988009ae0 con 0x55fac51f6c60 2023-10-26T06:43:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.772+0000 7f79797fa700 1 -- 172.21.15.50:0/859253544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880053e0 con 0x55fac51f6c60 2023-10-26T06:43:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 -- 172.21.15.50:0/859253544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 msgr2=0x55fac51f7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 0x55fac51f7040 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7988005d10 tx=0x7f7988011e00 comp rx=0 tx=0).stop 2023-10-26T06:43:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 -- 172.21.15.50:0/859253544 shutdown_connections 2023-10-26T06:43:39.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac51f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f6c60 0x55fac51f7040 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 --2- 172.21.15.50:0/859253544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f7580 0x55fac51f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 -- 172.21.15.50:0/859253544 >> 172.21.15.50:0/859253544 conn(0x55fac51657a0 msgr2=0x55fac51ebbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 -- 172.21.15.50:0/859253544 shutdown_connections 2023-10-26T06:43:39.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.773+0000 7f79ace78b80 1 -- 172.21.15.50:0/859253544 wait complete. 2023-10-26T06:43:39.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.774+0000 7f79ace78b80 1 -- start start 2023-10-26T06:43:39.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.774+0000 7f79ace78b80 1 Processor -- start 2023-10-26T06:43:39.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51fd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac51fa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5143ef0 con 0x55fac51f1650 2023-10-26T06:43:39.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac50e0790 con 0x55fac51f7580 2023-10-26T06:43:39.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac50e0430 con 0x55fac51f6c60 2023-10-26T06:43:39.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79ace78b80 10 client.0 _ll_register_callbacks cb 0x55fac502ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:39.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51fd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac51fa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac51fa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:46934/0 (socket says 172.21.15.50:46934) 2023-10-26T06:43:39.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79927fc700 1 -- 172.21.15.50:0/870355668 learned_addr learned my addr 172.21.15.50:0/870355668 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79937fe700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79937fe700 1 -- 172.21.15.50:0/870355668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 msgr2=0x55fac51fa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.775+0000 7f79937fe700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac51fa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f79937fe700 1 -- 172.21.15.50:0/870355668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 msgr2=0x55fac51fd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f79937fe700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51fd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f79937fe700 1 -- 172.21.15.50:0/870355668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7988019040 con 0x55fac51f7580 2023-10-26T06:43:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f7992ffd700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51fd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f79937fe700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51faf90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f798c0cbab0 tx=0x7f798c0976a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f24ed806636d0d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f7976ff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:43:39.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f7976ff5700 1 -- 172.21.15.50:0/870355668 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c09acc0 con 0x55fac51f7580 2023-10-26T06:43:39.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f7976ff5700 1 -- 172.21.15.50:0/870355668 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f798c019e30 con 0x55fac51f7580 2023-10-26T06:43:39.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fac5148f70 con 0x55fac51f7580 2023-10-26T06:43:39.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.776+0000 7f7976ff5700 1 -- 172.21.15.50:0/870355668 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f798c09ba60 con 0x55fac51f7580 2023-10-26T06:43:39.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 10 client.25496 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:39.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55fac4f6ee60 con 0x55fac51f7580 2023-10-26T06:43:39.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f7976ff5700 1 -- 172.21.15.50:0/870355668 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fac5148f70 con 0x55fac51f7580 2023-10-26T06:43:39.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f7976ff5700 1 -- 172.21.15.50:0/870355668 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f798c09a850 con 0x55fac51f7580 2023-10-26T06:43:39.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 10 client.25496 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:39.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 10 client.25496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:43:39.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 20 client.25496 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:39.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac520d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 4 client.25496 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:43:39.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.777+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fac51c0930 con 0x55fac520acf0 2023-10-26T06:43:39.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.778+0000 7f7992ffd700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac520d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.778+0000 7f7992ffd700 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac520d110 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=295c4bdd2f80b29b server_cookie=7926cf89616d1ec3 in_seq=0 out_seq=0 2023-10-26T06:43:39.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.778+0000 7f7976ff5700 10 client.25496 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:39.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f7976ff5700 1 -- 172.21.15.50:0/870355668 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fac51c0930 con 0x55fac520acf0 2023-10-26T06:43:39.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f7976ff5700 10 client.25496 handle_command_reply: tid=0 2023-10-26T06:43:39.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 client.25496 shutdown 2023-10-26T06:43:39.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 msgr2=0x55fac51faf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51faf90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f798c0cbab0 tx=0x7f798c0976a0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 shutdown_connections 2023-10-26T06:43:39.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac520d110 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51faf90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f7976ff5700 0 client.25496 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:39.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.779+0000 7f79ace78b80 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51fd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.780+0000 7f79ace78b80 1 --2- 172.21.15.50:0/870355668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac51fa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.780+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 >> 172.21.15.50:0/870355668 conn(0x55fac51657a0 msgr2=0x55fac51f0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.780+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 shutdown_connections 2023-10-26T06:43:39.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.780+0000 7f79ace78b80 1 -- 172.21.15.50:0/870355668 wait complete. 2023-10-26T06:43:39.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.780+0000 7f79ace78b80 20 client.25496 trim_cache size 0 max 16384 2023-10-26T06:43:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.800+0000 7f79ace78b80 1 Processor -- start 2023-10-26T06:43:39.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 -- start start 2023-10-26T06:43:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5201ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac4fc49a0 con 0x55fac51f1650 2023-10-26T06:43:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac51fb7d0 con 0x55fac51f7580 2023-10-26T06:43:39.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.801+0000 7f79ace78b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac51e8360 con 0x55fac51f6c60 2023-10-26T06:43:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f79927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5201ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f79927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5201ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:46936/0 (socket says 172.21.15.50:46936) 2023-10-26T06:43:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33954/0 (socket says 172.21.15.50:33954) 2023-10-26T06:43:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f79927fc700 1 -- 172.21.15.50:0/1404832520 learned_addr learned my addr 172.21.15.50:0/1404832520 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f79937fe700 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 -- 172.21.15.50:0/1404832520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 msgr2=0x55fac5201ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5201ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 -- 172.21.15.50:0/1404832520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 msgr2=0x55fac51f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 -- 172.21.15.50:0/1404832520 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fac5211d40 con 0x55fac51f1650 2023-10-26T06:43:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.802+0000 7f7992ffd700 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51f4f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55fac520d9f0 tx=0x7f7984009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f8b90b8e97a911 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.803+0000 7f7979ffb700 1 -- 172.21.15.50:0/1404832520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984017040 con 0x55fac51f1650 2023-10-26T06:43:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.803+0000 7f7979ffb700 1 -- 172.21.15.50:0/1404832520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7984018040 con 0x55fac51f1650 2023-10-26T06:43:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.803+0000 7f7979ffb700 1 -- 172.21.15.50:0/1404832520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984005020 con 0x55fac51f1650 2023-10-26T06:43:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 -- 172.21.15.50:0/1404832520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 msgr2=0x55fac51f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51f4f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55fac520d9f0 tx=0x7f7984009260 comp rx=0 tx=0).stop 2023-10-26T06:43:39.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 -- 172.21.15.50:0/1404832520 shutdown_connections 2023-10-26T06:43:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f7580 0x55fac51f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f1650 0x55fac51f4f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 --2- 172.21.15.50:0/1404832520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5201ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 -- 172.21.15.50:0/1404832520 >> 172.21.15.50:0/1404832520 conn(0x55fac51657a0 msgr2=0x55fac51f59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 -- 172.21.15.50:0/1404832520 shutdown_connections 2023-10-26T06:43:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 -- 172.21.15.50:0/1404832520 wait complete. 2023-10-26T06:43:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.804+0000 7f79ace78b80 1 -- start start 2023-10-26T06:43:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 Processor -- start 2023-10-26T06:43:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac5257ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5258420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f7580 0x55fac5201020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac5201670 con 0x55fac51f7580 2023-10-26T06:43:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac52017e0 con 0x55fac51f1650 2023-10-26T06:43:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac52019a0 con 0x55fac51f6c60 2023-10-26T06:43:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.805+0000 7f79ace78b80 10 client.0 _ll_register_callbacks cb 0x55fac502ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:39.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac5257ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac5257ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51224/0 (socket says 172.21.15.50:51224) 2023-10-26T06:43:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 -- 172.21.15.50:0/814977757 learned_addr learned my addr 172.21.15.50:0/814977757 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f79927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5258420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f79937fe700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f7580 0x55fac5201020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 -- 172.21.15.50:0/814977757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 msgr2=0x55fac5258420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5258420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 -- 172.21.15.50:0/814977757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f7580 msgr2=0x55fac5201020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f7580 0x55fac5201020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 -- 172.21.15.50:0/814977757 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7984012be0 con 0x55fac51f1650 2023-10-26T06:43:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f79937fe700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f7580 0x55fac5201020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:43:39.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f79927fc700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5258420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7992ffd700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac5257ee0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7984012350 tx=0x7f7984012380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee70f4b5b9e363ae server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.806+0000 7f7976ff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:43:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.807+0000 7f7976ff5700 1 -- 172.21.15.50:0/814977757 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984004950 con 0x55fac51f1650 2023-10-26T06:43:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.807+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7988009ae0 con 0x55fac51f1650 2023-10-26T06:43:39.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.807+0000 7f7976ff5700 1 -- 172.21.15.50:0/814977757 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7984021040 con 0x55fac51f1650 2023-10-26T06:43:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.807+0000 7f7976ff5700 1 -- 172.21.15.50:0/814977757 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7984004ab0 con 0x55fac51f1650 2023-10-26T06:43:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.807+0000 7f79ace78b80 10 client.25502 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.807+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55fac51ebdf0 con 0x55fac51f1650 2023-10-26T06:43:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f7976ff5700 1 -- 172.21.15.50:0/814977757 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7988009ae0 con 0x55fac51f1650 2023-10-26T06:43:39.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f7976ff5700 1 -- 172.21.15.50:0/814977757 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f798403b050 con 0x55fac51f1650 2023-10-26T06:43:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79ace78b80 10 client.25502 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79ace78b80 10 client.25502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:43:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79ace78b80 20 client.25502 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79ace78b80 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac5274000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:39.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79ace78b80 4 client.25502 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:43:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fac513ced0 con 0x55fac520acf0 2023-10-26T06:43:39.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.808+0000 7f79927fc700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac5274000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.809+0000 7f79927fc700 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac5274000 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1a83a5050a4ce2 server_cookie=fdf6f264476f5531 in_seq=0 out_seq=0 2023-10-26T06:43:39.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.809+0000 7f7976ff5700 10 client.25502 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f7976ff5700 1 -- 172.21.15.50:0/814977757 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fac513ced0 con 0x55fac520acf0 2023-10-26T06:43:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f7976ff5700 10 client.25502 handle_command_reply: tid=0 2023-10-26T06:43:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 client.25502 shutdown 2023-10-26T06:43:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 msgr2=0x55fac5257ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac5257ee0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7984012350 tx=0x7f7984012380 comp rx=0 tx=0).stop 2023-10-26T06:43:39.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 shutdown_connections 2023-10-26T06:43:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fac520acf0 0x55fac5274000 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fac51f7580 0x55fac5201020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fac51f1650 0x55fac5257ee0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f7976ff5700 0 client.25502 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:39.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 --2- 172.21.15.50:0/814977757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fac51f6c60 0x55fac5258420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.810+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 >> 172.21.15.50:0/814977757 conn(0x55fac51657a0 msgr2=0x55fac51f4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.811+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 shutdown_connections 2023-10-26T06:43:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.811+0000 7f79ace78b80 1 -- 172.21.15.50:0/814977757 wait complete. 2023-10-26T06:43:39.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.811+0000 7f79ace78b80 20 client.25502 trim_cache size 0 max 16384 2023-10-26T06:43:39.824 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:43:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:43:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "97d8f736-156f-4127-a760-5088df8a2fb3", 2023-10-26T06:43:39.824 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:43:39.824 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:43:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f797c0a14d0 msgr2=0x7f797c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f797c0a14d0 0x7f797c0a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f798800f6a0 tx=0x7f798801e000 comp rx=0 tx=0).stop 2023-10-26T06:43:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7994111730 msgr2=0x7f79941a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7994111730 0x7f79941a1cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b6c0 tx=0x7f798c0094b0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 shutdown_connections 2023-10-26T06:43:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f797c0a14d0 0x7f797c0a3990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7994111730 0x7f79941a1cd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7994072b90 0x7f799419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 --2- 172.21.15.50:0/2257464804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79940734b0 0x7f799419d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 >> 172.21.15.50:0/2257464804 conn(0x7f79940fc1b0 msgr2=0x7f79940fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 shutdown_connections 2023-10-26T06:43:39.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:39.812+0000 7f79995ff700 1 -- 172.21.15.50:0/2257464804 wait complete. 2023-10-26T06:43:39.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:43:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.034+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd4116c50 con 0x7fdcc40a1550 2023-10-26T06:43:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2033777376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed4103690 msgr2=0x7f6ed4103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2033777376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed4103690 0x7f6ed4103b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009990 tx=0x7f6ed0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2033777376 shutdown_connections 2023-10-26T06:43:40.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2033777376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4067890 0x7f6ed4067d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2033777376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed41056d0 0x7f6ed4103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2033777376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed4103690 0x7f6ed4103b10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.051+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2033777376 >> 172.21.15.50:0/2033777376 conn(0x7f6ed40767f0 msgr2=0x7f6ed4076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.052+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2033777376 shutdown_connections 2023-10-26T06:43:40.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.052+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2033777376 wait complete. 2023-10-26T06:43:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.053+0000 7f6edb7ff700 1 Processor -- start 2023-10-26T06:43:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.053+0000 7f6edb7ff700 1 -- start start 2023-10-26T06:43:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6edb7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed4067890 0x7f6ed419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6edb7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4103690 0x7f6ed419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6edb7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 0x7f6ed41a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6edb7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41a20e0 con 0x7f6ed4103690 2023-10-26T06:43:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6edb7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41a2250 con 0x7f6ed41056d0 2023-10-26T06:43:40.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6edb7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41a2410 con 0x7f6ed4067890 2023-10-26T06:43:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed4067890 0x7f6ed419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6ed9d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 0x7f6ed41a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed4067890 0x7f6ed419d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47000/0 (socket says 172.21.15.50:47000) 2023-10-26T06:43:40.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6ed9d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 0x7f6ed41a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51252/0 (socket says 172.21.15.50:51252) 2023-10-26T06:43:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6ed959b700 1 -- 172.21.15.50:0/2001062436 learned_addr learned my addr 172.21.15.50:0/2001062436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.054+0000 7f6ed8d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4103690 0x7f6ed419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/2001062436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed4067890 msgr2=0x7f6ed419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed4067890 0x7f6ed419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4103690 msgr2=0x7f6ed419d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4103690 0x7f6ed419d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/2001062436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00095f0 con 0x7f6ed41056d0 2023-10-26T06:43:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 0x7f6ed41a1aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00efc0 tx=0x7f6ecc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.055+0000 7f6ec67fc700 1 -- 172.21.15.50:0/2001062436 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc018070 con 0x7f6ed41056d0 2023-10-26T06:43:40.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.056+0000 7f6ec67fc700 1 -- 172.21.15.50:0/2001062436 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ecc00f040 con 0x7f6ed41056d0 2023-10-26T06:43:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.056+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed41a2690 con 0x7f6ed41056d0 2023-10-26T06:43:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.056+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed41a9f30 con 0x7f6ed41056d0 2023-10-26T06:43:40.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.056+0000 7f6ec67fc700 1 -- 172.21.15.50:0/2001062436 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00cc80 con 0x7f6ed41056d0 2023-10-26T06:43:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.060+0000 7f6ec67fc700 1 -- 172.21.15.50:0/2001062436 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6ecc004000 con 0x7f6ed41056d0 2023-10-26T06:43:40.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 Processor -- start 2023-10-26T06:43:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 -- start start 2023-10-26T06:43:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb813fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb80e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb80ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb7816e0 con 0x562fdb813be0 2023-10-26T06:43:40.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb767c60 con 0x562fdb814500 2023-10-26T06:43:40.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.061+0000 7f6eef173b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb765580 con 0x562fdb80e5d0 2023-10-26T06:43:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb80e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed8d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb813fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb80e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51268/0 (socket says 172.21.15.50:51268) 2023-10-26T06:43:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 -- 172.21.15.50:0/4264012558 learned_addr learned my addr 172.21.15.50:0/4264012558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb80ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 -- 172.21.15.50:0/4264012558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 msgr2=0x562fdb80ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb80ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 -- 172.21.15.50:0/4264012558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 msgr2=0x562fdb813fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb813fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed959b700 1 -- 172.21.15.50:0/4264012558 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fdb71e3f0 con 0x562fdb814500 2023-10-26T06:43:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.062+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb80ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:43:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.063+0000 7f6ec67fc700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ec00a1550 0x7f6ec00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.063+0000 7f6ed959b700 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb80e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800be20 tx=0x7f6ec80106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8019af712c35d89b server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.063+0000 7f6ec67fc700 1 -- 172.21.15.50:0/2001062436 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6ecc0cc810 con 0x7f6ed41056d0 2023-10-26T06:43:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.063+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ec00a1550 0x7f6ec00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.064+0000 7f6ebf7fe700 1 -- 172.21.15.50:0/4264012558 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8010ed0 con 0x562fdb814500 2023-10-26T06:43:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.064+0000 7f6ebf7fe700 1 -- 172.21.15.50:0/4264012558 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ec8015070 con 0x562fdb814500 2023-10-26T06:43:40.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.064+0000 7f6ebf7fe700 1 -- 172.21.15.50:0/4264012558 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8019790 con 0x562fdb814500 2023-10-26T06:43:40.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ec00a1550 0x7f6ec00a3a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098e0 tx=0x7f6ed001a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 -- 172.21.15.50:0/4264012558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 msgr2=0x562fdb80e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb80e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800be20 tx=0x7f6ec80106b0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 -- 172.21.15.50:0/4264012558 shutdown_connections 2023-10-26T06:43:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb80ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb813fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4264012558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb80e090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 -- 172.21.15.50:0/4264012558 >> 172.21.15.50:0/4264012558 conn(0x562fdb782720 msgr2=0x562fdb808b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 -- 172.21.15.50:0/4264012558 shutdown_connections 2023-10-26T06:43:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.065+0000 7f6eef173b80 1 -- 172.21.15.50:0/4264012558 wait complete. 2023-10-26T06:43:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.066+0000 7f6eef173b80 1 -- start start 2023-10-26T06:43:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.066+0000 7f6eef173b80 1 Processor -- start 2023-10-26T06:43:40.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb8177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb817d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb760e70 con 0x562fdb813be0 2023-10-26T06:43:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb6fd710 con 0x562fdb814500 2023-10-26T06:43:40.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb6fd3b0 con 0x562fdb80e5d0 2023-10-26T06:43:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6eef173b80 10 client.0 _ll_register_callbacks cb 0x562fdb647a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6ed9d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb817d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6ed9d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb817d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:51282/0 (socket says 172.21.15.50:51282) 2023-10-26T06:43:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/3000416852 learned_addr learned my addr 172.21.15.50:0/3000416852 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6ed959b700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.067+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb8177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/3000416852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 msgr2=0x562fdb81a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/3000416852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 msgr2=0x562fdb8177d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb8177d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ed9d9c700 1 -- 172.21.15.50:0/3000416852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec800ba50 con 0x562fdb814500 2023-10-26T06:43:40.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb817d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc095ff0 tx=0x7f6ecc004db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37bff8df59dce46 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ebcff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:43:40.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ebcff9700 1 -- 172.21.15.50:0/3000416852 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc09dc40 con 0x562fdb814500 2023-10-26T06:43:40.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ebcff9700 1 -- 172.21.15.50:0/3000416852 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6ecc0a1df0 con 0x562fdb814500 2023-10-26T06:43:40.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fdb765ef0 con 0x562fdb814500 2023-10-26T06:43:40.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.068+0000 7f6ebcff9700 1 -- 172.21.15.50:0/3000416852 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ecc097e90 con 0x562fdb814500 2023-10-26T06:43:40.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 10 client.25517 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:40.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562fdb58bde0 con 0x562fdb814500 2023-10-26T06:43:40.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6ebcff9700 1 -- 172.21.15.50:0/3000416852 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ecc0b6080 con 0x562fdb814500 2023-10-26T06:43:40.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6ebcff9700 1 -- 172.21.15.50:0/3000416852 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6ecc0a1960 con 0x562fdb814500 2023-10-26T06:43:40.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 10 client.25517 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:40.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 10 client.25517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:43:40.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 20 client.25517 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:40.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb827f50 0x562fdb82a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 4 client.25517 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:43:40.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fdb7dd8b0 con 0x562fdb827f50 2023-10-26T06:43:40.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.069+0000 7f6ed959b700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb827f50 0x562fdb82a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.070+0000 7f6ed959b700 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb827f50 0x562fdb82a370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd427ec4fc2422c server_cookie=fade57a44b225684 in_seq=0 out_seq=0 2023-10-26T06:43:40.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.070+0000 7f6ebcff9700 10 client.25517 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:40.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6ebcff9700 1 -- 172.21.15.50:0/3000416852 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562fdb7dd8b0 con 0x562fdb827f50 2023-10-26T06:43:40.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6ebcff9700 10 client.25517 handle_command_reply: tid=0 2023-10-26T06:43:40.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 client.25517 shutdown 2023-10-26T06:43:40.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 msgr2=0x562fdb817d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb817d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc095ff0 tx=0x7f6ecc004db0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 shutdown_connections 2023-10-26T06:43:40.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb827f50 0x562fdb82a370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb817d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6ebcff9700 0 client.25517 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:40.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 --2- 172.21.15.50:0/3000416852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb8177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 >> 172.21.15.50:0/3000416852 conn(0x562fdb782720 msgr2=0x562fdb808ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 shutdown_connections 2023-10-26T06:43:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.071+0000 7f6eef173b80 1 -- 172.21.15.50:0/3000416852 wait complete. 2023-10-26T06:43:40.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.072+0000 7f6eef173b80 20 client.25517 trim_cache size 0 max 16384 2023-10-26T06:43:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.108+0000 7f6eef173b80 1 Processor -- start 2023-10-26T06:43:40.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 -- start start 2023-10-26T06:43:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 0x562fdb81ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb813be0 0x562fdb819f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb8160a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb5e1920 con 0x562fdb80e5d0 2023-10-26T06:43:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb8098d0 con 0x562fdb814500 2023-10-26T06:43:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6eef173b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb8183c0 con 0x562fdb813be0 2023-10-26T06:43:40.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 0x562fdb81ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6ed9d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb8160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 0x562fdb81ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34014/0 (socket says 172.21.15.50:34014) 2023-10-26T06:43:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.109+0000 7f6ed959b700 1 -- 172.21.15.50:0/4097509095 learned_addr learned my addr 172.21.15.50:0/4097509095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb813be0 0x562fdb819f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed959b700 1 -- 172.21.15.50:0/4097509095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb813be0 msgr2=0x562fdb819f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed959b700 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb813be0 0x562fdb819f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed959b700 1 -- 172.21.15.50:0/4097509095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 msgr2=0x562fdb8160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed959b700 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb8160a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed959b700 1 -- 172.21.15.50:0/4097509095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fdb574c60 con 0x562fdb80e5d0 2023-10-26T06:43:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ed959b700 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 0x562fdb81ef40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80059d0 tx=0x7f6ec8011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eebaeea4aa35320 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.110+0000 7f6ebffff700 1 -- 172.21.15.50:0/4097509095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8010cd0 con 0x562fdb80e5d0 2023-10-26T06:43:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.111+0000 7f6ebffff700 1 -- 172.21.15.50:0/4097509095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ec8010e30 con 0x562fdb80e5d0 2023-10-26T06:43:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.111+0000 7f6ebffff700 1 -- 172.21.15.50:0/4097509095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8011940 con 0x562fdb80e5d0 2023-10-26T06:43:40.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.111+0000 7f6eef173b80 1 -- 172.21.15.50:0/4097509095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 msgr2=0x562fdb81ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.111+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 0x562fdb81ef40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80059d0 tx=0x7f6ec8011e80 comp rx=0 tx=0).stop 2023-10-26T06:43:40.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 -- 172.21.15.50:0/4097509095 shutdown_connections 2023-10-26T06:43:40.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb8160a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb80e5d0 0x562fdb81ef40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 --2- 172.21.15.50:0/4097509095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb813be0 0x562fdb819f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 -- 172.21.15.50:0/4097509095 >> 172.21.15.50:0/4097509095 conn(0x562fdb782720 msgr2=0x562fdb817790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 -- 172.21.15.50:0/4097509095 shutdown_connections 2023-10-26T06:43:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 -- 172.21.15.50:0/4097509095 wait complete. 2023-10-26T06:43:40.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 -- start start 2023-10-26T06:43:40.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.112+0000 7f6eef173b80 1 Processor -- start 2023-10-26T06:43:40.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb81b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb81b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb81c040 con 0x562fdb813be0 2023-10-26T06:43:40.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb81c1b0 con 0x562fdb814500 2023-10-26T06:43:40.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fdb87bdd0 con 0x562fdb80e5d0 2023-10-26T06:43:40.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6eef173b80 10 client.0 _ll_register_callbacks cb 0x562fdb647a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:43:40.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.113+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47030/0 (socket says 172.21.15.50:47030) 2023-10-26T06:43:40.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 -- 172.21.15.50:0/1467415738 learned_addr learned my addr 172.21.15.50:0/1467415738 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed9d9c700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb81b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb81b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 -- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 msgr2=0x562fdb81b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb81b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 -- 172.21.15.50:0/1467415738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 msgr2=0x562fdb81b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:43:40.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb81b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed959b700 1 -- 172.21.15.50:0/1467415738 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec801e040 con 0x562fdb80e5d0 2023-10-26T06:43:40.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.114+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb81b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:43:40.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.115+0000 7f6ed959b700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81eea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8010dc0 tx=0x7f6ec8010ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44611fd4f75e7f4f server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.115+0000 7f6ebcff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:43:40.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.115+0000 7f6ebcff9700 1 -- 172.21.15.50:0/1467415738 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8011730 con 0x562fdb80e5d0 2023-10-26T06:43:40.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.115+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ec8015070 con 0x562fdb80e5d0 2023-10-26T06:43:40.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.116+0000 7f6ebcff9700 1 -- 172.21.15.50:0/1467415738 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6ec8011890 con 0x562fdb80e5d0 2023-10-26T06:43:40.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.116+0000 7f6ebcff9700 1 -- 172.21.15.50:0/1467415738 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ec8011730 con 0x562fdb80e5d0 2023-10-26T06:43:40.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.116+0000 7f6eef173b80 10 client.25540 fetch_fsmap learned FSMap version 23 2023-10-26T06:43:40.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.116+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562fdb5b2250 con 0x562fdb80e5d0 2023-10-26T06:43:40.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.116+0000 7f6ebcff9700 1 -- 172.21.15.50:0/1467415738 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ec8015070 con 0x562fdb80e5d0 2023-10-26T06:43:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6ebcff9700 1 -- 172.21.15.50:0/1467415738 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6ec802c020 con 0x562fdb80e5d0 2023-10-26T06:43:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6eef173b80 10 client.25540 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:43:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6eef173b80 10 client.25540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:43:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6eef173b80 20 client.25540 populate_metadata read hostname 'smithi050' 2023-10-26T06:43:40.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6eef173b80 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb87d220 0x562fdb87f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6eef173b80 4 client.25540 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:43:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.117+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562fdb759e50 con 0x562fdb87d220 2023-10-26T06:43:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.118+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb87d220 0x562fdb87f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.119+0000 7f6ed8d9a700 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb87d220 0x562fdb87f640 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2738d2d36c30aa server_cookie=7173457cc7e2c9c0 in_seq=0 out_seq=0 2023-10-26T06:43:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.119+0000 7f6ebcff9700 10 client.25540 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:40.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.119+0000 7f6ebcff9700 1 -- 172.21.15.50:0/1467415738 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562fdb759e50 con 0x562fdb87d220 2023-10-26T06:43:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.119+0000 7f6ebcff9700 10 client.25540 handle_command_reply: tid=0 2023-10-26T06:43:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.119+0000 7f6eef173b80 1 client.25540 shutdown 2023-10-26T06:43:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 msgr2=0x562fdb81eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81eea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8010dc0 tx=0x7f6ec8010ab0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 shutdown_connections 2023-10-26T06:43:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562fdb87d220 0x562fdb87f640 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562fdb814500 0x562fdb81b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562fdb80e5d0 0x562fdb81eea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 --2- 172.21.15.50:0/1467415738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562fdb813be0 0x562fdb81b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 >> 172.21.15.50:0/1467415738 conn(0x562fdb782720 msgr2=0x562fdb8024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6ebcff9700 0 client.25540 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:43:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 shutdown_connections 2023-10-26T06:43:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 1 -- 172.21.15.50:0/1467415738 wait complete. 2023-10-26T06:43:40.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.120+0000 7f6eef173b80 20 client.25540 trim_cache size 0 max 16384 2023-10-26T06:43:40.131 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:43:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-26T06:43:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:43:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: "97d8f736-156f-4127-a760-5088df8a2fb3": { 2023-10-26T06:43:40.131 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:43:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "97d8f736-156f-4127-a760-5088df8a2fb3", 2023-10-26T06:43:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:43:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:43:40.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:43:40.132 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:43:40.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ec00a1550 msgr2=0x7f6ec00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ec00a1550 0x7f6ec00a3a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098e0 tx=0x7f6ed001a040 comp rx=0 tx=0).stop 2023-10-26T06:43:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 msgr2=0x7f6ed41a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 0x7f6ed41a1aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00efc0 tx=0x7f6ecc00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 shutdown_connections 2023-10-26T06:43:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f6ec00a1550 0x7f6ec00a3a10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ed41056d0 0x7f6ed41a1aa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ed4067890 0x7f6ed419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 --2- 172.21.15.50:0/2001062436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ed4103690 0x7f6ed419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 >> 172.21.15.50:0/2001062436 conn(0x7f6ed40767f0 msgr2=0x7f6ed40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 shutdown_connections 2023-10-26T06:43:40.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.121+0000 7f6edb7ff700 1 -- 172.21.15.50:0/2001062436 wait complete. 2023-10-26T06:43:40.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:39 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4286429191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:39 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2274774678' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.143 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:39 smithi050 ceph-mon[94997]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-10-26T06:43:40.143 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:39 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.145 INFO:tasks.cephfs.filesystem:scrub status for tag:97d8f736-156f-4127-a760-5088df8a2fb3 - {'path': '/', 'tag': '97d8f736-156f-4127-a760-5088df8a2fb3', 'options': 'recursive,force'} 2023-10-26T06:43:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.165+0000 7fdcd1ffb700 1 -- 172.21.15.50:0/2245919782 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdcd4116c50 con 0x7fdcc40a1550 2023-10-26T06:43:40.167 INFO:teuthology.orchestra.run.smithi050.stdout:Schedule set for path / 2023-10-26T06:43:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc40a1550 msgr2=0x7fdcc40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc40a1550 0x7fdcc40a3a10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009d70 tx=0x7fdcc8009260 comp rx=0 tx=0).stop 2023-10-26T06:43:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 msgr2=0x7fdcd419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd419d6b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0000c00 tx=0x7fdcc0005740 comp rx=0 tx=0).stop 2023-10-26T06:43:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 shutdown_connections 2023-10-26T06:43:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fdcc40a1550 0x7fdcc40a3a10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdcd4105680 0x7fdcd41a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdcd4067b20 0x7fdcd419d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 --2- 172.21.15.50:0/2245919782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd4103640 0x7fdcd419d6b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 >> 172.21.15.50:0/2245919782 conn(0x7fdcd4076790 msgr2=0x7fdcd40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 shutdown_connections 2023-10-26T06:43:40.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.168+0000 7fdcdabff700 1 -- 172.21.15.50:0/2245919782 wait complete. 2023-10-26T06:43:40.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:39 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4286429191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:39 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2274774678' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:39 smithi125 ceph-mon[130643]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-10-26T06:43:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:39 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-26T06:43:40.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:39 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4286429191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:39 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2274774678' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:39 smithi153 ceph-mon[131657]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-10-26T06:43:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:39 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:43:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.452+0000 7fd6073ff700 1 -- 172.21.15.50:0/3302324113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd600072c20 msgr2=0x7fd600073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.452+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3302324113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd600072c20 0x7fd600073000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009990 tx=0x7fd5fc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 -- 172.21.15.50:0/3302324113 shutdown_connections 2023-10-26T06:43:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3302324113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd60010cf00 0x7fd60010f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3302324113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd600072c20 0x7fd600073000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3302324113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd60010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 -- 172.21.15.50:0/3302324113 >> 172.21.15.50:0/3302324113 conn(0x7fd6000fc190 msgr2=0x7fd6000fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 -- 172.21.15.50:0/3302324113 shutdown_connections 2023-10-26T06:43:40.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.453+0000 7fd6073ff700 1 -- 172.21.15.50:0/3302324113 wait complete. 2023-10-26T06:43:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 Processor -- start 2023-10-26T06:43:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 -- start start 2023-10-26T06:43:40.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd600072c20 0x7fd600198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd6001992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd60010cf00 0x7fd60019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60019dca0 con 0x7fd600073540 2023-10-26T06:43:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60019de10 con 0x7fd60010cf00 2023-10-26T06:43:40.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd6073ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60019dfd0 con 0x7fd600072c20 2023-10-26T06:43:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.454+0000 7fd60499a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd6001992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd6001992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34038/0 (socket says 172.21.15.50:34038) 2023-10-26T06:43:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 -- 172.21.15.50:0/3950809620 learned_addr learned my addr 172.21.15.50:0/3950809620 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60599c700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd60010cf00 0x7fd60019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60519b700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd600072c20 0x7fd600198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 -- 172.21.15.50:0/3950809620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd600072c20 msgr2=0x7fd600198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd600072c20 0x7fd600198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 -- 172.21.15.50:0/3950809620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd60010cf00 msgr2=0x7fd60019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd60010cf00 0x7fd60019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 -- 172.21.15.50:0/3950809620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc0095f0 con 0x7fd600073540 2023-10-26T06:43:40.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd60499a700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd6001992c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000e9a0 tx=0x7fd5f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.455+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0009790 con 0x7fd600073540 2023-10-26T06:43:40.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.456+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5f000cbd0 con 0x7fd600073540 2023-10-26T06:43:40.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.456+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60019e2b0 con 0x7fd600073540 2023-10-26T06:43:40.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.456+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0018680 con 0x7fd600073540 2023-10-26T06:43:40.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.456+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6001a5af0 con 0x7fd600073540 2023-10-26T06:43:40.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.457+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600108110 con 0x7fd600073540 2023-10-26T06:43:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.459+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd5f000cd40 con 0x7fd600073540 2023-10-26T06:43:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.461+0000 7fd5f67fc700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5ec0a1550 0x7fd5ec0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.461+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd5f0014070 con 0x7fd600073540 2023-10-26T06:43:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.461+0000 7fd60519b700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5ec0a1550 0x7fd5ec0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:40.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.462+0000 7fd60519b700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5ec0a1550 0x7fd5ec0a3a10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00b2e0 tx=0x7fd5fc005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:40.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.465+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd5f0052100 con 0x7fd600073540 2023-10-26T06:43:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.715+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fd600112860 con 0x7fd5ec0a1550 2023-10-26T06:43:40.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.775+0000 7fd5f67fc700 1 -- 172.21.15.50:0/3950809620 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd600112860 con 0x7fd5ec0a1550 2023-10-26T06:43:40.777 INFO:teuthology.orchestra.run.smithi050.stdout:Retention added to path / 2023-10-26T06:43:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5ec0a1550 msgr2=0x7fd5ec0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5ec0a1550 0x7fd5ec0a3a10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00b2e0 tx=0x7fd5fc005fd0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 msgr2=0x7fd6001992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:40.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd6001992c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000e9a0 tx=0x7fd5f000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 shutdown_connections 2023-10-26T06:43:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5ec0a1550 0x7fd5ec0a3a10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd60010cf00 0x7fd60019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd600072c20 0x7fd600198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 --2- 172.21.15.50:0/3950809620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd600073540 0x7fd6001992c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 >> 172.21.15.50:0/3950809620 conn(0x7fd6000fc190 msgr2=0x7fd6000fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 shutdown_connections 2023-10-26T06:43:40.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:40.778+0000 7fd6073ff700 1 -- 172.21.15.50:0/3950809620 wait complete. 2023-10-26T06:43:40.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-26T06:43:41.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 -- 172.21.15.50:0/3232407383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 msgr2=0x7f694010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 --2- 172.21.15.50:0/3232407383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 0x7f694010d5b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f693800b0a0 tx=0x7f693800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 -- 172.21.15.50:0/3232407383 shutdown_connections 2023-10-26T06:43:41.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 --2- 172.21.15.50:0/3232407383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 0x7f694010d5b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 --2- 172.21.15.50:0/3232407383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401066f0 0x7f6940106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 --2- 172.21.15.50:0/3232407383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401006e0 0x7f6940100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 -- 172.21.15.50:0/3232407383 >> 172.21.15.50:0/3232407383 conn(0x7f69400fc1f0 msgr2=0x7f69400fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:41.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 -- 172.21.15.50:0/3232407383 shutdown_connections 2023-10-26T06:43:41.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.005+0000 7f69481ff700 1 -- 172.21.15.50:0/3232407383 wait complete. 2023-10-26T06:43:41.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.006+0000 7f69481ff700 1 Processor -- start 2023-10-26T06:43:41.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.006+0000 7f69481ff700 1 -- start start 2023-10-26T06:43:41.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f69481ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401006e0 0x7f6940198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f69481ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 0x7f6940199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f69481ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401066f0 0x7f694019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f69481ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694019cb30 con 0x7f69401006e0 2023-10-26T06:43:41.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f69481ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694019cca0 con 0x7f69401010a0 2023-10-26T06:43:41.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f69481ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694019ce60 con 0x7f69401066f0 2023-10-26T06:43:41.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f6945f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401006e0 0x7f6940198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694579a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 0x7f6940199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694679c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401066f0 0x7f694019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f6945f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401006e0 0x7f6940198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34058/0 (socket says 172.21.15.50:34058) 2023-10-26T06:43:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f6945f9b700 1 -- 172.21.15.50:0/1477505765 learned_addr learned my addr 172.21.15.50:0/1477505765 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694679c700 1 -- 172.21.15.50:0/1477505765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 msgr2=0x7f6940199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694679c700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 0x7f6940199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694679c700 1 -- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401006e0 msgr2=0x7f6940198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694679c700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401006e0 0x7f6940198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.007+0000 7f694679c700 1 -- 172.21.15.50:0/1477505765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938009d00 con 0x7f69401066f0 2023-10-26T06:43:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.008+0000 7f694679c700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401066f0 0x7f694019c530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f693800b070 tx=0x7f69380077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.008+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800e040 con 0x7f69401066f0 2023-10-26T06:43:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.008+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694019d0e0 con 0x7f69401066f0 2023-10-26T06:43:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.008+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6938004e60 con 0x7f69401066f0 2023-10-26T06:43:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.008+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938005040 con 0x7f69401066f0 2023-10-26T06:43:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.008+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69401a5aa0 con 0x7f69401066f0 2023-10-26T06:43:41.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.009+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6940101e20 con 0x7f69401066f0 2023-10-26T06:43:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.011+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f693801d470 con 0x7f69401066f0 2023-10-26T06:43:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.012+0000 7f6936ffd700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f692c0a14d0 0x7f692c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.012+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f69380ce270 con 0x7f69401066f0 2023-10-26T06:43:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.013+0000 7f6945f9b700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f692c0a14d0 0x7f692c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.013+0000 7f6945f9b700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f692c0a14d0 0x7f692c0a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f693c009ca0 tx=0x7f693c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.014+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6938097890 con 0x7f69401066f0 2023-10-26T06:43:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:40 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:43:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:40 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:43:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:40 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:43:41.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:40 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:43:41.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:40 smithi125 ceph-mon[130643]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:41.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:40 smithi125 ceph-mon[130643]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:40 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:43:41.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:40 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:43:41.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:40 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:43:41.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:40 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:43:41.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:40 smithi153 ceph-mon[131657]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:41.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:40 smithi153 ceph-mon[131657]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.263+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f694019a0a0 con 0x7f692c0a14d0 2023-10-26T06:43:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:40 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:43:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:40 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:43:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:40 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:43:41.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:40 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:43:41.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:40 smithi050 ceph-mon[94997]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:41.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:40 smithi050 ceph-mon[94997]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:41.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.271+0000 7f6936ffd700 1 -- 172.21.15.50:0/1477505765 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f694019a0a0 con 0x7f692c0a14d0 2023-10-26T06:43:41.273 INFO:teuthology.orchestra.run.smithi050.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-26T00:00:00", "created": "2023-10-26T06:43:40", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-26T06:43:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.274+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f692c0a14d0 msgr2=0x7f692c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.274+0000 7f69481ff700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f692c0a14d0 0x7f692c0a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f693c009ca0 tx=0x7f693c009260 comp rx=0 tx=0).stop 2023-10-26T06:43:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.274+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401066f0 msgr2=0x7f694019c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.274+0000 7f69481ff700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401066f0 0x7f694019c530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f693800b070 tx=0x7f69380077f0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 shutdown_connections 2023-10-26T06:43:41.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f692c0a14d0 0x7f692c0a3990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69401066f0 0x7f694019c530 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69401006e0 0x7f6940198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 --2- 172.21.15.50:0/1477505765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69401010a0 0x7f6940199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 >> 172.21.15.50:0/1477505765 conn(0x7f69400fc1f0 msgr2=0x7f694010bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 shutdown_connections 2023-10-26T06:43:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.275+0000 7f69481ff700 1 -- 172.21.15.50:0/1477505765 wait complete. 2023-10-26T06:43:41.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-26T06:43:41.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 -- 172.21.15.50:0/101063159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0ff5d0 msgr2=0x7fbcec0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/101063159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec0ffa50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009990 tx=0x7fbcd8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 -- 172.21.15.50:0/101063159 shutdown_connections 2023-10-26T06:43:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/101063159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcec0fff90 0x7fbcec10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/101063159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec1045e0 0x7fbcec1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/101063159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec0ffa50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 -- 172.21.15.50:0/101063159 >> 172.21.15.50:0/101063159 conn(0x7fbcec076790 msgr2=0x7fbcec076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:41.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 -- 172.21.15.50:0/101063159 shutdown_connections 2023-10-26T06:43:41.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.507+0000 7fbcf2dff700 1 -- 172.21.15.50:0/101063159 wait complete. 2023-10-26T06:43:41.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.508+0000 7fbcf2dff700 1 Processor -- start 2023-10-26T06:43:41.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.508+0000 7fbcf2dff700 1 -- start start 2023-10-26T06:43:41.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.508+0000 7fbcf2dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf2dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 0x7fbcec19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf2dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcec1045e0 0x7fbcec198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf2dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec199190 con 0x7fbcec0fff90 2023-10-26T06:43:41.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf2dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec199300 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf2dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec1994c0 con 0x7fbcec1045e0 2023-10-26T06:43:41.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 0x7fbcec19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 0x7fbcec19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34062/0 (socket says 172.21.15.50:34062) 2023-10-26T06:43:41.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf0b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcebfff700 1 -- 172.21.15.50:0/2281996763 learned_addr learned my addr 172.21.15.50:0/2281996763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:43:41.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf139c700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcec1045e0 0x7fbcec198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf0b9b700 1 -- 172.21.15.50:0/2281996763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcec1045e0 msgr2=0x7fbcec198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf0b9b700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcec1045e0 0x7fbcec198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf0b9b700 1 -- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 msgr2=0x7fbcec19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf0b9b700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 0x7fbcec19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcf0b9b700 1 -- 172.21.15.50:0/2281996763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009520 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.509+0000 7fbcebfff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 0x7fbcec19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:43:41.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.510+0000 7fbcf0b9b700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec19e9a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbce000e9c0 tx=0x7fbce000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:41.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.510+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000cb70 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.510+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbce000ee60 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.510+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd80095f0 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.510+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0018680 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.510+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec1a5860 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.511+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec100cd0 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.513+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 22) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbce0010430 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.514+0000 7fbce9ffb700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcdc0a14d0 0x7fbcdc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:43:41.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.514+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbce0014070 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.514+0000 7fbcebfff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcdc0a14d0 0x7fbcdc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:43:41.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.515+0000 7fbcebfff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcdc0a14d0 0x7fbcdc0a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbcec19a220 tx=0x7fbcd800b280 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:43:41.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.518+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbce0096710 con 0x7fbcec0ff5d0 2023-10-26T06:43:41.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.771+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fbcec1106c0 con 0x7fbcdc0a14d0 2023-10-26T06:43:41.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.778+0000 7fbce9ffb700 1 -- 172.21.15.50:0/2281996763 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fbcec1106c0 con 0x7fbcdc0a14d0 2023-10-26T06:43:41.780 INFO:teuthology.orchestra.run.smithi050.stdout:/ 1m 6m3h 2023-10-26T06:43:41.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcdc0a14d0 msgr2=0x7fbcdc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcdc0a14d0 0x7fbcdc0a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbcec19a220 tx=0x7fbcd800b280 comp rx=0 tx=0).stop 2023-10-26T06:43:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec0ff5d0 msgr2=0x7fbcec19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:43:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec19e9a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbce000e9c0 tx=0x7fbce000ecd0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 shutdown_connections 2023-10-26T06:43:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbcdc0a14d0 0x7fbcdc0a3990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcec1045e0 0x7fbcec198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcec0ff5d0 0x7fbcec19e9a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 --2- 172.21.15.50:0/2281996763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcec0fff90 0x7fbcec19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:43:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 >> 172.21.15.50:0/2281996763 conn(0x7fbcec076790 msgr2=0x7fbcec10a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:43:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 shutdown_connections 2023-10-26T06:43:41.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:43:41.781+0000 7fbcf2dff700 1 -- 172.21.15.50:0/2281996763 wait complete. 2023-10-26T06:43:41.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-26T06:43:41.908 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-26T06:43:41.921 INFO:teuthology.run_tasks:Running task workunit... 2023-10-26T06:43:41.973 INFO:tasks.workunit:Pulling workunits from ref 384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:43:41.974 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-26T06:43:41.974 INFO:tasks.workunit:timeout=3h 2023-10-26T06:43:41.974 INFO:tasks.workunit:cleanup=True 2023-10-26T06:43:41.975 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:42.024 INFO:teuthology.orchestra.run.smithi050.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:42.024 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-26T06:43:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2023-10-26T06:43:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-26T06:43:42.025 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-26T06:43:42.025 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-10-26 06:41:37.511924636 +0000 2023-10-26T06:43:42.025 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-10-26 06:41:37.511924636 +0000 2023-10-26T06:43:42.026 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-10-26 06:43:30.570363849 +0000 2023-10-26T06:43:42.026 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-10-26 06:41:37.511924636 +0000 2023-10-26T06:43:42.026 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-26T06:43:42.027 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-26T06:43:42.127 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:41 smithi050 ceph-mon[94997]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:42.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:41 smithi050 ceph-mon[94997]: pgmap v320: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-10-26T06:43:42.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:41 smithi050 ceph-mon[94997]: from='client.25541 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:42.148 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 384993681abceb8cb8affea10538d607052db4b4 2023-10-26T06:43:42.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:41 smithi125 ceph-mon[130643]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:42.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:41 smithi125 ceph-mon[130643]: pgmap v320: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-10-26T06:43:42.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:41 smithi125 ceph-mon[130643]: from='client.25541 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:42.200 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-26T06:43:42.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:41 smithi153 ceph-mon[131657]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:42.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:41 smithi153 ceph-mon[131657]: pgmap v320: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-10-26T06:43:42.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:41 smithi153 ceph-mon[131657]: from='client.25541 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:43:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:42 smithi125 ceph-mon[130643]: mgrmap e23: x(active, since 8m), standbys: z, y 2023-10-26T06:43:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:42 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:42 smithi153 ceph-mon[131657]: mgrmap e23: x(active, since 8m), standbys: z, y 2023-10-26T06:43:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:42 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:42 smithi050 ceph-mon[94997]: mgrmap e23: x(active, since 8m), standbys: z, y 2023-10-26T06:43:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:43.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:42 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:44.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:44.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:44.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-10-26T06:43:44.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:43:44.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:43:44.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:43:44.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:44.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-10-26T06:43:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:43:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:43:44.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:43:44.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:45.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-10-26T06:43:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:43:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:43:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:43:45.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:43:46.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:46 smithi153 ceph-mon[131657]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 93 KiB/s wr, 25 op/s 2023-10-26T06:43:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:46 smithi050 ceph-mon[94997]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 93 KiB/s wr, 25 op/s 2023-10-26T06:43:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:46 smithi125 ceph-mon[130643]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 93 KiB/s wr, 25 op/s 2023-10-26T06:43:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:48 smithi153 ceph-mon[131657]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 115 KiB/s wr, 40 op/s 2023-10-26T06:43:49.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:48 smithi050 ceph-mon[94997]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 115 KiB/s wr, 40 op/s 2023-10-26T06:43:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:48 smithi125 ceph-mon[130643]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 115 KiB/s wr, 40 op/s 2023-10-26T06:43:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:50 smithi153 ceph-mon[131657]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 115 KiB/s wr, 41 op/s 2023-10-26T06:43:51.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:50 smithi050 ceph-mon[94997]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 115 KiB/s wr, 41 op/s 2023-10-26T06:43:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:50 smithi125 ceph-mon[130643]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 115 KiB/s wr, 41 op/s 2023-10-26T06:43:52.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:52 smithi153 ceph-mon[131657]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 115 KiB/s wr, 40 op/s 2023-10-26T06:43:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:52 smithi050 ceph-mon[94997]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 115 KiB/s wr, 40 op/s 2023-10-26T06:43:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:52 smithi125 ceph-mon[130643]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 115 KiB/s wr, 40 op/s 2023-10-26T06:43:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:53 smithi125 ceph-mon[130643]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-10-26T06:43:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:53 smithi153 ceph-mon[131657]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-10-26T06:43:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:53 smithi050 ceph-mon[94997]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-10-26T06:43:56.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:56 smithi153 ceph-mon[131657]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-26T06:43:57.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:56 smithi050 ceph-mon[94997]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-26T06:43:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:56 smithi125 ceph-mon[130643]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-26T06:43:58.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:43:58 smithi153 ceph-mon[131657]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-26T06:43:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:43:58 smithi050 ceph-mon[94997]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-26T06:43:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:43:58 smithi125 ceph-mon[130643]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-10-26T06:44:00.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:00 smithi153 ceph-mon[131657]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2023-10-26T06:44:01.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:00 smithi050 ceph-mon[94997]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2023-10-26T06:44:01.018 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:44:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:44:00.790+0000 7fab9e830700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:44:01.019 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:44:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:44:00.790+0000 7fab9e830700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:44:01.019 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:44:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:44:00.790+0000 7fab9e830700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:44:01.020 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:44:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:44:00.790+0000 7fab9e830700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:44:01.020 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:44:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:44:00.790+0000 7fab9e830700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-26T06:44:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:00 smithi125 ceph-mon[130643]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2023-10-26T06:44:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:02 smithi050 ceph-mon[94997]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:44:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:02 smithi125 ceph-mon[130643]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:44:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:02 smithi153 ceph-mon[131657]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:44:04.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:03 smithi050 ceph-mon[94997]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-26T06:44:04.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:03 smithi125 ceph-mon[130643]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-26T06:44:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:03 smithi153 ceph-mon[131657]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-26T06:44:05.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:04 smithi050 ceph-mon[94997]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:44:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:04 smithi125 ceph-mon[130643]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:44:05.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:04 smithi153 ceph-mon[131657]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-10-26T06:44:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:06 smithi050 ceph-mon[94997]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-10-26T06:44:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:06 smithi125 ceph-mon[130643]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-10-26T06:44:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:06 smithi153 ceph-mon[131657]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-10-26T06:44:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:08 smithi050 ceph-mon[94997]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-10-26T06:44:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:08 smithi125 ceph-mon[130643]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-10-26T06:44:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:08 smithi153 ceph-mon[131657]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2023-10-26T06:44:10.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:44:10.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 -- 172.21.15.50:0/2201846565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc108960 msgr2=0x7fbecc108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 --2- 172.21.15.50:0/2201846565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc108960 0x7fbecc108d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009990 tx=0x7fbec8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 -- 172.21.15.50:0/2201846565 shutdown_connections 2023-10-26T06:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 --2- 172.21.15.50:0/2201846565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc103310 0x7fbecc10f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 --2- 172.21.15.50:0/2201846565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc108960 0x7fbecc108d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 --2- 172.21.15.50:0/2201846565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbecc102950 0x7fbecc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 -- 172.21.15.50:0/2201846565 >> 172.21.15.50:0/2201846565 conn(0x7fbecc0fe400 msgr2=0x7fbecc100820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 -- 172.21.15.50:0/2201846565 shutdown_connections 2023-10-26T06:44:10.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.370+0000 7fbed3fff700 1 -- 172.21.15.50:0/2201846565 wait complete. 2023-10-26T06:44:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.371+0000 7fbed3fff700 1 Processor -- start 2023-10-26T06:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.371+0000 7fbed3fff700 1 -- start start 2023-10-26T06:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 0x7fbecc198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc103310 0x7fbecc1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbecc108960 0x7fbecc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc19dca0 con 0x7fbecc108960 2023-10-26T06:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed3fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc19de10 con 0x7fbecc103310 2023-10-26T06:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc19dfd0 con 0x7fbecc102950 2023-10-26T06:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 0x7fbecc198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed159a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc103310 0x7fbecc1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbecc108960 0x7fbecc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 0x7fbecc198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53380/0 (socket says 172.21.15.50:53380) 2023-10-26T06:44:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.372+0000 7fbed1d9b700 1 -- 172.21.15.50:0/1320270701 learned_addr learned my addr 172.21.15.50:0/1320270701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed1d9b700 1 -- 172.21.15.50:0/1320270701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc103310 msgr2=0x7fbecc1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc103310 0x7fbecc1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed1d9b700 1 -- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbecc108960 msgr2=0x7fbecc19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbecc108960 0x7fbecc19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed1d9b700 1 -- 172.21.15.50:0/1320270701 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80095f0 con 0x7fbecc102950 2023-10-26T06:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 0x7fbecc198d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbec8004730 tx=0x7fbec8004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbec2ffd700 1 -- 172.21.15.50:0/1320270701 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec801d070 con 0x7fbecc102950 2023-10-26T06:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc19e250 con 0x7fbecc102950 2023-10-26T06:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbec2ffd700 1 -- 172.21.15.50:0/1320270701 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec8022470 con 0x7fbecc102950 2023-10-26T06:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbec2ffd700 1 -- 172.21.15.50:0/1320270701 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8017650 con 0x7fbecc102950 2023-10-26T06:44:10.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.373+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1a5af0 con 0x7fbecc102950 2023-10-26T06:44:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.377+0000 7fbec2ffd700 1 -- 172.21.15.50:0/1320270701 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbec80225e0 con 0x7fbecc102950 2023-10-26T06:44:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.378+0000 7fbee7871b80 1 Processor -- start 2023-10-26T06:44:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.378+0000 7fbee7871b80 1 -- start start 2023-10-26T06:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.378+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cb8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.378+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cb3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cb3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbee7871b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043c266e0 con 0x558043cb8be0 2023-10-26T06:44:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbee7871b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043c0cc60 con 0x558043cb35d0 2023-10-26T06:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbee7871b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043c0a580 con 0x558043cb9500 2023-10-26T06:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbed259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cb8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbec2ffd700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbeb80a15f0 0x7fbeb80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbed259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cb8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35680/0 (socket says 172.21.15.50:35680) 2023-10-26T06:44:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbed259c700 1 -- 172.21.15.50:0/3543781322 learned_addr learned my addr 172.21.15.50:0/3543781322 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbed159a700 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cb3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbec2ffd700 1 -- 172.21.15.50:0/1320270701 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbec80ce2a0 con 0x7fbecc102950 2023-10-26T06:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cb3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.379+0000 7fbed259c700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbeb80a15f0 0x7fbeb80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed1d9b700 1 -- 172.21.15.50:0/3543781322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 msgr2=0x558043cb3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cb3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed1d9b700 1 -- 172.21.15.50:0/3543781322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 msgr2=0x558043cb8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cb8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed1d9b700 1 -- 172.21.15.50:0/3543781322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558043bc33f0 con 0x558043cb9500 2023-10-26T06:44:10.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cb3090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbec80cba40 tx=0x7fbec80977c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd7dea543552d015 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbeb7fff700 1 -- 172.21.15.50:0/3543781322 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec809acc0 con 0x558043cb9500 2023-10-26T06:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbed259c700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbeb80a15f0 0x7fbeb80a3ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbec400fb80 tx=0x7fbec4004b40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbeb7fff700 1 -- 172.21.15.50:0/3543781322 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec809ba60 con 0x558043cb9500 2023-10-26T06:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.380+0000 7fbeb7fff700 1 -- 172.21.15.50:0/3543781322 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec809b5c0 con 0x558043cb9500 2023-10-26T06:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 -- 172.21.15.50:0/3543781322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 msgr2=0x558043cb3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cb3090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbec80cba40 tx=0x7fbec80977c0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 -- 172.21.15.50:0/3543781322 shutdown_connections 2023-10-26T06:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cb3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cb8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 --2- 172.21.15.50:0/3543781322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cb3090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 -- 172.21.15.50:0/3543781322 >> 172.21.15.50:0/3543781322 conn(0x558043c27720 msgr2=0x558043cadb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 -- 172.21.15.50:0/3543781322 shutdown_connections 2023-10-26T06:44:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.381+0000 7fbee7871b80 1 -- 172.21.15.50:0/3543781322 wait complete. 2023-10-26T06:44:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 -- start start 2023-10-26T06:44:10.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 Processor -- start 2023-10-26T06:44:10.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 0x558043cbf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cbc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb9500 0x558043cbcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043c05e70 con 0x558043cb9500 2023-10-26T06:44:10.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043ba2710 con 0x558043cb8be0 2023-10-26T06:44:10.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.382+0000 7fbee7871b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043ba23b0 con 0x558043cb35d0 2023-10-26T06:44:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbee7871b80 10 client.0 _ll_register_callbacks cb 0x558043aeca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 0x558043cbf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 0x558043cbf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53396/0 (socket says 172.21.15.50:53396) 2023-10-26T06:44:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 -- 172.21.15.50:0/712395126 learned_addr learned my addr 172.21.15.50:0/712395126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:10.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed159a700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cbc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed259c700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb9500 0x558043cbcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 -- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 msgr2=0x558043cbc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cbc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 -- 172.21.15.50:0/712395126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb9500 msgr2=0x558043cbcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb9500 0x558043cbcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.383+0000 7fbed1d9b700 1 -- 172.21.15.50:0/712395126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1a5af0 con 0x558043cb35d0 2023-10-26T06:44:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 0x558043cbf4a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbec809b060 tx=0x7fbec809ab00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118cd8c125a1be71 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbeb57fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbeb57fa700 1 -- 172.21.15.50:0/712395126 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec809acc0 con 0x558043cb35d0 2023-10-26T06:44:10.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558043c0aef0 con 0x558043cb35d0 2023-10-26T06:44:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbeb57fa700 1 -- 172.21.15.50:0/712395126 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbec80cd030 con 0x558043cb35d0 2023-10-26T06:44:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbeb57fa700 1 -- 172.21.15.50:0/712395126 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec809b360 con 0x558043cb35d0 2023-10-26T06:44:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbee7871b80 10 client.25576 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558043a30de0 con 0x558043cb35d0 2023-10-26T06:44:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.384+0000 7fbeb57fa700 1 -- 172.21.15.50:0/712395126 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558043c0aef0 con 0x558043cb35d0 2023-10-26T06:44:10.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbeb57fa700 1 -- 172.21.15.50:0/712395126 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbec80a31d0 con 0x558043cb35d0 2023-10-26T06:44:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbee7871b80 10 client.25576 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbee7871b80 10 client.25576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbee7871b80 20 client.25576 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbee7871b80 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043ccc630 0x558043ccea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbee7871b80 4 client.25576 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558043c828b0 con 0x558043ccc630 2023-10-26T06:44:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.385+0000 7fbed159a700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043ccc630 0x558043ccea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.386+0000 7fbed159a700 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043ccc630 0x558043ccea50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45804d213e8f7c6d server_cookie=7326c0111d7df646 in_seq=0 out_seq=0 2023-10-26T06:44:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.386+0000 7fbeb57fa700 10 client.25576 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:10.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.386+0000 7fbeb57fa700 1 -- 172.21.15.50:0/712395126 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558043c828b0 con 0x558043ccc630 2023-10-26T06:44:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.386+0000 7fbeb57fa700 10 client.25576 handle_command_reply: tid=0 2023-10-26T06:44:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.386+0000 7fbee7871b80 1 client.25576 shutdown 2023-10-26T06:44:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 msgr2=0x558043cbf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 0x558043cbf4a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbec809b060 tx=0x7fbec809ab00 comp rx=0 tx=0).stop 2023-10-26T06:44:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 shutdown_connections 2023-10-26T06:44:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043ccc630 0x558043ccea50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb9500 0x558043cbcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb35d0 0x558043cbf4a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 --2- 172.21.15.50:0/712395126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cbc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbeb57fa700 0 client.25576 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 >> 172.21.15.50:0/712395126 conn(0x558043c27720 msgr2=0x558043cadac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 shutdown_connections 2023-10-26T06:44:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 1 -- 172.21.15.50:0/712395126 wait complete. 2023-10-26T06:44:10.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.387+0000 7fbee7871b80 20 client.25576 trim_cache size 0 max 16384 2023-10-26T06:44:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 Processor -- start 2023-10-26T06:44:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 -- start start 2023-10-26T06:44:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 0x558043cbc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cc3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cbefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043a86920 con 0x558043cb35d0 2023-10-26T06:44:10.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043cb4030 con 0x558043cb8be0 2023-10-26T06:44:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.405+0000 7fbee7871b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043cbd350 con 0x558043cb9500 2023-10-26T06:44:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 0x558043cbc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed159a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cc3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 0x558043cbc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35692/0 (socket says 172.21.15.50:35692) 2023-10-26T06:44:10.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 -- 172.21.15.50:0/2432941740 learned_addr learned my addr 172.21.15.50:0/2432941740 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed259c700 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cbefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 -- 172.21.15.50:0/2432941740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 msgr2=0x558043cbefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cbefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 -- 172.21.15.50:0/2432941740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 msgr2=0x558043cc3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cc3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 -- 172.21.15.50:0/2432941740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558043cadd70 con 0x558043cb35d0 2023-10-26T06:44:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed159a700 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cc3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 0x558043cbc730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbec80996b0 tx=0x7fbec80a3740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199da6c393e89af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.406+0000 7fbec0ff9700 1 -- 172.21.15.50:0/2432941740 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec809acc0 con 0x558043cb35d0 2023-10-26T06:44:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.407+0000 7fbec0ff9700 1 -- 172.21.15.50:0/2432941740 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec8063070 con 0x558043cb35d0 2023-10-26T06:44:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.407+0000 7fbec0ff9700 1 -- 172.21.15.50:0/2432941740 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec809f540 con 0x558043cb35d0 2023-10-26T06:44:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.407+0000 7fbee7871b80 1 -- 172.21.15.50:0/2432941740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 msgr2=0x558043cbc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.407+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 0x558043cbc730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbec80996b0 tx=0x7fbec80a3740 comp rx=0 tx=0).stop 2023-10-26T06:44:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 -- 172.21.15.50:0/2432941740 shutdown_connections 2023-10-26T06:44:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043cbefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb35d0 0x558043cbc730 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2432941740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb8be0 0x558043cc3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 -- 172.21.15.50:0/2432941740 >> 172.21.15.50:0/2432941740 conn(0x558043c27720 msgr2=0x558043cbc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 -- 172.21.15.50:0/2432941740 shutdown_connections 2023-10-26T06:44:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 -- 172.21.15.50:0/2432941740 wait complete. 2023-10-26T06:44:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 -- start start 2023-10-26T06:44:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.408+0000 7fbee7871b80 1 Processor -- start 2023-10-26T06:44:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cc0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cc1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043d20420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043d20960 con 0x558043cb8be0 2023-10-26T06:44:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043d20aa0 con 0x558043cb35d0 2023-10-26T06:44:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558043d20c30 con 0x558043cb9500 2023-10-26T06:44:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbee7871b80 10 client.0 _ll_register_callbacks cb 0x558043aeca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cc1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cc1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35698/0 (socket says 172.21.15.50:35698) 2023-10-26T06:44:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 -- 172.21.15.50:0/2292715376 learned_addr learned my addr 172.21.15.50:0/2292715376 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cc0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed259c700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043d20420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 -- 172.21.15.50:0/2292715376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 msgr2=0x558043d20420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043d20420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 -- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 msgr2=0x558043cc0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cc0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.409+0000 7fbed159a700 1 -- 172.21.15.50:0/2292715376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc009c70 con 0x558043cb8be0 2023-10-26T06:44:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbed159a700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cc1020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbecc19a2d0 tx=0x7fbebc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a3f734d6e6fe0c server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbeb57fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbeb57fa700 1 -- 172.21.15.50:0/2292715376 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc016070 con 0x558043cb8be0 2023-10-26T06:44:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbec809ba60 con 0x558043cb8be0 2023-10-26T06:44:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbeb57fa700 1 -- 172.21.15.50:0/2292715376 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbebc003c70 con 0x558043cb8be0 2023-10-26T06:44:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbeb57fa700 1 -- 172.21.15.50:0/2292715376 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbebc003e30 con 0x558043cb8be0 2023-10-26T06:44:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbee7871b80 10 client.15567 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.410+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558043a30de0 con 0x558043cb8be0 2023-10-26T06:44:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbeb57fa700 1 -- 172.21.15.50:0/2292715376 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec809ba60 con 0x558043cb8be0 2023-10-26T06:44:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbeb57fa700 1 -- 172.21.15.50:0/2292715376 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbebc023030 con 0x558043cb8be0 2023-10-26T06:44:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbee7871b80 10 client.15567 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbee7871b80 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbee7871b80 20 client.15567 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043d224f0 0x558043d24910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbee7871b80 4 client.15567 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:44:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558043bfee50 con 0x558043d224f0 2023-10-26T06:44:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.411+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043d224f0 0x558043d24910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbeb57fa700 10 client.15567 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbed1d9b700 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043d224f0 0x558043d24910 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc001c8986a5fdfd server_cookie=19d8b77bde89da02 in_seq=0 out_seq=0 2023-10-26T06:44:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbeb57fa700 1 -- 172.21.15.50:0/2292715376 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558043bfee50 con 0x558043d224f0 2023-10-26T06:44:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbeb57fa700 10 client.15567 handle_command_reply: tid=0 2023-10-26T06:44:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 client.15567 shutdown 2023-10-26T06:44:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 msgr2=0x558043cc1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cc1020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbecc19a2d0 tx=0x7fbebc004470 comp rx=0 tx=0).stop 2023-10-26T06:44:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 shutdown_connections 2023-10-26T06:44:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x558043d224f0 0x558043d24910 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558043cb9500 0x558043d20420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558043cb35d0 0x558043cc0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbeb57fa700 0 client.15567 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 --2- 172.21.15.50:0/2292715376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558043cb8be0 0x558043cc1020 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.412+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 >> 172.21.15.50:0/2292715376 conn(0x558043c27720 msgr2=0x558043cc8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 shutdown_connections 2023-10-26T06:44:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbee7871b80 1 -- 172.21.15.50:0/2292715376 wait complete. 2023-10-26T06:44:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbee7871b80 20 client.15567 trim_cache size 0 max 16384 2023-10-26T06:44:10.427 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:44:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:44:10.428 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:44:10.428 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:44:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbeb80a15f0 msgr2=0x7fbeb80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbed3fff700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbeb80a15f0 0x7fbeb80a3ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbec400fb80 tx=0x7fbec4004b40 comp rx=0 tx=0).stop 2023-10-26T06:44:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 msgr2=0x7fbecc198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.413+0000 7fbed3fff700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 0x7fbecc198d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbec8004730 tx=0x7fbec8004760 comp rx=0 tx=0).stop 2023-10-26T06:44:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 shutdown_connections 2023-10-26T06:44:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbeb80a15f0 0x7fbeb80a3ab0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbecc108960 0x7fbecc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbecc102950 0x7fbecc198d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 --2- 172.21.15.50:0/1320270701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbecc103310 0x7fbecc1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 >> 172.21.15.50:0/1320270701 conn(0x7fbecc0fe400 msgr2=0x7fbecc0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 shutdown_connections 2023-10-26T06:44:10.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.414+0000 7fbed3fff700 1 -- 172.21.15.50:0/1320270701 wait complete. 2023-10-26T06:44:10.433 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:44:10.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:44:10.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2109393502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4781066c0 msgr2=0x7fa478106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2109393502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4781066c0 0x7fa478106aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa468009990 tx=0x7fa468009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2109393502 shutdown_connections 2023-10-26T06:44:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2109393502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa478067fa0 0x7fa47810d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2109393502 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4781066c0 0x7fa478106aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2109393502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478106fe0 0x7fa478067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.646+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2109393502 >> 172.21.15.50:0/2109393502 conn(0x7fa478076400 msgr2=0x7fa478076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.647+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2109393502 shutdown_connections 2023-10-26T06:44:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.647+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2109393502 wait complete. 2023-10-26T06:44:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.648+0000 7fa47c9ff700 1 Processor -- start 2023-10-26T06:44:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.648+0000 7fa47c9ff700 1 -- start start 2023-10-26T06:44:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47c9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478067fa0 0x7fa47819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47c9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781066c0 0x7fa47819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47c9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 0x7fa4781969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47c9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478197020 con 0x7fa4781066c0 2023-10-26T06:44:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47c9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478197190 con 0x7fa478106fe0 2023-10-26T06:44:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47c9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa478197350 con 0x7fa478067fa0 2023-10-26T06:44:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa476d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 0x7fa4781969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781066c0 0x7fa47819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa47659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478067fa0 0x7fa47819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa476d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 0x7fa4781969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45518/0 (socket says 172.21.15.50:45518) 2023-10-26T06:44:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.649+0000 7fa476d9d700 1 -- 172.21.15.50:0/2440282215 learned_addr learned my addr 172.21.15.50:0/2440282215 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa476d9d700 1 -- 172.21.15.50:0/2440282215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478067fa0 msgr2=0x7fa47819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa476d9d700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478067fa0 0x7fa47819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa476d9d700 1 -- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781066c0 msgr2=0x7fa47819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa476d9d700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781066c0 0x7fa47819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa476d9d700 1 -- 172.21.15.50:0/2440282215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680095f0 con 0x7fa478106fe0 2023-10-26T06:44:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa47659c700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478067fa0 0x7fa47819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa476d9d700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 0x7fa4781969c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa47000ef30 tx=0x7fa47000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470018070 con 0x7fa478106fe0 2023-10-26T06:44:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4781975d0 con 0x7fa478106fe0 2023-10-26T06:44:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa47000f040 con 0x7fa478106fe0 2023-10-26T06:44:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000cd00 con 0x7fa478106fe0 2023-10-26T06:44:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.650+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4781a3880 con 0x7fa478106fe0 2023-10-26T06:44:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.651+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478108c10 con 0x7fa478106fe0 2023-10-26T06:44:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.654+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa470003a00 con 0x7fa478106fe0 2023-10-26T06:44:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.655+0000 7fa46f7fe700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4640a15f0 0x7fa4640a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.655+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa4700cd5c0 con 0x7fa478106fe0 2023-10-26T06:44:10.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.655+0000 7fa47659c700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4640a15f0 0x7fa4640a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:10.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.656+0000 7fa47659c700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4640a15f0 0x7fa4640a3ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b2e0 tx=0x7fa468005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:10.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.657+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa4700969c0 con 0x7fa478106fe0 2023-10-26T06:44:10.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.944+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa478197e80 con 0x7fa478106fe0 2023-10-26T06:44:10.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.945+0000 7fa46f7fe700 1 -- 172.21.15.50:0/2440282215 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7fa470099fe0 con 0x7fa478106fe0 2023-10-26T06:44:10.946 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:44:10.947 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:44:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4640a15f0 msgr2=0x7fa4640a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4640a15f0 0x7fa4640a3ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b2e0 tx=0x7fa468005fd0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 msgr2=0x7fa4781969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 0x7fa4781969c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa47000ef30 tx=0x7fa47000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 shutdown_connections 2023-10-26T06:44:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa4640a15f0 0x7fa4640a3ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa478106fe0 0x7fa4781969c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa478067fa0 0x7fa47819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 --2- 172.21.15.50:0/2440282215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4781066c0 0x7fa47819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 >> 172.21.15.50:0/2440282215 conn(0x7fa478076400 msgr2=0x7fa4780fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 shutdown_connections 2023-10-26T06:44:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:10.948+0000 7fa47c9ff700 1 -- 172.21.15.50:0/2440282215 wait complete. 2023-10-26T06:44:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:44:10.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:44:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:10 smithi050 ceph-mon[94997]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-10-26T06:44:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:10 smithi125 ceph-mon[130643]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-10-26T06:44:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 -- 172.21.15.50:0/1796883518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6110106720 msgr2=0x7f6110106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 --2- 172.21.15.50:0/1796883518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6110106720 0x7f6110106b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f610c009990 tx=0x7f610c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 -- 172.21.15.50:0/1796883518 shutdown_connections 2023-10-26T06:44:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 --2- 172.21.15.50:0/1796883518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61101010d0 0x7f611010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 --2- 172.21.15.50:0/1796883518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6110106720 0x7f6110106b00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 --2- 172.21.15.50:0/1796883518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6110100710 0x7f6110100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 -- 172.21.15.50:0/1796883518 >> 172.21.15.50:0/1796883518 conn(0x7f61100fc200 msgr2=0x7f61100fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 -- 172.21.15.50:0/1796883518 shutdown_connections 2023-10-26T06:44:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.184+0000 7f6116bff700 1 -- 172.21.15.50:0/1796883518 wait complete. 2023-10-26T06:44:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.185+0000 7f6116bff700 1 Processor -- start 2023-10-26T06:44:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.185+0000 7f6116bff700 1 -- start start 2023-10-26T06:44:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.185+0000 7f6116bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6110100710 0x7f6110198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.185+0000 7f6116bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 0x7f61101992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.185+0000 7f6116bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6110106720 0x7f611019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6116bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611019dc90 con 0x7f61101010d0 2023-10-26T06:44:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6116bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611019de00 con 0x7f6110106720 2023-10-26T06:44:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6116bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611019dfc0 con 0x7f6110100710 2023-10-26T06:44:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 0x7f61101992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 0x7f61101992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35740/0 (socket says 172.21.15.50:35740) 2023-10-26T06:44:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 -- 172.21.15.50:0/1655248981 learned_addr learned my addr 172.21.15.50:0/1655248981 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f611499b700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6110100710 0x7f6110198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f611519c700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6110106720 0x7f611019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 -- 172.21.15.50:0/1655248981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6110100710 msgr2=0x7f6110198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6110100710 0x7f6110198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 -- 172.21.15.50:0/1655248981 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6110106720 msgr2=0x7f611019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6110106720 0x7f611019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.186+0000 7f6107fff700 1 -- 172.21.15.50:0/1655248981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0095f0 con 0x7f61101010d0 2023-10-26T06:44:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.187+0000 7f6107fff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 0x7f61101992b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f610000e9a0 tx=0x7f610000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.187+0000 7f6105ffb700 1 -- 172.21.15.50:0/1655248981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100009790 con 0x7f61101010d0 2023-10-26T06:44:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.187+0000 7f6105ffb700 1 -- 172.21.15.50:0/1655248981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6100010430 con 0x7f61101010d0 2023-10-26T06:44:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.187+0000 7f6105ffb700 1 -- 172.21.15.50:0/1655248981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100018680 con 0x7f61101010d0 2023-10-26T06:44:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.187+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611019e2a0 con 0x7f61101010d0 2023-10-26T06:44:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.187+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61101a5ae0 con 0x7f61101010d0 2023-10-26T06:44:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.192+0000 7f6105ffb700 1 -- 172.21.15.50:0/1655248981 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f61000105a0 con 0x7f61101010d0 2023-10-26T06:44:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 Processor -- start 2023-10-26T06:44:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 -- start start 2023-10-26T06:44:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f6105ffb700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60f80a1670 0x7f60f80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f6105ffb700 1 -- 172.21.15.50:0/1655248981 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6100014070 con 0x7f61101010d0 2023-10-26T06:44:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab642fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 0x5589ab63d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab63d5d0 0x5589ab63da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab5b06e0 con 0x5589ab642be0 2023-10-26T06:44:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab596c60 con 0x5589ab643500 2023-10-26T06:44:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.193+0000 7f612a612b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab594580 con 0x5589ab63d5d0 2023-10-26T06:44:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f611519c700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60f80a1670 0x7f60f80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 0x5589ab63d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 0x5589ab63d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45552/0 (socket says 172.21.15.50:45552) 2023-10-26T06:44:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 -- 172.21.15.50:0/3293828851 learned_addr learned my addr 172.21.15.50:0/3293828851 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f611519c700 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab63d5d0 0x5589ab63da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f611499b700 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab642fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 -- 172.21.15.50:0/3293828851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab63d5d0 msgr2=0x5589ab63da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab63d5d0 0x5589ab63da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 -- 172.21.15.50:0/3293828851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 msgr2=0x5589ab642fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab642fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f6107fff700 1 -- 172.21.15.50:0/3293828851 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ab54d3f0 con 0x5589ab643500 2023-10-26T06:44:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.194+0000 7f611499b700 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab642fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.195+0000 7f611519c700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60f80a1670 0x7f60f80a3b30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ec0 tx=0x7f61080134a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.195+0000 7f6107fff700 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 0x5589ab63d090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61000a20a0 tx=0x7f610009a940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4818c70e05070499 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.195+0000 7f60f6ffd700 1 -- 172.21.15.50:0/3293828851 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000a25d0 con 0x5589ab643500 2023-10-26T06:44:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.195+0000 7f60f6ffd700 1 -- 172.21.15.50:0/3293828851 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61000985e0 con 0x5589ab643500 2023-10-26T06:44:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.195+0000 7f60f6ffd700 1 -- 172.21.15.50:0/3293828851 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100099990 con 0x5589ab643500 2023-10-26T06:44:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 -- 172.21.15.50:0/3293828851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 msgr2=0x5589ab63d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 0x5589ab63d090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61000a20a0 tx=0x7f610009a940 comp rx=0 tx=0).stop 2023-10-26T06:44:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 -- 172.21.15.50:0/3293828851 shutdown_connections 2023-10-26T06:44:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab63d5d0 0x5589ab63da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab642fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 --2- 172.21.15.50:0/3293828851 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab643500 0x5589ab63d090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 -- 172.21.15.50:0/3293828851 >> 172.21.15.50:0/3293828851 conn(0x5589ab5b1720 msgr2=0x5589ab637b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 -- 172.21.15.50:0/3293828851 shutdown_connections 2023-10-26T06:44:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.196+0000 7f612a612b80 1 -- 172.21.15.50:0/3293828851 wait complete. 2023-10-26T06:44:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.197+0000 7f612a612b80 1 -- start start 2023-10-26T06:44:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.197+0000 7f612a612b80 1 Processor -- start 2023-10-26T06:44:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab649550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab646840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab646f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab58fe70 con 0x5589ab642be0 2023-10-26T06:44:11.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab52c710 con 0x5589ab63d5d0 2023-10-26T06:44:11.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab52c3b0 con 0x5589ab643500 2023-10-26T06:44:11.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f612a612b80 10 client.0 _ll_register_callbacks cb 0x5589ab476a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:11.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab649550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f6107fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab646840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab649550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45564/0 (socket says 172.21.15.50:45564) 2023-10-26T06:44:11.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 -- 172.21.15.50:0/1988384838 learned_addr learned my addr 172.21.15.50:0/1988384838 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611519c700 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab646f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 -- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 msgr2=0x5589ab646f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab646f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 -- 172.21.15.50:0/1988384838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 msgr2=0x5589ab646840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab646840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.198+0000 7f611499b700 1 -- 172.21.15.50:0/1988384838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61101a5ae0 con 0x5589ab63d5d0 2023-10-26T06:44:11.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f611499b700 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab649550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f610c005750 tx=0x7f610c005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0598b542c62308 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f60effff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f60effff700 1 -- 172.21.15.50:0/1988384838 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c01d070 con 0x5589ab63d5d0 2023-10-26T06:44:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589ab594ef0 con 0x5589ab63d5d0 2023-10-26T06:44:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f60effff700 1 -- 172.21.15.50:0/1988384838 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f610c004500 con 0x5589ab63d5d0 2023-10-26T06:44:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f60effff700 1 -- 172.21.15.50:0/1988384838 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f610c0046c0 con 0x5589ab63d5d0 2023-10-26T06:44:11.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f612a612b80 10 client.25583 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:11.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.199+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5589ab3bade0 con 0x5589ab63d5d0 2023-10-26T06:44:11.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f60effff700 1 -- 172.21.15.50:0/1988384838 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5589ab594ef0 con 0x5589ab63d5d0 2023-10-26T06:44:11.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f60effff700 1 -- 172.21.15.50:0/1988384838 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f610c0247c0 con 0x5589ab63d5d0 2023-10-26T06:44:11.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f612a612b80 10 client.25583 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:11.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f612a612b80 10 client.25583 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:44:11.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f612a612b80 20 client.25583 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f612a612b80 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab656f20 0x5589ab659340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f612a612b80 4 client.25583 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589ab60c8b0 con 0x5589ab656f20 2023-10-26T06:44:11.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.200+0000 7f6107fff700 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab656f20 0x5589ab659340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.201+0000 7f6107fff700 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab656f20 0x5589ab659340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67086c6c97ec8ecb server_cookie=5a83cbfa1b7b895b in_seq=0 out_seq=0 2023-10-26T06:44:11.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.201+0000 7f60effff700 10 client.25583 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:11.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.201+0000 7f60effff700 1 -- 172.21.15.50:0/1988384838 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5589ab60c8b0 con 0x5589ab656f20 2023-10-26T06:44:11.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.201+0000 7f60effff700 10 client.25583 handle_command_reply: tid=0 2023-10-26T06:44:11.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 client.25583 shutdown 2023-10-26T06:44:11.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 msgr2=0x5589ab649550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab649550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f610c005750 tx=0x7f610c005780 comp rx=0 tx=0).stop 2023-10-26T06:44:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 shutdown_connections 2023-10-26T06:44:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab656f20 0x5589ab659340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab646f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab649550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 --2- 172.21.15.50:0/1988384838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab646840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 >> 172.21.15.50:0/1988384838 conn(0x5589ab5b1720 msgr2=0x5589ab637ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f60effff700 0 client.25583 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 shutdown_connections 2023-10-26T06:44:11.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 1 -- 172.21.15.50:0/1988384838 wait complete. 2023-10-26T06:44:11.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.202+0000 7f612a612b80 20 client.25583 trim_cache size 0 max 16384 2023-10-26T06:44:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.216+0000 7f612a612b80 1 Processor -- start 2023-10-26T06:44:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.216+0000 7f612a612b80 1 -- start start 2023-10-26T06:44:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f612a612b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab638650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f612a612b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab64deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f612a612b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab649080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f612a612b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab410920 con 0x5589ab642be0 2023-10-26T06:44:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f612a612b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab6433a0 con 0x5589ab63d5d0 2023-10-26T06:44:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f612a612b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab64e470 con 0x5589ab643500 2023-10-26T06:44:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f611499b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab638650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f6107fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab64deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f611499b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab638650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45572/0 (socket says 172.21.15.50:45572) 2023-10-26T06:44:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f611499b700 1 -- 172.21.15.50:0/3424725996 learned_addr learned my addr 172.21.15.50:0/3424725996 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.217+0000 7f611519c700 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab649080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611499b700 1 -- 172.21.15.50:0/3424725996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 msgr2=0x5589ab649080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611499b700 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab649080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611499b700 1 -- 172.21.15.50:0/3424725996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 msgr2=0x5589ab64deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611499b700 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab64deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611499b700 1 -- 172.21.15.50:0/3424725996 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ab3a3c60 con 0x5589ab63d5d0 2023-10-26T06:44:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611519c700 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab649080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f611499b700 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab638650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f610c006010 tx=0x7f610c00b6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b105c0441d0f226d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f60f77fe700 1 -- 172.21.15.50:0/3424725996 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c01d040 con 0x5589ab63d5d0 2023-10-26T06:44:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f60f77fe700 1 -- 172.21.15.50:0/3424725996 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f610c01e040 con 0x5589ab63d5d0 2023-10-26T06:44:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.218+0000 7f60f77fe700 1 -- 172.21.15.50:0/3424725996 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c004a00 con 0x5589ab63d5d0 2023-10-26T06:44:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 -- 172.21.15.50:0/3424725996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 msgr2=0x5589ab638650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab638650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f610c006010 tx=0x7f610c00b6b0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 -- 172.21.15.50:0/3424725996 shutdown_connections 2023-10-26T06:44:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab643500 0x5589ab649080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab638650 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 --2- 172.21.15.50:0/3424725996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab642be0 0x5589ab64deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 -- 172.21.15.50:0/3424725996 >> 172.21.15.50:0/3424725996 conn(0x5589ab5b1720 msgr2=0x5589ab63d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 -- 172.21.15.50:0/3424725996 shutdown_connections 2023-10-26T06:44:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 -- 172.21.15.50:0/3424725996 wait complete. 2023-10-26T06:44:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.219+0000 7f612a612b80 1 -- start start 2023-10-26T06:44:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 Processor -- start 2023-10-26T06:44:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab64c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab642be0 0x5589ab64c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab643500 0x5589ab6a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab6a42f0 con 0x5589ab643500 2023-10-26T06:44:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab6a4460 con 0x5589ab63d5d0 2023-10-26T06:44:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab6a4620 con 0x5589ab642be0 2023-10-26T06:44:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f612a612b80 10 client.0 _ll_register_callbacks cb 0x5589ab476a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f611519c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab643500 0x5589ab6a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f611499b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab64c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f611499b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab64c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45588/0 (socket says 172.21.15.50:45588) 2023-10-26T06:44:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f611499b700 1 -- 172.21.15.50:0/3371597033 learned_addr learned my addr 172.21.15.50:0/3371597033 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.220+0000 7f611519c700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab643500 0x5589ab6a3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35756/0 (socket says 172.21.15.50:35756) 2023-10-26T06:44:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f6107fff700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab642be0 0x5589ab64c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f611499b700 1 -- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab642be0 msgr2=0x5589ab64c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f611499b700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab642be0 0x5589ab64c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f611499b700 1 -- 172.21.15.50:0/3371597033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab643500 msgr2=0x5589ab6a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f611499b700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab643500 0x5589ab6a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f611499b700 1 -- 172.21.15.50:0/3371597033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589ab3bade0 con 0x5589ab63d5d0 2023-10-26T06:44:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f611499b700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab64c080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f610c0098e0 tx=0x7f610c005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aae4523a3c32e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f60effff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f60effff700 1 -- 172.21.15.50:0/3371597033 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c004880 con 0x5589ab63d5d0 2023-10-26T06:44:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f60effff700 1 -- 172.21.15.50:0/3371597033 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f610c000e40 con 0x5589ab63d5d0 2023-10-26T06:44:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.221+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61000985e0 con 0x5589ab63d5d0 2023-10-26T06:44:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f60effff700 1 -- 172.21.15.50:0/3371597033 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f610c00ba30 con 0x5589ab63d5d0 2023-10-26T06:44:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 10 client.25589 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5589ab3e1250 con 0x5589ab63d5d0 2023-10-26T06:44:11.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f60effff700 1 -- 172.21.15.50:0/3371597033 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61000985e0 con 0x5589ab63d5d0 2023-10-26T06:44:11.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f60effff700 1 -- 172.21.15.50:0/3371597033 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f610c00fa60 con 0x5589ab63d5d0 2023-10-26T06:44:11.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 10 client.25589 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:11.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 10 client.25589 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:44:11.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 20 client.25589 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab6ab9e0 0x5589ab6ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 4 client.25589 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:44:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.222+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5589ab588e50 con 0x5589ab6ab9e0 2023-10-26T06:44:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f6107fff700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab6ab9e0 0x5589ab6ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f6107fff700 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab6ab9e0 0x5589ab6ade00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=301498ef70377859 server_cookie=cca9caa80bcbeefc in_seq=0 out_seq=0 2023-10-26T06:44:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f60effff700 10 client.25589 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f60effff700 1 -- 172.21.15.50:0/3371597033 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5589ab588e50 con 0x5589ab6ab9e0 2023-10-26T06:44:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f60effff700 10 client.25589 handle_command_reply: tid=0 2023-10-26T06:44:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f612a612b80 1 client.25589 shutdown 2023-10-26T06:44:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 msgr2=0x5589ab64c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.223+0000 7f612a612b80 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab64c080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f610c0098e0 tx=0x7f610c005c70 comp rx=0 tx=0).stop 2023-10-26T06:44:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 shutdown_connections 2023-10-26T06:44:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5589ab6ab9e0 0x5589ab6ade00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589ab643500 0x5589ab6a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5589ab63d5d0 0x5589ab64c080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f60effff700 0 client.25589 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 --2- 172.21.15.50:0/3371597033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5589ab642be0 0x5589ab64c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 >> 172.21.15.50:0/3371597033 conn(0x5589ab5b1720 msgr2=0x5589ab6409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 shutdown_connections 2023-10-26T06:44:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 1 -- 172.21.15.50:0/3371597033 wait complete. 2023-10-26T06:44:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.224+0000 7f612a612b80 20 client.25589 trim_cache size 0 max 16384 2023-10-26T06:44:11.241 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:44:11.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:10 smithi153 ceph-mon[131657]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-10-26T06:44:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60f80a1670 msgr2=0x7f60f80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60f80a1670 0x7f60f80a3b30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ec0 tx=0x7f61080134a0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 msgr2=0x7f61101992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 0x7f61101992b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f610000e9a0 tx=0x7f610000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 shutdown_connections 2023-10-26T06:44:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f60f80a1670 0x7f60f80a3b30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6110106720 0x7f611019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6110100710 0x7f6110198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 --2- 172.21.15.50:0/1655248981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61101010d0 0x7f61101992b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 >> 172.21.15.50:0/1655248981 conn(0x7f61100fc200 msgr2=0x7f611010bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 shutdown_connections 2023-10-26T06:44:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.225+0000 7f6116bff700 1 -- 172.21.15.50:0/1655248981 wait complete. 2023-10-26T06:44:11.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:44:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.509+0000 7f15fd99d700 1 -- 172.21.15.50:0/214249565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8101810 msgr2=0x7f15f8101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.509+0000 7f15fd99d700 1 --2- 172.21.15.50:0/214249565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8101810 0x7f15f8101bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009990 tx=0x7f15ec009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 -- 172.21.15.50:0/214249565 shutdown_connections 2023-10-26T06:44:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 --2- 172.21.15.50:0/214249565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15f810abe0 0x7f15f810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 --2- 172.21.15.50:0/214249565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8101810 0x7f15f8101bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 --2- 172.21.15.50:0/214249565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8102130 0x7f15f810a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 -- 172.21.15.50:0/214249565 >> 172.21.15.50:0/214249565 conn(0x7f15f80fafb0 msgr2=0x7f15f80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 -- 172.21.15.50:0/214249565 shutdown_connections 2023-10-26T06:44:11.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.510+0000 7f15fd99d700 1 -- 172.21.15.50:0/214249565 wait complete. 2023-10-26T06:44:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.511+0000 7f15fd99d700 1 Processor -- start 2023-10-26T06:44:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.511+0000 7f15fd99d700 1 -- start start 2023-10-26T06:44:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8101810 0x7f15f819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd99d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 0x7f15f819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd99d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15f810abe0 0x7f15f8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd99d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8199100 con 0x7f15f8101810 2023-10-26T06:44:11.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd99d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8199270 con 0x7f15f810abe0 2023-10-26T06:44:11.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd99d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8199430 con 0x7f15f8102130 2023-10-26T06:44:11.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8101810 0x7f15f819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 0x7f15f819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 0x7f15f819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53484/0 (socket says 172.21.15.50:53484) 2023-10-26T06:44:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15f7fff700 1 -- 172.21.15.50:0/2176466533 learned_addr learned my addr 172.21.15.50:0/2176466533 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.512+0000 7f15fd19c700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15f810abe0 0x7f15f8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fc99b700 1 -- 172.21.15.50:0/2176466533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 msgr2=0x7f15f819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fc99b700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 0x7f15f819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fc99b700 1 -- 172.21.15.50:0/2176466533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15f810abe0 msgr2=0x7f15f8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fc99b700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15f810abe0 0x7f15f8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fc99b700 1 -- 172.21.15.50:0/2176466533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4009520 con 0x7f15f8101810 2023-10-26T06:44:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 0x7f15f819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fc99b700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8101810 0x7f15f819e970 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f15ec006010 tx=0x7f15ec005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15f5ffb700 1 -- 172.21.15.50:0/2176466533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec01d070 con 0x7f15f8101810 2023-10-26T06:44:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15f5ffb700 1 -- 172.21.15.50:0/2176466533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15ec022470 con 0x7f15f8101810 2023-10-26T06:44:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0095f0 con 0x7f15f8101810 2023-10-26T06:44:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.513+0000 7f15f5ffb700 1 -- 172.21.15.50:0/2176466533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec017650 con 0x7f15f8101810 2023-10-26T06:44:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.514+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f81a5780 con 0x7f15f8101810 2023-10-26T06:44:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.517+0000 7f15f5ffb700 1 -- 172.21.15.50:0/2176466533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f15ec022890 con 0x7f15f8101810 2023-10-26T06:44:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.518+0000 7f15f5ffb700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15e80a15f0 0x7f15e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.518+0000 7f161251db80 1 Processor -- start 2023-10-26T06:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.518+0000 7f15f5ffb700 1 -- 172.21.15.50:0/2176466533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f15ec0ce300 con 0x7f15f8101810 2023-10-26T06:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 -- start start 2023-10-26T06:44:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15e80a15f0 0x7f15e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241442e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924144c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609240b76e0 con 0x560924149d60 2023-10-26T06:44:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092409dc60 con 0x56092414a680 2023-10-26T06:44:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f161251db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092409b580 con 0x560924144820 2023-10-26T06:44:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.519+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15e80a15f0 0x7f15e80a3ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009fd0 tx=0x7f15e4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35794/0 (socket says 172.21.15.50:35794) 2023-10-26T06:44:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fc99b700 1 -- 172.21.15.50:0/3897683046 learned_addr learned my addr 172.21.15.50:0/3897683046 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 -- 172.21.15.50:0/3897683046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 msgr2=0x5609241442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 -- 172.21.15.50:0/3897683046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 msgr2=0x56092414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 -- 172.21.15.50:0/3897683046 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609240543f0 con 0x560924144820 2023-10-26T06:44:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fc99b700 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.520+0000 7f15fd19c700 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924144c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f15f0011580 tx=0x7f15f0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8a423e49de04e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f15e2ffd700 1 -- 172.21.15.50:0/3897683046 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000e040 con 0x560924144820 2023-10-26T06:44:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f15e2ffd700 1 -- 172.21.15.50:0/3897683046 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f000f040 con 0x560924144820 2023-10-26T06:44:11.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f15e2ffd700 1 -- 172.21.15.50:0/3897683046 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00044f0 con 0x560924144820 2023-10-26T06:44:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 -- 172.21.15.50:0/3897683046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 msgr2=0x560924144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924144c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f15f0011580 tx=0x7f15f0009920 comp rx=0 tx=0).stop 2023-10-26T06:44:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 -- 172.21.15.50:0/3897683046 shutdown_connections 2023-10-26T06:44:11.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924144c80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 --2- 172.21.15.50:0/3897683046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.521+0000 7f161251db80 1 -- 172.21.15.50:0/3897683046 >> 172.21.15.50:0/3897683046 conn(0x5609240b8720 msgr2=0x56092413ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.522+0000 7f161251db80 1 -- 172.21.15.50:0/3897683046 shutdown_connections 2023-10-26T06:44:11.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.522+0000 7f161251db80 1 -- 172.21.15.50:0/3897683046 wait complete. 2023-10-26T06:44:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.522+0000 7f161251db80 1 -- start start 2023-10-26T06:44:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.522+0000 7f161251db80 1 Processor -- start 2023-10-26T06:44:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 0x560924150640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560924096e70 con 0x560924149d60 2023-10-26T06:44:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560924033710 con 0x560924144820 2023-10-26T06:44:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609240333b0 con 0x56092414a680 2023-10-26T06:44:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f161251db80 10 client.0 _ll_register_callbacks cb 0x560923f7da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:11.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 0x560924150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 0x560924150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45618/0 (socket says 172.21.15.50:45618) 2023-10-26T06:44:11.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f15fc99b700 1 -- 172.21.15.50:0/3236877395 learned_addr learned my addr 172.21.15.50:0/3236877395 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f15fd19c700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.523+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15fc99b700 1 -- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 msgr2=0x56092414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15fc99b700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15fc99b700 1 -- 172.21.15.50:0/3236877395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 msgr2=0x56092414d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15fc99b700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15fc99b700 1 -- 172.21.15.50:0/3236877395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f81a5780 con 0x560924144820 2023-10-26T06:44:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15fc99b700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 0x560924150640 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0098e0 tx=0x7f15ec09b190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9d8c1b0c3c8ae0d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15d7fff700 1 -- 172.21.15.50:0/3236877395 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec09ad20 con 0x560924144820 2023-10-26T06:44:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15d7fff700 1 -- 172.21.15.50:0/3236877395 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f15ec09bac0 con 0x560924144820 2023-10-26T06:44:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56092409bef0 con 0x560924144820 2023-10-26T06:44:11.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f15d7fff700 1 -- 172.21.15.50:0/3236877395 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15ec09b3c0 con 0x560924144820 2023-10-26T06:44:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f161251db80 10 client.25601 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.524+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f15f0011230 con 0x560924144820 2023-10-26T06:44:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f15d7fff700 1 -- 172.21.15.50:0/3236877395 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56092409bef0 con 0x560924144820 2023-10-26T06:44:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f15d7fff700 1 -- 172.21.15.50:0/3236877395 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f15ec0a3230 con 0x560924144820 2023-10-26T06:44:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f161251db80 10 client.25601 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:11.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f161251db80 10 client.25601 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:44:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f161251db80 20 client.25601 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f161251db80 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x56092415dda0 0x5609241601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f161251db80 4 client.25601 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609241138b0 con 0x56092415dda0 2023-10-26T06:44:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.525+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x56092415dda0 0x5609241601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.526+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x56092415dda0 0x5609241601c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77982f03720e246e server_cookie=19a8d4164f552dfa in_seq=0 out_seq=0 2023-10-26T06:44:11.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.526+0000 7f15d7fff700 10 client.25601 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:11.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f15d7fff700 1 -- 172.21.15.50:0/3236877395 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5609241138b0 con 0x56092415dda0 2023-10-26T06:44:11.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f15d7fff700 10 client.25601 handle_command_reply: tid=0 2023-10-26T06:44:11.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 client.25601 shutdown 2023-10-26T06:44:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 msgr2=0x560924150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 0x560924150640 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0098e0 tx=0x7f15ec09b190 comp rx=0 tx=0).stop 2023-10-26T06:44:11.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 shutdown_connections 2023-10-26T06:44:11.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x56092415dda0 0x5609241601c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924144820 0x560924150640 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 --2- 172.21.15.50:0/3236877395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x56092414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f15d7fff700 0 client.25601 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 >> 172.21.15.50:0/3236877395 conn(0x5609240b8720 msgr2=0x5609241432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 shutdown_connections 2023-10-26T06:44:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 1 -- 172.21.15.50:0/3236877395 wait complete. 2023-10-26T06:44:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.527+0000 7f161251db80 20 client.25601 trim_cache size 0 max 16384 2023-10-26T06:44:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.542+0000 7f161251db80 1 Processor -- start 2023-10-26T06:44:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.542+0000 7f161251db80 1 -- start start 2023-10-26T06:44:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f161251db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924139820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f161251db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x560924155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f161251db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f161251db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560923f17920 con 0x560924149d60 2023-10-26T06:44:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f161251db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560924149940 con 0x56092414a680 2023-10-26T06:44:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f161251db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560924143810 con 0x560924144820 2023-10-26T06:44:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x560924155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x560924155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35808/0 (socket says 172.21.15.50:35808) 2023-10-26T06:44:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 -- 172.21.15.50:0/3100073443 learned_addr learned my addr 172.21.15.50:0/3100073443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15fc99b700 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15fd19c700 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 -- 172.21.15.50:0/3100073443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 msgr2=0x560924139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 -- 172.21.15.50:0/3100073443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 msgr2=0x5609241432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15f7fff700 1 -- 172.21.15.50:0/3100073443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560923ec1de0 con 0x560924149d60 2023-10-26T06:44:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.543+0000 7f15fd19c700 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.544+0000 7f15f7fff700 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x560924155060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009950 tx=0x7f15e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3438a80c1687f4d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.544+0000 7f15e37fe700 1 -- 172.21.15.50:0/3100073443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4021070 con 0x560924149d60 2023-10-26T06:44:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.544+0000 7f15e37fe700 1 -- 172.21.15.50:0/3100073443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15e4022040 con 0x560924149d60 2023-10-26T06:44:11.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.544+0000 7f15e37fe700 1 -- 172.21.15.50:0/3100073443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e401b7e0 con 0x560924149d60 2023-10-26T06:44:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 -- 172.21.15.50:0/3100073443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 msgr2=0x560924155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x560924155060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009950 tx=0x7f15e4014000 comp rx=0 tx=0).stop 2023-10-26T06:44:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 -- 172.21.15.50:0/3100073443 shutdown_connections 2023-10-26T06:44:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x56092414a680 0x5609241432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560924144820 0x560924139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 --2- 172.21.15.50:0/3100073443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924149d60 0x560924155060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 -- 172.21.15.50:0/3100073443 >> 172.21.15.50:0/3100073443 conn(0x5609240b8720 msgr2=0x560924143b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 -- 172.21.15.50:0/3100073443 shutdown_connections 2023-10-26T06:44:11.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 -- 172.21.15.50:0/3100073443 wait complete. 2023-10-26T06:44:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.545+0000 7f161251db80 1 -- start start 2023-10-26T06:44:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 Processor -- start 2023-10-26T06:44:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 0x560924154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924149d60 0x56092414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092414b680 con 0x560924144820 2023-10-26T06:44:11.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092414b7f0 con 0x560924149d60 2023-10-26T06:44:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092414b9b0 con 0x56092414a680 2023-10-26T06:44:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f161251db80 10 client.0 _ll_register_callbacks cb 0x560923f7da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 0x560924154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f15fc99b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 0x560924154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35812/0 (socket says 172.21.15.50:35812) 2023-10-26T06:44:11.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.546+0000 7f15fc99b700 1 -- 172.21.15.50:0/2609343674 learned_addr learned my addr 172.21.15.50:0/2609343674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924149d60 0x56092414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fd19c700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fc99b700 1 -- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 msgr2=0x56092414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fc99b700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fc99b700 1 -- 172.21.15.50:0/2609343674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924149d60 msgr2=0x56092414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fc99b700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924149d60 0x56092414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fc99b700 1 -- 172.21.15.50:0/2609343674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e4017050 con 0x560924144820 2023-10-26T06:44:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924149d60 0x56092414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15fc99b700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 0x560924154ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0a3590 tx=0x7f15ec022c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b0a328168ff7b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15d7fff700 1 -- 172.21.15.50:0/2609343674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec09a8b0 con 0x560924144820 2023-10-26T06:44:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f15d7fff700 1 -- 172.21.15.50:0/2609343674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f15ec09bac0 con 0x560924144820 2023-10-26T06:44:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.547+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15f000f040 con 0x560924144820 2023-10-26T06:44:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f15d7fff700 1 -- 172.21.15.50:0/2609343674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15ec09ad20 con 0x560924144820 2023-10-26T06:44:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 10 client.15609 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560923eaac60 con 0x560924144820 2023-10-26T06:44:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f15d7fff700 1 -- 172.21.15.50:0/2609343674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f000f040 con 0x560924144820 2023-10-26T06:44:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f15d7fff700 1 -- 172.21.15.50:0/2609343674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f15ec09f190 con 0x560924144820 2023-10-26T06:44:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 10 client.15609 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 10 client.15609 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:44:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 20 client.15609 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5609241b2ee0 0x5609241b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 4 client.15609 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:44:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56092408fe50 con 0x5609241b2ee0 2023-10-26T06:44:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.548+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5609241b2ee0 0x5609241b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f15f7fff700 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5609241b2ee0 0x5609241b5300 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=773e1c99c098d513 server_cookie=fe6fac8e3198a3d1 in_seq=0 out_seq=0 2023-10-26T06:44:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f15d7fff700 10 client.15609 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f15d7fff700 1 -- 172.21.15.50:0/2609343674 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56092408fe50 con 0x5609241b2ee0 2023-10-26T06:44:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f15d7fff700 10 client.15609 handle_command_reply: tid=0 2023-10-26T06:44:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 client.15609 shutdown 2023-10-26T06:44:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 msgr2=0x560924154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 0x560924154ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0a3590 tx=0x7f15ec022c30 comp rx=0 tx=0).stop 2023-10-26T06:44:11.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 shutdown_connections 2023-10-26T06:44:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56092414a680 0x56092414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560924144820 0x560924154ea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5609241b2ee0 0x5609241b5300 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 --2- 172.21.15.50:0/2609343674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560924149d60 0x56092414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.549+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 >> 172.21.15.50:0/2609343674 conn(0x5609240b8720 msgr2=0x560924140720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15d7fff700 0 client.15609 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 shutdown_connections 2023-10-26T06:44:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f161251db80 1 -- 172.21.15.50:0/2609343674 wait complete. 2023-10-26T06:44:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f161251db80 20 client.15609 trim_cache size 0 max 16384 2023-10-26T06:44:11.581 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:44:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15e80a15f0 msgr2=0x7f15e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15e80a15f0 0x7f15e80a3ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009fd0 tx=0x7f15e4009260 comp rx=0 tx=0).stop 2023-10-26T06:44:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8101810 msgr2=0x7f15f819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8101810 0x7f15f819e970 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f15ec006010 tx=0x7f15ec005740 comp rx=0 tx=0).stop 2023-10-26T06:44:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 shutdown_connections 2023-10-26T06:44:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15e80a15f0 0x7f15e80a3ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15f810abe0 0x7f15f8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f8101810 0x7f15f819e970 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 --2- 172.21.15.50:0/2176466533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8102130 0x7f15f819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.550+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 >> 172.21.15.50:0/2176466533 conn(0x7f15f80fafb0 msgr2=0x7f15f80ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.551+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 shutdown_connections 2023-10-26T06:44:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.551+0000 7f15fd99d700 1 -- 172.21.15.50:0/2176466533 wait complete. 2023-10-26T06:44:11.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:44:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 -- 172.21.15.50:0/1017123600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 msgr2=0x7f4188100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 --2- 172.21.15.50:0/1017123600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 0x7f4188100bc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4178009990 tx=0x7f4178009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 -- 172.21.15.50:0/1017123600 shutdown_connections 2023-10-26T06:44:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 --2- 172.21.15.50:0/1017123600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 --2- 172.21.15.50:0/1017123600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 0x7f4188106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 --2- 172.21.15.50:0/1017123600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 0x7f4188100bc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.816+0000 7f41901ff700 1 -- 172.21.15.50:0/1017123600 >> 172.21.15.50:0/1017123600 conn(0x7f41880fc230 msgr2=0x7f41880fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.817+0000 7f41901ff700 1 -- 172.21.15.50:0/1017123600 shutdown_connections 2023-10-26T06:44:11.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.817+0000 7f41901ff700 1 -- 172.21.15.50:0/1017123600 wait complete. 2023-10-26T06:44:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.818+0000 7f41901ff700 1 Processor -- start 2023-10-26T06:44:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.818+0000 7f41901ff700 1 -- start start 2023-10-26T06:44:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f41901ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 0x7f418819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f41901ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f41901ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 0x7f4188196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f41901ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41881970d0 con 0x7f4188101100 2023-10-26T06:44:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f41901ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4188197240 con 0x7f4188106750 2023-10-26T06:44:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f41901ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4188197400 con 0x7f4188100740 2023-10-26T06:44:11.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f418d79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f418d79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35822/0 (socket says 172.21.15.50:35822) 2023-10-26T06:44:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f418d79a700 1 -- 172.21.15.50:0/4153488674 learned_addr learned my addr 172.21.15.50:0/4153488674 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f418e79c700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 0x7f4188196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.819+0000 7f418df9b700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 0x7f418819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418e79c700 1 -- 172.21.15.50:0/4153488674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 msgr2=0x7f418819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418e79c700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 0x7f418819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418e79c700 1 -- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 msgr2=0x7f418819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418e79c700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418e79c700 1 -- 172.21.15.50:0/4153488674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180009c40 con 0x7f4188106750 2023-10-26T06:44:11.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418d79a700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:11.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f418e79c700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 0x7f4188196a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f418000efb0 tx=0x7f418000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f417effd700 1 -- 172.21.15.50:0/4153488674 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180003a00 con 0x7f4188106750 2023-10-26T06:44:11.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f417effd700 1 -- 172.21.15.50:0/4153488674 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f418000f040 con 0x7f4188106750 2023-10-26T06:44:11.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780095f0 con 0x7f4188106750 2023-10-26T06:44:11.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f417effd700 1 -- 172.21.15.50:0/4153488674 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180004540 con 0x7f4188106750 2023-10-26T06:44:11.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.820+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41881a3750 con 0x7f4188106750 2023-10-26T06:44:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.825+0000 7f417effd700 1 -- 172.21.15.50:0/4153488674 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4180003bf0 con 0x7f4188106750 2023-10-26T06:44:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 Processor -- start 2023-10-26T06:44:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 -- start start 2023-10-26T06:44:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2f9e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 0x5654f2f984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f98e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2f076e0 con 0x5654f2f9e910 2023-10-26T06:44:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2eedc60 con 0x5654f2f989e0 2023-10-26T06:44:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.826+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2eeb580 con 0x5654f2f9dff0 2023-10-26T06:44:11.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f417effd700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f41740a1670 0x7f41740a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 0x5654f2f984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 0x5654f2f984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35838/0 (socket says 172.21.15.50:35838) 2023-10-26T06:44:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 -- 172.21.15.50:0/1710014618 learned_addr learned my addr 172.21.15.50:0/1710014618 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418d79a700 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2f9e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f417effd700 1 -- 172.21.15.50:0/4153488674 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f41800ccc80 con 0x7f4188106750 2023-10-26T06:44:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418d79a700 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f98e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418e79c700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f41740a1670 0x7f41740a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 -- 172.21.15.50:0/1710014618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 msgr2=0x5654f2f9e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2f9e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 -- 172.21.15.50:0/1710014618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 msgr2=0x5654f2f98e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f98e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418df9b700 1 -- 172.21.15.50:0/1710014618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f2ea43f0 con 0x5654f2f9e910 2023-10-26T06:44:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.827+0000 7f418d79a700 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f98e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.828+0000 7f418e79c700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f41740a1670 0x7f41740a3b30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4180009fd0 tx=0x7f4180009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.828+0000 7f418df9b700 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 0x5654f2f984a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4184009d00 tx=0x7f4184011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf37d4cb7836e44 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.828+0000 7f4173fff700 1 -- 172.21.15.50:0/1710014618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184004230 con 0x5654f2f9e910 2023-10-26T06:44:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.828+0000 7f4173fff700 1 -- 172.21.15.50:0/1710014618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4184004390 con 0x5654f2f9e910 2023-10-26T06:44:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.828+0000 7f4173fff700 1 -- 172.21.15.50:0/1710014618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184019880 con 0x5654f2f9e910 2023-10-26T06:44:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1710014618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 msgr2=0x5654f2f984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 0x5654f2f984a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4184009d00 tx=0x7f4184011720 comp rx=0 tx=0).stop 2023-10-26T06:44:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1710014618 shutdown_connections 2023-10-26T06:44:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f98e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2f9e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1710014618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9e910 0x5654f2f984a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1710014618 >> 172.21.15.50:0/1710014618 conn(0x5654f2f08720 msgr2=0x5654f2f8eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1710014618 shutdown_connections 2023-10-26T06:44:11.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.829+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1710014618 wait complete. 2023-10-26T06:44:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.830+0000 7f41a3a6bb80 1 -- start start 2023-10-26T06:44:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.830+0000 7f41a3a6bb80 1 Processor -- start 2023-10-26T06:44:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.830+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.830+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2fa1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.830+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9e910 0x5654f2fa2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.830+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2ee6e70 con 0x5654f2f989e0 2023-10-26T06:44:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2e83710 con 0x5654f2f9e910 2023-10-26T06:44:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2e833b0 con 0x5654f2f9dff0 2023-10-26T06:44:11.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f41a3a6bb80 10 client.0 _ll_register_callbacks cb 0x5654f2dcda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418df9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2fa1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35842/0 (socket says 172.21.15.50:35842) 2023-10-26T06:44:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 -- 172.21.15.50:0/1645716531 learned_addr learned my addr 172.21.15.50:0/1645716531 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9e910 0x5654f2fa2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 -- 172.21.15.50:0/1645716531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 msgr2=0x5654f2fa1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2fa1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 -- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9e910 msgr2=0x5654f2fa2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9e910 0x5654f2fa2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.831+0000 7f418d79a700 1 -- 172.21.15.50:0/1645716531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184009960 con 0x5654f2f989e0 2023-10-26T06:44:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f418d79a700 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa4810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4178005910 tx=0x7f4178009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7832f49cd53a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41717fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41717fa700 1 -- 172.21.15.50:0/1645716531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417801d040 con 0x5654f2f989e0 2023-10-26T06:44:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41717fa700 1 -- 172.21.15.50:0/1645716531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f4178004710 con 0x5654f2f989e0 2023-10-26T06:44:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654f2eebef0 con 0x5654f2f989e0 2023-10-26T06:44:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41717fa700 1 -- 172.21.15.50:0/1645716531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41780048d0 con 0x5654f2f989e0 2023-10-26T06:44:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41a3a6bb80 10 client.15621 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5654f2d11de0 con 0x5654f2f989e0 2023-10-26T06:44:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.832+0000 7f41717fa700 1 -- 172.21.15.50:0/1645716531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5654f2eebef0 con 0x5654f2f989e0 2023-10-26T06:44:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41717fa700 1 -- 172.21.15.50:0/1645716531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4178034a50 con 0x5654f2f989e0 2023-10-26T06:44:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41a3a6bb80 10 client.15621 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41a3a6bb80 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41a3a6bb80 20 client.15621 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f2fb22c0 0x5654f2fb46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41a3a6bb80 4 client.15621 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654f2f638b0 con 0x5654f2fb22c0 2023-10-26T06:44:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.833+0000 7f418df9b700 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f2fb22c0 0x5654f2fb46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.834+0000 7f418df9b700 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f2fb22c0 0x5654f2fb46e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b2722f18045999 server_cookie=b1824eddfe092971 in_seq=0 out_seq=0 2023-10-26T06:44:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.834+0000 7f41717fa700 10 client.15621 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.834+0000 7f41717fa700 1 -- 172.21.15.50:0/1645716531 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5654f2f638b0 con 0x5654f2fb22c0 2023-10-26T06:44:11.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.834+0000 7f41717fa700 10 client.15621 handle_command_reply: tid=0 2023-10-26T06:44:11.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.834+0000 7f41a3a6bb80 1 client.15621 shutdown 2023-10-26T06:44:11.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 msgr2=0x5654f2fa4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa4810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4178005910 tx=0x7f4178009310 comp rx=0 tx=0).stop 2023-10-26T06:44:11.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 shutdown_connections 2023-10-26T06:44:11.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f2fb22c0 0x5654f2fb46e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9e910 0x5654f2fa2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa4810 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/1645716531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9dff0 0x5654f2fa1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 >> 172.21.15.50:0/1645716531 conn(0x5654f2f08720 msgr2=0x5654f2f97490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41717fa700 0 client.15621 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:11.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 shutdown_connections 2023-10-26T06:44:11.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/1645716531 wait complete. 2023-10-26T06:44:11.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.835+0000 7f41a3a6bb80 20 client.15621 trim_cache size 0 max 16384 2023-10-26T06:44:11.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 Processor -- start 2023-10-26T06:44:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 -- start start 2023-10-26T06:44:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 0x5654f2fa92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f8e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2d67920 con 0x5654f2f9dff0 2023-10-26T06:44:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2f86fd0 con 0x5654f2f989e0 2023-10-26T06:44:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2f9e720 con 0x5654f2f9e910 2023-10-26T06:44:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f418df9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 0x5654f2fa92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f418d79a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f418df9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 0x5654f2fa92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35850/0 (socket says 172.21.15.50:35850) 2023-10-26T06:44:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.849+0000 7f418df9b700 1 -- 172.21.15.50:0/674025451 learned_addr learned my addr 172.21.15.50:0/674025451 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418d79a700 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f8e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418df9b700 1 -- 172.21.15.50:0/674025451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 msgr2=0x5654f2f8e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418df9b700 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f8e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418df9b700 1 -- 172.21.15.50:0/674025451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 msgr2=0x5654f2f895d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418df9b700 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f895d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418df9b700 1 -- 172.21.15.50:0/674025451 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f2cfac60 con 0x5654f2f9dff0 2023-10-26T06:44:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f418df9b700 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 0x5654f2fa92f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f418401b040 tx=0x7f4184019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8678b992a6165c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f417cff9700 1 -- 172.21.15.50:0/674025451 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184005ce0 con 0x5654f2f9dff0 2023-10-26T06:44:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f417cff9700 1 -- 172.21.15.50:0/674025451 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4184004170 con 0x5654f2f9dff0 2023-10-26T06:44:11.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.850+0000 7f417cff9700 1 -- 172.21.15.50:0/674025451 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184004500 con 0x5654f2f9dff0 2023-10-26T06:44:11.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/674025451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 msgr2=0x5654f2fa92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 0x5654f2fa92f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f418401b040 tx=0x7f4184019420 comp rx=0 tx=0).stop 2023-10-26T06:44:11.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/674025451 shutdown_connections 2023-10-26T06:44:11.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f8e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f989e0 0x5654f2f895d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/674025451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f9dff0 0x5654f2fa92f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/674025451 >> 172.21.15.50:0/674025451 conn(0x5654f2f08720 msgr2=0x5654f2fa1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/674025451 shutdown_connections 2023-10-26T06:44:11.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.851+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/674025451 wait complete. 2023-10-26T06:44:11.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.852+0000 7f41a3a6bb80 1 -- start start 2023-10-26T06:44:11.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.852+0000 7f41a3a6bb80 1 Processor -- start 2023-10-26T06:44:11.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.852+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9dff0 0x5654f2fa9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f41a3a6bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f97490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2f97b70 con 0x5654f2f989e0 2023-10-26T06:44:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2f97cb0 con 0x5654f2f9dff0 2023-10-26T06:44:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f41a3a6bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f2f97e70 con 0x5654f2f9e910 2023-10-26T06:44:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f41a3a6bb80 10 client.0 _ll_register_callbacks cb 0x5654f2dcda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35852/0 (socket says 172.21.15.50:35852) 2023-10-26T06:44:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 -- 172.21.15.50:0/579948762 learned_addr learned my addr 172.21.15.50:0/579948762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418df9b700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9dff0 0x5654f2fa9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f97490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 -- 172.21.15.50:0/579948762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 msgr2=0x5654f2f97490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f97490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 -- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9dff0 msgr2=0x5654f2fa9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9dff0 0x5654f2fa9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418d79a700 1 -- 172.21.15.50:0/579948762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654f2ea43f0 con 0x5654f2f989e0 2023-10-26T06:44:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.853+0000 7f418df9b700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9dff0 0x5654f2fa9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f418d79a700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa8ae0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4178000c00 tx=0x7f4178005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fd84111fdd9b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41717fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41717fa700 1 -- 172.21.15.50:0/579948762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417801d070 con 0x5654f2f989e0 2023-10-26T06:44:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41717fa700 1 -- 172.21.15.50:0/579948762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f4178000e40 con 0x5654f2f989e0 2023-10-26T06:44:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4184004390 con 0x5654f2f989e0 2023-10-26T06:44:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41717fa700 1 -- 172.21.15.50:0/579948762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f417800bc00 con 0x5654f2f989e0 2023-10-26T06:44:11.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41a3a6bb80 10 client.15627 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:11.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.854+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5654f2d38250 con 0x5654f2f989e0 2023-10-26T06:44:11.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41717fa700 1 -- 172.21.15.50:0/579948762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4184004390 con 0x5654f2f989e0 2023-10-26T06:44:11.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41717fa700 1 -- 172.21.15.50:0/579948762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4178034960 con 0x5654f2f989e0 2023-10-26T06:44:11.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41a3a6bb80 10 client.15627 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:11.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41a3a6bb80 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:11.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41a3a6bb80 20 client.15627 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:11.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f3006e40 0x5654f3009260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:11.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41a3a6bb80 4 client.15627 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:44:11.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654f2edfe50 con 0x5654f3006e40 2023-10-26T06:44:11.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.855+0000 7f418df9b700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f3006e40 0x5654f3009260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:11.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f418df9b700 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f3006e40 0x5654f3009260 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3306f583506483 server_cookie=2e2328bbd402acf8 in_seq=0 out_seq=0 2023-10-26T06:44:11.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41717fa700 10 client.15627 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:11.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41717fa700 1 -- 172.21.15.50:0/579948762 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654f2edfe50 con 0x5654f3006e40 2023-10-26T06:44:11.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41717fa700 10 client.15627 handle_command_reply: tid=0 2023-10-26T06:44:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 client.15627 shutdown 2023-10-26T06:44:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 msgr2=0x5654f2fa8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa8ae0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4178000c00 tx=0x7f4178005c30 comp rx=0 tx=0).stop 2023-10-26T06:44:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 shutdown_connections 2023-10-26T06:44:11.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5654f3006e40 0x5654f3009260 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5654f2f9e910 0x5654f2f97490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654f2f989e0 0x5654f2fa8ae0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41717fa700 0 client.15627 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 --2- 172.21.15.50:0/579948762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5654f2f9dff0 0x5654f2fa9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 >> 172.21.15.50:0/579948762 conn(0x5654f2f08720 msgr2=0x5654f2f8e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 shutdown_connections 2023-10-26T06:44:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 1 -- 172.21.15.50:0/579948762 wait complete. 2023-10-26T06:44:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.856+0000 7f41a3a6bb80 20 client.15627 trim_cache size 0 max 16384 2023-10-26T06:44:11.873 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:44:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f41740a1670 msgr2=0x7f41740a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f41740a1670 0x7f41740a3b30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4180009fd0 tx=0x7f4180009040 comp rx=0 tx=0).stop 2023-10-26T06:44:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 msgr2=0x7f4188196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 0x7f4188196a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f418000efb0 tx=0x7f418000c3a0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 shutdown_connections 2023-10-26T06:44:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f41740a1670 0x7f41740a3b30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4188106750 0x7f4188196a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4188100740 0x7f418819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 --2- 172.21.15.50:0/4153488674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4188101100 0x7f418819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 >> 172.21.15.50:0/4153488674 conn(0x7f41880fc230 msgr2=0x7f41880fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 shutdown_connections 2023-10-26T06:44:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:11.857+0000 7f41901ff700 1 -- 172.21.15.50:0/4153488674 wait complete. 2023-10-26T06:44:12.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:11 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2440282215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:44:12.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:11 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2440282215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:44:12.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:11 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2440282215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:44:12.878 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:44:12.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:44:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:12 smithi050 ceph-mon[94997]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-26T06:44:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 -- 172.21.15.50:0/2831291524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 msgr2=0x7fcd5c10d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 --2- 172.21.15.50:0/2831291524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c10d540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400b0d0 tx=0x7fcd5400b3e0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 -- 172.21.15.50:0/2831291524 shutdown_connections 2023-10-26T06:44:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 --2- 172.21.15.50:0/2831291524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c10d540 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 --2- 172.21.15.50:0/2831291524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd5c067d40 0x7fcd5c068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 --2- 172.21.15.50:0/2831291524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 -- 172.21.15.50:0/2831291524 >> 172.21.15.50:0/2831291524 conn(0x7fcd5c0767f0 msgr2=0x7fcd5c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 -- 172.21.15.50:0/2831291524 shutdown_connections 2023-10-26T06:44:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.094+0000 7fcd63fff700 1 -- 172.21.15.50:0/2831291524 wait complete. 2023-10-26T06:44:13.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.095+0000 7fcd63fff700 1 Processor -- start 2023-10-26T06:44:13.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 -- start start 2023-10-26T06:44:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd5c067d40 0x7fcd5c198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c19de00 con 0x7fcd5c105b30 2023-10-26T06:44:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c19df70 con 0x7fcd5c067d40 2023-10-26T06:44:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd63fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c19e130 con 0x7fcd5c105170 2023-10-26T06:44:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd61d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd5c067d40 0x7fcd5c198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.096+0000 7fcd6259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53610/0 (socket says 172.21.15.50:53610) 2023-10-26T06:44:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 -- 172.21.15.50:0/4194616856 learned_addr learned my addr 172.21.15.50:0/4194616856 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 -- 172.21.15.50:0/4194616856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd5c067d40 msgr2=0x7fcd5c198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd5c067d40 0x7fcd5c198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 -- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 msgr2=0x7fcd5c19d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c19d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 -- 172.21.15.50:0/4194616856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54009d00 con 0x7fcd5c105170 2023-10-26T06:44:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6259c700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.097+0000 7fcd6159a700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c199420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e9a0 tx=0x7fcd4c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.098+0000 7fcd52ffd700 1 -- 172.21.15.50:0/4194616856 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c009790 con 0x7fcd5c105170 2023-10-26T06:44:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.098+0000 7fcd52ffd700 1 -- 172.21.15.50:0/4194616856 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4c010430 con 0x7fcd5c105170 2023-10-26T06:44:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.098+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c19e410 con 0x7fcd5c105170 2023-10-26T06:44:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.098+0000 7fcd52ffd700 1 -- 172.21.15.50:0/4194616856 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c018680 con 0x7fcd5c105170 2023-10-26T06:44:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.098+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c1a5c50 con 0x7fcd5c105170 2023-10-26T06:44:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.102+0000 7fcd52ffd700 1 -- 172.21.15.50:0/4194616856 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcd4c0105a0 con 0x7fcd5c105170 2023-10-26T06:44:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.103+0000 7fcd7785ab80 1 Processor -- start 2023-10-26T06:44:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.103+0000 7fcd7785ab80 1 -- start start 2023-10-26T06:44:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee5c60 0x55a4daee6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee6580 0x55a4daee0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 0x55a4daee0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dae53760 con 0x55a4daee6580 2023-10-26T06:44:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dae39ce0 con 0x55a4daee5c60 2023-10-26T06:44:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dae37600 con 0x55a4daee0650 2023-10-26T06:44:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd52ffd700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcd480a15f0 0x7fcd480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd52ffd700 1 -- 172.21.15.50:0/4194616856 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcd4c014070 con 0x7fcd5c105170 2023-10-26T06:44:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd6259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee5c60 0x55a4daee6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 0x55a4daee0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 0x55a4daee0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53618/0 (socket says 172.21.15.50:53618) 2023-10-26T06:44:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd6159a700 1 -- 172.21.15.50:0/3456025695 learned_addr learned my addr 172.21.15.50:0/3456025695 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.104+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee6580 0x55a4daee0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6159a700 1 -- 172.21.15.50:0/3456025695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee5c60 msgr2=0x55a4daee6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6159a700 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee5c60 0x55a4daee6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6259c700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcd480a15f0 0x7fcd480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6159a700 1 -- 172.21.15.50:0/3456025695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee6580 msgr2=0x55a4daee0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6159a700 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee6580 0x55a4daee0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6159a700 1 -- 172.21.15.50:0/3456025695 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4dadf0470 con 0x55a4daee0650 2023-10-26T06:44:13.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd6159a700 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 0x55a4daee0ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c2d0 tx=0x7fcd4c099ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fea04b01a0d25ea server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd47fff700 1 -- 172.21.15.50:0/3456025695 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c09e170 con 0x55a4daee0650 2023-10-26T06:44:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd47fff700 1 -- 172.21.15.50:0/3456025695 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4c09e390 con 0x55a4daee0650 2023-10-26T06:44:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.105+0000 7fcd47fff700 1 -- 172.21.15.50:0/3456025695 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c099730 con 0x55a4daee0650 2023-10-26T06:44:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3456025695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 msgr2=0x55a4daee0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 0x55a4daee0ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c2d0 tx=0x7fcd4c099ba0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd6259c700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcd480a15f0 0x7fcd480a3ab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd540060b0 tx=0x7fcd5400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3456025695 shutdown_connections 2023-10-26T06:44:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee0650 0x55a4daee0ad0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee5c60 0x55a4daee6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3456025695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee6580 0x55a4daee0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3456025695 >> 172.21.15.50:0/3456025695 conn(0x55a4dae547a0 msgr2=0x55a4daedabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3456025695 shutdown_connections 2023-10-26T06:44:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.106+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3456025695 wait complete. 2023-10-26T06:44:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 -- start start 2023-10-26T06:44:13.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 Processor -- start 2023-10-26T06:44:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daee9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daeea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dae32ef0 con 0x55a4daee5c60 2023-10-26T06:44:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dadcf790 con 0x55a4daee0650 2023-10-26T06:44:13.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dadcf430 con 0x55a4daee6580 2023-10-26T06:44:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.107+0000 7fcd7785ab80 10 client.0 _ll_register_callbacks cb 0x55a4dad19b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35872/0 (socket says 172.21.15.50:35872) 2023-10-26T06:44:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 -- 172.21.15.50:0/967889784 learned_addr learned my addr 172.21.15.50:0/967889784 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6259c700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daeea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daee9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 -- 172.21.15.50:0/967889784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 msgr2=0x55a4daeea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daeea390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 -- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 msgr2=0x55a4daee9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daee9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 -- 172.21.15.50:0/967889784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c1a5c50 con 0x55a4daee5c60 2023-10-26T06:44:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd6159a700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee9e50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c098590 tx=0x7fcd4c09a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f183dbb5498f2cd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.108+0000 7fcd457fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd457fa700 1 -- 172.21.15.50:0/967889784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0b8070 con 0x55a4daee5c60 2023-10-26T06:44:13.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd457fa700 1 -- 172.21.15.50:0/967889784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcd4c09e170 con 0x55a4daee5c60 2023-10-26T06:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4dae37f70 con 0x55a4daee5c60 2023-10-26T06:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd457fa700 1 -- 172.21.15.50:0/967889784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd4c09a6b0 con 0x55a4daee5c60 2023-10-26T06:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 10 client.15639 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a4dac5de60 con 0x55a4daee5c60 2023-10-26T06:44:13.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd457fa700 1 -- 172.21.15.50:0/967889784 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a4dae37f70 con 0x55a4daee5c60 2023-10-26T06:44:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd457fa700 1 -- 172.21.15.50:0/967889784 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcd4c0991a0 con 0x55a4daee5c60 2023-10-26T06:44:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 10 client.15639 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 20 client.15639 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:13.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daef9b50 0x55a4daefbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 4 client.15639 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.109+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4daeaf930 con 0x55a4daef9b50 2023-10-26T06:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.110+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daef9b50 0x55a4daefbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.110+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daef9b50 0x55a4daefbf40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa6498643b11f4e0 server_cookie=1d241753e45f19d3 in_seq=0 out_seq=0 2023-10-26T06:44:13.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.110+0000 7fcd457fa700 10 client.15639 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd457fa700 1 -- 172.21.15.50:0/967889784 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a4daeaf930 con 0x55a4daef9b50 2023-10-26T06:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd457fa700 10 client.15639 handle_command_reply: tid=0 2023-10-26T06:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 client.15639 shutdown 2023-10-26T06:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 msgr2=0x55a4daee9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee9e50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c098590 tx=0x7fcd4c09a300 comp rx=0 tx=0).stop 2023-10-26T06:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 shutdown_connections 2023-10-26T06:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daef9b50 0x55a4daefbf40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daeea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daee9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/967889784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee9e50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 >> 172.21.15.50:0/967889784 conn(0x55a4dae547a0 msgr2=0x55a4daedf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.111+0000 7fcd457fa700 0 client.15639 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.112+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 shutdown_connections 2023-10-26T06:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.112+0000 7fcd7785ab80 1 -- 172.21.15.50:0/967889784 wait complete. 2023-10-26T06:44:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.112+0000 7fcd7785ab80 20 client.15639 trim_cache size 0 max 16384 2023-10-26T06:44:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.130+0000 7fcd7785ab80 1 Processor -- start 2023-10-26T06:44:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.130+0000 7fcd7785ab80 1 -- start start 2023-10-26T06:44:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daef0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daee8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4dacb39a0 con 0x55a4daee5c60 2023-10-26T06:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4daedc430 con 0x55a4daee0650 2023-10-26T06:44:13.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4daeeaf10 con 0x55a4daee6580 2023-10-26T06:44:13.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35880/0 (socket says 172.21.15.50:35880) 2023-10-26T06:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 -- 172.21.15.50:0/3912253832 learned_addr learned my addr 172.21.15.50:0/3912253832 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6259c700 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daee8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daef0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 -- 172.21.15.50:0/3912253832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 msgr2=0x55a4daee8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daee8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 -- 172.21.15.50:0/3912253832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 msgr2=0x55a4daef0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daef0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.131+0000 7fcd6159a700 1 -- 172.21.15.50:0/3912253832 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4dac46ce0 con 0x55a4daee5c60 2023-10-26T06:44:13.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.132+0000 7fcd6159a700 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee8240 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c096cb0 tx=0x7fcd4c099c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9e7911e9c5f168 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.132+0000 7fcd50ff9700 1 -- 172.21.15.50:0/3912253832 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0b8040 con 0x55a4daee5c60 2023-10-26T06:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.132+0000 7fcd50ff9700 1 -- 172.21.15.50:0/3912253832 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4c09e170 con 0x55a4daee5c60 2023-10-26T06:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.132+0000 7fcd50ff9700 1 -- 172.21.15.50:0/3912253832 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0a23c0 con 0x55a4daee5c60 2023-10-26T06:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3912253832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 msgr2=0x55a4daee8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee8240 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c096cb0 tx=0x7fcd4c099c90 comp rx=0 tx=0).stop 2023-10-26T06:44:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3912253832 shutdown_connections 2023-10-26T06:44:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee6580 0x55a4daee8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee0650 0x55a4daef0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/3912253832 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee5c60 0x55a4daee8240 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3912253832 >> 172.21.15.50:0/3912253832 conn(0x55a4dae547a0 msgr2=0x55a4daeda890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3912253832 shutdown_connections 2023-10-26T06:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 -- 172.21.15.50:0/3912253832 wait complete. 2023-10-26T06:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.133+0000 7fcd7785ab80 1 -- start start 2023-10-26T06:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 Processor -- start 2023-10-26T06:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee0650 0x55a4daeefd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee5c60 0x55a4daef0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee6580 0x55a4daf4d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4daef0950 con 0x55a4daee0650 2023-10-26T06:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4daf4dea0 con 0x55a4daee6580 2023-10-26T06:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4daf4dfe0 con 0x55a4daee5c60 2023-10-26T06:44:13.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd7785ab80 10 client.0 _ll_register_callbacks cb 0x55a4dad19b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd61d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee0650 0x55a4daeefd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd6159a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee5c60 0x55a4daef0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd61d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee0650 0x55a4daeefd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35890/0 (socket says 172.21.15.50:35890) 2023-10-26T06:44:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.134+0000 7fcd61d9b700 1 -- 172.21.15.50:0/1939249817 learned_addr learned my addr 172.21.15.50:0/1939249817 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6259c700 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee6580 0x55a4daf4d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6159a700 1 -- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee6580 msgr2=0x55a4daf4d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6159a700 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee6580 0x55a4daf4d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6159a700 1 -- 172.21.15.50:0/1939249817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee0650 msgr2=0x55a4daeefd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6159a700 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee0650 0x55a4daeefd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6159a700 1 -- 172.21.15.50:0/1939249817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4dac5de60 con 0x55a4daee5c60 2023-10-26T06:44:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd6159a700 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee5c60 0x55a4daef0270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55a4daef6b40 tx=0x7fcd4c096600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ffb0057efbf7d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd457fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd457fa700 1 -- 172.21.15.50:0/1939249817 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0b8040 con 0x55a4daee5c60 2023-10-26T06:44:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd457fa700 1 -- 172.21.15.50:0/1939249817 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcd4c0b81a0 con 0x55a4daee5c60 2023-10-26T06:44:13.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.135+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd4c09e390 con 0x55a4daee5c60 2023-10-26T06:44:13.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd457fa700 1 -- 172.21.15.50:0/1939249817 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd4c0b83a0 con 0x55a4daee5c60 2023-10-26T06:44:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 10 client.25657 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a4dac842d0 con 0x55a4daee5c60 2023-10-26T06:44:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd457fa700 1 -- 172.21.15.50:0/1939249817 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4c09e390 con 0x55a4daee5c60 2023-10-26T06:44:13.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd457fa700 1 -- 172.21.15.50:0/1939249817 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcd4c00cd10 con 0x55a4daee5c60 2023-10-26T06:44:13.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 10 client.25657 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:13.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 10 client.25657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:13.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 20 client.25657 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:13.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daf4f310 0x55a4daf51700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 4 client.25657 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:44:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a4dae2bed0 con 0x55a4daf4f310 2023-10-26T06:44:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.136+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daf4f310 0x55a4daf51700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.137+0000 7fcd61d9b700 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daf4f310 0x55a4daf51700 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec64b7f5df5792b server_cookie=e6b0ef0c397bfc3c in_seq=0 out_seq=0 2023-10-26T06:44:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.137+0000 7fcd457fa700 10 client.25657 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.138+0000 7fcd457fa700 1 -- 172.21.15.50:0/1939249817 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a4dae2bed0 con 0x55a4daf4f310 2023-10-26T06:44:13.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.138+0000 7fcd457fa700 10 client.25657 handle_command_reply: tid=0 2023-10-26T06:44:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.138+0000 7fcd7785ab80 1 client.25657 shutdown 2023-10-26T06:44:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee5c60 msgr2=0x55a4daef0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee5c60 0x55a4daef0270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55a4daef6b40 tx=0x7fcd4c096600 comp rx=0 tx=0).stop 2023-10-26T06:44:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 shutdown_connections 2023-10-26T06:44:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a4daf4f310 0x55a4daf51700 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a4daee6580 0x55a4daf4d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a4daee0650 0x55a4daeefd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 --2- 172.21.15.50:0/1939249817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a4daee5c60 0x55a4daef0270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 >> 172.21.15.50:0/1939249817 conn(0x55a4dae547a0 msgr2=0x55a4daee4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd457fa700 0 client.25657 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 shutdown_connections 2023-10-26T06:44:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 1 -- 172.21.15.50:0/1939249817 wait complete. 2023-10-26T06:44:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.139+0000 7fcd7785ab80 20 client.25657 trim_cache size 0 max 16384 2023-10-26T06:44:13.153 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:44:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:44:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "60821eab-7695-4246-9aa2-ee0dbc3bfe24", 2023-10-26T06:44:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:44:13.154 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:44:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcd480a15f0 msgr2=0x7fcd480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcd480a15f0 0x7fcd480a3ab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd540060b0 tx=0x7fcd5400b040 comp rx=0 tx=0).stop 2023-10-26T06:44:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 msgr2=0x7fcd5c199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c199420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e9a0 tx=0x7fcd4c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 shutdown_connections 2023-10-26T06:44:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcd480a15f0 0x7fcd480a3ab0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c105b30 0x7fcd5c19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd5c067d40 0x7fcd5c198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 --2- 172.21.15.50:0/4194616856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd5c105170 0x7fcd5c199420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 >> 172.21.15.50:0/4194616856 conn(0x7fcd5c0767f0 msgr2=0x7fcd5c100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 shutdown_connections 2023-10-26T06:44:13.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.140+0000 7fcd63fff700 1 -- 172.21.15.50:0/4194616856 wait complete. 2023-10-26T06:44:13.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:44:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:12 smithi125 ceph-mon[130643]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-26T06:44:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:12 smithi153 ceph-mon[131657]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-26T06:44:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 -- 172.21.15.50:0/1662179641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7168106730 msgr2=0x7f7168106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1662179641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7168106730 0x7f7168106b10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7158009990 tx=0x7f7158009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 -- 172.21.15.50:0/1662179641 shutdown_connections 2023-10-26T06:44:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1662179641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71681010e0 0x7f716810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1662179641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7168106730 0x7f7168106b10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1662179641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7168100720 0x7f7168100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 -- 172.21.15.50:0/1662179641 >> 172.21.15.50:0/1662179641 conn(0x7f71680fc1b0 msgr2=0x7f71680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 -- 172.21.15.50:0/1662179641 shutdown_connections 2023-10-26T06:44:13.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.387+0000 7f716e3ff700 1 -- 172.21.15.50:0/1662179641 wait complete. 2023-10-26T06:44:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 Processor -- start 2023-10-26T06:44:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 -- start start 2023-10-26T06:44:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 0x7f7168198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71681010e0 0x7f7168199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7168106730 0x7f716819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716819dc90 con 0x7f71681010e0 2023-10-26T06:44:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716819de00 con 0x7f7168106730 2023-10-26T06:44:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f716e3ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716819dfc0 con 0x7f7168100720 2023-10-26T06:44:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.389+0000 7f71677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71681010e0 0x7f7168199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 0x7f7168198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 0x7f7168198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53666/0 (socket says 172.21.15.50:53666) 2023-10-26T06:44:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 -- 172.21.15.50:0/1299990298 learned_addr learned my addr 172.21.15.50:0/1299990298 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f716c99c700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7168106730 0x7f716819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 -- 172.21.15.50:0/1299990298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7168106730 msgr2=0x7f716819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7168106730 0x7f716819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 -- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71681010e0 msgr2=0x7f7168199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71681010e0 0x7f7168199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 -- 172.21.15.50:0/1299990298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c009520 con 0x7f7168100720 2023-10-26T06:44:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.390+0000 7f7167fff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 0x7f7168198dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7158000c00 tx=0x7f7158005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.391+0000 7f71657fa700 1 -- 172.21.15.50:0/1299990298 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715801d070 con 0x7f7168100720 2023-10-26T06:44:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.391+0000 7f71657fa700 1 -- 172.21.15.50:0/1299990298 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7158022470 con 0x7f7168100720 2023-10-26T06:44:13.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.391+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71580095f0 con 0x7f7168100720 2023-10-26T06:44:13.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.391+0000 7f71657fa700 1 -- 172.21.15.50:0/1299990298 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158017650 con 0x7f7168100720 2023-10-26T06:44:13.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.391+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71681a5900 con 0x7f7168100720 2023-10-26T06:44:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.394+0000 7f71657fa700 1 -- 172.21.15.50:0/1299990298 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f71580225e0 con 0x7f7168100720 2023-10-26T06:44:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.395+0000 7f7181da8b80 1 Processor -- start 2023-10-26T06:44:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.395+0000 7f7181da8b80 1 -- start start 2023-10-26T06:44:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cb9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cb4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cb4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7181da8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74c276e0 con 0x55ba74cba500 2023-10-26T06:44:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7181da8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74c0dc60 con 0x55ba74cb9be0 2023-10-26T06:44:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7181da8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74c0b580 con 0x55ba74cb45d0 2023-10-26T06:44:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7167fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cb4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7167fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cb4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35920/0 (socket says 172.21.15.50:35920) 2023-10-26T06:44:13.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f7167fff700 1 -- 172.21.15.50:0/4150153904 learned_addr learned my addr 172.21.15.50:0/4150153904 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f71677fe700 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cb4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f716c99c700 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cb9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.396+0000 7f71657fa700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71500a15f0 0x7f71500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71677fe700 1 -- 172.21.15.50:0/4150153904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 msgr2=0x55ba74cb9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71677fe700 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cb9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71677fe700 1 -- 172.21.15.50:0/4150153904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 msgr2=0x55ba74cb4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71677fe700 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cb4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71677fe700 1 -- 172.21.15.50:0/4150153904 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba74bc43f0 con 0x55ba74cb45d0 2023-10-26T06:44:13.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71657fa700 1 -- 172.21.15.50:0/1299990298 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f71580ce3b0 con 0x7f7168100720 2023-10-26T06:44:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f716c99c700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71500a15f0 0x7f71500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f71677fe700 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cb4a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f715c009e10 tx=0x7f715c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a170a78f50514f1f server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f714e7fc700 1 -- 172.21.15.50:0/4150153904 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c019630 con 0x55ba74cb45d0 2023-10-26T06:44:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f716c99c700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71500a15f0 0x7f71500a3ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7160009710 tx=0x7f7160004ad0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.397+0000 7f714e7fc700 1 -- 172.21.15.50:0/4150153904 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715c019c50 con 0x55ba74cb45d0 2023-10-26T06:44:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f714e7fc700 1 -- 172.21.15.50:0/4150153904 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00ece0 con 0x55ba74cb45d0 2023-10-26T06:44:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 -- 172.21.15.50:0/4150153904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 msgr2=0x55ba74cb4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cb4a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f715c009e10 tx=0x7f715c011720 comp rx=0 tx=0).stop 2023-10-26T06:44:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 -- 172.21.15.50:0/4150153904 shutdown_connections 2023-10-26T06:44:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cb4a50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cb9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 --2- 172.21.15.50:0/4150153904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cb4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 -- 172.21.15.50:0/4150153904 >> 172.21.15.50:0/4150153904 conn(0x55ba74c28720 msgr2=0x55ba74caeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 -- 172.21.15.50:0/4150153904 shutdown_connections 2023-10-26T06:44:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.398+0000 7f7181da8b80 1 -- 172.21.15.50:0/4150153904 wait complete. 2023-10-26T06:44:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.399+0000 7f7181da8b80 1 -- start start 2023-10-26T06:44:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.399+0000 7f7181da8b80 1 Processor -- start 2023-10-26T06:44:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 0x55ba74cc0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74c06e70 con 0x55ba74cba500 2023-10-26T06:44:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74ba3710 con 0x55ba74cb45d0 2023-10-26T06:44:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74ba33b0 con 0x55ba74cb9be0 2023-10-26T06:44:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7181da8b80 10 client.0 _ll_register_callbacks cb 0x55ba74aeda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7167fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 0x55ba74cc0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f716c99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7167fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 0x55ba74cc0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45790/0 (socket says 172.21.15.50:45790) 2023-10-26T06:44:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f7167fff700 1 -- 172.21.15.50:0/3653320323 learned_addr learned my addr 172.21.15.50:0/3653320323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.400+0000 7f71677fe700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7167fff700 1 -- 172.21.15.50:0/3653320323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb9be0 msgr2=0x55ba74cbd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7167fff700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7167fff700 1 -- 172.21.15.50:0/3653320323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 msgr2=0x55ba74cbdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7167fff700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7167fff700 1 -- 172.21.15.50:0/3653320323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c009a70 con 0x55ba74cb45d0 2023-10-26T06:44:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f716c99c700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7167fff700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 0x55ba74cc0500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f715800f740 tx=0x7f71580978e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba67932ae247fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f71477fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f71477fe700 1 -- 172.21.15.50:0/3653320323 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715809b8d0 con 0x55ba74cb45d0 2023-10-26T06:44:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba74c0bef0 con 0x55ba74cb45d0 2023-10-26T06:44:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.401+0000 7f71477fe700 1 -- 172.21.15.50:0/3653320323 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f715809bb70 con 0x55ba74cb45d0 2023-10-26T06:44:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.402+0000 7f71477fe700 1 -- 172.21.15.50:0/3653320323 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71580b3ea0 con 0x55ba74cb45d0 2023-10-26T06:44:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.402+0000 7f7181da8b80 10 client.25655 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.402+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ba74a31de0 con 0x55ba74cb45d0 2023-10-26T06:44:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.402+0000 7f71477fe700 1 -- 172.21.15.50:0/3653320323 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71580b7080 con 0x55ba74cb45d0 2023-10-26T06:44:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f71477fe700 1 -- 172.21.15.50:0/3653320323 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f715809a960 con 0x55ba74cb45d0 2023-10-26T06:44:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f7181da8b80 10 client.25655 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f7181da8b80 10 client.25655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f7181da8b80 20 client.25655 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74ccda90 0x55ba74ccfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f7181da8b80 4 client.25655 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba74c838b0 con 0x55ba74ccda90 2023-10-26T06:44:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.403+0000 7f71677fe700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74ccda90 0x55ba74ccfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.404+0000 7f71677fe700 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74ccda90 0x55ba74ccfeb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57924cc32d939b70 server_cookie=506ca39bd7217830 in_seq=0 out_seq=0 2023-10-26T06:44:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.404+0000 7f71477fe700 10 client.25655 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f71477fe700 1 -- 172.21.15.50:0/3653320323 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba74c838b0 con 0x55ba74ccda90 2023-10-26T06:44:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f71477fe700 10 client.25655 handle_command_reply: tid=0 2023-10-26T06:44:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 client.25655 shutdown 2023-10-26T06:44:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 msgr2=0x55ba74cc0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 0x55ba74cc0500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f715800f740 tx=0x7f71580978e0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 shutdown_connections 2023-10-26T06:44:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74ccda90 0x55ba74ccfeb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb45d0 0x55ba74cc0500 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3653320323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f71477fe700 0 client.25655 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 >> 172.21.15.50:0/3653320323 conn(0x55ba74c28720 msgr2=0x55ba74cb3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 shutdown_connections 2023-10-26T06:44:13.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 1 -- 172.21.15.50:0/3653320323 wait complete. 2023-10-26T06:44:13.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.405+0000 7f7181da8b80 20 client.25655 trim_cache size 0 max 16384 2023-10-26T06:44:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.429+0000 7f7181da8b80 1 Processor -- start 2023-10-26T06:44:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.429+0000 7f7181da8b80 1 -- start start 2023-10-26T06:44:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.429+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.429+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f7181da8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74a87920 con 0x55ba74cba500 2023-10-26T06:44:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f7181da8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74cb0570 con 0x55ba74cb9be0 2023-10-26T06:44:13.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f7181da8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74cb5000 con 0x55ba74cb45d0 2023-10-26T06:44:13.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f716c99c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:45792/0 (socket says 172.21.15.50:45792) 2023-10-26T06:44:13.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 -- 172.21.15.50:0/3119951443 learned_addr learned my addr 172.21.15.50:0/3119951443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f7167fff700 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 -- 172.21.15.50:0/3119951443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 msgr2=0x55ba74cc4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 -- 172.21.15.50:0/3119951443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 msgr2=0x55ba74cbd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.430+0000 7f71677fe700 1 -- 172.21.15.50:0/3119951443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba74a1ac60 con 0x55ba74cb9be0 2023-10-26T06:44:13.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.431+0000 7f71677fe700 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f715c011a70 tx=0x7f715c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b979da9b78198ee4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.431+0000 7f714effd700 1 -- 172.21.15.50:0/3119951443 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c02a040 con 0x55ba74cb9be0 2023-10-26T06:44:13.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.431+0000 7f714effd700 1 -- 172.21.15.50:0/3119951443 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715c00e4d0 con 0x55ba74cb9be0 2023-10-26T06:44:13.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.431+0000 7f714effd700 1 -- 172.21.15.50:0/3119951443 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0199e0 con 0x55ba74cb9be0 2023-10-26T06:44:13.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 -- 172.21.15.50:0/3119951443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 msgr2=0x55ba74cbd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f715c011a70 tx=0x7f715c009260 comp rx=0 tx=0).stop 2023-10-26T06:44:13.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 -- 172.21.15.50:0/3119951443 shutdown_connections 2023-10-26T06:44:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cba500 0x55ba74cbd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3119951443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cb9be0 0x55ba74cbd010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 -- 172.21.15.50:0/3119951443 >> 172.21.15.50:0/3119951443 conn(0x55ba74c28720 msgr2=0x55ba74cb3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 -- 172.21.15.50:0/3119951443 shutdown_connections 2023-10-26T06:44:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 -- 172.21.15.50:0/3119951443 wait complete. 2023-10-26T06:44:13.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.432+0000 7f7181da8b80 1 -- start start 2023-10-26T06:44:13.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 Processor -- start 2023-10-26T06:44:13.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cb9be0 0x55ba74cc3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cba500 0x55ba74cc4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74d21a20 con 0x55ba74cb9be0 2023-10-26T06:44:13.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74d21b90 con 0x55ba74cba500 2023-10-26T06:44:13.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba74d21d50 con 0x55ba74cb45d0 2023-10-26T06:44:13.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f7181da8b80 10 client.0 _ll_register_callbacks cb 0x55ba74aeda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.433+0000 7f71677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cb9be0 0x55ba74cc3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f71677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cb9be0 0x55ba74cc3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35942/0 (socket says 172.21.15.50:35942) 2023-10-26T06:44:13.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f71677fe700 1 -- 172.21.15.50:0/3838072789 learned_addr learned my addr 172.21.15.50:0/3838072789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:13.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f716c99c700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cba500 0x55ba74cc4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 -- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cba500 msgr2=0x55ba74cc4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cba500 0x55ba74cc4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 -- 172.21.15.50:0/3838072789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cb9be0 msgr2=0x55ba74cc3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:13.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cb9be0 0x55ba74cc3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 -- 172.21.15.50:0/3838072789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba74bc43f0 con 0x55ba74cb45d0 2023-10-26T06:44:13.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f716c99c700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cba500 0x55ba74cc4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7167fff700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc38b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f715809b170 tx=0x7f715809ab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3280524143300289 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f71477fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f71477fe700 1 -- 172.21.15.50:0/3838072789 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580b3ea0 con 0x55ba74cb45d0 2023-10-26T06:44:13.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f71477fe700 1 -- 172.21.15.50:0/3838072789 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f715809a760 con 0x55ba74cb45d0 2023-10-26T06:44:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.434+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f715c019c50 con 0x55ba74cb45d0 2023-10-26T06:44:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f71477fe700 1 -- 172.21.15.50:0/3838072789 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71580d1950 con 0x55ba74cb45d0 2023-10-26T06:44:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 10 client.25675 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ba74a58250 con 0x55ba74cb45d0 2023-10-26T06:44:13.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f71477fe700 1 -- 172.21.15.50:0/3838072789 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715c019c50 con 0x55ba74cb45d0 2023-10-26T06:44:13.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f71477fe700 1 -- 172.21.15.50:0/3838072789 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f715809b6d0 con 0x55ba74cb45d0 2023-10-26T06:44:13.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 10 client.25675 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:13.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 10 client.25675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:13.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 20 client.25675 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:13.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74d23050 0x55ba74d25470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:13.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 4 client.25675 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:44:13.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.435+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ba74bffe50 con 0x55ba74d23050 2023-10-26T06:44:13.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.436+0000 7f71677fe700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74d23050 0x55ba74d25470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:13.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.436+0000 7f71677fe700 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74d23050 0x55ba74d25470 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5b83625aaf78e84 server_cookie=1cbbbb905f3f8865 in_seq=0 out_seq=0 2023-10-26T06:44:13.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.436+0000 7f71477fe700 10 client.25675 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.436+0000 7f71477fe700 1 -- 172.21.15.50:0/3838072789 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ba74bffe50 con 0x55ba74d23050 2023-10-26T06:44:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.436+0000 7f71477fe700 10 client.25675 handle_command_reply: tid=0 2023-10-26T06:44:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.436+0000 7f7181da8b80 1 client.25675 shutdown 2023-10-26T06:44:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 msgr2=0x55ba74cc38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc38b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f715809b170 tx=0x7f715809ab70 comp rx=0 tx=0).stop 2023-10-26T06:44:13.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 shutdown_connections 2023-10-26T06:44:13.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ba74d23050 0x55ba74d25470 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ba74cba500 0x55ba74cc4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba74cb45d0 0x55ba74cc38b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 --2- 172.21.15.50:0/3838072789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba74cb9be0 0x55ba74cc3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f71477fe700 0 client.25675 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:13.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 >> 172.21.15.50:0/3838072789 conn(0x55ba74c28720 msgr2=0x55ba74cb7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 shutdown_connections 2023-10-26T06:44:13.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 1 -- 172.21.15.50:0/3838072789 wait complete. 2023-10-26T06:44:13.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.437+0000 7f7181da8b80 20 client.25675 trim_cache size 0 max 16384 2023-10-26T06:44:13.461 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:44:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-26T06:44:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:44:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "60821eab-7695-4246-9aa2-ee0dbc3bfe24": { 2023-10-26T06:44:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:44:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "60821eab-7695-4246-9aa2-ee0dbc3bfe24", 2023-10-26T06:44:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:44:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:44:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:44:13.463 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:44:13.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71500a15f0 msgr2=0x7f71500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71500a15f0 0x7f71500a3ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7160009710 tx=0x7f7160004ad0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 msgr2=0x7f7168198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 0x7f7168198dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7158000c00 tx=0x7f7158005740 comp rx=0 tx=0).stop 2023-10-26T06:44:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 shutdown_connections 2023-10-26T06:44:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71500a15f0 0x7f71500a3ab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7168106730 0x7f716819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7168100720 0x7f7168198dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 --2- 172.21.15.50:0/1299990298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71681010e0 0x7f7168199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 >> 172.21.15.50:0/1299990298 conn(0x7f71680fc1b0 msgr2=0x7f71680fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:13.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 shutdown_connections 2023-10-26T06:44:13.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:13.438+0000 7f716e3ff700 1 -- 172.21.15.50:0/1299990298 wait complete. 2023-10-26T06:44:13.467 INFO:tasks.cephfs.filesystem:scrub status for tag:60821eab-7695-4246-9aa2-ee0dbc3bfe24 - {'path': '/', 'tag': '60821eab-7695-4246-9aa2-ee0dbc3bfe24', 'options': 'recursive,force'} 2023-10-26T06:44:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:13 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:44:14.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:13 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:13 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:44:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:13 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:14.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:13 smithi125 ceph-mon[130643]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-10-26T06:44:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:13 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:44:14.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:13 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:14.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:13 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:44:14.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:13 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:14.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:13 smithi153 ceph-mon[131657]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-10-26T06:44:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:13 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:44:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:13 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:14.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:13 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:44:14.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:13 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:14.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:13 smithi050 ceph-mon[94997]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-10-26T06:44:15.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:14 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:44:15.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:14 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:44:15.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:14 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:44:16.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:15 smithi125 ceph-mon[130643]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-10-26T06:44:16.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:15 smithi153 ceph-mon[131657]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-10-26T06:44:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:15 smithi050 ceph-mon[94997]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2023-10-26T06:44:18.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:18 smithi153 ceph-mon[131657]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-26T06:44:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:18 smithi050 ceph-mon[94997]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-26T06:44:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:18 smithi125 ceph-mon[130643]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2023-10-26T06:44:20.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:20 smithi153 ceph-mon[131657]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-10-26T06:44:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:20 smithi050 ceph-mon[94997]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-10-26T06:44:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:20 smithi125 ceph-mon[130643]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-10-26T06:44:22.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:22 smithi153 ceph-mon[131657]: pgmap v340: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 6 op/s 2023-10-26T06:44:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:22 smithi050 ceph-mon[94997]: pgmap v340: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 6 op/s 2023-10-26T06:44:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:22 smithi125 ceph-mon[130643]: pgmap v340: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 6 op/s 2023-10-26T06:44:24.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:23 smithi125 ceph-mon[130643]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 6 op/s 2023-10-26T06:44:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:23 smithi153 ceph-mon[131657]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 6 op/s 2023-10-26T06:44:24.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:23 smithi050 ceph-mon[94997]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 6 op/s 2023-10-26T06:44:26.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:26 smithi153 ceph-mon[131657]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2023-10-26T06:44:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:26 smithi050 ceph-mon[94997]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2023-10-26T06:44:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:26 smithi125 ceph-mon[130643]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2023-10-26T06:44:28.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:28 smithi153 ceph-mon[131657]: pgmap v343: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 6 op/s 2023-10-26T06:44:29.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:28 smithi050 ceph-mon[94997]: pgmap v343: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 6 op/s 2023-10-26T06:44:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:28 smithi125 ceph-mon[130643]: pgmap v343: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 6 op/s 2023-10-26T06:44:30.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:30 smithi153 ceph-mon[131657]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2023-10-26T06:44:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:30 smithi050 ceph-mon[94997]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2023-10-26T06:44:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:30 smithi125 ceph-mon[130643]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2023-10-26T06:44:32.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:32 smithi153 ceph-mon[131657]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:44:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:32 smithi050 ceph-mon[94997]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:44:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:32 smithi125 ceph-mon[130643]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-10-26T06:44:34.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:33 smithi125 ceph-mon[130643]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:33 smithi153 ceph-mon[131657]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:33 smithi050 ceph-mon[94997]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:36.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:36 smithi153 ceph-mon[131657]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:44:37.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:36 smithi050 ceph-mon[94997]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:44:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:36 smithi125 ceph-mon[130643]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:44:38.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:38 smithi153 ceph-mon[131657]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:39.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:38 smithi050 ceph-mon[94997]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:38 smithi125 ceph-mon[130643]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:40.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:40 smithi153 ceph-mon[131657]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:41.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:40 smithi050 ceph-mon[94997]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:40 smithi125 ceph-mon[130643]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:42 smithi050 ceph-mon[94997]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:42 smithi125 ceph-mon[130643]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:42 smithi153 ceph-mon[131657]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:43.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:44:43.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.820+0000 7fa0165ff700 1 -- 172.21.15.50:0/2207028299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010067d40 msgr2=0x7fa010068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.820+0000 7fa0165ff700 1 --2- 172.21.15.50:0/2207028299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010067d40 0x7fa010068120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa004009990 tx=0x7fa004009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 -- 172.21.15.50:0/2207028299 shutdown_connections 2023-10-26T06:44:43.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 --2- 172.21.15.50:0/2207028299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa010105b30 0x7fa01010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 --2- 172.21.15.50:0/2207028299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010067d40 0x7fa010068120 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 --2- 172.21.15.50:0/2207028299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010105170 0x7fa0101055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 -- 172.21.15.50:0/2207028299 >> 172.21.15.50:0/2207028299 conn(0x7fa0100767f0 msgr2=0x7fa010076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:43.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 -- 172.21.15.50:0/2207028299 shutdown_connections 2023-10-26T06:44:43.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.821+0000 7fa0165ff700 1 -- 172.21.15.50:0/2207028299 wait complete. 2023-10-26T06:44:43.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.823+0000 7fa0165ff700 1 Processor -- start 2023-10-26T06:44:43.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.823+0000 7fa0165ff700 1 -- start start 2023-10-26T06:44:43.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.824+0000 7fa0165ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 0x7fa010194a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.824+0000 7fa0165ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010105170 0x7fa010194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.824+0000 7fa0165ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa010105b30 0x7fa010199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.824+0000 7fa0165ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010199900 con 0x7fa010067d40 2023-10-26T06:44:43.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.824+0000 7fa0165ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010199a70 con 0x7fa010105170 2023-10-26T06:44:43.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.824+0000 7fa0165ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010199c30 con 0x7fa010105b30 2023-10-26T06:44:43.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 0x7fa010194a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 0x7fa010194a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36288/0 (socket says 172.21.15.50:36288) 2023-10-26T06:44:43.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 -- 172.21.15.50:0/3538607647 learned_addr learned my addr 172.21.15.50:0/3538607647 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:43.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010105170 0x7fa010194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa014b9c700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa010105b30 0x7fa010199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 -- 172.21.15.50:0/3538607647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa010105b30 msgr2=0x7fa010199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa010105b30 0x7fa010199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 -- 172.21.15.50:0/3538607647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010105170 msgr2=0x7fa010194fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010105170 0x7fa010194fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.825+0000 7fa00ffff700 1 -- 172.21.15.50:0/3538607647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040095f0 con 0x7fa010067d40 2023-10-26T06:44:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.826+0000 7fa00ffff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 0x7fa010194a70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa004005910 tx=0x7fa00400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.826+0000 7fa00d7fa700 1 -- 172.21.15.50:0/3538607647 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00401d070 con 0x7fa010067d40 2023-10-26T06:44:43.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.826+0000 7fa00d7fa700 1 -- 172.21.15.50:0/3538607647 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00400fc30 con 0x7fa010067d40 2023-10-26T06:44:43.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.826+0000 7fa00d7fa700 1 -- 172.21.15.50:0/3538607647 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004017650 con 0x7fa010067d40 2023-10-26T06:44:43.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.827+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa010199eb0 con 0x7fa010067d40 2023-10-26T06:44:43.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.827+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101a15e0 con 0x7fa010067d40 2023-10-26T06:44:43.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.835+0000 7fa00d7fa700 1 -- 172.21.15.50:0/3538607647 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa004021410 con 0x7fa010067d40 2023-10-26T06:44:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.837+0000 7fa00d7fa700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ff80a5b40 0x7f9ff80a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.837+0000 7fa00d7fa700 1 -- 172.21.15.50:0/3538607647 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0040ce1c0 con 0x7fa010067d40 2023-10-26T06:44:43.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.838+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ff80a5b40 0x7f9ff80a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.838+0000 7fa029e70b80 1 Processor -- start 2023-10-26T06:44:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.838+0000 7fa029e70b80 1 -- start start 2023-10-26T06:44:43.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ff80a5b40 0x7f9ff80a8000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa000006fd0 tx=0x7fa000008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:43.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa029e70b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620833576e0 con 0x5620833eca90 2023-10-26T06:44:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa029e70b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208333dc60 con 0x5620833ed3b0 2023-10-26T06:44:43.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa029e70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208333b580 con 0x5620833f1500 2023-10-26T06:44:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.839+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36298/0 (socket says 172.21.15.50:36298) 2023-10-26T06:44:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 -- 172.21.15.50:0/1289936637 learned_addr learned my addr 172.21.15.50:0/1289936637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa014b9c700 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 -- 172.21.15.50:0/1289936637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 msgr2=0x5620833f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 -- 172.21.15.50:0/1289936637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 msgr2=0x5620833f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00ffff700 1 -- 172.21.15.50:0/1289936637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620832f43f0 con 0x5620833eca90 2023-10-26T06:44:43.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.840+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.841+0000 7fa00ffff700 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833ece70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa0040a3050 tx=0x7fa00409ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c6957091e333e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.841+0000 7f9ff67fc700 1 -- 172.21.15.50:0/1289936637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400fda0 con 0x5620833eca90 2023-10-26T06:44:43.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.841+0000 7f9ff67fc700 1 -- 172.21.15.50:0/1289936637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00409b280 con 0x5620833eca90 2023-10-26T06:44:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.841+0000 7f9ff67fc700 1 -- 172.21.15.50:0/1289936637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00409a770 con 0x5620833eca90 2023-10-26T06:44:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.842+0000 7fa029e70b80 1 -- 172.21.15.50:0/1289936637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 msgr2=0x5620833ece70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.842+0000 7fa029e70b80 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833ece70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa0040a3050 tx=0x7fa00409ae90 comp rx=0 tx=0).stop 2023-10-26T06:44:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 -- 172.21.15.50:0/1289936637 shutdown_connections 2023-10-26T06:44:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833ece70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 --2- 172.21.15.50:0/1289936637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 -- 172.21.15.50:0/1289936637 >> 172.21.15.50:0/1289936637 conn(0x562083358720 msgr2=0x5620833deb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 -- 172.21.15.50:0/1289936637 shutdown_connections 2023-10-26T06:44:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.843+0000 7fa029e70b80 1 -- 172.21.15.50:0/1289936637 wait complete. 2023-10-26T06:44:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.844+0000 7fa029e70b80 1 -- start start 2023-10-26T06:44:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.844+0000 7fa029e70b80 1 Processor -- start 2023-10-26T06:44:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833ed3b0 0x5620833f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562083336e70 con 0x5620833ed3b0 2023-10-26T06:44:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620832d3710 con 0x5620833eca90 2023-10-26T06:44:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620832d33b0 con 0x5620833f1500 2023-10-26T06:44:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa029e70b80 10 client.0 _ll_register_callbacks cb 0x56208321da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa014b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa014b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55078/0 (socket says 172.21.15.50:55078) 2023-10-26T06:44:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.845+0000 7fa014b9c700 1 -- 172.21.15.50:0/4080012943 learned_addr learned my addr 172.21.15.50:0/4080012943 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00ffff700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833ed3b0 0x5620833f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00ffff700 1 -- 172.21.15.50:0/4080012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 msgr2=0x5620833f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00ffff700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00ffff700 1 -- 172.21.15.50:0/4080012943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833ed3b0 msgr2=0x5620833f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00ffff700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833ed3b0 0x5620833f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00ffff700 1 -- 172.21.15.50:0/4080012943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101a15e0 con 0x5620833eca90 2023-10-26T06:44:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.846+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833ed3b0 0x5620833f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.847+0000 7fa00ffff700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833f8c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa00400f930 tx=0x7fa004021b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48daed05169363c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.847+0000 7f9fef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.847+0000 7f9fef7fe700 1 -- 172.21.15.50:0/4080012943 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040b7070 con 0x5620833eca90 2023-10-26T06:44:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.847+0000 7f9fef7fe700 1 -- 172.21.15.50:0/4080012943 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0040a3580 con 0x5620833eca90 2023-10-26T06:44:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.847+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56208333bef0 con 0x5620833eca90 2023-10-26T06:44:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7f9fef7fe700 1 -- 172.21.15.50:0/4080012943 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0040b92b0 con 0x5620833eca90 2023-10-26T06:44:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 10 client.25673 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562083161de0 con 0x5620833eca90 2023-10-26T06:44:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7f9fef7fe700 1 -- 172.21.15.50:0/4080012943 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00407b020 con 0x5620833eca90 2023-10-26T06:44:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7f9fef7fe700 1 -- 172.21.15.50:0/4080012943 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0040a31d0 con 0x5620833eca90 2023-10-26T06:44:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 10 client.25673 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 10 client.25673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 20 client.25673 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5620833e7a30 0x5620833e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 4 client.25673 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.848+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620833b38b0 con 0x5620833e7a30 2023-10-26T06:44:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.849+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5620833e7a30 0x5620833e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.849+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5620833e7a30 0x5620833e9e50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f307dda146bf4c7 server_cookie=479cb561e420f1a in_seq=0 out_seq=0 2023-10-26T06:44:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.849+0000 7f9fef7fe700 10 client.25673 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.850+0000 7f9fef7fe700 1 -- 172.21.15.50:0/4080012943 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5620833b38b0 con 0x5620833e7a30 2023-10-26T06:44:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.850+0000 7f9fef7fe700 10 client.25673 handle_command_reply: tid=0 2023-10-26T06:44:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.850+0000 7fa029e70b80 1 client.25673 shutdown 2023-10-26T06:44:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 msgr2=0x5620833f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833f8c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa00400f930 tx=0x7fa004021b30 comp rx=0 tx=0).stop 2023-10-26T06:44:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 shutdown_connections 2023-10-26T06:44:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5620833e7a30 0x5620833e9e50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833f8c70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 --2- 172.21.15.50:0/4080012943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833ed3b0 0x5620833f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 >> 172.21.15.50:0/4080012943 conn(0x562083358720 msgr2=0x5620833e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7f9fef7fe700 0 client.25673 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 shutdown_connections 2023-10-26T06:44:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.851+0000 7fa029e70b80 1 -- 172.21.15.50:0/4080012943 wait complete. 2023-10-26T06:44:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.852+0000 7fa029e70b80 20 client.25673 trim_cache size 0 max 16384 2023-10-26T06:44:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 Processor -- start 2023-10-26T06:44:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 -- start start 2023-10-26T06:44:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833fd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620831b7920 con 0x5620833eca90 2023-10-26T06:44:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620833f6b50 con 0x5620833ed3b0 2023-10-26T06:44:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.886+0000 7fa029e70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620833f75b0 con 0x5620833f1500 2023-10-26T06:44:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.887+0000 7fa014b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.887+0000 7fa014b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55090/0 (socket says 172.21.15.50:55090) 2023-10-26T06:44:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.887+0000 7fa014b9c700 1 -- 172.21.15.50:0/2241462256 learned_addr learned my addr 172.21.15.50:0/2241462256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.887+0000 7fa00ffff700 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.887+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.888+0000 7fa014b9c700 1 -- 172.21.15.50:0/2241462256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 msgr2=0x5620833f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.888+0000 7fa014b9c700 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.888+0000 7fa014b9c700 1 -- 172.21.15.50:0/2241462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 msgr2=0x5620833fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.888+0000 7fa014b9c700 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.888+0000 7fa014b9c700 1 -- 172.21.15.50:0/2241462256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56208314ac60 con 0x5620833f1500 2023-10-26T06:44:43.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.888+0000 7fa014b9c700 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f87a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0080087d0 tx=0x7fa008008800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f581e67df082e863 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:43.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.889+0000 7f9ff6ffd700 1 -- 172.21.15.50:0/2241462256 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008017630 con 0x5620833f1500 2023-10-26T06:44:43.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.889+0000 7f9ff6ffd700 1 -- 172.21.15.50:0/2241462256 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa008010040 con 0x5620833f1500 2023-10-26T06:44:43.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.889+0000 7f9ff6ffd700 1 -- 172.21.15.50:0/2241462256 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008016ad0 con 0x5620833f1500 2023-10-26T06:44:43.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 -- 172.21.15.50:0/2241462256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 msgr2=0x5620833f87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f87a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0080087d0 tx=0x7fa008008800 comp rx=0 tx=0).stop 2023-10-26T06:44:43.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 -- 172.21.15.50:0/2241462256 shutdown_connections 2023-10-26T06:44:43.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833f1500 0x5620833f87a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833eca90 0x5620833fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 --2- 172.21.15.50:0/2241462256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833ed3b0 0x5620833f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 -- 172.21.15.50:0/2241462256 >> 172.21.15.50:0/2241462256 conn(0x562083358720 msgr2=0x5620833e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:43.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 -- 172.21.15.50:0/2241462256 shutdown_connections 2023-10-26T06:44:43.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.890+0000 7fa029e70b80 1 -- 172.21.15.50:0/2241462256 wait complete. 2023-10-26T06:44:43.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.891+0000 7fa029e70b80 1 -- start start 2023-10-26T06:44:43.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.891+0000 7fa029e70b80 1 Processor -- start 2023-10-26T06:44:43.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 0x5620833f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833f1500 0x5620833f9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620833f9f00 con 0x5620833f1500 2023-10-26T06:44:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620833fa070 con 0x5620833eca90 2023-10-26T06:44:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620833fa230 con 0x5620833ed3b0 2023-10-26T06:44:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa029e70b80 10 client.0 _ll_register_callbacks cb 0x56208321da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa00f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 0x5620833f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa00f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 0x5620833f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55102/0 (socket says 172.21.15.50:55102) 2023-10-26T06:44:43.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.892+0000 7fa00f7fe700 1 -- 172.21.15.50:0/3862906938 learned_addr learned my addr 172.21.15.50:0/3862906938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:43.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7fa00f7fe700 1 -- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 msgr2=0x5620833fd020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:44:43.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833fd020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7fa00f7fe700 1 -- 172.21.15.50:0/3862906938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833f1500 msgr2=0x5620833f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:43.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833f1500 0x5620833f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7fa00f7fe700 1 -- 172.21.15.50:0/3862906938 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0080084b0 con 0x5620833ed3b0 2023-10-26T06:44:43.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7fa00f7fe700 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 0x5620833f9430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa010195f70 tx=0x7fa000013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90135ee18f293103 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:43.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.893+0000 7f9fef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.894+0000 7f9fef7fe700 1 -- 172.21.15.50:0/3862906938 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000d9a0 con 0x5620833ed3b0 2023-10-26T06:44:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.894+0000 7f9fef7fe700 1 -- 172.21.15.50:0/3862906938 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa00000db00 con 0x5620833ed3b0 2023-10-26T06:44:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.894+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa00409b280 con 0x5620833ed3b0 2023-10-26T06:44:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.894+0000 7f9fef7fe700 1 -- 172.21.15.50:0/3862906938 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa00000dcc0 con 0x5620833ed3b0 2023-10-26T06:44:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.894+0000 7fa029e70b80 10 client.25690 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.894+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562083188250 con 0x5620833ed3b0 2023-10-26T06:44:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7f9fef7fe700 1 -- 172.21.15.50:0/3862906938 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00003b020 con 0x5620833ed3b0 2023-10-26T06:44:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7f9fef7fe700 1 -- 172.21.15.50:0/3862906938 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa000035020 con 0x5620833ed3b0 2023-10-26T06:44:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7fa029e70b80 10 client.25690 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7fa029e70b80 10 client.25690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7fa029e70b80 20 client.25690 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7fa029e70b80 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56208345fba0 0x562083477530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7fa029e70b80 4 client.25690 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:44:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.895+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56208332fe50 con 0x56208345fba0 2023-10-26T06:44:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.896+0000 7fa00ffff700 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56208345fba0 0x562083477530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.896+0000 7fa00ffff700 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56208345fba0 0x562083477530 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafeee160188e15c server_cookie=ee12bef7e927e207 in_seq=0 out_seq=0 2023-10-26T06:44:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.896+0000 7f9fef7fe700 10 client.25690 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.896+0000 7f9fef7fe700 1 -- 172.21.15.50:0/3862906938 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56208332fe50 con 0x56208345fba0 2023-10-26T06:44:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.896+0000 7f9fef7fe700 10 client.25690 handle_command_reply: tid=0 2023-10-26T06:44:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.896+0000 7fa029e70b80 1 client.25690 shutdown 2023-10-26T06:44:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 msgr2=0x5620833f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 0x5620833f9430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa010195f70 tx=0x7fa000013000 comp rx=0 tx=0).stop 2023-10-26T06:44:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 shutdown_connections 2023-10-26T06:44:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56208345fba0 0x562083477530 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620833f1500 0x5620833f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5620833eca90 0x5620833fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 --2- 172.21.15.50:0/3862906938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620833ed3b0 0x5620833f9430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7f9fef7fe700 0 client.25690 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 >> 172.21.15.50:0/3862906938 conn(0x562083358720 msgr2=0x5620833f38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 shutdown_connections 2023-10-26T06:44:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 1 -- 172.21.15.50:0/3862906938 wait complete. 2023-10-26T06:44:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.897+0000 7fa029e70b80 20 client.25690 trim_cache size 0 max 16384 2023-10-26T06:44:43.908 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:44:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:44:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:44:43.908 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:44:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ff80a5b40 msgr2=0x7f9ff80a8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ff80a5b40 0x7f9ff80a8000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa000006fd0 tx=0x7fa000008040 comp rx=0 tx=0).stop 2023-10-26T06:44:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 msgr2=0x7fa010194a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 0x7fa010194a70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa004005910 tx=0x7fa00400f810 comp rx=0 tx=0).stop 2023-10-26T06:44:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 shutdown_connections 2023-10-26T06:44:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ff80a5b40 0x7f9ff80a8000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa010105b30 0x7fa010199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa010067d40 0x7fa010194a70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 --2- 172.21.15.50:0/3538607647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa010105170 0x7fa010194fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.898+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 >> 172.21.15.50:0/3538607647 conn(0x7fa0100767f0 msgr2=0x7fa0100fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.899+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 shutdown_connections 2023-10-26T06:44:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:43.899+0000 7fa0165ff700 1 -- 172.21.15.50:0/3538607647 wait complete. 2023-10-26T06:44:43.930 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:44:43.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:44:44.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:43 smithi125 ceph-mon[130643]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:43 smithi153 ceph-mon[131657]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:43 smithi050 ceph-mon[94997]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-10-26T06:44:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 -- 172.21.15.50:0/1524851747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c103120 msgr2=0x7f5e2c1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 --2- 172.21.15.50:0/1524851747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c103120 0x7f5e2c1035d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009f90 tx=0x7f5e2400b330 comp rx=0 tx=0).stop 2023-10-26T06:44:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 -- 172.21.15.50:0/1524851747 shutdown_connections 2023-10-26T06:44:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 --2- 172.21.15.50:0/1524851747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c103120 0x7f5e2c1035d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 --2- 172.21.15.50:0/1524851747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c1055d0 0x7f5e2c1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 --2- 172.21.15.50:0/1524851747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 0x7f5e2c067d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 -- 172.21.15.50:0/1524851747 >> 172.21.15.50:0/1524851747 conn(0x7f5e2c076400 msgr2=0x7f5e2c076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 -- 172.21.15.50:0/1524851747 shutdown_connections 2023-10-26T06:44:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.277+0000 7f5e32dff700 1 -- 172.21.15.50:0/1524851747 wait complete. 2023-10-26T06:44:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.279+0000 7f5e32dff700 1 Processor -- start 2023-10-26T06:44:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.279+0000 7f5e32dff700 1 -- start start 2023-10-26T06:44:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.279+0000 7f5e32dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 0x7f5e2c19d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e32dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c103120 0x7f5e2c19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e32dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c1055d0 0x7f5e2c1a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e32dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c1a2190 con 0x7f5e2c1055d0 2023-10-26T06:44:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e32dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c1a2300 con 0x7f5e2c103120 2023-10-26T06:44:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e32dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c1a24c0 con 0x7f5e2c0678c0 2023-10-26T06:44:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e30b9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 0x7f5e2c19d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e2bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c103120 0x7f5e2c19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.280+0000 7f5e30b9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 0x7f5e2c19d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55120/0 (socket says 172.21.15.50:55120) 2023-10-26T06:44:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e30b9b700 1 -- 172.21.15.50:0/3942756298 learned_addr learned my addr 172.21.15.50:0/3942756298 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e3139c700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c1055d0 0x7f5e2c1a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e3139c700 1 -- 172.21.15.50:0/3942756298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 msgr2=0x7f5e2c19d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e3139c700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 0x7f5e2c19d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e3139c700 1 -- 172.21.15.50:0/3942756298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c103120 msgr2=0x7f5e2c19d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e3139c700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c103120 0x7f5e2c19d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e3139c700 1 -- 172.21.15.50:0/3942756298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e24009c40 con 0x7f5e2c1055d0 2023-10-26T06:44:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.281+0000 7f5e2bfff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c103120 0x7f5e2c19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.282+0000 7f5e3139c700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c1055d0 0x7f5e2c1a1b50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400b6c0 tx=0x7f5e240094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.282+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400e040 con 0x7f5e2c1055d0 2023-10-26T06:44:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.282+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c1a2740 con 0x7f5e2c1055d0 2023-10-26T06:44:44.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.282+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e24007e10 con 0x7f5e2c1055d0 2023-10-26T06:44:44.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.282+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24005040 con 0x7f5e2c1055d0 2023-10-26T06:44:44.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.283+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c1a9fe0 con 0x7f5e2c1055d0 2023-10-26T06:44:44.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.285+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c0ffc00 con 0x7f5e2c1055d0 2023-10-26T06:44:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.289+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5e2400bcf0 con 0x7f5e2c1055d0 2023-10-26T06:44:44.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.291+0000 7f5e29ffb700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5e1c0a1670 0x7f5e1c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:44.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.291+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5e240ce570 con 0x7f5e2c1055d0 2023-10-26T06:44:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.292+0000 7f5e30b9b700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5e1c0a1670 0x7f5e1c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:44.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.293+0000 7f5e30b9b700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5e1c0a1670 0x7f5e1c0a3b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009ca0 tx=0x7f5e20009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:44.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.296+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e24097970 con 0x7f5e2c1055d0 2023-10-26T06:44:44.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.807+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e2c19e570 con 0x7f5e2c1055d0 2023-10-26T06:44:44.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.808+0000 7f5e29ffb700 1 -- 172.21.15.50:0/3942756298 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11321 (secure 0 0 0) 0x7f5e2401bed0 con 0x7f5e2c1055d0 2023-10-26T06:44:44.811 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:44:44.811 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:41:35.994192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:44:44.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5e1c0a1670 msgr2=0x7f5e1c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:44.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5e1c0a1670 0x7f5e1c0a3b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009ca0 tx=0x7f5e20009260 comp rx=0 tx=0).stop 2023-10-26T06:44:44.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c1055d0 msgr2=0x7f5e2c1a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:44.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c1055d0 0x7f5e2c1a1b50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400b6c0 tx=0x7f5e240094b0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 shutdown_connections 2023-10-26T06:44:44.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5e1c0a1670 0x7f5e1c0a3b30 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009ca0 tx=0x7f5e20009260 comp rx=0 tx=0).stop 2023-10-26T06:44:44.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e2c1055d0 0x7f5e2c1a1b50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e2c0678c0 0x7f5e2c19d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 --2- 172.21.15.50:0/3942756298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e2c103120 0x7f5e2c19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:44.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.812+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 >> 172.21.15.50:0/3942756298 conn(0x7f5e2c076400 msgr2=0x7f5e2c102100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:44.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.813+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 shutdown_connections 2023-10-26T06:44:44.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:44.813+0000 7f5e32dff700 1 -- 172.21.15.50:0/3942756298 wait complete. 2023-10-26T06:44:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-10-26T06:44:44.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:44:45.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:44 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:44:45.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:44 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3942756298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:44:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 -- 172.21.15.50:0/470077407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8078067890 msgr2=0x7f8078067d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 --2- 172.21.15.50:0/470077407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8078067890 0x7f8078067d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f807000b0a0 tx=0x7f807000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 -- 172.21.15.50:0/470077407 shutdown_connections 2023-10-26T06:44:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 --2- 172.21.15.50:0/470077407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8078067890 0x7f8078067d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 --2- 172.21.15.50:0/470077407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80781056d0 0x7f8078103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 --2- 172.21.15.50:0/470077407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 0x7f8078103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.189+0000 7f807edff700 1 -- 172.21.15.50:0/470077407 >> 172.21.15.50:0/470077407 conn(0x7f80780767f0 msgr2=0x7f8078076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.190+0000 7f807edff700 1 -- 172.21.15.50:0/470077407 shutdown_connections 2023-10-26T06:44:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.190+0000 7f807edff700 1 -- 172.21.15.50:0/470077407 wait complete. 2023-10-26T06:44:45.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.191+0000 7f807edff700 1 Processor -- start 2023-10-26T06:44:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 -- start start 2023-10-26T06:44:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078067890 0x7f807819d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 0x7f807819d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80781056d0 0x7f80781a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781a21c0 con 0x7f8078103690 2023-10-26T06:44:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781a2330 con 0x7f80781056d0 2023-10-26T06:44:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.192+0000 7f807edff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781a24f0 con 0x7f8078067890 2023-10-26T06:44:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.193+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078067890 0x7f807819d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.193+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078067890 0x7f807819d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55140/0 (socket says 172.21.15.50:55140) 2023-10-26T06:44:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.193+0000 7f807cb9b700 1 -- 172.21.15.50:0/2793151406 learned_addr learned my addr 172.21.15.50:0/2793151406 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.193+0000 7f807d39c700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80781056d0 0x7f80781a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.194+0000 7f8077fff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 0x7f807819d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.194+0000 7f8077fff700 1 -- 172.21.15.50:0/2793151406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078067890 msgr2=0x7f807819d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.194+0000 7f8077fff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078067890 0x7f807819d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.194+0000 7f8077fff700 1 -- 172.21.15.50:0/2793151406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80781056d0 msgr2=0x7f80781a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.194+0000 7f8077fff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80781056d0 0x7f80781a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.194+0000 7f8077fff700 1 -- 172.21.15.50:0/2793151406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070009d00 con 0x7f8078103690 2023-10-26T06:44:45.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.195+0000 7f8077fff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 0x7f807819d7e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f806400d950 tx=0x7f806400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.195+0000 7f8075ffb700 1 -- 172.21.15.50:0/2793151406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400f890 con 0x7f8078103690 2023-10-26T06:44:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.196+0000 7f8075ffb700 1 -- 172.21.15.50:0/2793151406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8064010460 con 0x7f8078103690 2023-10-26T06:44:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.196+0000 7f8075ffb700 1 -- 172.21.15.50:0/2793151406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400e610 con 0x7f8078103690 2023-10-26T06:44:45.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.196+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80781a27d0 con 0x7f8078103690 2023-10-26T06:44:45.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.196+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078105de0 con 0x7f8078103690 2023-10-26T06:44:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.202+0000 7f8075ffb700 1 -- 172.21.15.50:0/2793151406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f80640105d0 con 0x7f8078103690 2023-10-26T06:44:45.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.203+0000 7f809264db80 1 Processor -- start 2023-10-26T06:44:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.203+0000 7f809264db80 1 -- start start 2023-10-26T06:44:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.203+0000 7f809264db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 0x563573e23fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f809264db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e1e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f809264db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e1e5d0 0x563573e1ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f809264db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573d916e0 con 0x563573e1e5d0 2023-10-26T06:44:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f809264db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573d77c60 con 0x563573e24500 2023-10-26T06:44:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f809264db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573d75580 con 0x563573e23be0 2023-10-26T06:44:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f807d39c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 0x563573e23fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e1e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e1e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38186/0 (socket says 172.21.15.50:38186) 2023-10-26T06:44:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f807d39c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 0x563573e23fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55154/0 (socket says 172.21.15.50:55154) 2023-10-26T06:44:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.204+0000 7f807cb9b700 1 -- 172.21.15.50:0/2530577892 learned_addr learned my addr 172.21.15.50:0/2530577892 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f807d39c700 1 -- 172.21.15.50:0/2530577892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 msgr2=0x563573e1e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f807d39c700 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e1e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f807d39c700 1 -- 172.21.15.50:0/2530577892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e1e5d0 msgr2=0x563573e1ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:44:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f807d39c700 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e1e5d0 0x563573e1ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f807d39c700 1 -- 172.21.15.50:0/2530577892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563573d2e3f0 con 0x563573e23be0 2023-10-26T06:44:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f8075ffb700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f80680a16f0 0x7f80680a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.205+0000 7f8075ffb700 1 -- 172.21.15.50:0/2793151406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f80640cc730 con 0x7f8078103690 2023-10-26T06:44:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.206+0000 7f807d39c700 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 0x563573e23fc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8070009fd0 tx=0x7f8070009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2292095038fb47e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.206+0000 7f807cb9b700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f80680a16f0 0x7f80680a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.206+0000 7f8062ffd700 1 -- 172.21.15.50:0/2530577892 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807000e040 con 0x563573e23be0 2023-10-26T06:44:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.206+0000 7f8062ffd700 1 -- 172.21.15.50:0/2530577892 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8070007d80 con 0x563573e23be0 2023-10-26T06:44:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.206+0000 7f8062ffd700 1 -- 172.21.15.50:0/2530577892 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070007830 con 0x563573e23be0 2023-10-26T06:44:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 -- 172.21.15.50:0/2530577892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 msgr2=0x563573e23fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 0x563573e23fc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8070009fd0 tx=0x7f8070009c60 comp rx=0 tx=0).stop 2023-10-26T06:44:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f807cb9b700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f80680a16f0 0x7f80680a3bb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x563573e19a70 tx=0x7f806c00b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 -- 172.21.15.50:0/2530577892 shutdown_connections 2023-10-26T06:44:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e1e5d0 0x563573e1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e23be0 0x563573e23fc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 --2- 172.21.15.50:0/2530577892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e1e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.208+0000 7f809264db80 1 -- 172.21.15.50:0/2530577892 >> 172.21.15.50:0/2530577892 conn(0x563573d92720 msgr2=0x563573e18b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.209+0000 7f809264db80 1 -- 172.21.15.50:0/2530577892 shutdown_connections 2023-10-26T06:44:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.209+0000 7f809264db80 1 -- 172.21.15.50:0/2530577892 wait complete. 2023-10-26T06:44:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.210+0000 7f809264db80 1 -- start start 2023-10-26T06:44:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.210+0000 7f809264db80 1 Processor -- start 2023-10-26T06:44:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.211+0000 7f809264db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e27990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.211+0000 7f809264db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e27ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.211+0000 7f809264db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e28410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.212+0000 7f8077fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e27ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.212+0000 7f8077fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e27ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36354/0 (socket says 172.21.15.50:36354) 2023-10-26T06:44:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.212+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e27990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.212+0000 7f807d39c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e28410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.212+0000 7f807d39c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e28410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55166/0 (socket says 172.21.15.50:55166) 2023-10-26T06:44:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e27990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38188/0 (socket says 172.21.15.50:38188) 2023-10-26T06:44:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f809264db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573d70e70 con 0x563573e23be0 2023-10-26T06:44:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f8077fff700 1 -- 172.21.15.50:0/290019264 learned_addr learned my addr 172.21.15.50:0/290019264 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573d0d710 con 0x563573e1e5d0 2023-10-26T06:44:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573d0d3b0 con 0x563573e24500 2023-10-26T06:44:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f807d39c700 1 -- 172.21.15.50:0/290019264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 msgr2=0x563573e27990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f807d39c700 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e27990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f807d39c700 1 -- 172.21.15.50:0/290019264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 msgr2=0x563573e27ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f807d39c700 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e27ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f807d39c700 1 -- 172.21.15.50:0/290019264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078114580 con 0x563573e24500 2023-10-26T06:44:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.213+0000 7f809264db80 10 client.0 _ll_register_callbacks cb 0x563573c57a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.214+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563573d75ef0 con 0x563573e24500 2023-10-26T06:44:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.214+0000 7f807d39c700 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e28410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f807000b070 tx=0x7f8070007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122611973a01f090 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.214+0000 7f8057fff700 10 client.25708 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:45.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.214+0000 7f8057fff700 1 -- 172.21.15.50:0/290019264 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807000e070 con 0x563573e24500 2023-10-26T06:44:45.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.214+0000 7f8057fff700 1 -- 172.21.15.50:0/290019264 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f80700092d0 con 0x563573e24500 2023-10-26T06:44:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.217+0000 7f8057fff700 1 -- 172.21.15.50:0/290019264 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8070009490 con 0x563573e24500 2023-10-26T06:44:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 10 client.25708 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=23}) v3 -- 0x563573b9bde0 con 0x563573e24500 2023-10-26T06:44:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f8057fff700 1 -- 172.21.15.50:0/290019264 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8070019050 con 0x563573e24500 2023-10-26T06:44:45.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 10 client.25708 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 10 client.25708 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:44:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 20 client.25708 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e37810 0x563573e39c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 4 client.25708 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.218+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563573ded8b0 con 0x563573e37810 2023-10-26T06:44:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.219+0000 7f807cb9b700 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e37810 0x563573e39c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.220+0000 7f807cb9b700 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e37810 0x563573e39c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c13802bb839a1362 server_cookie=ba4148eb3f3262d1 in_seq=0 out_seq=0 2023-10-26T06:44:45.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.220+0000 7f8057fff700 10 client.25708 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.221+0000 7f8057fff700 1 -- 172.21.15.50:0/290019264 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563573ded8b0 con 0x563573e37810 2023-10-26T06:44:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.221+0000 7f8057fff700 10 client.25708 handle_command_reply: tid=0 2023-10-26T06:44:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.221+0000 7f809264db80 1 client.25708 shutdown 2023-10-26T06:44:45.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.221+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 msgr2=0x563573e28410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e28410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f807000b070 tx=0x7f8070007a00 comp rx=0 tx=0).stop 2023-10-26T06:44:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 shutdown_connections 2023-10-26T06:44:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e37810 0x563573e39c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e28410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e27990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 --2- 172.21.15.50:0/290019264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e27ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 >> 172.21.15.50:0/290019264 conn(0x563573d92720 msgr2=0x563573e1d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.222+0000 7f8057fff700 0 client.25708 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.223+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 shutdown_connections 2023-10-26T06:44:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.223+0000 7f809264db80 1 -- 172.21.15.50:0/290019264 wait complete. 2023-10-26T06:44:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.224+0000 7f809264db80 20 client.25708 trim_cache size 0 max 16384 2023-10-26T06:44:45.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:44 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:44:45.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:44 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3942756298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:44:45.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.251+0000 7f809264db80 1 Processor -- start 2023-10-26T06:44:45.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.251+0000 7f809264db80 1 -- start start 2023-10-26T06:44:45.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.252+0000 7f809264db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e1e5d0 0x563573e1e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.252+0000 7f809264db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.252+0000 7f809264db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e2ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.252+0000 7f809264db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573bf1920 con 0x563573e23be0 2023-10-26T06:44:45.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.252+0000 7f809264db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573e1a3b0 con 0x563573e24500 2023-10-26T06:44:45.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.252+0000 7f809264db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573e1ede0 con 0x563573e1e5d0 2023-10-26T06:44:45.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.253+0000 7f807d39c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e2ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.253+0000 7f807d39c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e2ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38200/0 (socket says 172.21.15.50:38200) 2023-10-26T06:44:45.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.253+0000 7f807d39c700 1 -- 172.21.15.50:0/1373229443 learned_addr learned my addr 172.21.15.50:0/1373229443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.253+0000 7f8077fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.254+0000 7f8077fff700 1 -- 172.21.15.50:0/1373229443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e1e5d0 msgr2=0x563573e1e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.254+0000 7f8077fff700 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e1e5d0 0x563573e1e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.254+0000 7f8077fff700 1 -- 172.21.15.50:0/1373229443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 msgr2=0x563573e2ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.254+0000 7f8077fff700 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e2ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.254+0000 7f8077fff700 1 -- 172.21.15.50:0/1373229443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563573b84c60 con 0x563573e23be0 2023-10-26T06:44:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.255+0000 7f807d39c700 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e2ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.255+0000 7f8077fff700 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e135d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8064095c60 tx=0x7f80640c9f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2611eefeae7bfb6a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.255+0000 7f80637fe700 1 -- 172.21.15.50:0/1373229443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640990c0 con 0x563573e23be0 2023-10-26T06:44:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.256+0000 7f80637fe700 1 -- 172.21.15.50:0/1373229443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8064099e60 con 0x563573e23be0 2023-10-26T06:44:45.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.256+0000 7f80637fe700 1 -- 172.21.15.50:0/1373229443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064084070 con 0x563573e23be0 2023-10-26T06:44:45.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 -- 172.21.15.50:0/1373229443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 msgr2=0x563573e135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e135d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8064095c60 tx=0x7f80640c9f40 comp rx=0 tx=0).stop 2023-10-26T06:44:45.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 -- 172.21.15.50:0/1373229443 shutdown_connections 2023-10-26T06:44:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e24500 0x563573e2ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e1e5d0 0x563573e1e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 --2- 172.21.15.50:0/1373229443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e135d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.257+0000 7f809264db80 1 -- 172.21.15.50:0/1373229443 >> 172.21.15.50:0/1373229443 conn(0x563573d92720 msgr2=0x563573e27220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.258+0000 7f809264db80 1 -- 172.21.15.50:0/1373229443 shutdown_connections 2023-10-26T06:44:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.258+0000 7f809264db80 1 -- 172.21.15.50:0/1373229443 wait complete. 2023-10-26T06:44:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.258+0000 7f809264db80 1 -- start start 2023-10-26T06:44:45.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.259+0000 7f809264db80 1 Processor -- start 2023-10-26T06:44:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e2d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e2da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e2df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573e85660 con 0x563573e23be0 2023-10-26T06:44:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573e857d0 con 0x563573e1e5d0 2023-10-26T06:44:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563573e85990 con 0x563573e24500 2023-10-26T06:44:45.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.261+0000 7f809264db80 10 client.0 _ll_register_callbacks cb 0x563573c57a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.263+0000 7f807cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e2d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.263+0000 7f807d39c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.263+0000 7f807d39c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e2df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55174/0 (socket says 172.21.15.50:55174) 2023-10-26T06:44:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.263+0000 7f807d39c700 1 -- 172.21.15.50:0/316527643 learned_addr learned my addr 172.21.15.50:0/316527643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.263+0000 7f8077fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e2da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.265+0000 7f807d39c700 1 -- 172.21.15.50:0/316527643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 msgr2=0x563573e2d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.265+0000 7f807d39c700 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e2d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.265+0000 7f807d39c700 1 -- 172.21.15.50:0/316527643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 msgr2=0x563573e2da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.265+0000 7f807d39c700 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e2da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.265+0000 7f807d39c700 1 -- 172.21.15.50:0/316527643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563573b9bde0 con 0x563573e24500 2023-10-26T06:44:45.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:44 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:44:45.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:44 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3942756298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:44:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.266+0000 7f8057fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.266+0000 7f807d39c700 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e2df70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8070009cd0 tx=0x7f8070006230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3127929d757874c server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.267+0000 7f8057fff700 1 -- 172.21.15.50:0/316527643 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070003df0 con 0x563573e24500 2023-10-26T06:44:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.267+0000 7f8057fff700 1 -- 172.21.15.50:0/316527643 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f807000ce80 con 0x563573e24500 2023-10-26T06:44:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.267+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8070007d80 con 0x563573e24500 2023-10-26T06:44:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.268+0000 7f8057fff700 1 -- 172.21.15.50:0/316527643 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8070003df0 con 0x563573e24500 2023-10-26T06:44:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.269+0000 7f809264db80 10 client.25711 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.269+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f8078105de0 con 0x563573e24500 2023-10-26T06:44:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f8057fff700 1 -- 172.21.15.50:0/316527643 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8070020070 con 0x563573e24500 2023-10-26T06:44:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f8057fff700 1 -- 172.21.15.50:0/316527643 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f807000b0d0 con 0x563573e24500 2023-10-26T06:44:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f809264db80 10 client.25711 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f809264db80 10 client.25711 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:44:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f809264db80 20 client.25711 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f809264db80 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e86c40 0x563573e87020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f809264db80 4 client.25711 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:44:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.270+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f8070007d80 con 0x563573e86c40 2023-10-26T06:44:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.271+0000 7f807cb9b700 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e86c40 0x563573e87020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.272+0000 7f807cb9b700 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e86c40 0x563573e87020 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2095e9d02231851 server_cookie=fe48788a16a58e81 in_seq=0 out_seq=0 2023-10-26T06:44:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.272+0000 7f8057fff700 10 client.25711 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.272+0000 7f8057fff700 1 -- 172.21.15.50:0/316527643 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f8070007d80 con 0x563573e86c40 2023-10-26T06:44:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.272+0000 7f8057fff700 10 client.25711 handle_command_reply: tid=0 2023-10-26T06:44:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.272+0000 7f809264db80 1 client.25711 shutdown 2023-10-26T06:44:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 msgr2=0x563573e2df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e2df70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8070009cd0 tx=0x7f8070006230 comp rx=0 tx=0).stop 2023-10-26T06:44:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 shutdown_connections 2023-10-26T06:44:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x563573e86c40 0x563573e87020 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563573e24500 0x563573e2df70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x563573e1e5d0 0x563573e2d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 --2- 172.21.15.50:0/316527643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563573e23be0 0x563573e2da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 >> 172.21.15.50:0/316527643 conn(0x563573d92720 msgr2=0x563573e26260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f8057fff700 0 client.25711 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:44:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 shutdown_connections 2023-10-26T06:44:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.274+0000 7f809264db80 1 -- 172.21.15.50:0/316527643 wait complete. 2023-10-26T06:44:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.276+0000 7f809264db80 20 client.25711 trim_cache size 0 max 16384 2023-10-26T06:44:45.280 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:44:45.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f80680a16f0 msgr2=0x7f80680a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f80680a16f0 0x7f80680a3bb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x563573e19a70 tx=0x7f806c00b500 comp rx=0 tx=0).stop 2023-10-26T06:44:45.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 msgr2=0x7f807819d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 0x7f807819d7e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f806400d950 tx=0x7f806400dc60 comp rx=0 tx=0).stop 2023-10-26T06:44:45.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 shutdown_connections 2023-10-26T06:44:45.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f80680a16f0 0x7f80680a3bb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80781056d0 0x7f80781a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078067890 0x7f807819d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 --2- 172.21.15.50:0/2793151406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8078103690 0x7f807819d7e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.277+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 >> 172.21.15.50:0/2793151406 conn(0x7f80780767f0 msgr2=0x7f80780fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.278+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 shutdown_connections 2023-10-26T06:44:45.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.278+0000 7f807edff700 1 -- 172.21.15.50:0/2793151406 wait complete. 2023-10-26T06:44:45.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:44:45.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 -- 172.21.15.50:0/1703035527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105170 msgr2=0x7fb0741055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1703035527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105170 0x7fb0741055f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0680099c0 tx=0x7fb068009cd0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 -- 172.21.15.50:0/1703035527 shutdown_connections 2023-10-26T06:44:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1703035527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105b30 0x7fb07410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1703035527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074067d40 0x7fb074068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1703035527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105170 0x7fb0741055f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.665+0000 7fb0793ff700 1 -- 172.21.15.50:0/1703035527 >> 172.21.15.50:0/1703035527 conn(0x7fb0740767f0 msgr2=0x7fb074076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.666+0000 7fb0793ff700 1 -- 172.21.15.50:0/1703035527 shutdown_connections 2023-10-26T06:44:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.666+0000 7fb0793ff700 1 -- 172.21.15.50:0/1703035527 wait complete. 2023-10-26T06:44:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.667+0000 7fb0793ff700 1 Processor -- start 2023-10-26T06:44:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.667+0000 7fb0793ff700 1 -- start start 2023-10-26T06:44:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0793ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074067d40 0x7fb0741012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0793ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 0x7fb0740ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0793ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105b30 0x7fb0740ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0793ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0741004e0 con 0x7fb074067d40 2023-10-26T06:44:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0793ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0741a9550 con 0x7fb074105170 2023-10-26T06:44:45.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0793ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0741a96c0 con 0x7fb074105b30 2023-10-26T06:44:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.668+0000 7fb0727fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 0x7fb0740ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.669+0000 7fb0727fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 0x7fb0740ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38220/0 (socket says 172.21.15.50:38220) 2023-10-26T06:44:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.669+0000 7fb0727fc700 1 -- 172.21.15.50:0/1239554544 learned_addr learned my addr 172.21.15.50:0/1239554544 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.669+0000 7fb0737fe700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105b30 0x7fb0740ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.669+0000 7fb072ffd700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074067d40 0x7fb0741012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.670+0000 7fb0727fc700 1 -- 172.21.15.50:0/1239554544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105b30 msgr2=0x7fb0740ffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.670+0000 7fb0727fc700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105b30 0x7fb0740ffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.670+0000 7fb0727fc700 1 -- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074067d40 msgr2=0x7fb0741012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.670+0000 7fb0727fc700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074067d40 0x7fb0741012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.670+0000 7fb0727fc700 1 -- 172.21.15.50:0/1239554544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680095f0 con 0x7fb074105170 2023-10-26T06:44:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.671+0000 7fb0727fc700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 0x7fb0740ff6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb06800b580 tx=0x7fb06800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.671+0000 7fb05bfff700 1 -- 172.21.15.50:0/1239554544 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06801c070 con 0x7fb074105170 2023-10-26T06:44:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.671+0000 7fb05bfff700 1 -- 172.21.15.50:0/1239554544 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb06800fe30 con 0x7fb074105170 2023-10-26T06:44:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.671+0000 7fb05bfff700 1 -- 172.21.15.50:0/1239554544 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068022d40 con 0x7fb074105170 2023-10-26T06:44:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.671+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0741a9940 con 0x7fb074105170 2023-10-26T06:44:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.672+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0741a9d10 con 0x7fb074105170 2023-10-26T06:44:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.677+0000 7fb08cd22b80 1 Processor -- start 2023-10-26T06:44:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.678+0000 7fb08cd22b80 1 -- start start 2023-10-26T06:44:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.678+0000 7fb05bfff700 1 -- 172.21.15.50:0/1239554544 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb068020070 con 0x7fb074105170 2023-10-26T06:44:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b183d6e0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b1823c60 con 0x55e3b18d0500 2023-10-26T06:44:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b1821580 con 0x55e3b18cfbe0 2023-10-26T06:44:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38222/0 (socket says 172.21.15.50:38222) 2023-10-26T06:44:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.679+0000 7fb072ffd700 1 -- 172.21.15.50:0/611715819 learned_addr learned my addr 172.21.15.50:0/611715819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb0727fc700 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb0737fe700 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb072ffd700 1 -- 172.21.15.50:0/611715819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 msgr2=0x55e3b18cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb072ffd700 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb072ffd700 1 -- 172.21.15.50:0/611715819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 msgr2=0x55e3b18caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb072ffd700 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.680+0000 7fb072ffd700 1 -- 172.21.15.50:0/611715819 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3b17da3f0 con 0x55e3b18d0500 2023-10-26T06:44:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.681+0000 7fb0727fc700 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:44:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.681+0000 7fb072ffd700 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18ca090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb064009d10 tx=0x7fb0640116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afb396ddb0347b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.681+0000 7fb0597fa700 1 -- 172.21.15.50:0/611715819 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064011ed0 con 0x55e3b18d0500 2023-10-26T06:44:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.681+0000 7fb0597fa700 1 -- 172.21.15.50:0/611715819 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb064009e60 con 0x55e3b18d0500 2023-10-26T06:44:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.681+0000 7fb0597fa700 1 -- 172.21.15.50:0/611715819 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400f8a0 con 0x55e3b18d0500 2023-10-26T06:44:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.681+0000 7fb05bfff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb05c0a16f0 0x7fb05c0a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.682+0000 7fb05bfff700 1 -- 172.21.15.50:0/1239554544 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb0680cdaa0 con 0x7fb074105170 2023-10-26T06:44:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.682+0000 7fb0737fe700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb05c0a16f0 0x7fb05c0a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.682+0000 7fb08cd22b80 1 -- 172.21.15.50:0/611715819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 msgr2=0x55e3b18ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.682+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18ca090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb064009d10 tx=0x7fb0640116c0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 -- 172.21.15.50:0/611715819 shutdown_connections 2023-10-26T06:44:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/611715819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18ca090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 -- 172.21.15.50:0/611715819 >> 172.21.15.50:0/611715819 conn(0x55e3b183e720 msgr2=0x55e3b18c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb0737fe700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb05c0a16f0 0x7fb05c0a3bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009550 tx=0x7fb06c009050 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 -- 172.21.15.50:0/611715819 shutdown_connections 2023-10-26T06:44:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.683+0000 7fb08cd22b80 1 -- 172.21.15.50:0/611715819 wait complete. 2023-10-26T06:44:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.684+0000 7fb08cd22b80 1 -- start start 2023-10-26T06:44:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.684+0000 7fb08cd22b80 1 Processor -- start 2023-10-26T06:44:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 0x55e3b18d63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18cfbe0 0x55e3b18d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b181ce70 con 0x55e3b18cfbe0 2023-10-26T06:44:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b17b9710 con 0x55e3b18d0500 2023-10-26T06:44:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b17b93b0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.685+0000 7fb08cd22b80 10 client.0 _ll_register_callbacks cb 0x55e3b1703a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 0x55e3b18d63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb0737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 0x55e3b18d63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55192/0 (socket says 172.21.15.50:55192) 2023-10-26T06:44:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 -- 172.21.15.50:0/1566089008 learned_addr learned my addr 172.21.15.50:0/1566089008 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 -- 172.21.15.50:0/1566089008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 msgr2=0x55e3b18d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18d3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 -- 172.21.15.50:0/1566089008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18cfbe0 msgr2=0x55e3b18d3760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:44:45.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18cfbe0 0x55e3b18d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.686+0000 7fb072ffd700 1 -- 172.21.15.50:0/1566089008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb064009940 con 0x55e3b18ca5d0 2023-10-26T06:44:45.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.687+0000 7fb072ffd700 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 0x55e3b18d63d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb064000c00 tx=0x7fb0640042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993b8441bfe469cd server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.687+0000 7fb056ff5700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.687+0000 7fb056ff5700 1 -- 172.21.15.50:0/1566089008 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064005460 con 0x55e3b18ca5d0 2023-10-26T06:44:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.687+0000 7fb056ff5700 1 -- 172.21.15.50:0/1566089008 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb0640055c0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.687+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3b1821ef0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.688+0000 7fb056ff5700 1 -- 172.21.15.50:0/1566089008 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb064004590 con 0x55e3b18ca5d0 2023-10-26T06:44:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.688+0000 7fb08cd22b80 10 client.25720 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:45.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.688+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55e3b1647de0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.688+0000 7fb056ff5700 1 -- 172.21.15.50:0/1566089008 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3b1821ef0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb056ff5700 1 -- 172.21.15.50:0/1566089008 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb064004bc0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb08cd22b80 10 client.25720 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb08cd22b80 10 client.25720 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:44:45.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb08cd22b80 20 client.25720 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:45.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b1905c70 0x55e3b1908090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb08cd22b80 4 client.25720 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:45.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3b18998b0 con 0x55e3b1905c70 2023-10-26T06:44:45.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.689+0000 7fb0727fc700 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b1905c70 0x55e3b1908090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.690+0000 7fb0727fc700 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b1905c70 0x55e3b1908090 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef16c18a41a15745 server_cookie=42cffd42beb987da in_seq=0 out_seq=0 2023-10-26T06:44:45.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.690+0000 7fb056ff5700 10 client.25720 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:45.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.690+0000 7fb056ff5700 1 -- 172.21.15.50:0/1566089008 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e3b18998b0 con 0x55e3b1905c70 2023-10-26T06:44:45.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.690+0000 7fb056ff5700 10 client.25720 handle_command_reply: tid=0 2023-10-26T06:44:45.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.691+0000 7fb08cd22b80 1 client.25720 shutdown 2023-10-26T06:44:45.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.691+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 msgr2=0x55e3b18d63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.691+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 0x55e3b18d63d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb064000c00 tx=0x7fb0640042f0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 shutdown_connections 2023-10-26T06:44:45.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b1905c70 0x55e3b1908090 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18d0500 0x55e3b18d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18ca5d0 0x55e3b18d63d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/1566089008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18cfbe0 0x55e3b18d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 >> 172.21.15.50:0/1566089008 conn(0x55e3b183e720 msgr2=0x55e3b18c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb056ff5700 0 client.25720 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:45.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 shutdown_connections 2023-10-26T06:44:45.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 1 -- 172.21.15.50:0/1566089008 wait complete. 2023-10-26T06:44:45.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.692+0000 7fb08cd22b80 20 client.25720 trim_cache size 0 max 16384 2023-10-26T06:44:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.713+0000 7fb08cd22b80 1 Processor -- start 2023-10-26T06:44:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.713+0000 7fb08cd22b80 1 -- start start 2023-10-26T06:44:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18d0500 0x55e3b18d3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b169d920 con 0x55e3b18d0500 2023-10-26T06:44:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b18bfa70 con 0x55e3b18ca5d0 2023-10-26T06:44:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b18ec430 con 0x55e3b18cfbe0 2023-10-26T06:44:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38230/0 (socket says 172.21.15.50:38230) 2023-10-26T06:44:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb072ffd700 1 -- 172.21.15.50:0/4074776054 learned_addr learned my addr 172.21.15.50:0/4074776054 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb0727fc700 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.714+0000 7fb0737fe700 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18d0500 0x55e3b18d3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.715+0000 7fb072ffd700 1 -- 172.21.15.50:0/4074776054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 msgr2=0x55e3b18c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.715+0000 7fb072ffd700 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.715+0000 7fb072ffd700 1 -- 172.21.15.50:0/4074776054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18d0500 msgr2=0x55e3b18d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.715+0000 7fb072ffd700 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18d0500 0x55e3b18d3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.715+0000 7fb072ffd700 1 -- 172.21.15.50:0/4074776054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3b190cd00 con 0x55e3b18ca5d0 2023-10-26T06:44:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.715+0000 7fb072ffd700 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb064005980 tx=0x7fb064009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5950676c762bcd13 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.716+0000 7fb059ffb700 1 -- 172.21.15.50:0/4074776054 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064003d30 con 0x55e3b18ca5d0 2023-10-26T06:44:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.716+0000 7fb059ffb700 1 -- 172.21.15.50:0/4074776054 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb064009c10 con 0x55e3b18ca5d0 2023-10-26T06:44:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.716+0000 7fb059ffb700 1 -- 172.21.15.50:0/4074776054 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064004490 con 0x55e3b18ca5d0 2023-10-26T06:44:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 -- 172.21.15.50:0/4074776054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 msgr2=0x55e3b18ebef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb064005980 tx=0x7fb064009260 comp rx=0 tx=0).stop 2023-10-26T06:44:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 -- 172.21.15.50:0/4074776054 shutdown_connections 2023-10-26T06:44:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18d0500 0x55e3b18d3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebef0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/4074776054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18cfbe0 0x55e3b18c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 -- 172.21.15.50:0/4074776054 >> 172.21.15.50:0/4074776054 conn(0x55e3b183e720 msgr2=0x55e3b18d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 -- 172.21.15.50:0/4074776054 shutdown_connections 2023-10-26T06:44:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.717+0000 7fb08cd22b80 1 -- 172.21.15.50:0/4074776054 wait complete. 2023-10-26T06:44:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.718+0000 7fb08cd22b80 1 -- start start 2023-10-26T06:44:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.718+0000 7fb08cd22b80 1 Processor -- start 2023-10-26T06:44:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18cfbe0 0x55e3b18e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18d0500 0x55e3b18ea530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b18eaa70 con 0x55e3b18ca5d0 2023-10-26T06:44:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b18eabe0 con 0x55e3b18cfbe0 2023-10-26T06:44:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3b18eada0 con 0x55e3b18d0500 2023-10-26T06:44:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb08cd22b80 10 client.0 _ll_register_callbacks cb 0x55e3b1703a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb0727fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18cfbe0 0x55e3b18e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb072ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36432/0 (socket says 172.21.15.50:36432) 2023-10-26T06:44:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb0727fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18cfbe0 0x55e3b18e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38244/0 (socket says 172.21.15.50:38244) 2023-10-26T06:44:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.719+0000 7fb0727fc700 1 -- 172.21.15.50:0/2368497128 learned_addr learned my addr 172.21.15.50:0/2368497128 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb0737fe700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18d0500 0x55e3b18ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb072ffd700 1 -- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18d0500 msgr2=0x55e3b18ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb072ffd700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18d0500 0x55e3b18ea530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb072ffd700 1 -- 172.21.15.50:0/2368497128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18cfbe0 msgr2=0x55e3b18e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:45.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb072ffd700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18cfbe0 0x55e3b18e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb072ffd700 1 -- 172.21.15.50:0/2368497128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3b1647de0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb0737fe700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18d0500 0x55e3b18ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:44:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.720+0000 7fb072ffd700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebb50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb0640036a0 tx=0x7fb064012af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d292086418850163 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.721+0000 7fb056ff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.725+0000 7fb056ff5700 1 -- 172.21.15.50:0/2368497128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064005670 con 0x55e3b18ca5d0 2023-10-26T06:44:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.725+0000 7fb056ff5700 1 -- 172.21.15.50:0/2368497128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb064004410 con 0x55e3b18ca5d0 2023-10-26T06:44:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.725+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb064009e60 con 0x55e3b18ca5d0 2023-10-26T06:44:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.725+0000 7fb056ff5700 1 -- 172.21.15.50:0/2368497128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0640125d0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.725+0000 7fb08cd22b80 10 client.15708 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.726+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55e3b1630c60 con 0x55e3b18ca5d0 2023-10-26T06:44:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.726+0000 7fb056ff5700 1 -- 172.21.15.50:0/2368497128 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb064009e60 con 0x55e3b18ca5d0 2023-10-26T06:44:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.726+0000 7fb056ff5700 1 -- 172.21.15.50:0/2368497128 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb0640235f0 con 0x55e3b18ca5d0 2023-10-26T06:44:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb08cd22b80 10 client.15708 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb08cd22b80 10 client.15708 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:44:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb08cd22b80 20 client.15708 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:45.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b195abc0 0x55e3b195cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb08cd22b80 4 client.15708 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:44:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e3b1815e50 con 0x55e3b195abc0 2023-10-26T06:44:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.727+0000 7fb0727fc700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b195abc0 0x55e3b195cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.732+0000 7fb0727fc700 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b195abc0 0x55e3b195cfe0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=131e08966513d444 server_cookie=4eeb12969a77ba8d in_seq=0 out_seq=0 2023-10-26T06:44:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.732+0000 7fb056ff5700 10 client.15708 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.732+0000 7fb056ff5700 1 -- 172.21.15.50:0/2368497128 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e3b1815e50 con 0x55e3b195abc0 2023-10-26T06:44:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.732+0000 7fb056ff5700 10 client.15708 handle_command_reply: tid=0 2023-10-26T06:44:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.732+0000 7fb08cd22b80 1 client.15708 shutdown 2023-10-26T06:44:45.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 msgr2=0x55e3b18ebb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebb50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb0640036a0 tx=0x7fb064012af0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 shutdown_connections 2023-10-26T06:44:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e3b18d0500 0x55e3b18ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e3b18ca5d0 0x55e3b18ebb50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55e3b195abc0 0x55e3b195cfe0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 --2- 172.21.15.50:0/2368497128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55e3b18cfbe0 0x55e3b18e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 >> 172.21.15.50:0/2368497128 conn(0x55e3b183e720 msgr2=0x55e3b18d1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.733+0000 7fb056ff5700 0 client.15708 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:44:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.734+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 shutdown_connections 2023-10-26T06:44:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.734+0000 7fb08cd22b80 1 -- 172.21.15.50:0/2368497128 wait complete. 2023-10-26T06:44:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.734+0000 7fb08cd22b80 20 client.15708 trim_cache size 0 max 16384 2023-10-26T06:44:45.739 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:44:45.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.735+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb05c0a16f0 msgr2=0x7fb05c0a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.735+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb05c0a16f0 0x7fb05c0a3bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009550 tx=0x7fb06c009050 comp rx=0 tx=0).stop 2023-10-26T06:44:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.735+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 msgr2=0x7fb0740ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.735+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 0x7fb0740ff6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb06800b580 tx=0x7fb06800f690 comp rx=0 tx=0).stop 2023-10-26T06:44:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 shutdown_connections 2023-10-26T06:44:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb05c0a16f0 0x7fb05c0a3bb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb074105b30 0x7fb0740ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb074067d40 0x7fb0741012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 --2- 172.21.15.50:0/1239554544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb074105170 0x7fb0740ff6b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 >> 172.21.15.50:0/1239554544 conn(0x7fb0740767f0 msgr2=0x7fb0740fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 shutdown_connections 2023-10-26T06:44:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:45.736+0000 7fb0793ff700 1 -- 172.21.15.50:0/1239554544 wait complete. 2023-10-26T06:44:45.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:44:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 -- 172.21.15.50:0/1303350414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 msgr2=0x7f8bc810f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/1303350414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc810f820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000b0a0 tx=0x7f8bc000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 -- 172.21.15.50:0/1303350414 shutdown_connections 2023-10-26T06:44:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/1303350414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc810f820 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/1303350414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8108960 0x7f8bc8108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/1303350414 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bc8102950 0x7f8bc8102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.041+0000 7f8bcdbff700 1 -- 172.21.15.50:0/1303350414 >> 172.21.15.50:0/1303350414 conn(0x7f8bc80fe400 msgr2=0x7f8bc8100820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.042+0000 7f8bcdbff700 1 -- 172.21.15.50:0/1303350414 shutdown_connections 2023-10-26T06:44:46.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.042+0000 7f8bcdbff700 1 -- 172.21.15.50:0/1303350414 wait complete. 2023-10-26T06:44:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.043+0000 7f8bcdbff700 1 Processor -- start 2023-10-26T06:44:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 -- start start 2023-10-26T06:44:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8102950 0x7f8bc819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bc8108960 0x7f8bc8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc81991e0 con 0x7f8bc8102950 2023-10-26T06:44:46.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8199350 con 0x7f8bc8108960 2023-10-26T06:44:46.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.044+0000 7f8bcdbff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc8199510 con 0x7f8bc8103310 2023-10-26T06:44:46.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55238/0 (socket says 172.21.15.50:55238) 2023-10-26T06:44:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4182110008 learned_addr learned my addr 172.21.15.50:0/4182110008 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:46.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8102950 0x7f8bc819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4182110008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bc8108960 msgr2=0x7f8bc8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bc8108960 0x7f8bc8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8102950 msgr2=0x7f8bc819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8102950 0x7f8bc819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4182110008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009d00 con 0x7f8bc8103310 2023-10-26T06:44:46.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.045+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8102950 0x7f8bc819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:44:46.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.046+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc819ef90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000e9a0 tx=0x7f8bb000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:46.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.046+0000 7f8bc4ff9700 1 -- 172.21.15.50:0/4182110008 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000cbd0 con 0x7f8bc8103310 2023-10-26T06:44:46.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.046+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc81997f0 con 0x7f8bc8103310 2023-10-26T06:44:46.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.047+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc81a5a40 con 0x7f8bc8103310 2023-10-26T06:44:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.047+0000 7f8bc4ff9700 1 -- 172.21.15.50:0/4182110008 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bb000cd30 con 0x7f8bc8103310 2023-10-26T06:44:46.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.047+0000 7f8bc4ff9700 1 -- 172.21.15.50:0/4182110008 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0018680 con 0x7f8bc8103310 2023-10-26T06:44:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.053+0000 7f8bc4ff9700 1 -- 172.21.15.50:0/4182110008 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8bb0005060 con 0x7f8bc8103310 2023-10-26T06:44:46.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.054+0000 7f8be14c7b80 1 Processor -- start 2023-10-26T06:44:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.054+0000 7f8be14c7b80 1 -- start start 2023-10-26T06:44:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b782286e0 con 0x560b782bb500 2023-10-26T06:44:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7820ec60 con 0x560b782b55d0 2023-10-26T06:44:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7820c580 con 0x560b782babe0 2023-10-26T06:44:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.055+0000 7f8bc4ff9700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8bb40a16f0 0x7f8bb40a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.056+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.056+0000 7f8bc4ff9700 1 -- 172.21.15.50:0/4182110008 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8bb0014070 con 0x7f8bc8103310 2023-10-26T06:44:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.056+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38280/0 (socket says 172.21.15.50:38280) 2023-10-26T06:44:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.056+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4095440774 learned_addr learned my addr 172.21.15.50:0/4095440774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.056+0000 7f8bc7fff700 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc7fff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8bb40a16f0 0x7f8bb40a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4095440774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 msgr2=0x560b782bafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782bafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4095440774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 msgr2=0x560b782b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/4095440774 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b781c53f0 con 0x560b782b55d0 2023-10-26T06:44:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782b5a50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000e970 tx=0x7f8bb008fee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98ffbf951924e27 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bc7fff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8bb40a16f0 0x7f8bb40a3bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009fd0 tx=0x7f8bc000b700 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.057+0000 7f8bbdffb700 1 -- 172.21.15.50:0/4095440774 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb009a0d0 con 0x560b782b55d0 2023-10-26T06:44:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8bbdffb700 1 -- 172.21.15.50:0/4095440774 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bb009ae70 con 0x560b782b55d0 2023-10-26T06:44:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8bbdffb700 1 -- 172.21.15.50:0/4095440774 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00850b0 con 0x560b782b55d0 2023-10-26T06:44:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 -- 172.21.15.50:0/4095440774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 msgr2=0x560b782b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782b5a50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000e970 tx=0x7f8bb008fee0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 -- 172.21.15.50:0/4095440774 shutdown_connections 2023-10-26T06:44:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782b5a50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/4095440774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.059+0000 7f8be14c7b80 1 -- 172.21.15.50:0/4095440774 >> 172.21.15.50:0/4095440774 conn(0x560b78229720 msgr2=0x560b782afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:46.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.060+0000 7f8be14c7b80 1 -- 172.21.15.50:0/4095440774 shutdown_connections 2023-10-26T06:44:46.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.060+0000 7f8be14c7b80 1 -- 172.21.15.50:0/4095440774 wait complete. 2023-10-26T06:44:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.060+0000 7f8be14c7b80 1 -- start start 2023-10-26T06:44:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 Processor -- start 2023-10-26T06:44:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b78207e70 con 0x560b782bb500 2023-10-26T06:44:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b781a4710 con 0x560b782babe0 2023-10-26T06:44:46.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.061+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b781a43b0 con 0x560b782b55d0 2023-10-26T06:44:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8be14c7b80 10 client.0 _ll_register_callbacks cb 0x560b780eea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782be790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38294/0 (socket says 172.21.15.50:38294) 2023-10-26T06:44:46.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3272987734 learned_addr learned my addr 172.21.15.50:0/3272987734 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8bc7fff700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.062+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3272987734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 msgr2=0x560b782c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3272987734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 msgr2=0x560b782bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3272987734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc81a5a40 con 0x560b782babe0 2023-10-26T06:44:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc7fff700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:44:46.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782be790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00cd870 tx=0x7f8bb0005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa52c11ab4e6281 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8ba6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3272987734 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b3070 con 0x560b782babe0 2023-10-26T06:44:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3272987734 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8bb001e270 con 0x560b782babe0 2023-10-26T06:44:46.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b7820cef0 con 0x560b782babe0 2023-10-26T06:44:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.064+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3272987734 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bb009a9d0 con 0x560b782babe0 2023-10-26T06:44:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 10 client.25727 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560b78032de0 con 0x560b782babe0 2023-10-26T06:44:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3272987734 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560b7820cef0 con 0x560b782babe0 2023-10-26T06:44:46.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3272987734 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8bb00a2670 con 0x560b782babe0 2023-10-26T06:44:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 10 client.25727 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 10 client.25727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 20 client.25727 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b782cec30 0x560b782d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 4 client.25727 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:46.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.065+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b782848b0 con 0x560b782cec30 2023-10-26T06:44:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.066+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b782cec30 0x560b782d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.066+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b782cec30 0x560b782d1050 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c2191ff4f6b5775 server_cookie=6f68212cfd155887 in_seq=0 out_seq=0 2023-10-26T06:44:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.066+0000 7f8ba6ffd700 10 client.25727 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:46.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3272987734 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560b782848b0 con 0x560b782cec30 2023-10-26T06:44:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8ba6ffd700 10 client.25727 handle_command_reply: tid=0 2023-10-26T06:44:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 client.25727 shutdown 2023-10-26T06:44:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 msgr2=0x560b782be790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782be790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00cd870 tx=0x7f8bb0005c80 comp rx=0 tx=0).stop 2023-10-26T06:44:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 shutdown_connections 2023-10-26T06:44:46.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b782cec30 0x560b782d1050 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3272987734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782be790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 >> 172.21.15.50:0/3272987734 conn(0x560b78229720 msgr2=0x560b782b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:46.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.067+0000 7f8ba6ffd700 0 client.25727 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:46.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.068+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 shutdown_connections 2023-10-26T06:44:46.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.068+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3272987734 wait complete. 2023-10-26T06:44:46.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.068+0000 7f8be14c7b80 20 client.25727 trim_cache size 0 max 16384 2023-10-26T06:44:46.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.082+0000 7f8be14c7b80 1 Processor -- start 2023-10-26T06:44:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.082+0000 7f8be14c7b80 1 -- start start 2023-10-26T06:44:46.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.083+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.083+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782af810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b782aaaf0 con 0x560b782bb500 2023-10-26T06:44:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b78088920 con 0x560b782babe0 2023-10-26T06:44:46.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b782b5070 con 0x560b782b55d0 2023-10-26T06:44:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55256/0 (socket says 172.21.15.50:55256) 2023-10-26T06:44:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 -- 172.21.15.50:0/1671281444 learned_addr learned my addr 172.21.15.50:0/1671281444 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:46.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc7fff700 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 -- 172.21.15.50:0/1671281444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 msgr2=0x560b782af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 -- 172.21.15.50:0/1671281444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 msgr2=0x560b782be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.084+0000 7f8bc77fe700 1 -- 172.21.15.50:0/1671281444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b7801bc60 con 0x560b782b55d0 2023-10-26T06:44:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.085+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c5f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80096f0 tx=0x7f8bb80094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac49f249a47b5df server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.085+0000 7f8bbe7fc700 1 -- 172.21.15.50:0/1671281444 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8017040 con 0x560b782b55d0 2023-10-26T06:44:46.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.085+0000 7f8bbe7fc700 1 -- 172.21.15.50:0/1671281444 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bb8019570 con 0x560b782b55d0 2023-10-26T06:44:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.085+0000 7f8bbe7fc700 1 -- 172.21.15.50:0/1671281444 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80118a0 con 0x560b782b55d0 2023-10-26T06:44:46.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 -- 172.21.15.50:0/1671281444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 msgr2=0x560b782c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c5f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80096f0 tx=0x7f8bb80094b0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 -- 172.21.15.50:0/1671281444 shutdown_connections 2023-10-26T06:44:46.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b782be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782b55d0 0x560b782c5f40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/1671281444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782babe0 0x560b782af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 -- 172.21.15.50:0/1671281444 >> 172.21.15.50:0/1671281444 conn(0x560b78229720 msgr2=0x560b782d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:46.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 -- 172.21.15.50:0/1671281444 shutdown_connections 2023-10-26T06:44:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.086+0000 7f8be14c7b80 1 -- 172.21.15.50:0/1671281444 wait complete. 2023-10-26T06:44:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.087+0000 7f8be14c7b80 1 -- start start 2023-10-26T06:44:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.087+0000 7f8be14c7b80 1 Processor -- start 2023-10-26T06:44:46.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b7832a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b782c4d60 con 0x560b782bb500 2023-10-26T06:44:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7832a770 con 0x560b782b55d0 2023-10-26T06:44:46.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b7832a8b0 con 0x560b782babe0 2023-10-26T06:44:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8be14c7b80 10 client.0 _ll_register_callbacks cb 0x560b780eea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8bc6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55264/0 (socket says 172.21.15.50:55264) 2023-10-26T06:44:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3565986456 learned_addr learned my addr 172.21.15.50:0/3565986456 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.088+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 msgr2=0x560b782c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3565986456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 msgr2=0x560b7832a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b7832a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8bc6ffd700 1 -- 172.21.15.50:0/3565986456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb8009ad0 con 0x560b782babe0 2023-10-26T06:44:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8bc6ffd700 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782c4650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0098ac0 tx=0x7f8bb009a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae5fc61f6a48b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:46.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8ba6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:46.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3565986456 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0099a30 con 0x560b782babe0 2023-10-26T06:44:46.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.089+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3565986456 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8bb009e8c0 con 0x560b782babe0 2023-10-26T06:44:46.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bb009ae70 con 0x560b782babe0 2023-10-26T06:44:46.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3565986456 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bb00a2b00 con 0x560b782babe0 2023-10-26T06:44:46.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 10 client.25741 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:46.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560b78059250 con 0x560b782babe0 2023-10-26T06:44:46.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3565986456 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bb009ae70 con 0x560b782babe0 2023-10-26T06:44:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3565986456 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8bb0005310 con 0x560b782babe0 2023-10-26T06:44:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 10 client.25741 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 10 client.25741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:46.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 20 client.25741 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:46.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b7832bb50 0x560b7832df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:46.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 4 client.25741 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:44:46.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.090+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560b78200e50 con 0x560b7832bb50 2023-10-26T06:44:46.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.091+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b7832bb50 0x560b7832df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:46.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.091+0000 7f8bc77fe700 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b7832bb50 0x560b7832df40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9994b6a58215b2 server_cookie=760be5d1b60ca609 in_seq=0 out_seq=0 2023-10-26T06:44:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.091+0000 7f8ba6ffd700 10 client.25741 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8ba6ffd700 1 -- 172.21.15.50:0/3565986456 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560b78200e50 con 0x560b7832bb50 2023-10-26T06:44:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8ba6ffd700 10 client.25741 handle_command_reply: tid=0 2023-10-26T06:44:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 client.25741 shutdown 2023-10-26T06:44:46.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 msgr2=0x560b782c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782c4650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0098ac0 tx=0x7f8bb009a0d0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 shutdown_connections 2023-10-26T06:44:46.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560b7832bb50 0x560b7832df40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560b782bb500 0x560b7832a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560b782b55d0 0x560b782c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 --2- 172.21.15.50:0/3565986456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560b782babe0 0x560b782c4650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 >> 172.21.15.50:0/3565986456 conn(0x560b78229720 msgr2=0x560b782af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:46.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8ba6ffd700 0 client.25741 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:46.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 shutdown_connections 2023-10-26T06:44:46.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.092+0000 7f8be14c7b80 1 -- 172.21.15.50:0/3565986456 wait complete. 2023-10-26T06:44:46.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.093+0000 7f8be14c7b80 20 client.25741 trim_cache size 0 max 16384 2023-10-26T06:44:46.109 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:44:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.093+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8bb40a16f0 msgr2=0x7f8bb40a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.093+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8bb40a16f0 0x7f8bb40a3bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009fd0 tx=0x7f8bc000b700 comp rx=0 tx=0).stop 2023-10-26T06:44:46.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.093+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 msgr2=0x7f8bc819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:46.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.093+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc819ef90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000e9a0 tx=0x7f8bb000ed60 comp rx=0 tx=0).stop 2023-10-26T06:44:46.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 shutdown_connections 2023-10-26T06:44:46.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8bb40a16f0 0x7f8bb40a3bb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bc8108960 0x7f8bc8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bc8102950 0x7f8bc819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 --2- 172.21.15.50:0/4182110008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc8103310 0x7f8bc819ef90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:46.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 >> 172.21.15.50:0/4182110008 conn(0x7f8bc80fe400 msgr2=0x7f8bc80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:46.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 shutdown_connections 2023-10-26T06:44:46.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:46.094+0000 7f8bcdbff700 1 -- 172.21.15.50:0/4182110008 wait complete. 2023-10-26T06:44:46.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:46 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:46 smithi153 ceph-mon[131657]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:44:46.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:46 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:46 smithi050 ceph-mon[94997]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:44:46.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:46 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:46.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:46 smithi125 ceph-mon[130643]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-10-26T06:44:47.118 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:44:47.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:44:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 -- 172.21.15.50:0/3299548070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c073540 msgr2=0x7fbf8c10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 --2- 172.21.15.50:0/3299548070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c073540 0x7fbf8c10ca20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009990 tx=0x7fbf80009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 -- 172.21.15.50:0/3299548070 shutdown_connections 2023-10-26T06:44:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 --2- 172.21.15.50:0/3299548070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 --2- 172.21.15.50:0/3299548070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf8c072c20 0x7fbf8c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 --2- 172.21.15.50:0/3299548070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c073540 0x7fbf8c10ca20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 -- 172.21.15.50:0/3299548070 >> 172.21.15.50:0/3299548070 conn(0x7fbf8c0fc1b0 msgr2=0x7fbf8c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 -- 172.21.15.50:0/3299548070 shutdown_connections 2023-10-26T06:44:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.345+0000 7fbf929ff700 1 -- 172.21.15.50:0/3299548070 wait complete. 2023-10-26T06:44:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.346+0000 7fbf929ff700 1 Processor -- start 2023-10-26T06:44:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.346+0000 7fbf929ff700 1 -- start start 2023-10-26T06:44:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.346+0000 7fbf929ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c072c20 0x7fbf8c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf929ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf8c073540 0x7fbf8c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf929ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf929ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c19ddc0 con 0x7fbf8c10cf60 2023-10-26T06:44:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf929ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c19df30 con 0x7fbf8c073540 2023-10-26T06:44:47.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf929ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c19e0f0 con 0x7fbf8c072c20 2023-10-26T06:44:47.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf90f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c072c20 0x7fbf8c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf90f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c19d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36488/0 (socket says 172.21.15.50:36488) 2023-10-26T06:44:47.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf90f9c700 1 -- 172.21.15.50:0/4239770161 learned_addr learned my addr 172.21.15.50:0/4239770161 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf8c073540 0x7fbf8c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8bfff700 1 -- 172.21.15.50:0/4239770161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf8c073540 msgr2=0x7fbf8c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf8c073540 0x7fbf8c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8bfff700 1 -- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 msgr2=0x7fbf8c19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf8bfff700 1 -- 172.21.15.50:0/4239770161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800095f0 con 0x7fbf8c072c20 2023-10-26T06:44:47.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.347+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.348+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c072c20 0x7fbf8c198ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00e9f0 tx=0x7fbf7c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.348+0000 7fbf897fa700 1 -- 172.21.15.50:0/4239770161 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00c9c0 con 0x7fbf8c072c20 2023-10-26T06:44:47.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.348+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c19e3d0 con 0x7fbf8c072c20 2023-10-26T06:44:47.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.348+0000 7fbf897fa700 1 -- 172.21.15.50:0/4239770161 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf7c010430 con 0x7fbf8c072c20 2023-10-26T06:44:47.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.348+0000 7fbf897fa700 1 -- 172.21.15.50:0/4239770161 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c018680 con 0x7fbf8c072c20 2023-10-26T06:44:47.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.348+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c1a5c10 con 0x7fbf8c072c20 2023-10-26T06:44:47.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.351+0000 7fbf897fa700 1 -- 172.21.15.50:0/4239770161 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbf7c0187e0 con 0x7fbf8c072c20 2023-10-26T06:44:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 Processor -- start 2023-10-26T06:44:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 -- start start 2023-10-26T06:44:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbf897fa700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbf740a15f0 0x7fbf740a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bbf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bb9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bb9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50b2c760 con 0x55ee50bbec60 2023-10-26T06:44:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50b12ce0 con 0x55ee50bbf580 2023-10-26T06:44:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50b10600 con 0x55ee50bb9650 2023-10-26T06:44:47.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbf897fa700 1 -- 172.21.15.50:0/4239770161 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbf7c014070 con 0x7fbf8c072c20 2023-10-26T06:44:47.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bbf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.353+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbf740a15f0 0x7fbf740a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf90f9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bb9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bbf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36494/0 (socket says 172.21.15.50:36494) 2023-10-26T06:44:47.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 -- 172.21.15.50:0/423549331 learned_addr learned my addr 172.21.15.50:0/423549331 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bb9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55290/0 (socket says 172.21.15.50:55290) 2023-10-26T06:44:47.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bb9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 -- 172.21.15.50:0/423549331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 msgr2=0x55ee50bb9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bb9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 -- 172.21.15.50:0/423549331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 msgr2=0x55ee50bb9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bb9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 -- 172.21.15.50:0/423549331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee50ac9470 con 0x55ee50bbec60 2023-10-26T06:44:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bb9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bb9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbf740a15f0 0x7fbf740a3ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009fd0 tx=0x7fbf84009470 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.354+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bbf040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0a2060 tx=0x7fbf7c099be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b30ea7e8454b1e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.355+0000 7fbf727fc700 1 -- 172.21.15.50:0/423549331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c09e160 con 0x55ee50bbec60 2023-10-26T06:44:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.355+0000 7fbf727fc700 1 -- 172.21.15.50:0/423549331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf7c09e350 con 0x55ee50bbec60 2023-10-26T06:44:47.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.355+0000 7fbf727fc700 1 -- 172.21.15.50:0/423549331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c010860 con 0x55ee50bbec60 2023-10-26T06:44:47.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.355+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/423549331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 msgr2=0x55ee50bbf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.355+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bbf040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0a2060 tx=0x7fbf7c099be0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/423549331 shutdown_connections 2023-10-26T06:44:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bb9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bbf040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/423549331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bb9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/423549331 >> 172.21.15.50:0/423549331 conn(0x55ee50b2d7a0 msgr2=0x55ee50bb3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/423549331 shutdown_connections 2023-10-26T06:44:47.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/423549331 wait complete. 2023-10-26T06:44:47.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.356+0000 7fbfa62c8b80 1 -- start start 2023-10-26T06:44:47.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.357+0000 7fbfa62c8b80 1 Processor -- start 2023-10-26T06:44:47.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.357+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bc5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bc2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bc2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50b0bef0 con 0x55ee50bbec60 2023-10-26T06:44:47.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50aa8790 con 0x55ee50bbf580 2023-10-26T06:44:47.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50aa8430 con 0x55ee50bb9650 2023-10-26T06:44:47.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbfa62c8b80 10 client.0 _ll_register_callbacks cb 0x55ee509f2b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:47.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bc5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bc2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bc5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:55294/0 (socket says 172.21.15.50:55294) 2023-10-26T06:44:47.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 -- 172.21.15.50:0/2442271452 learned_addr learned my addr 172.21.15.50:0/2442271452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bc2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 -- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 msgr2=0x55ee50bc2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bc2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 -- 172.21.15.50:0/2442271452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 msgr2=0x55ee50bc2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bc2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf8bfff700 1 -- 172.21.15.50:0/2442271452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c110090 con 0x55ee50bb9650 2023-10-26T06:44:47.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.358+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bc2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:44:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bc5500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c099cd0 tx=0x7fbf7c09a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70ef42091430273 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbf6b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:44:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/2442271452 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0a2590 con 0x55ee50bb9650 2023-10-26T06:44:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/2442271452 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbf7c010860 con 0x55ee50bb9650 2023-10-26T06:44:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee50b10f70 con 0x55ee50bb9650 2023-10-26T06:44:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/2442271452 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf7c09a460 con 0x55ee50bb9650 2023-10-26T06:44:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbfa62c8b80 10 client.25753 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fbf8c1a5c10 con 0x55ee50bb9650 2023-10-26T06:44:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.359+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/2442271452 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee50b10f70 con 0x55ee50bb9650 2023-10-26T06:44:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/2442271452 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbf7c090ed0 con 0x55ee50bb9650 2023-10-26T06:44:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbfa62c8b80 10 client.25753 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbfa62c8b80 10 client.25753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbfa62c8b80 20 client.25753 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50bd2a10 0x55ee50bd4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbfa62c8b80 4 client.25753 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee50b88930 con 0x55ee50bd2a10 2023-10-26T06:44:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.360+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50bd2a10 0x55ee50bd4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.361+0000 7fbf6b7fe700 10 client.25753 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.361+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50bd2a10 0x55ee50bd4e00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22e9d3fe3f12e888 server_cookie=229a67ea03cf6e6f in_seq=0 out_seq=0 2023-10-26T06:44:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.361+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/2442271452 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee50b88930 con 0x55ee50bd2a10 2023-10-26T06:44:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.361+0000 7fbf6b7fe700 10 client.25753 handle_command_reply: tid=0 2023-10-26T06:44:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.361+0000 7fbfa62c8b80 1 client.25753 shutdown 2023-10-26T06:44:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 msgr2=0x55ee50bc5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bc5500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c099cd0 tx=0x7fbf7c09a100 comp rx=0 tx=0).stop 2023-10-26T06:44:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 shutdown_connections 2023-10-26T06:44:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50bd2a10 0x55ee50bd4e00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bbf580 0x55ee50bc2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbf6b7fe700 0 client.25753 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bb9650 0x55ee50bc5500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/2442271452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbec60 0x55ee50bc2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 >> 172.21.15.50:0/2442271452 conn(0x55ee50b2d7a0 msgr2=0x55ee50bb8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 shutdown_connections 2023-10-26T06:44:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/2442271452 wait complete. 2023-10-26T06:44:47.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.362+0000 7fbfa62c8b80 20 client.25753 trim_cache size 0 max 16384 2023-10-26T06:44:47.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.381+0000 7fbfa62c8b80 1 Processor -- start 2023-10-26T06:44:47.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 -- start start 2023-10-26T06:44:47.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bbcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50bb41b0 con 0x55ee50bbf580 2023-10-26T06:44:47.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50baeb70 con 0x55ee50bb9650 2023-10-26T06:44:47.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee5098c9a0 con 0x55ee50bbec60 2023-10-26T06:44:47.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbf90f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bbcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:38358/0 (socket says 172.21.15.50:38358) 2023-10-26T06:44:47.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.382+0000 7fbf8bfff700 1 -- 172.21.15.50:0/1761233823 learned_addr learned my addr 172.21.15.50:0/1761233823 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8bfff700 1 -- 172.21.15.50:0/1761233823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 msgr2=0x55ee50bc16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8bfff700 1 -- 172.21.15.50:0/1761233823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 msgr2=0x55ee50bbcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bbcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8bfff700 1 -- 172.21.15.50:0/1761233823 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee50bd9a00 con 0x55ee50bb9650 2023-10-26T06:44:47.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc0970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c5b0 tx=0x7fbf7c099be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449481ded163b2c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf72ffd700 1 -- 172.21.15.50:0/1761233823 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0a22f0 con 0x55ee50bb9650 2023-10-26T06:44:47.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf72ffd700 1 -- 172.21.15.50:0/1761233823 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf7c0a2590 con 0x55ee50bb9650 2023-10-26T06:44:47.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.383+0000 7fbf72ffd700 1 -- 172.21.15.50:0/1761233823 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c099950 con 0x55ee50bb9650 2023-10-26T06:44:47.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/1761233823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 msgr2=0x55ee50bc0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc0970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c5b0 tx=0x7fbf7c099be0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/1761233823 shutdown_connections 2023-10-26T06:44:47.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bbcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc0970 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/1761233823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/1761233823 >> 172.21.15.50:0/1761233823 conn(0x55ee50b2d7a0 msgr2=0x55ee50bbc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/1761233823 shutdown_connections 2023-10-26T06:44:47.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.384+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/1761233823 wait complete. 2023-10-26T06:44:47.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.385+0000 7fbfa62c8b80 1 -- start start 2023-10-26T06:44:47.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.385+0000 7fbfa62c8b80 1 Processor -- start 2023-10-26T06:44:47.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bc9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50c26970 con 0x55ee50bbf580 2023-10-26T06:44:47.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50c26ae0 con 0x55ee50bb9650 2023-10-26T06:44:47.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee50c26ca0 con 0x55ee50bbec60 2023-10-26T06:44:47.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbfa62c8b80 10 client.0 _ll_register_callbacks cb 0x55ee509f2b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:47.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbf90f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bc9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbf90f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bc9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36534/0 (socket says 172.21.15.50:36534) 2023-10-26T06:44:47.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbf90f9c700 1 -- 172.21.15.50:0/3720841625 learned_addr learned my addr 172.21.15.50:0/3720841625 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.386+0000 7fbf8b7fe700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf90f9c700 1 -- 172.21.15.50:0/3720841625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 msgr2=0x55ee50bc8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf90f9c700 1 -- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 msgr2=0x55ee50bc8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf90f9c700 1 -- 172.21.15.50:0/3720841625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf800051e0 con 0x55ee50bbf580 2023-10-26T06:44:47.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf90f9c700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bc9400 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400eef0 tx=0x7fbf8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cabc6121004d30a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf6b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:47.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/3720841625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84008320 con 0x55ee50bbf580 2023-10-26T06:44:47.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf7c09e350 con 0x55ee50bbf580 2023-10-26T06:44:47.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/3720841625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbf84021040 con 0x55ee50bbf580 2023-10-26T06:44:47.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.387+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/3720841625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf8401ba70 con 0x55ee50bbf580 2023-10-26T06:44:47.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 10 client.15735 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:47.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fbf8c1a5c10 con 0x55ee50bbf580 2023-10-26T06:44:47.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/3720841625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf7c09e350 con 0x55ee50bbf580 2023-10-26T06:44:47.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/3720841625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbf84038050 con 0x55ee50bbf580 2023-10-26T06:44:47.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 10 client.15735 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:47.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:47.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 20 client.15735 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:47.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50c28590 0x55ee50c2a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 4 client.15735 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:44:47.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ee50b04ed0 con 0x55ee50c28590 2023-10-26T06:44:47.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.388+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50c28590 0x55ee50c2a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.389+0000 7fbf8bfff700 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50c28590 0x55ee50c2a9b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e5ccf5ce51e5ce server_cookie=95d66f998b1a341c in_seq=0 out_seq=0 2023-10-26T06:44:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.389+0000 7fbf6b7fe700 10 client.15735 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbf6b7fe700 1 -- 172.21.15.50:0/3720841625 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ee50b04ed0 con 0x55ee50c28590 2023-10-26T06:44:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbf6b7fe700 10 client.15735 handle_command_reply: tid=0 2023-10-26T06:44:47.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 client.15735 shutdown 2023-10-26T06:44:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 msgr2=0x55ee50bc9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bc9400 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400eef0 tx=0x7fbf8400b040 comp rx=0 tx=0).stop 2023-10-26T06:44:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 shutdown_connections 2023-10-26T06:44:47.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ee50c28590 0x55ee50c2a9b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee50bbf580 0x55ee50bc9400 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ee50bb9650 0x55ee50bc8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 --2- 172.21.15.50:0/3720841625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ee50bbec60 0x55ee50bc8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbf6b7fe700 0 client.15735 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.390+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 >> 172.21.15.50:0/3720841625 conn(0x55ee50b2d7a0 msgr2=0x55ee50bad530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 shutdown_connections 2023-10-26T06:44:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbfa62c8b80 1 -- 172.21.15.50:0/3720841625 wait complete. 2023-10-26T06:44:47.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbfa62c8b80 20 client.15735 trim_cache size 0 max 16384 2023-10-26T06:44:47.407 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:44:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:44:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "92e1689a-13a2-41fd-ab36-8a951f1d6847", 2023-10-26T06:44:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:44:47.407 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:44:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbf740a15f0 msgr2=0x7fbf740a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbf929ff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbf740a15f0 0x7fbf740a3ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009fd0 tx=0x7fbf84009470 comp rx=0 tx=0).stop 2023-10-26T06:44:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c072c20 msgr2=0x7fbf8c198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.391+0000 7fbf929ff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c072c20 0x7fbf8c198ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00e9f0 tx=0x7fbf7c00ed00 comp rx=0 tx=0).stop 2023-10-26T06:44:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 shutdown_connections 2023-10-26T06:44:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbf740a15f0 0x7fbf740a3ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf8c10cf60 0x7fbf8c19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf8c072c20 0x7fbf8c198ea0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 --2- 172.21.15.50:0/4239770161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbf8c073540 0x7fbf8c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 >> 172.21.15.50:0/4239770161 conn(0x7fbf8c0fc1b0 msgr2=0x7fbf8c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 shutdown_connections 2023-10-26T06:44:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.392+0000 7fbf929ff700 1 -- 172.21.15.50:0/4239770161 wait complete. 2023-10-26T06:44:47.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:44:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 -- 172.21.15.50:0/3921708260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 msgr2=0x7f37c4073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 --2- 172.21.15.50:0/3921708260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4073000 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009990 tx=0x7f37b4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 -- 172.21.15.50:0/3921708260 shutdown_connections 2023-10-26T06:44:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 --2- 172.21.15.50:0/3921708260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37c410cf50 0x7f37c410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 --2- 172.21.15.50:0/3921708260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4073000 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 --2- 172.21.15.50:0/3921708260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c4073540 0x7f37c410ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 -- 172.21.15.50:0/3921708260 >> 172.21.15.50:0/3921708260 conn(0x7f37c40fc200 msgr2=0x7f37c40fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 -- 172.21.15.50:0/3921708260 shutdown_connections 2023-10-26T06:44:47.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.627+0000 7f37c99ff700 1 -- 172.21.15.50:0/3921708260 wait complete. 2023-10-26T06:44:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.628+0000 7f37c99ff700 1 Processor -- start 2023-10-26T06:44:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.628+0000 7f37c99ff700 1 -- start start 2023-10-26T06:44:47.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c99ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c99ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37c4073540 0x7f37c41992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c99ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c410cf50 0x7f37c419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c99ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419dcb0 con 0x7f37c4072c20 2023-10-26T06:44:47.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c99ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419de20 con 0x7f37c410cf50 2023-10-26T06:44:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c99ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419dfe0 con 0x7f37c4073540 2023-10-26T06:44:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36548/0 (socket says 172.21.15.50:36548) 2023-10-26T06:44:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 -- 172.21.15.50:0/2186446108 learned_addr learned my addr 172.21.15.50:0/2186446108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c37fe700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c410cf50 0x7f37c419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c27fc700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37c4073540 0x7f37c41992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 -- 172.21.15.50:0/2186446108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37c4073540 msgr2=0x7f37c41992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37c4073540 0x7f37c41992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 -- 172.21.15.50:0/2186446108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c410cf50 msgr2=0x7f37c419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c410cf50 0x7f37c419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c2ffd700 1 -- 172.21.15.50:0/2186446108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40095f0 con 0x7f37c4072c20 2023-10-26T06:44:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.629+0000 7f37c37fe700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c410cf50 0x7f37c419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.630+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4198d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000c00 tx=0x7f37b4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.630+0000 7f37c89fd700 1 -- 172.21.15.50:0/2186446108 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b401d070 con 0x7f37c4072c20 2023-10-26T06:44:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.630+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c419e260 con 0x7f37c4072c20 2023-10-26T06:44:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.630+0000 7f37c89fd700 1 -- 172.21.15.50:0/2186446108 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b4022470 con 0x7f37c4072c20 2023-10-26T06:44:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.630+0000 7f37c89fd700 1 -- 172.21.15.50:0/2186446108 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4017650 con 0x7f37c4072c20 2023-10-26T06:44:47.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.630+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c41a5b00 con 0x7f37c4072c20 2023-10-26T06:44:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.634+0000 7f37c89fd700 1 -- 172.21.15.50:0/2186446108 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f37b40225e0 con 0x7f37c4072c20 2023-10-26T06:44:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.635+0000 7f37c89fd700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f37ac0a1670 0x7f37ac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.635+0000 7f37c89fd700 1 -- 172.21.15.50:0/2186446108 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f37b40ce490 con 0x7f37c4072c20 2023-10-26T06:44:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.635+0000 7f37dd3bdb80 1 Processor -- start 2023-10-26T06:44:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 -- start start 2023-10-26T06:44:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37c27fc700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f37ac0a1670 0x7f37ac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 0x55a1e20d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d8500 0x55a1e20d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e20456e0 con 0x55a1e20d7be0 2023-10-26T06:44:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e202bc60 con 0x55a1e20d25d0 2023-10-26T06:44:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e2029580 con 0x55a1e20d8500 2023-10-26T06:44:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 0x55a1e20d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 0x55a1e20d7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36562/0 (socket says 172.21.15.50:36562) 2023-10-26T06:44:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.636+0000 7f37c2ffd700 1 -- 172.21.15.50:0/869721247 learned_addr learned my addr 172.21.15.50:0/869721247 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c37fe700 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c27fc700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f37ac0a1670 0x7f37ac0a3b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f37c419a2e0 tx=0x7f37b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c27fc700 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d8500 0x55a1e20d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c2ffd700 1 -- 172.21.15.50:0/869721247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d8500 msgr2=0x55a1e20d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d8500 0x55a1e20d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c2ffd700 1 -- 172.21.15.50:0/869721247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 msgr2=0x55a1e20d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c2ffd700 1 -- 172.21.15.50:0/869721247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1e1fe23f0 con 0x55a1e20d7be0 2023-10-26T06:44:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c27fc700 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d8500 0x55a1e20d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:44:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 0x55a1e20d7fc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37b4097b70 tx=0x7f37b4022b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c53824a4c03e46 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37a9ffb700 1 -- 172.21.15.50:0/869721247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b409afd0 con 0x55a1e20d7be0 2023-10-26T06:44:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37a9ffb700 1 -- 172.21.15.50:0/869721247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b409bd70 con 0x55a1e20d7be0 2023-10-26T06:44:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.637+0000 7f37a9ffb700 1 -- 172.21.15.50:0/869721247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b409b8d0 con 0x55a1e20d7be0 2023-10-26T06:44:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/869721247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 msgr2=0x55a1e20d7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 0x55a1e20d7fc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37b4097b70 tx=0x7f37b4022b90 comp rx=0 tx=0).stop 2023-10-26T06:44:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/869721247 shutdown_connections 2023-10-26T06:44:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d7be0 0x55a1e20d7fc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/869721247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d8500 0x55a1e20d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/869721247 >> 172.21.15.50:0/869721247 conn(0x55a1e2046720 msgr2=0x55a1e20ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/869721247 shutdown_connections 2023-10-26T06:44:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.638+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/869721247 wait complete. 2023-10-26T06:44:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.639+0000 7f37dd3bdb80 1 -- start start 2023-10-26T06:44:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.639+0000 7f37dd3bdb80 1 Processor -- start 2023-10-26T06:44:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20db870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20dbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e2024e70 con 0x55a1e20d8500 2023-10-26T06:44:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e1fc1710 con 0x55a1e20d25d0 2023-10-26T06:44:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e1fc13b0 con 0x55a1e20d7be0 2023-10-26T06:44:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37dd3bdb80 10 client.0 _ll_register_callbacks cb 0x55a1e1f0ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20dbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20dbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36572/0 (socket says 172.21.15.50:36572) 2023-10-26T06:44:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c37fe700 1 -- 172.21.15.50:0/507733625 learned_addr learned my addr 172.21.15.50:0/507733625 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c27fc700 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20db870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c2ffd700 1 -- 172.21.15.50:0/507733625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 msgr2=0x55a1e20db870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20db870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c2ffd700 1 -- 172.21.15.50:0/507733625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 msgr2=0x55a1e20dbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20dbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.640+0000 7f37c2ffd700 1 -- 172.21.15.50:0/507733625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c41a5b00 con 0x55a1e20d25d0 2023-10-26T06:44:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20de3e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37b40a3b30 tx=0x7f37b4022af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1115ae7088885132 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:44:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37a2ffd700 1 -- 172.21.15.50:0/507733625 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b409b670 con 0x55a1e20d25d0 2023-10-26T06:44:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37a2ffd700 1 -- 172.21.15.50:0/507733625 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f37b409f7c0 con 0x55a1e20d25d0 2023-10-26T06:44:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1e2029ef0 con 0x55a1e20d25d0 2023-10-26T06:44:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37a2ffd700 1 -- 172.21.15.50:0/507733625 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b409b8d0 con 0x55a1e20d25d0 2023-10-26T06:44:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37dd3bdb80 10 client.25763 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a1e1e4fde0 con 0x55a1e20d25d0 2023-10-26T06:44:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.641+0000 7f37a2ffd700 1 -- 172.21.15.50:0/507733625 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a1e2029ef0 con 0x55a1e20d25d0 2023-10-26T06:44:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37a2ffd700 1 -- 172.21.15.50:0/507733625 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f37b40a3bc0 con 0x55a1e20d25d0 2023-10-26T06:44:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37dd3bdb80 10 client.25763 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37dd3bdb80 10 client.25763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37dd3bdb80 20 client.25763 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e20eb590 0x55a1e20ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37dd3bdb80 4 client.25763 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:44:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1e20a18b0 con 0x55a1e20eb590 2023-10-26T06:44:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.642+0000 7f37c27fc700 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e20eb590 0x55a1e20ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.643+0000 7f37c27fc700 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e20eb590 0x55a1e20ed9b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6344b520da8daaf6 server_cookie=7034eeb20573d0cb in_seq=0 out_seq=0 2023-10-26T06:44:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.643+0000 7f37a2ffd700 10 client.25763 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.643+0000 7f37a2ffd700 1 -- 172.21.15.50:0/507733625 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a1e20a18b0 con 0x55a1e20eb590 2023-10-26T06:44:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.643+0000 7f37a2ffd700 10 client.25763 handle_command_reply: tid=0 2023-10-26T06:44:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 client.25763 shutdown 2023-10-26T06:44:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 msgr2=0x55a1e20de3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20de3e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37b40a3b30 tx=0x7f37b4022af0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 shutdown_connections 2023-10-26T06:44:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e20eb590 0x55a1e20ed9b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20dbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20de3e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37a2ffd700 0 client.25763 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/507733625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20db870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 >> 172.21.15.50:0/507733625 conn(0x55a1e2046720 msgr2=0x55a1e20d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 shutdown_connections 2023-10-26T06:44:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/507733625 wait complete. 2023-10-26T06:44:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.644+0000 7f37dd3bdb80 20 client.25763 trim_cache size 0 max 16384 2023-10-26T06:44:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 Processor -- start 2023-10-26T06:44:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 -- start start 2023-10-26T06:44:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d25d0 0x55a1e20e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d7be0 0x55a1e20ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e20c7af0 con 0x55a1e20d8500 2023-10-26T06:44:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e1ea5920 con 0x55a1e20d7be0 2023-10-26T06:44:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e20dcbc0 con 0x55a1e20d25d0 2023-10-26T06:44:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36574/0 (socket says 172.21.15.50:36574) 2023-10-26T06:44:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37c37fe700 1 -- 172.21.15.50:0/3712790211 learned_addr learned my addr 172.21.15.50:0/3712790211 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37c27fc700 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d7be0 0x55a1e20ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.662+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d25d0 0x55a1e20e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c37fe700 1 -- 172.21.15.50:0/3712790211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d25d0 msgr2=0x55a1e20e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c37fe700 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d25d0 0x55a1e20e29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c37fe700 1 -- 172.21.15.50:0/3712790211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d7be0 msgr2=0x55a1e20ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c37fe700 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d7be0 0x55a1e20ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c37fe700 1 -- 172.21.15.50:0/3712790211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1e1e38c60 con 0x55a1e20d8500 2023-10-26T06:44:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c27fc700 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d7be0 0x55a1e20ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:44:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37c37fe700 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20cc810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00e9e0 tx=0x7f37bc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0a425ef0f026a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37aa7fc700 1 -- 172.21.15.50:0/3712790211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc004bb0 con 0x55a1e20d8500 2023-10-26T06:44:47.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37aa7fc700 1 -- 172.21.15.50:0/3712790211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37bc00f040 con 0x55a1e20d8500 2023-10-26T06:44:47.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.663+0000 7f37aa7fc700 1 -- 172.21.15.50:0/3712790211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0077f0 con 0x55a1e20d8500 2023-10-26T06:44:47.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/3712790211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 msgr2=0x55a1e20cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20cc810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00e9e0 tx=0x7f37bc009920 comp rx=0 tx=0).stop 2023-10-26T06:44:47.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/3712790211 shutdown_connections 2023-10-26T06:44:47.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20cc810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d25d0 0x55a1e20e29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/3712790211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d7be0 0x55a1e20ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/3712790211 >> 172.21.15.50:0/3712790211 conn(0x55a1e2046720 msgr2=0x55a1e20d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/3712790211 shutdown_connections 2023-10-26T06:44:47.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.664+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/3712790211 wait complete. 2023-10-26T06:44:47.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 -- start start 2023-10-26T06:44:47.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 Processor -- start 2023-10-26T06:44:47.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20e1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20e21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e20e2770 con 0x55a1e20d8500 2023-10-26T06:44:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e20e28e0 con 0x55a1e20d25d0 2023-10-26T06:44:47.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1e20e2aa0 con 0x55a1e20d7be0 2023-10-26T06:44:47.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.665+0000 7f37dd3bdb80 10 client.0 _ll_register_callbacks cb 0x55a1e1f0ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:44:47.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20e21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20e1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20e21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36584/0 (socket says 172.21.15.50:36584) 2023-10-26T06:44:47.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 -- 172.21.15.50:0/2869001963 learned_addr learned my addr 172.21.15.50:0/2869001963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:44:47.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 -- 172.21.15.50:0/2869001963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 msgr2=0x55a1e20e1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20e1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 -- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 msgr2=0x55a1e20d7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:44:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.666+0000 7f37c37fe700 1 -- 172.21.15.50:0/2869001963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b8017070 con 0x55a1e20d8500 2023-10-26T06:44:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37c37fe700 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20e21e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009510 tx=0x7f37bc017f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4c6e9908b19b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:44:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:44:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37a2ffd700 1 -- 172.21.15.50:0/2869001963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc017990 con 0x55a1e20d8500 2023-10-26T06:44:47.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37b409bd70 con 0x55a1e20d8500 2023-10-26T06:44:47.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37a2ffd700 1 -- 172.21.15.50:0/2869001963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f37bc017af0 con 0x55a1e20d8500 2023-10-26T06:44:47.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37a2ffd700 1 -- 172.21.15.50:0/2869001963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37bc007500 con 0x55a1e20d8500 2023-10-26T06:44:47.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37dd3bdb80 10 client.15753 fetch_fsmap learned FSMap version 23 2023-10-26T06:44:47.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f37bc00e660 con 0x55a1e20d8500 2023-10-26T06:44:47.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.667+0000 7f37a2ffd700 1 -- 172.21.15.50:0/2869001963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b409bd70 con 0x55a1e20d8500 2023-10-26T06:44:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37a2ffd700 1 -- 172.21.15.50:0/2869001963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f37bc028760 con 0x55a1e20d8500 2023-10-26T06:44:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37dd3bdb80 10 client.15753 fetch_fsmap finished waiting for FSMap version 23 2023-10-26T06:44:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37dd3bdb80 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:44:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37dd3bdb80 20 client.15753 populate_metadata read hostname 'smithi050' 2023-10-26T06:44:47.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e2140930 0x55a1e2142d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:44:47.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37dd3bdb80 4 client.15753 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:44:47.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a1e201de50 con 0x55a1e2140930 2023-10-26T06:44:47.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.668+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e2140930 0x55a1e2142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:44:47.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37c2ffd700 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e2140930 0x55a1e2142d50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a916d3e78f0dc0f server_cookie=150fd33a2faa55ab in_seq=0 out_seq=0 2023-10-26T06:44:47.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37a2ffd700 10 client.15753 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37a2ffd700 1 -- 172.21.15.50:0/2869001963 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a1e201de50 con 0x55a1e2140930 2023-10-26T06:44:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37a2ffd700 10 client.15753 handle_command_reply: tid=0 2023-10-26T06:44:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 client.15753 shutdown 2023-10-26T06:44:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 msgr2=0x55a1e20e21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20e21e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009510 tx=0x7f37bc017f30 comp rx=0 tx=0).stop 2023-10-26T06:44:47.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 shutdown_connections 2023-10-26T06:44:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55a1e2140930 0x55a1e2142d50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1e20d8500 0x55a1e20e21e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55a1e20d25d0 0x55a1e20d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 --2- 172.21.15.50:0/2869001963 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1e20d7be0 0x55a1e20e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37a2ffd700 0 client.15753 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:44:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 >> 172.21.15.50:0/2869001963 conn(0x55a1e2046720 msgr2=0x55a1e20cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 shutdown_connections 2023-10-26T06:44:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.669+0000 7f37dd3bdb80 1 -- 172.21.15.50:0/2869001963 wait complete. 2023-10-26T06:44:47.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37dd3bdb80 20 client.15753 trim_cache size 0 max 16384 2023-10-26T06:44:47.685 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:44:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-26T06:44:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:44:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: "92e1689a-13a2-41fd-ab36-8a951f1d6847": { 2023-10-26T06:44:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:44:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "92e1689a-13a2-41fd-ab36-8a951f1d6847", 2023-10-26T06:44:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:44:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:44:47.687 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:44:47.687 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:44:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f37ac0a1670 msgr2=0x7f37ac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f37ac0a1670 0x7f37ac0a3b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f37c419a2e0 tx=0x7f37b8009260 comp rx=0 tx=0).stop 2023-10-26T06:44:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 msgr2=0x7f37c4198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:44:47.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4198d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000c00 tx=0x7f37b4005740 comp rx=0 tx=0).stop 2023-10-26T06:44:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 shutdown_connections 2023-10-26T06:44:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f37ac0a1670 0x7f37ac0a3b30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37c410cf50 0x7f37c419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c4072c20 0x7f37c4198d90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 --2- 172.21.15.50:0/2186446108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37c4073540 0x7f37c41992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:44:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 >> 172.21.15.50:0/2186446108 conn(0x7f37c40fc200 msgr2=0x7f37c40fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:44:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.670+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 shutdown_connections 2023-10-26T06:44:47.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:44:47.671+0000 7f37c99ff700 1 -- 172.21.15.50:0/2186446108 wait complete. 2023-10-26T06:44:47.692 INFO:tasks.cephfs.filesystem:scrub status for tag:92e1689a-13a2-41fd-ab36-8a951f1d6847 - {'path': '/', 'tag': '92e1689a-13a2-41fd-ab36-8a951f1d6847', 'options': 'recursive,force'} 2023-10-26T06:44:47.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:44:47.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:44:47.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:47.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:44:47.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:47.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:44:47.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:47 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:47.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:44:47.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:44:47.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:47.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:44:47.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:47.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:44:47.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:47 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:47.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:44:47.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:44:47.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:44:47.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:44:47.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:47.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:44:47.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:47 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:44:48.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:48 smithi125 ceph-mon[130643]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:48.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:48 smithi153 ceph-mon[131657]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:49.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:48 smithi050 ceph-mon[94997]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-10-26T06:44:49.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:49 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:44:49.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:49 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:44:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:49 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:44:50.541 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 62% (7571/12067) Updating files: 63% (7603/12067) Updating files: 64% (7723/12067) Updating files: 65% (7844/12067) Updating files: 66% (7965/12067) Updating files: 67% (8085/12067) Updating files: 68% (8206/12067) Updating files: 69% (8327/12067) Updating files: 70% (8447/12067) Updating files: 71% (8568/12067) Updating files: 72% (8689/12067) Updating files: 73% (8809/12067) Updating files: 74% (8930/12067) Updating files: 75% (9051/12067) Updating files: 76% (9171/12067) Updating files: 77% (9292/12067) Updating files: 78% (9413/12067) Updating files: 79% (9533/12067) Updating files: 80% (9654/12067) Updating files: 81% (9775/12067) Updating files: 82% (9895/12067) Updating files: 83% (10016/12067) Updating files: 84% (10137/12067) Updating files: 85% (10257/12067) Updating files: 86% (10378/12067) Updating files: 87% (10499/12067) Updating files: 88% (10619/12067) Updating files: 89% (10740/12067) Updating files: 90% (10861/12067) Updating files: 91% (10981/12067) Updating files: 92% (11102/12067) Updating files: 93% (11223/12067) Updating files: 94% (11343/12067) Updating files: 95% (11464/12067) Updating files: 96% (11585/12067) Updating files: 97% (11705/12067) Updating files: 98% (11826/12067) Updating files: 99% (11947/12067) Updating files: 100% (12067/12067) Updating files: 100% (12067/12067), done. 2023-10-26T06:44:50.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:50 smithi125 ceph-mon[130643]: pgmap v354: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-10-26T06:44:50.943 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '384993681abceb8cb8affea10538d607052db4b4'. 2023-10-26T06:44:50.944 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.944 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-26T06:44:50.944 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-26T06:44:50.944 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2023-10-26T06:44:50.944 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.945 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-26T06:44:50.945 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-26T06:44:50.945 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.945 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2023-10-26T06:44:50.945 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.946 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2023-10-26T06:44:50.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.946 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2023-10-26T06:44:50.946 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.947 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-26T06:44:50.947 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:50.947 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 384993681ab Merge PR #47121 into wip-batrick-testing-20231024.144545 2023-10-26T06:44:50.948 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-26T06:44:50.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:50 smithi153 ceph-mon[131657]: pgmap v354: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-10-26T06:44:51.002 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-26T06:44:51.007 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-26T06:44:51.007 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-26T06:44:51.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:50 smithi050 ceph-mon[94997]: pgmap v354: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-10-26T06:44:51.607 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-26T06:44:51.696 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-26T06:44:51.762 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-26T06:44:51.766 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-26T06:44:51.766 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-26T06:44:51.831 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-26T06:44:51.838 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:44:51.839 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-26T06:44:51.883 INFO:tasks.workunit:Running workunits matching kernel_untar_build.sh on client.0... 2023-10-26T06:44:51.884 INFO:tasks.workunit:Running workunit kernel_untar_build.sh... 2023-10-26T06:44:51.885 DEBUG:teuthology.orchestra.run.smithi050:workunit test kernel_untar_build.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh 2023-10-26T06:44:51.982 INFO:tasks.workunit.client.0.smithi050.stderr:+ wget -O linux.tar.gz http://download.ceph.com/qa/linux-5.4.tar.gz 2023-10-26T06:44:52.026 INFO:tasks.workunit.client.0.smithi050.stderr:--2023-10-26 06:44:52-- http://download.ceph.com/qa/linux-5.4.tar.gz 2023-10-26T06:44:52.026 INFO:tasks.workunit.client.0.smithi050.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-26T06:44:52.061 INFO:tasks.workunit.client.0.smithi050.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-26T06:44:52.098 INFO:tasks.workunit.client.0.smithi050.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-26T06:44:52.098 INFO:tasks.workunit.client.0.smithi050.stderr:Length: 172616875 (165M) [application/octet-stream] 2023-10-26T06:44:52.098 INFO:tasks.workunit.client.0.smithi050.stderr:Saving to: ‘linux.tar.gz’ 2023-10-26T06:44:52.102 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:52.171 INFO:tasks.workunit.client.0.smithi050.stderr: 0K .......... .......... .......... .......... .......... 0% 692K 4m3s 2023-10-26T06:44:52.244 INFO:tasks.workunit.client.0.smithi050.stderr: 50K .......... .......... .......... .......... .......... 0% 1.34M 3m3s 2023-10-26T06:44:52.244 INFO:tasks.workunit.client.0.smithi050.stderr: 100K .......... .......... .......... .......... .......... 0% 1.34M 2m43s 2023-10-26T06:44:52.281 INFO:tasks.workunit.client.0.smithi050.stderr: 150K .......... .......... .......... .......... .......... 0% 1.36M 2m32s 2023-10-26T06:44:52.281 INFO:tasks.workunit.client.0.smithi050.stderr: 200K .......... .......... .......... .......... .......... 0% 90.2M 2m2s 2023-10-26T06:44:52.320 INFO:tasks.workunit.client.0.smithi050.stderr: 250K .......... .......... .......... .......... .......... 0% 1.39M 2m1s 2023-10-26T06:44:52.321 INFO:tasks.workunit.client.0.smithi050.stderr: 300K .......... .......... .......... .......... .......... 0% 133M 1m44s 2023-10-26T06:44:52.321 INFO:tasks.workunit.client.0.smithi050.stderr: 350K .......... .......... .......... .......... .......... 0% 113M 91s 2023-10-26T06:44:52.321 INFO:tasks.workunit.client.0.smithi050.stderr: 400K .......... .......... .......... .......... .......... 0% 110M 81s 2023-10-26T06:44:52.321 INFO:tasks.workunit.client.0.smithi050.stderr: 450K .......... .......... .......... .......... .......... 0% 104M 73s 2023-10-26T06:44:52.322 INFO:tasks.workunit.client.0.smithi050.stderr: 500K .......... .......... .......... .......... .......... 0% 117M 67s 2023-10-26T06:44:52.363 INFO:tasks.workunit.client.0.smithi050.stderr: 550K .......... .......... .......... .......... .......... 0% 1.42M 71s 2023-10-26T06:44:52.364 INFO:tasks.workunit.client.0.smithi050.stderr: 600K .......... .......... .......... .......... .......... 0% 118M 65s 2023-10-26T06:44:52.364 INFO:tasks.workunit.client.0.smithi050.stderr: 650K .......... .......... .......... .......... .......... 0% 104M 61s 2023-10-26T06:44:52.364 INFO:tasks.workunit.client.0.smithi050.stderr: 700K .......... .......... .......... .......... .......... 0% 95.9M 57s 2023-10-26T06:44:52.364 INFO:tasks.workunit.client.0.smithi050.stderr: 750K .......... .......... .......... .......... .......... 0% 161M 53s 2023-10-26T06:44:52.364 INFO:tasks.workunit.client.0.smithi050.stderr: 800K .......... .......... .......... .......... .......... 0% 127M 50s 2023-10-26T06:44:52.365 INFO:tasks.workunit.client.0.smithi050.stderr: 850K .......... .......... .......... .......... .......... 0% 113M 48s 2023-10-26T06:44:52.365 INFO:tasks.workunit.client.0.smithi050.stderr: 900K .......... .......... .......... .......... .......... 0% 51.2M 45s 2023-10-26T06:44:52.365 INFO:tasks.workunit.client.0.smithi050.stderr: 950K .......... .......... .......... .......... .......... 0% 28.1M 43s 2023-10-26T06:44:52.365 INFO:tasks.workunit.client.0.smithi050.stderr: 1000K .......... .......... .......... .......... .......... 0% 35.1M 41s 2023-10-26T06:44:52.417 INFO:tasks.workunit.client.0.smithi050.stderr: 1050K .......... .......... .......... .......... .......... 0% 1.67M 44s 2023-10-26T06:44:52.418 INFO:tasks.workunit.client.0.smithi050.stderr: 1100K .......... .......... .......... .......... .......... 0% 121M 42s 2023-10-26T06:44:52.418 INFO:tasks.workunit.client.0.smithi050.stderr: 1150K .......... .......... .......... .......... .......... 0% 115M 40s 2023-10-26T06:44:52.418 INFO:tasks.workunit.client.0.smithi050.stderr: 1200K .......... .......... .......... .......... .......... 0% 110M 39s 2023-10-26T06:44:52.418 INFO:tasks.workunit.client.0.smithi050.stderr: 1250K .......... .......... .......... .......... .......... 0% 114M 37s 2023-10-26T06:44:52.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1300K .......... .......... .......... .......... .......... 0% 108M 36s 2023-10-26T06:44:52.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1350K .......... .......... .......... .......... .......... 0% 108M 35s 2023-10-26T06:44:52.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1400K .......... .......... .......... .......... .......... 0% 104M 34s 2023-10-26T06:44:52.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1450K .......... .......... .......... .......... .......... 0% 28.9M 33s 2023-10-26T06:44:52.419 INFO:tasks.workunit.client.0.smithi050.stderr: 1500K .......... .......... .......... .......... .......... 0% 31.6M 32s 2023-10-26T06:44:52.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1550K .......... .......... .......... .......... .......... 0% 22.2M 31s 2023-10-26T06:44:52.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1600K .......... .......... .......... .......... .......... 0% 32.6M 30s 2023-10-26T06:44:52.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1650K .......... .......... .......... .......... .......... 1% 46.7M 29s 2023-10-26T06:44:52.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1700K .......... .......... .......... .......... .......... 1% 26.1M 29s 2023-10-26T06:44:52.420 INFO:tasks.workunit.client.0.smithi050.stderr: 1750K .......... .......... .......... .......... .......... 1% 23.3M 28s 2023-10-26T06:44:52.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1800K .......... .......... .......... .......... .......... 1% 34.0M 28s 2023-10-26T06:44:52.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1850K .......... .......... .......... .......... .......... 1% 24.2M 27s 2023-10-26T06:44:52.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1900K .......... .......... .......... .......... .......... 1% 43.7M 26s 2023-10-26T06:44:52.421 INFO:tasks.workunit.client.0.smithi050.stderr: 1950K .......... .......... .......... .......... .......... 1% 24.4M 26s 2023-10-26T06:44:52.421 INFO:tasks.workunit.client.0.smithi050.stderr: 2000K .......... .......... .......... .......... .......... 1% 29.2M 25s 2023-10-26T06:44:52.422 INFO:tasks.workunit.client.0.smithi050.stderr: 2050K .......... .......... .......... .......... .......... 1% 31.4M 25s 2023-10-26T06:44:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: 2100K .......... .......... .......... .......... .......... 1% 4.24M 25s 2023-10-26T06:44:52.502 INFO:tasks.workunit.client.0.smithi050.stderr: 2150K .......... .......... .......... .......... .......... 1% 132M 25s 2023-10-26T06:44:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: 2200K .......... .......... .......... .......... .......... 1% 109M 24s 2023-10-26T06:44:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: 2250K .......... .......... .......... .......... .......... 1% 110M 24s 2023-10-26T06:44:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: 2300K .......... .......... .......... .......... .......... 1% 117M 23s 2023-10-26T06:44:52.503 INFO:tasks.workunit.client.0.smithi050.stderr: 2350K .......... .......... .......... .......... .......... 1% 104M 23s 2023-10-26T06:44:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: 2400K .......... .......... .......... .......... .......... 1% 113M 22s 2023-10-26T06:44:52.504 INFO:tasks.workunit.client.0.smithi050.stderr: 2450K .......... .......... .......... .......... .......... 1% 58.9M 22s 2023-10-26T06:44:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: 2500K .......... .......... .......... .......... .......... 1% 30.6M 22s 2023-10-26T06:44:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: 2550K .......... .......... .......... .......... .......... 1% 24.5M 21s 2023-10-26T06:44:52.505 INFO:tasks.workunit.client.0.smithi050.stderr: 2600K .......... .......... .......... .......... .......... 1% 24.6M 21s 2023-10-26T06:44:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: 2650K .......... .......... .......... .......... .......... 1% 58.3M 21s 2023-10-26T06:44:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: 2700K .......... .......... .......... .......... .......... 1% 25.1M 20s 2023-10-26T06:44:52.506 INFO:tasks.workunit.client.0.smithi050.stderr: 2750K .......... .......... .......... .......... .......... 1% 28.3M 20s 2023-10-26T06:44:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: 2800K .......... .......... .......... .......... .......... 1% 25.2M 20s 2023-10-26T06:44:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: 2850K .......... .......... .......... .......... .......... 1% 24.4M 20s 2023-10-26T06:44:52.507 INFO:tasks.workunit.client.0.smithi050.stderr: 2900K .......... .......... .......... .......... .......... 1% 73.4M 19s 2023-10-26T06:44:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: 2950K .......... .......... .......... .......... .......... 1% 28.2M 19s 2023-10-26T06:44:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: 3000K .......... .......... .......... .......... .......... 1% 23.4M 19s 2023-10-26T06:44:52.508 INFO:tasks.workunit.client.0.smithi050.stderr: 3050K .......... .......... .......... .......... .......... 1% 23.9M 19s 2023-10-26T06:44:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: 3100K .......... .......... .......... .......... .......... 1% 23.1M 18s 2023-10-26T06:44:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: 3150K .......... .......... .......... .......... .......... 1% 67.4M 18s 2023-10-26T06:44:52.509 INFO:tasks.workunit.client.0.smithi050.stderr: 3200K .......... .......... .......... .......... .......... 1% 27.5M 18s 2023-10-26T06:44:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: 3250K .......... .......... .......... .......... .......... 1% 25.3M 18s 2023-10-26T06:44:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: 3300K .......... .......... .......... .......... .......... 1% 21.3M 18s 2023-10-26T06:44:52.510 INFO:tasks.workunit.client.0.smithi050.stderr: 3350K .......... .......... .......... .......... .......... 2% 24.8M 17s 2023-10-26T06:44:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: 3400K .......... .......... .......... .......... .......... 2% 67.9M 17s 2023-10-26T06:44:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: 3450K .......... .......... .......... .......... .......... 2% 27.9M 17s 2023-10-26T06:44:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: 3500K .......... .......... .......... .......... .......... 2% 20.7M 17s 2023-10-26T06:44:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: 3550K .......... .......... .......... .......... .......... 2% 58.2M 17s 2023-10-26T06:44:52.511 INFO:tasks.workunit.client.0.smithi050.stderr: 3600K .......... .......... .......... .......... .......... 2% 23.5M 17s 2023-10-26T06:44:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: 3650K .......... .......... .......... .......... .......... 2% 35.4M 16s 2023-10-26T06:44:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: 3700K .......... .......... .......... .......... .......... 2% 25.2M 16s 2023-10-26T06:44:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: 3750K .......... .......... .......... .......... .......... 2% 25.5M 16s 2023-10-26T06:44:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: 3800K .......... .......... .......... .......... .......... 2% 20.4M 16s 2023-10-26T06:44:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: 3850K .......... .......... .......... .......... .......... 2% 31.2M 16s 2023-10-26T06:44:52.512 INFO:tasks.workunit.client.0.smithi050.stderr: 3900K .......... .......... .......... .......... .......... 2% 97.7M 16s 2023-10-26T06:44:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: 3950K .......... .......... .......... .......... .......... 2% 24.8M 16s 2023-10-26T06:44:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: 4000K .......... .......... .......... .......... .......... 2% 22.1M 16s 2023-10-26T06:44:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: 4050K .......... .......... .......... .......... .......... 2% 25.2M 15s 2023-10-26T06:44:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: 4100K .......... .......... .......... .......... .......... 2% 24.3M 15s 2023-10-26T06:44:52.513 INFO:tasks.workunit.client.0.smithi050.stderr: 4150K .......... .......... .......... .......... .......... 2% 107M 15s 2023-10-26T06:44:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: 4200K .......... .......... .......... .......... .......... 2% 18.0M 15s 2023-10-26T06:44:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: 4250K .......... .......... .......... .......... .......... 2% 28.0M 15s 2023-10-26T06:44:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: 4300K .......... .......... .......... .......... .......... 2% 22.9M 15s 2023-10-26T06:44:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: 4350K .......... .......... .......... .......... .......... 2% 29.4M 15s 2023-10-26T06:44:52.514 INFO:tasks.workunit.client.0.smithi050.stderr: 4400K .......... .......... .......... .......... .......... 2% 70.2M 15s 2023-10-26T06:44:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: 4450K .......... .......... .......... .......... .......... 2% 24.0M 14s 2023-10-26T06:44:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: 4500K .......... .......... .......... .......... .......... 2% 27.0M 14s 2023-10-26T06:44:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: 4550K .......... .......... .......... .......... .......... 2% 22.5M 14s 2023-10-26T06:44:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: 4600K .......... .......... .......... .......... .......... 2% 27.9M 14s 2023-10-26T06:44:52.515 INFO:tasks.workunit.client.0.smithi050.stderr: 4650K .......... .......... .......... .......... .......... 2% 88.0M 14s 2023-10-26T06:44:52.540 INFO:tasks.workunit.client.0.smithi050.stderr: 4700K .......... .......... .......... .......... .......... 2% 20.9M 14s 2023-10-26T06:44:52.540 INFO:tasks.workunit.client.0.smithi050.stderr: 4750K .......... .......... .......... .......... .......... 2% 17.1M 14s 2023-10-26T06:44:52.540 INFO:tasks.workunit.client.0.smithi050.stderr: 4800K .......... .......... .......... .......... .......... 2% 113M 14s 2023-10-26T06:44:52.540 INFO:tasks.workunit.client.0.smithi050.stderr: 4850K .......... .......... .......... .......... .......... 2% 19.5M 14s 2023-10-26T06:44:52.540 INFO:tasks.workunit.client.0.smithi050.stderr: 4900K .......... .......... .......... .......... .......... 2% 50.3M 14s 2023-10-26T06:44:52.541 INFO:tasks.workunit.client.0.smithi050.stderr: 4950K .......... .......... .......... .......... .......... 2% 26.4M 14s 2023-10-26T06:44:52.541 INFO:tasks.workunit.client.0.smithi050.stderr: 5000K .......... .......... .......... .......... .......... 2% 31.4M 13s 2023-10-26T06:44:52.541 INFO:tasks.workunit.client.0.smithi050.stderr: 5050K .......... .......... .......... .......... .......... 3% 26.9M 13s 2023-10-26T06:44:52.541 INFO:tasks.workunit.client.0.smithi050.stderr: 5100K .......... .......... .......... .......... .......... 3% 22.7M 13s 2023-10-26T06:44:52.541 INFO:tasks.workunit.client.0.smithi050.stderr: 5150K .......... .......... .......... .......... .......... 3% 80.9M 13s 2023-10-26T06:44:52.542 INFO:tasks.workunit.client.0.smithi050.stderr: 5200K .......... .......... .......... .......... .......... 3% 22.5M 13s 2023-10-26T06:44:52.542 INFO:tasks.workunit.client.0.smithi050.stderr: 5250K .......... .......... .......... .......... .......... 3% 22.4M 13s 2023-10-26T06:44:52.542 INFO:tasks.workunit.client.0.smithi050.stderr: 5300K .......... .......... .......... .......... .......... 3% 33.3M 13s 2023-10-26T06:44:52.543 INFO:tasks.workunit.client.0.smithi050.stderr: 5350K .......... .......... .......... .......... .......... 3% 34.3M 13s 2023-10-26T06:44:52.543 INFO:tasks.workunit.client.0.smithi050.stderr: 5400K .......... .......... .......... .......... .......... 3% 34.6M 13s 2023-10-26T06:44:52.543 INFO:tasks.workunit.client.0.smithi050.stderr: 5450K .......... .......... .......... .......... .......... 3% 25.7M 13s 2023-10-26T06:44:52.543 INFO:tasks.workunit.client.0.smithi050.stderr: 5500K .......... .......... .......... .......... .......... 3% 31.8M 13s 2023-10-26T06:44:52.544 INFO:tasks.workunit.client.0.smithi050.stderr: 5550K .......... .......... .......... .......... .......... 3% 21.1M 13s 2023-10-26T06:44:52.544 INFO:tasks.workunit.client.0.smithi050.stderr: 5600K .......... .......... .......... .......... .......... 3% 29.7M 13s 2023-10-26T06:44:52.544 INFO:tasks.workunit.client.0.smithi050.stderr: 5650K .......... .......... .......... .......... .......... 3% 52.5M 13s 2023-10-26T06:44:52.544 INFO:tasks.workunit.client.0.smithi050.stderr: 5700K .......... .......... .......... .......... .......... 3% 25.3M 12s 2023-10-26T06:44:52.544 INFO:tasks.workunit.client.0.smithi050.stderr: 5750K .......... .......... .......... .......... .......... 3% 32.4M 12s 2023-10-26T06:44:52.551 INFO:tasks.workunit.client.0.smithi050.stderr: 5800K .......... .......... .......... .......... .......... 3% 20.3M 12s 2023-10-26T06:44:52.551 INFO:tasks.workunit.client.0.smithi050.stderr: 5850K .......... .......... .......... .......... .......... 3% 23.0M 12s 2023-10-26T06:44:52.551 INFO:tasks.workunit.client.0.smithi050.stderr: 5900K .......... .......... .......... .......... .......... 3% 88.4M 12s 2023-10-26T06:44:52.551 INFO:tasks.workunit.client.0.smithi050.stderr: 5950K .......... .......... .......... .......... .......... 3% 24.3M 12s 2023-10-26T06:44:52.552 INFO:tasks.workunit.client.0.smithi050.stderr: 6000K .......... .......... .......... .......... .......... 3% 26.9M 12s 2023-10-26T06:44:52.552 INFO:tasks.workunit.client.0.smithi050.stderr: 6050K .......... .......... .......... .......... .......... 3% 28.6M 12s 2023-10-26T06:44:52.552 INFO:tasks.workunit.client.0.smithi050.stderr: 6100K .......... .......... .......... .......... .......... 3% 32.4M 12s 2023-10-26T06:44:52.554 INFO:tasks.workunit.client.0.smithi050.stderr: 6150K .......... .......... .......... .......... .......... 3% 22.8M 12s 2023-10-26T06:44:52.555 INFO:tasks.workunit.client.0.smithi050.stderr: 6200K .......... .......... .......... .......... .......... 3% 29.3M 12s 2023-10-26T06:44:52.557 INFO:tasks.workunit.client.0.smithi050.stderr: 6250K .......... .......... .......... .......... .......... 3% 26.0M 12s 2023-10-26T06:44:52.559 INFO:tasks.workunit.client.0.smithi050.stderr: 6300K .......... .......... .......... .......... .......... 3% 30.2M 12s 2023-10-26T06:44:52.561 INFO:tasks.workunit.client.0.smithi050.stderr: 6350K .......... .......... .......... .......... .......... 3% 26.3M 12s 2023-10-26T06:44:52.563 INFO:tasks.workunit.client.0.smithi050.stderr: 6400K .......... .......... .......... .......... .......... 3% 25.7M 12s 2023-10-26T06:44:52.563 INFO:tasks.workunit.client.0.smithi050.stderr: 6450K .......... .......... .......... .......... .......... 3% 46.4M 12s 2023-10-26T06:44:52.565 INFO:tasks.workunit.client.0.smithi050.stderr: 6500K .......... .......... .......... .......... .......... 3% 23.7M 12s 2023-10-26T06:44:52.568 INFO:tasks.workunit.client.0.smithi050.stderr: 6550K .......... .......... .......... .......... .......... 3% 38.4M 11s 2023-10-26T06:44:52.569 INFO:tasks.workunit.client.0.smithi050.stderr: 6600K .......... .......... .......... .......... .......... 3% 22.8M 11s 2023-10-26T06:44:52.571 INFO:tasks.workunit.client.0.smithi050.stderr: 6650K .......... .......... .......... .......... .......... 3% 25.0M 11s 2023-10-26T06:44:52.572 INFO:tasks.workunit.client.0.smithi050.stderr: 6700K .......... .......... .......... .......... .......... 4% 46.8M 11s 2023-10-26T06:44:52.573 INFO:tasks.workunit.client.0.smithi050.stderr: 6750K .......... .......... .......... .......... .......... 4% 29.2M 11s 2023-10-26T06:44:52.575 INFO:tasks.workunit.client.0.smithi050.stderr: 6800K .......... .......... .......... .......... .......... 4% 30.7M 11s 2023-10-26T06:44:52.578 INFO:tasks.workunit.client.0.smithi050.stderr: 6850K .......... .......... .......... .......... .......... 4% 23.0M 11s 2023-10-26T06:44:52.580 INFO:tasks.workunit.client.0.smithi050.stderr: 6900K .......... .......... .......... .......... .......... 4% 25.4M 11s 2023-10-26T06:44:52.580 INFO:tasks.workunit.client.0.smithi050.stderr: 6950K .......... .......... .......... .......... .......... 4% 58.1M 11s 2023-10-26T06:44:52.582 INFO:tasks.workunit.client.0.smithi050.stderr: 7000K .......... .......... .......... .......... .......... 4% 24.5M 11s 2023-10-26T06:44:52.584 INFO:tasks.workunit.client.0.smithi050.stderr: 7050K .......... .......... .......... .......... .......... 4% 32.3M 11s 2023-10-26T06:44:52.586 INFO:tasks.workunit.client.0.smithi050.stderr: 7100K .......... .......... .......... .......... .......... 4% 23.1M 11s 2023-10-26T06:44:52.588 INFO:tasks.workunit.client.0.smithi050.stderr: 7150K .......... .......... .......... .......... .......... 4% 21.0M 11s 2023-10-26T06:44:52.589 INFO:tasks.workunit.client.0.smithi050.stderr: 7200K .......... .......... .......... .......... .......... 4% 85.9M 11s 2023-10-26T06:44:52.590 INFO:tasks.workunit.client.0.smithi050.stderr: 7250K .......... .......... .......... .......... .......... 4% 28.4M 11s 2023-10-26T06:44:52.592 INFO:tasks.workunit.client.0.smithi050.stderr: 7300K .......... .......... .......... .......... .......... 4% 25.7M 11s 2023-10-26T06:44:52.593 INFO:tasks.workunit.client.0.smithi050.stderr: 7350K .......... .......... .......... .......... .......... 4% 37.9M 11s 2023-10-26T06:44:52.600 INFO:tasks.workunit.client.0.smithi050.stderr: 7400K .......... .......... .......... .......... .......... 4% 26.9M 11s 2023-10-26T06:44:52.601 INFO:tasks.workunit.client.0.smithi050.stderr: 7450K .......... .......... .......... .......... .......... 4% 29.1M 11s 2023-10-26T06:44:52.601 INFO:tasks.workunit.client.0.smithi050.stderr: 7500K .......... .......... .......... .......... .......... 4% 22.2M 11s 2023-10-26T06:44:52.601 INFO:tasks.workunit.client.0.smithi050.stderr: 7550K .......... .......... .......... .......... .......... 4% 46.6M 11s 2023-10-26T06:44:52.607 INFO:tasks.workunit.client.0.smithi050.stderr: 7600K .......... .......... .......... .......... .......... 4% 22.3M 11s 2023-10-26T06:44:52.607 INFO:tasks.workunit.client.0.smithi050.stderr: 7650K .......... .......... .......... .......... .......... 4% 23.2M 11s 2023-10-26T06:44:52.607 INFO:tasks.workunit.client.0.smithi050.stderr: 7700K .......... .......... .......... .......... .......... 4% 41.3M 11s 2023-10-26T06:44:52.608 INFO:tasks.workunit.client.0.smithi050.stderr: 7750K .......... .......... .......... .......... .......... 4% 24.6M 10s 2023-10-26T06:44:52.610 INFO:tasks.workunit.client.0.smithi050.stderr: 7800K .......... .......... .......... .......... .......... 4% 26.0M 10s 2023-10-26T06:44:52.611 INFO:tasks.workunit.client.0.smithi050.stderr: 7850K .......... .......... .......... .......... .......... 4% 24.3M 10s 2023-10-26T06:44:52.614 INFO:tasks.workunit.client.0.smithi050.stderr: 7900K .......... .......... .......... .......... .......... 4% 24.0M 10s 2023-10-26T06:44:52.614 INFO:tasks.workunit.client.0.smithi050.stderr: 7950K .......... .......... .......... .......... .......... 4% 56.1M 10s 2023-10-26T06:44:52.617 INFO:tasks.workunit.client.0.smithi050.stderr: 8000K .......... .......... .......... .......... .......... 4% 24.6M 10s 2023-10-26T06:44:52.619 INFO:tasks.workunit.client.0.smithi050.stderr: 8050K .......... .......... .......... .......... .......... 4% 24.0M 10s 2023-10-26T06:44:52.620 INFO:tasks.workunit.client.0.smithi050.stderr: 8100K .......... .......... .......... .......... .......... 4% 29.2M 10s 2023-10-26T06:44:52.622 INFO:tasks.workunit.client.0.smithi050.stderr: 8150K .......... .......... .......... .......... .......... 4% 29.5M 10s 2023-10-26T06:44:52.623 INFO:tasks.workunit.client.0.smithi050.stderr: 8200K .......... .......... .......... .......... .......... 4% 48.9M 10s 2023-10-26T06:44:52.625 INFO:tasks.workunit.client.0.smithi050.stderr: 8250K .......... .......... .......... .......... .......... 4% 21.8M 10s 2023-10-26T06:44:52.627 INFO:tasks.workunit.client.0.smithi050.stderr: 8300K .......... .......... .......... .......... .......... 4% 34.3M 10s 2023-10-26T06:44:52.629 INFO:tasks.workunit.client.0.smithi050.stderr: 8350K .......... .......... .......... .......... .......... 4% 21.8M 10s 2023-10-26T06:44:52.630 INFO:tasks.workunit.client.0.smithi050.stderr: 8400K .......... .......... .......... .......... .......... 5% 47.4M 10s 2023-10-26T06:44:52.638 INFO:tasks.workunit.client.0.smithi050.stderr: 8450K .......... .......... .......... .......... .......... 5% 32.8M 10s 2023-10-26T06:44:52.639 INFO:tasks.workunit.client.0.smithi050.stderr: 8500K .......... .......... .......... .......... .......... 5% 22.0M 10s 2023-10-26T06:44:52.639 INFO:tasks.workunit.client.0.smithi050.stderr: 8550K .......... .......... .......... .......... .......... 5% 23.1M 10s 2023-10-26T06:44:52.639 INFO:tasks.workunit.client.0.smithi050.stderr: 8600K .......... .......... .......... .......... .......... 5% 36.7M 10s 2023-10-26T06:44:52.640 INFO:tasks.workunit.client.0.smithi050.stderr: 8650K .......... .......... .......... .......... .......... 5% 39.4M 10s 2023-10-26T06:44:52.648 INFO:tasks.workunit.client.0.smithi050.stderr: 8700K .......... .......... .......... .......... .......... 5% 26.5M 10s 2023-10-26T06:44:52.648 INFO:tasks.workunit.client.0.smithi050.stderr: 8750K .......... .......... .......... .......... .......... 5% 24.2M 10s 2023-10-26T06:44:52.649 INFO:tasks.workunit.client.0.smithi050.stderr: 8800K .......... .......... .......... .......... .......... 5% 25.1M 10s 2023-10-26T06:44:52.649 INFO:tasks.workunit.client.0.smithi050.stderr: 8850K .......... .......... .......... .......... .......... 5% 48.5M 10s 2023-10-26T06:44:52.649 INFO:tasks.workunit.client.0.smithi050.stderr: 8900K .......... .......... .......... .......... .......... 5% 20.1M 10s 2023-10-26T06:44:52.649 INFO:tasks.workunit.client.0.smithi050.stderr: 8950K .......... .......... .......... .......... .......... 5% 57.2M 10s 2023-10-26T06:44:52.651 INFO:tasks.workunit.client.0.smithi050.stderr: 9000K .......... .......... .......... .......... .......... 5% 26.0M 10s 2023-10-26T06:44:52.652 INFO:tasks.workunit.client.0.smithi050.stderr: 9050K .......... .......... .......... .......... .......... 5% 20.7M 10s 2023-10-26T06:44:52.654 INFO:tasks.workunit.client.0.smithi050.stderr: 9100K .......... .......... .......... .......... .......... 5% 39.0M 10s 2023-10-26T06:44:52.656 INFO:tasks.workunit.client.0.smithi050.stderr: 9150K .......... .......... .......... .......... .......... 5% 25.6M 10s 2023-10-26T06:44:52.656 INFO:tasks.workunit.client.0.smithi050.stderr: 9200K .......... .......... .......... .......... .......... 5% 57.6M 10s 2023-10-26T06:44:52.658 INFO:tasks.workunit.client.0.smithi050.stderr: 9250K .......... .......... .......... .......... .......... 5% 22.7M 10s 2023-10-26T06:44:52.660 INFO:tasks.workunit.client.0.smithi050.stderr: 9300K .......... .......... .......... .......... .......... 5% 28.4M 10s 2023-10-26T06:44:52.663 INFO:tasks.workunit.client.0.smithi050.stderr: 9350K .......... .......... .......... .......... .......... 5% 24.1M 10s 2023-10-26T06:44:52.664 INFO:tasks.workunit.client.0.smithi050.stderr: 9400K .......... .......... .......... .......... .......... 5% 38.1M 10s 2023-10-26T06:44:52.665 INFO:tasks.workunit.client.0.smithi050.stderr: 9450K .......... .......... .......... .......... .......... 5% 36.9M 9s 2023-10-26T06:44:52.667 INFO:tasks.workunit.client.0.smithi050.stderr: 9500K .......... .......... .......... .......... .......... 5% 23.3M 9s 2023-10-26T06:44:52.668 INFO:tasks.workunit.client.0.smithi050.stderr: 9550K .......... .......... .......... .......... .......... 5% 27.7M 9s 2023-10-26T06:44:52.671 INFO:tasks.workunit.client.0.smithi050.stderr: 9600K .......... .......... .......... .......... .......... 5% 28.6M 9s 2023-10-26T06:44:52.725 INFO:tasks.workunit.client.0.smithi050.stderr: 9650K .......... .......... .......... .......... .......... 5% 24.1M 9s 2023-10-26T06:44:52.725 INFO:tasks.workunit.client.0.smithi050.stderr: 9700K .......... .......... .......... .......... .......... 5% 48.6M 9s 2023-10-26T06:44:52.725 INFO:tasks.workunit.client.0.smithi050.stderr: 9750K .......... .......... .......... .......... .......... 5% 23.6M 9s 2023-10-26T06:44:52.726 INFO:tasks.workunit.client.0.smithi050.stderr: 9800K .......... .......... .......... .......... .......... 5% 25.0M 9s 2023-10-26T06:44:52.726 INFO:tasks.workunit.client.0.smithi050.stderr: 9850K .......... .......... .......... .......... .......... 5% 41.4M 9s 2023-10-26T06:44:52.726 INFO:tasks.workunit.client.0.smithi050.stderr: 9900K .......... .......... .......... .......... .......... 5% 36.5M 9s 2023-10-26T06:44:52.726 INFO:tasks.workunit.client.0.smithi050.stderr: 9950K .......... .......... .......... .......... .......... 5% 26.3M 9s 2023-10-26T06:44:52.726 INFO:tasks.workunit.client.0.smithi050.stderr: 10000K .......... .......... .......... .......... .......... 5% 22.6M 9s 2023-10-26T06:44:52.727 INFO:tasks.workunit.client.0.smithi050.stderr: 10050K .......... .......... .......... .......... .......... 5% 22.3M 9s 2023-10-26T06:44:52.727 INFO:tasks.workunit.client.0.smithi050.stderr: 10100K .......... .......... .......... .......... .......... 6% 42.7M 9s 2023-10-26T06:44:52.727 INFO:tasks.workunit.client.0.smithi050.stderr: 10150K .......... .......... .......... .......... .......... 6% 23.1M 9s 2023-10-26T06:44:52.727 INFO:tasks.workunit.client.0.smithi050.stderr: 10200K .......... .......... .......... .......... .......... 6% 33.3M 9s 2023-10-26T06:44:52.727 INFO:tasks.workunit.client.0.smithi050.stderr: 10250K .......... .......... .......... .......... .......... 6% 29.9M 9s 2023-10-26T06:44:52.728 INFO:tasks.workunit.client.0.smithi050.stderr: 10300K .......... .......... .......... .......... .......... 6% 31.9M 9s 2023-10-26T06:44:52.728 INFO:tasks.workunit.client.0.smithi050.stderr: 10350K .......... .......... .......... .......... .......... 6% 24.5M 9s 2023-10-26T06:44:52.728 INFO:tasks.workunit.client.0.smithi050.stderr: 10400K .......... .......... .......... .......... .......... 6% 25.7M 9s 2023-10-26T06:44:52.728 INFO:tasks.workunit.client.0.smithi050.stderr: 10450K .......... .......... .......... .......... .......... 6% 47.3M 9s 2023-10-26T06:44:52.729 INFO:tasks.workunit.client.0.smithi050.stderr: 10500K .......... .......... .......... .......... .......... 6% 24.7M 9s 2023-10-26T06:44:52.729 INFO:tasks.workunit.client.0.smithi050.stderr: 10550K .......... .......... .......... .......... .......... 6% 26.6M 9s 2023-10-26T06:44:52.729 INFO:tasks.workunit.client.0.smithi050.stderr: 10600K .......... .......... .......... .......... .......... 6% 30.3M 9s 2023-10-26T06:44:52.730 INFO:tasks.workunit.client.0.smithi050.stderr: 10650K .......... .......... .......... .......... .......... 6% 23.4M 9s 2023-10-26T06:44:52.730 INFO:tasks.workunit.client.0.smithi050.stderr: 10700K .......... .......... .......... .......... .......... 6% 44.5M 9s 2023-10-26T06:44:52.730 INFO:tasks.workunit.client.0.smithi050.stderr: 10750K .......... .......... .......... .......... .......... 6% 24.4M 9s 2023-10-26T06:44:52.730 INFO:tasks.workunit.client.0.smithi050.stderr: 10800K .......... .......... .......... .......... .......... 6% 26.0M 9s 2023-10-26T06:44:52.731 INFO:tasks.workunit.client.0.smithi050.stderr: 10850K .......... .......... .......... .......... .......... 6% 32.3M 9s 2023-10-26T06:44:52.731 INFO:tasks.workunit.client.0.smithi050.stderr: 10900K .......... .......... .......... .......... .......... 6% 26.1M 9s 2023-10-26T06:44:52.731 INFO:tasks.workunit.client.0.smithi050.stderr: 10950K .......... .......... .......... .......... .......... 6% 43.8M 9s 2023-10-26T06:44:52.731 INFO:tasks.workunit.client.0.smithi050.stderr: 11000K .......... .......... .......... .......... .......... 6% 22.0M 9s 2023-10-26T06:44:52.731 INFO:tasks.workunit.client.0.smithi050.stderr: 11050K .......... .......... .......... .......... .......... 6% 26.6M 9s 2023-10-26T06:44:52.731 INFO:tasks.workunit.client.0.smithi050.stderr: 11100K .......... .......... .......... .......... .......... 6% 32.2M 9s 2023-10-26T06:44:52.732 INFO:tasks.workunit.client.0.smithi050.stderr: 11150K .......... .......... .......... .......... .......... 6% 20.0M 9s 2023-10-26T06:44:52.732 INFO:tasks.workunit.client.0.smithi050.stderr: 11200K .......... .......... .......... .......... .......... 6% 130M 9s 2023-10-26T06:44:52.741 INFO:tasks.workunit.client.0.smithi050.stderr: 11250K .......... .......... .......... .......... .......... 6% 24.8M 9s 2023-10-26T06:44:52.741 INFO:tasks.workunit.client.0.smithi050.stderr: 11300K .......... .......... .......... .......... .......... 6% 23.1M 9s 2023-10-26T06:44:52.741 INFO:tasks.workunit.client.0.smithi050.stderr: 11350K .......... .......... .......... .......... .......... 6% 32.1M 9s 2023-10-26T06:44:52.742 INFO:tasks.workunit.client.0.smithi050.stderr: 11400K .......... .......... .......... .......... .......... 6% 25.5M 9s 2023-10-26T06:44:52.742 INFO:tasks.workunit.client.0.smithi050.stderr: 11450K .......... .......... .......... .......... .......... 6% 28.5M 9s 2023-10-26T06:44:52.742 INFO:tasks.workunit.client.0.smithi050.stderr: 11500K .......... .......... .......... .......... .......... 6% 30.5M 9s 2023-10-26T06:44:52.742 INFO:tasks.workunit.client.0.smithi050.stderr: 11550K .......... .......... .......... .......... .......... 6% 30.0M 9s 2023-10-26T06:44:52.742 INFO:tasks.workunit.client.0.smithi050.stderr: 11600K .......... .......... .......... .......... .......... 6% 39.7M 9s 2023-10-26T06:44:52.743 INFO:tasks.workunit.client.0.smithi050.stderr: 11650K .......... .......... .......... .......... .......... 6% 18.3M 9s 2023-10-26T06:44:52.746 INFO:tasks.workunit.client.0.smithi050.stderr: 11700K .......... .......... .......... .......... .......... 6% 29.1M 9s 2023-10-26T06:44:52.746 INFO:tasks.workunit.client.0.smithi050.stderr: 11750K .......... .......... .......... .......... .......... 7% 43.6M 9s 2023-10-26T06:44:52.747 INFO:tasks.workunit.client.0.smithi050.stderr: 11800K .......... .......... .......... .......... .......... 7% 26.2M 9s 2023-10-26T06:44:52.748 INFO:tasks.workunit.client.0.smithi050.stderr: 11850K .......... .......... .......... .......... .......... 7% 21.3M 9s 2023-10-26T06:44:52.751 INFO:tasks.workunit.client.0.smithi050.stderr: 11900K .......... .......... .......... .......... .......... 7% 20.7M 9s 2023-10-26T06:44:52.752 INFO:tasks.workunit.client.0.smithi050.stderr: 11950K .......... .......... .......... .......... .......... 7% 29.4M 9s 2023-10-26T06:44:52.753 INFO:tasks.workunit.client.0.smithi050.stderr: 12000K .......... .......... .......... .......... .......... 7% 72.4M 8s 2023-10-26T06:44:52.755 INFO:tasks.workunit.client.0.smithi050.stderr: 12050K .......... .......... .......... .......... .......... 7% 23.7M 8s 2023-10-26T06:44:52.756 INFO:tasks.workunit.client.0.smithi050.stderr: 12100K .......... .......... .......... .......... .......... 7% 35.6M 8s 2023-10-26T06:44:52.757 INFO:tasks.workunit.client.0.smithi050.stderr: 12150K .......... .......... .......... .......... .......... 7% 29.0M 8s 2023-10-26T06:44:52.760 INFO:tasks.workunit.client.0.smithi050.stderr: 12200K .......... .......... .......... .......... .......... 7% 21.2M 8s 2023-10-26T06:44:52.761 INFO:tasks.workunit.client.0.smithi050.stderr: 12250K .......... .......... .......... .......... .......... 7% 40.7M 8s 2023-10-26T06:44:52.763 INFO:tasks.workunit.client.0.smithi050.stderr: 12300K .......... .......... .......... .......... .......... 7% 27.2M 8s 2023-10-26T06:44:52.765 INFO:tasks.workunit.client.0.smithi050.stderr: 12350K .......... .......... .......... .......... .......... 7% 26.7M 8s 2023-10-26T06:44:52.766 INFO:tasks.workunit.client.0.smithi050.stderr: 12400K .......... .......... .......... .......... .......... 7% 27.6M 8s 2023-10-26T06:44:52.768 INFO:tasks.workunit.client.0.smithi050.stderr: 12450K .......... .......... .......... .......... .......... 7% 31.1M 8s 2023-10-26T06:44:52.769 INFO:tasks.workunit.client.0.smithi050.stderr: 12500K .......... .......... .......... .......... .......... 7% 30.8M 8s 2023-10-26T06:44:52.771 INFO:tasks.workunit.client.0.smithi050.stderr: 12550K .......... .......... .......... .......... .......... 7% 23.1M 8s 2023-10-26T06:44:52.773 INFO:tasks.workunit.client.0.smithi050.stderr: 12600K .......... .......... .......... .......... .......... 7% 33.7M 8s 2023-10-26T06:44:52.780 INFO:tasks.workunit.client.0.smithi050.stderr: 12650K .......... .......... .......... .......... .......... 7% 12.2M 8s 2023-10-26T06:44:52.780 INFO:tasks.workunit.client.0.smithi050.stderr: 12700K .......... .......... .......... .......... .......... 7% 49.1M 8s 2023-10-26T06:44:52.780 INFO:tasks.workunit.client.0.smithi050.stderr: 12750K .......... .......... .......... .......... .......... 7% 115M 8s 2023-10-26T06:44:52.780 INFO:tasks.workunit.client.0.smithi050.stderr: 12800K .......... .......... .......... .......... .......... 7% 34.9M 8s 2023-10-26T06:44:52.782 INFO:tasks.workunit.client.0.smithi050.stderr: 12850K .......... .......... .......... .......... .......... 7% 33.3M 8s 2023-10-26T06:44:52.784 INFO:tasks.workunit.client.0.smithi050.stderr: 12900K .......... .......... .......... .......... .......... 7% 22.3M 8s 2023-10-26T06:44:52.786 INFO:tasks.workunit.client.0.smithi050.stderr: 12950K .......... .......... .......... .......... .......... 7% 24.3M 8s 2023-10-26T06:44:52.787 INFO:tasks.workunit.client.0.smithi050.stderr: 13000K .......... .......... .......... .......... .......... 7% 51.7M 8s 2023-10-26T06:44:52.789 INFO:tasks.workunit.client.0.smithi050.stderr: 13050K .......... .......... .......... .......... .......... 7% 26.2M 8s 2023-10-26T06:44:52.791 INFO:tasks.workunit.client.0.smithi050.stderr: 13100K .......... .......... .......... .......... .......... 7% 26.2M 8s 2023-10-26T06:44:52.792 INFO:tasks.workunit.client.0.smithi050.stderr: 13150K .......... .......... .......... .......... .......... 7% 28.7M 8s 2023-10-26T06:44:52.820 INFO:tasks.workunit.client.0.smithi050.stderr: 13200K .......... .......... .......... .......... .......... 7% 26.4M 8s 2023-10-26T06:44:52.821 INFO:tasks.workunit.client.0.smithi050.stderr: 13250K .......... .......... .......... .......... .......... 7% 45.2M 8s 2023-10-26T06:44:52.821 INFO:tasks.workunit.client.0.smithi050.stderr: 13300K .......... .......... .......... .......... .......... 7% 25.7M 8s 2023-10-26T06:44:52.821 INFO:tasks.workunit.client.0.smithi050.stderr: 13350K .......... .......... .......... .......... .......... 7% 29.8M 8s 2023-10-26T06:44:52.821 INFO:tasks.workunit.client.0.smithi050.stderr: 13400K .......... .......... .......... .......... .......... 7% 25.9M 8s 2023-10-26T06:44:52.822 INFO:tasks.workunit.client.0.smithi050.stderr: 13450K .......... .......... .......... .......... .......... 8% 26.7M 8s 2023-10-26T06:44:52.822 INFO:tasks.workunit.client.0.smithi050.stderr: 13500K .......... .......... .......... .......... .......... 8% 45.1M 8s 2023-10-26T06:44:52.822 INFO:tasks.workunit.client.0.smithi050.stderr: 13550K .......... .......... .......... .......... .......... 8% 24.3M 8s 2023-10-26T06:44:52.822 INFO:tasks.workunit.client.0.smithi050.stderr: 13600K .......... .......... .......... .......... .......... 8% 34.3M 8s 2023-10-26T06:44:52.823 INFO:tasks.workunit.client.0.smithi050.stderr: 13650K .......... .......... .......... .......... .......... 8% 23.0M 8s 2023-10-26T06:44:52.823 INFO:tasks.workunit.client.0.smithi050.stderr: 13700K .......... .......... .......... .......... .......... 8% 27.3M 8s 2023-10-26T06:44:52.823 INFO:tasks.workunit.client.0.smithi050.stderr: 13750K .......... .......... .......... .......... .......... 8% 41.7M 8s 2023-10-26T06:44:52.824 INFO:tasks.workunit.client.0.smithi050.stderr: 13800K .......... .......... .......... .......... .......... 8% 23.8M 8s 2023-10-26T06:44:52.824 INFO:tasks.workunit.client.0.smithi050.stderr: 13850K .......... .......... .......... .......... .......... 8% 29.8M 8s 2023-10-26T06:44:52.824 INFO:tasks.workunit.client.0.smithi050.stderr: 13900K .......... .......... .......... .......... .......... 8% 44.1M 8s 2023-10-26T06:44:52.824 INFO:tasks.workunit.client.0.smithi050.stderr: 13950K .......... .......... .......... .......... .......... 8% 18.0M 8s 2023-10-26T06:44:52.825 INFO:tasks.workunit.client.0.smithi050.stderr: 14000K .......... .......... .......... .......... .......... 8% 53.8M 8s 2023-10-26T06:44:52.830 INFO:tasks.workunit.client.0.smithi050.stderr: 14050K .......... .......... .......... .......... .......... 8% 21.4M 8s 2023-10-26T06:44:52.830 INFO:tasks.workunit.client.0.smithi050.stderr: 14100K .......... .......... .......... .......... .......... 8% 28.7M 8s 2023-10-26T06:44:52.830 INFO:tasks.workunit.client.0.smithi050.stderr: 14150K .......... .......... .......... .......... .......... 8% 38.1M 8s 2023-10-26T06:44:52.830 INFO:tasks.workunit.client.0.smithi050.stderr: 14200K .......... .......... .......... .......... .......... 8% 21.8M 8s 2023-10-26T06:44:52.831 INFO:tasks.workunit.client.0.smithi050.stderr: 14250K .......... .......... .......... .......... .......... 8% 25.6M 8s 2023-10-26T06:44:52.836 INFO:tasks.workunit.client.0.smithi050.stderr: 14300K .......... .......... .......... .......... .......... 8% 41.6M 8s 2023-10-26T06:44:52.836 INFO:tasks.workunit.client.0.smithi050.stderr: 14350K .......... .......... .......... .......... .......... 8% 46.4M 8s 2023-10-26T06:44:52.837 INFO:tasks.workunit.client.0.smithi050.stderr: 14400K .......... .......... .......... .......... .......... 8% 24.1M 8s 2023-10-26T06:44:52.837 INFO:tasks.workunit.client.0.smithi050.stderr: 14450K .......... .......... .......... .......... .......... 8% 24.4M 8s 2023-10-26T06:44:52.837 INFO:tasks.workunit.client.0.smithi050.stderr: 14500K .......... .......... .......... .......... .......... 8% 55.2M 8s 2023-10-26T06:44:52.839 INFO:tasks.workunit.client.0.smithi050.stderr: 14550K .......... .......... .......... .......... .......... 8% 22.9M 8s 2023-10-26T06:44:52.841 INFO:tasks.workunit.client.0.smithi050.stderr: 14600K .......... .......... .......... .......... .......... 8% 29.2M 8s 2023-10-26T06:44:52.843 INFO:tasks.workunit.client.0.smithi050.stderr: 14650K .......... .......... .......... .......... .......... 8% 29.4M 8s 2023-10-26T06:44:52.848 INFO:tasks.workunit.client.0.smithi050.stderr: 14700K .......... .......... .......... .......... .......... 8% 21.9M 8s 2023-10-26T06:44:52.849 INFO:tasks.workunit.client.0.smithi050.stderr: 14750K .......... .......... .......... .......... .......... 8% 84.9M 8s 2023-10-26T06:44:52.849 INFO:tasks.workunit.client.0.smithi050.stderr: 14800K .......... .......... .......... .......... .......... 8% 25.3M 8s 2023-10-26T06:44:52.849 INFO:tasks.workunit.client.0.smithi050.stderr: 14850K .......... .......... .......... .......... .......... 8% 27.9M 8s 2023-10-26T06:44:52.852 INFO:tasks.workunit.client.0.smithi050.stderr: 14900K .......... .......... .......... .......... .......... 8% 26.0M 8s 2023-10-26T06:44:52.853 INFO:tasks.workunit.client.0.smithi050.stderr: 14950K .......... .......... .......... .......... .......... 8% 24.2M 8s 2023-10-26T06:44:52.854 INFO:tasks.workunit.client.0.smithi050.stderr: 15000K .......... .......... .......... .......... .......... 8% 50.9M 8s 2023-10-26T06:44:52.856 INFO:tasks.workunit.client.0.smithi050.stderr: 15050K .......... .......... .......... .......... .......... 8% 24.2M 8s 2023-10-26T06:44:52.858 INFO:tasks.workunit.client.0.smithi050.stderr: 15100K .......... .......... .......... .......... .......... 8% 29.4M 8s 2023-10-26T06:44:52.860 INFO:tasks.workunit.client.0.smithi050.stderr: 15150K .......... .......... .......... .......... .......... 9% 23.9M 8s 2023-10-26T06:44:52.860 INFO:tasks.workunit.client.0.smithi050.stderr: 15200K .......... .......... .......... .......... .......... 9% 48.8M 8s 2023-10-26T06:44:52.862 INFO:tasks.workunit.client.0.smithi050.stderr: 15250K .......... .......... .......... .......... .......... 9% 31.0M 8s 2023-10-26T06:44:52.864 INFO:tasks.workunit.client.0.smithi050.stderr: 15300K .......... .......... .......... .......... .......... 9% 22.5M 8s 2023-10-26T06:44:52.867 INFO:tasks.workunit.client.0.smithi050.stderr: 15350K .......... .......... .......... .......... .......... 9% 26.0M 8s 2023-10-26T06:44:52.867 INFO:tasks.workunit.client.0.smithi050.stderr: 15400K .......... .......... .......... .......... .......... 9% 42.0M 8s 2023-10-26T06:44:52.869 INFO:tasks.workunit.client.0.smithi050.stderr: 15450K .......... .......... .......... .......... .......... 9% 22.1M 8s 2023-10-26T06:44:52.870 INFO:tasks.workunit.client.0.smithi050.stderr: 15500K .......... .......... .......... .......... .......... 9% 40.3M 8s 2023-10-26T06:44:52.872 INFO:tasks.workunit.client.0.smithi050.stderr: 15550K .......... .......... .......... .......... .......... 9% 21.8M 8s 2023-10-26T06:44:52.875 INFO:tasks.workunit.client.0.smithi050.stderr: 15600K .......... .......... .......... .......... .......... 9% 20.0M 8s 2023-10-26T06:44:52.876 INFO:tasks.workunit.client.0.smithi050.stderr: 15650K .......... .......... .......... .......... .......... 9% 38.4M 8s 2023-10-26T06:44:52.879 INFO:tasks.workunit.client.0.smithi050.stderr: 15700K .......... .......... .......... .......... .......... 9% 22.3M 8s 2023-10-26T06:44:52.880 INFO:tasks.workunit.client.0.smithi050.stderr: 15750K .......... .......... .......... .......... .......... 9% 60.9M 8s 2023-10-26T06:44:52.881 INFO:tasks.workunit.client.0.smithi050.stderr: 15800K .......... .......... .......... .......... .......... 9% 21.1M 8s 2023-10-26T06:44:52.884 INFO:tasks.workunit.client.0.smithi050.stderr: 15850K .......... .......... .......... .......... .......... 9% 28.6M 8s 2023-10-26T06:44:52.885 INFO:tasks.workunit.client.0.smithi050.stderr: 15900K .......... .......... .......... .......... .......... 9% 33.4M 8s 2023-10-26T06:44:52.888 INFO:tasks.workunit.client.0.smithi050.stderr: 15950K .......... .......... .......... .......... .......... 9% 24.3M 8s 2023-10-26T06:44:52.888 INFO:tasks.workunit.client.0.smithi050.stderr: 16000K .......... .......... .......... .......... .......... 9% 47.3M 8s 2023-10-26T06:44:52.890 INFO:tasks.workunit.client.0.smithi050.stderr: 16050K .......... .......... .......... .......... .......... 9% 23.9M 7s 2023-10-26T06:44:52.893 INFO:tasks.workunit.client.0.smithi050.stderr: 16100K .......... .......... .......... .......... .......... 9% 30.5M 7s 2023-10-26T06:44:52.894 INFO:tasks.workunit.client.0.smithi050.stderr: 16150K .......... .......... .......... .......... .......... 9% 20.6M 7s 2023-10-26T06:44:52.895 INFO:tasks.workunit.client.0.smithi050.stderr: 16200K .......... .......... .......... .......... .......... 9% 29.7M 7s 2023-10-26T06:44:52.897 INFO:tasks.workunit.client.0.smithi050.stderr: 16250K .......... .......... .......... .......... .......... 9% 48.5M 7s 2023-10-26T06:44:52.898 INFO:tasks.workunit.client.0.smithi050.stderr: 16300K .......... .......... .......... .......... .......... 9% 25.2M 7s 2023-10-26T06:44:52.901 INFO:tasks.workunit.client.0.smithi050.stderr: 16350K .......... .......... .......... .......... .......... 9% 24.2M 7s 2023-10-26T06:44:52.902 INFO:tasks.workunit.client.0.smithi050.stderr: 16400K .......... .......... .......... .......... .......... 9% 33.0M 7s 2023-10-26T06:44:52.903 INFO:tasks.workunit.client.0.smithi050.stderr: 16450K .......... .......... .......... .......... .......... 9% 35.6M 7s 2023-10-26T06:44:52.906 INFO:tasks.workunit.client.0.smithi050.stderr: 16500K .......... .......... .......... .......... .......... 9% 34.2M 7s 2023-10-26T06:44:52.907 INFO:tasks.workunit.client.0.smithi050.stderr: 16550K .......... .......... .......... .......... .......... 9% 21.1M 7s 2023-10-26T06:44:52.909 INFO:tasks.workunit.client.0.smithi050.stderr: 16600K .......... .......... .......... .......... .......... 9% 25.5M 7s 2023-10-26T06:44:52.959 INFO:tasks.workunit.client.0.smithi050.stderr: 16650K .......... .......... .......... .......... .......... 9% 25.8M 7s 2023-10-26T06:44:52.959 INFO:tasks.workunit.client.0.smithi050.stderr: 16700K .......... .......... .......... .......... .......... 9% 34.5M 7s 2023-10-26T06:44:52.959 INFO:tasks.workunit.client.0.smithi050.stderr: 16750K .......... .......... .......... .......... .......... 9% 24.8M 7s 2023-10-26T06:44:52.959 INFO:tasks.workunit.client.0.smithi050.stderr: 16800K .......... .......... .......... .......... .......... 9% 47.8M 7s 2023-10-26T06:44:52.960 INFO:tasks.workunit.client.0.smithi050.stderr: 16850K .......... .......... .......... .......... .......... 10% 32.6M 7s 2023-10-26T06:44:52.960 INFO:tasks.workunit.client.0.smithi050.stderr: 16900K .......... .......... .......... .......... .......... 10% 25.2M 7s 2023-10-26T06:44:52.960 INFO:tasks.workunit.client.0.smithi050.stderr: 16950K .......... .......... .......... .......... .......... 10% 23.6M 7s 2023-10-26T06:44:52.960 INFO:tasks.workunit.client.0.smithi050.stderr: 17000K .......... .......... .......... .......... .......... 10% 22.5M 7s 2023-10-26T06:44:52.960 INFO:tasks.workunit.client.0.smithi050.stderr: 17050K .......... .......... .......... .......... .......... 10% 60.6M 7s 2023-10-26T06:44:52.961 INFO:tasks.workunit.client.0.smithi050.stderr: 17100K .......... .......... .......... .......... .......... 10% 24.8M 7s 2023-10-26T06:44:52.961 INFO:tasks.workunit.client.0.smithi050.stderr: 17150K .......... .......... .......... .......... .......... 10% 32.7M 7s 2023-10-26T06:44:52.961 INFO:tasks.workunit.client.0.smithi050.stderr: 17200K .......... .......... .......... .......... .......... 10% 25.2M 7s 2023-10-26T06:44:52.961 INFO:tasks.workunit.client.0.smithi050.stderr: 17250K .......... .......... .......... .......... .......... 10% 23.4M 7s 2023-10-26T06:44:52.961 INFO:tasks.workunit.client.0.smithi050.stderr: 17300K .......... .......... .......... .......... .......... 10% 42.9M 7s 2023-10-26T06:44:52.961 INFO:tasks.workunit.client.0.smithi050.stderr: 17350K .......... .......... .......... .......... .......... 10% 25.0M 7s 2023-10-26T06:44:52.962 INFO:tasks.workunit.client.0.smithi050.stderr: 17400K .......... .......... .......... .......... .......... 10% 29.0M 7s 2023-10-26T06:44:52.962 INFO:tasks.workunit.client.0.smithi050.stderr: 17450K .......... .......... .......... .......... .......... 10% 25.2M 7s 2023-10-26T06:44:52.962 INFO:tasks.workunit.client.0.smithi050.stderr: 17500K .......... .......... .......... .......... .......... 10% 42.6M 7s 2023-10-26T06:44:52.962 INFO:tasks.workunit.client.0.smithi050.stderr: 17550K .......... .......... .......... .......... .......... 10% 28.6M 7s 2023-10-26T06:44:52.962 INFO:tasks.workunit.client.0.smithi050.stderr: 17600K .......... .......... .......... .......... .......... 10% 26.3M 7s 2023-10-26T06:44:52.963 INFO:tasks.workunit.client.0.smithi050.stderr: 17650K .......... .......... .......... .......... .......... 10% 35.3M 7s 2023-10-26T06:44:52.963 INFO:tasks.workunit.client.0.smithi050.stderr: 17700K .......... .......... .......... .......... .......... 10% 27.6M 7s 2023-10-26T06:44:52.963 INFO:tasks.workunit.client.0.smithi050.stderr: 17750K .......... .......... .......... .......... .......... 10% 21.3M 7s 2023-10-26T06:44:52.963 INFO:tasks.workunit.client.0.smithi050.stderr: 17800K .......... .......... .......... .......... .......... 10% 35.6M 7s 2023-10-26T06:44:52.963 INFO:tasks.workunit.client.0.smithi050.stderr: 17850K .......... .......... .......... .......... .......... 10% 32.7M 7s 2023-10-26T06:44:52.964 INFO:tasks.workunit.client.0.smithi050.stderr: 17900K .......... .......... .......... .......... .......... 10% 21.4M 7s 2023-10-26T06:44:52.964 INFO:tasks.workunit.client.0.smithi050.stderr: 17950K .......... .......... .......... .......... .......... 10% 50.3M 7s 2023-10-26T06:44:52.964 INFO:tasks.workunit.client.0.smithi050.stderr: 18000K .......... .......... .......... .......... .......... 10% 26.0M 7s 2023-10-26T06:44:52.964 INFO:tasks.workunit.client.0.smithi050.stderr: 18050K .......... .......... .......... .......... .......... 10% 34.2M 7s 2023-10-26T06:44:52.973 INFO:tasks.workunit.client.0.smithi050.stderr: 18100K .......... .......... .......... .......... .......... 10% 21.4M 7s 2023-10-26T06:44:52.973 INFO:tasks.workunit.client.0.smithi050.stderr: 18150K .......... .......... .......... .......... .......... 10% 49.5M 7s 2023-10-26T06:44:52.973 INFO:tasks.workunit.client.0.smithi050.stderr: 18200K .......... .......... .......... .......... .......... 10% 28.8M 7s 2023-10-26T06:44:52.973 INFO:tasks.workunit.client.0.smithi050.stderr: 18250K .......... .......... .......... .......... .......... 10% 26.0M 7s 2023-10-26T06:44:52.973 INFO:tasks.workunit.client.0.smithi050.stderr: 18300K .......... .......... .......... .......... .......... 10% 23.9M 7s 2023-10-26T06:44:52.974 INFO:tasks.workunit.client.0.smithi050.stderr: 18350K .......... .......... .......... .......... .......... 10% 31.8M 7s 2023-10-26T06:44:52.974 INFO:tasks.workunit.client.0.smithi050.stderr: 18400K .......... .......... .......... .......... .......... 10% 22.9M 7s 2023-10-26T06:44:52.974 INFO:tasks.workunit.client.0.smithi050.stderr: 18450K .......... .......... .......... .......... .......... 10% 56.1M 7s 2023-10-26T06:44:52.974 INFO:tasks.workunit.client.0.smithi050.stderr: 18500K .......... .......... .......... .......... .......... 11% 28.0M 7s 2023-10-26T06:44:52.976 INFO:tasks.workunit.client.0.smithi050.stderr: 18550K .......... .......... .......... .......... .......... 11% 21.2M 7s 2023-10-26T06:44:52.977 INFO:tasks.workunit.client.0.smithi050.stderr: 18600K .......... .......... .......... .......... .......... 11% 34.3M 7s 2023-10-26T06:44:52.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:52 smithi153 ceph-mon[131657]: pgmap v355: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2023-10-26T06:44:52.989 INFO:tasks.workunit.client.0.smithi050.stderr: 18650K .......... .......... .......... .......... .......... 11% 21.2M 7s 2023-10-26T06:44:52.989 INFO:tasks.workunit.client.0.smithi050.stderr: 18700K .......... .......... .......... .......... .......... 11% 49.9M 7s 2023-10-26T06:44:52.989 INFO:tasks.workunit.client.0.smithi050.stderr: 18750K .......... .......... .......... .......... .......... 11% 21.8M 7s 2023-10-26T06:44:52.990 INFO:tasks.workunit.client.0.smithi050.stderr: 18800K .......... .......... .......... .......... .......... 11% 36.3M 7s 2023-10-26T06:44:52.990 INFO:tasks.workunit.client.0.smithi050.stderr: 18850K .......... .......... .......... .......... .......... 11% 23.6M 7s 2023-10-26T06:44:52.990 INFO:tasks.workunit.client.0.smithi050.stderr: 18900K .......... .......... .......... .......... .......... 11% 30.4M 7s 2023-10-26T06:44:52.990 INFO:tasks.workunit.client.0.smithi050.stderr: 18950K .......... .......... .......... .......... .......... 11% 23.4M 7s 2023-10-26T06:44:52.993 INFO:tasks.workunit.client.0.smithi050.stderr: 19000K .......... .......... .......... .......... .......... 11% 25.7M 7s 2023-10-26T06:44:52.993 INFO:tasks.workunit.client.0.smithi050.stderr: 19050K .......... .......... .......... .......... .......... 11% 48.5M 7s 2023-10-26T06:44:52.995 INFO:tasks.workunit.client.0.smithi050.stderr: 19100K .......... .......... .......... .......... .......... 11% 21.4M 7s 2023-10-26T06:44:52.996 INFO:tasks.workunit.client.0.smithi050.stderr: 19150K .......... .......... .......... .......... .......... 11% 27.5M 7s 2023-10-26T06:44:52.997 INFO:tasks.workunit.client.0.smithi050.stderr: 19200K .......... .......... .......... .......... .......... 11% 51.9M 7s 2023-10-26T06:44:52.999 INFO:tasks.workunit.client.0.smithi050.stderr: 19250K .......... .......... .......... .......... .......... 11% 23.4M 7s 2023-10-26T06:44:53.001 INFO:tasks.workunit.client.0.smithi050.stderr: 19300K .......... .......... .......... .......... .......... 11% 35.7M 7s 2023-10-26T06:44:53.002 INFO:tasks.workunit.client.0.smithi050.stderr: 19350K .......... .......... .......... .......... .......... 11% 26.6M 7s 2023-10-26T06:44:53.003 INFO:tasks.workunit.client.0.smithi050.stderr: 19400K .......... .......... .......... .......... .......... 11% 35.0M 7s 2023-10-26T06:44:53.006 INFO:tasks.workunit.client.0.smithi050.stderr: 19450K .......... .......... .......... .......... .......... 11% 29.4M 7s 2023-10-26T06:44:53.008 INFO:tasks.workunit.client.0.smithi050.stderr: 19500K .......... .......... .......... .......... .......... 11% 26.9M 7s 2023-10-26T06:44:53.009 INFO:tasks.workunit.client.0.smithi050.stderr: 19550K .......... .......... .......... .......... .......... 11% 24.5M 7s 2023-10-26T06:44:53.012 INFO:tasks.workunit.client.0.smithi050.stderr: 19600K .......... .......... .......... .......... .......... 11% 21.9M 7s 2023-10-26T06:44:53.012 INFO:tasks.workunit.client.0.smithi050.stderr: 19650K .......... .......... .......... .......... .......... 11% 45.7M 7s 2023-10-26T06:44:53.014 INFO:tasks.workunit.client.0.smithi050.stderr: 19700K .......... .......... .......... .......... .......... 11% 30.3M 7s 2023-10-26T06:44:53.016 INFO:tasks.workunit.client.0.smithi050.stderr: 19750K .......... .......... .......... .......... .......... 11% 24.6M 7s 2023-10-26T06:44:53.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:52 smithi050 ceph-mon[94997]: pgmap v355: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2023-10-26T06:44:53.027 INFO:tasks.workunit.client.0.smithi050.stderr: 19800K .......... .......... .......... .......... .......... 11% 24.1M 7s 2023-10-26T06:44:53.027 INFO:tasks.workunit.client.0.smithi050.stderr: 19850K .......... .......... .......... .......... .......... 11% 36.1M 7s 2023-10-26T06:44:53.028 INFO:tasks.workunit.client.0.smithi050.stderr: 19900K .......... .......... .......... .......... .......... 11% 24.3M 7s 2023-10-26T06:44:53.028 INFO:tasks.workunit.client.0.smithi050.stderr: 19950K .......... .......... .......... .......... .......... 11% 43.6M 7s 2023-10-26T06:44:53.028 INFO:tasks.workunit.client.0.smithi050.stderr: 20000K .......... .......... .......... .......... .......... 11% 19.6M 7s 2023-10-26T06:44:53.028 INFO:tasks.workunit.client.0.smithi050.stderr: 20050K .......... .......... .......... .......... .......... 11% 24.7M 7s 2023-10-26T06:44:53.031 INFO:tasks.workunit.client.0.smithi050.stderr: 20100K .......... .......... .......... .......... .......... 11% 36.0M 7s 2023-10-26T06:44:53.032 INFO:tasks.workunit.client.0.smithi050.stderr: 20150K .......... .......... .......... .......... .......... 11% 24.7M 7s 2023-10-26T06:44:53.033 INFO:tasks.workunit.client.0.smithi050.stderr: 20200K .......... .......... .......... .......... .......... 12% 51.8M 7s 2023-10-26T06:44:53.034 INFO:tasks.workunit.client.0.smithi050.stderr: 20250K .......... .......... .......... .......... .......... 12% 23.2M 7s 2023-10-26T06:44:53.035 INFO:tasks.workunit.client.0.smithi050.stderr: 20300K .......... .......... .......... .......... .......... 12% 24.0M 7s 2023-10-26T06:44:53.036 INFO:tasks.workunit.client.0.smithi050.stderr: 20350K .......... .......... .......... .......... .......... 12% 44.5M 7s 2023-10-26T06:44:53.038 INFO:tasks.workunit.client.0.smithi050.stderr: 20400K .......... .......... .......... .......... .......... 12% 28.7M 7s 2023-10-26T06:44:53.040 INFO:tasks.workunit.client.0.smithi050.stderr: 20450K .......... .......... .......... .......... .......... 12% 22.8M 7s 2023-10-26T06:44:53.042 INFO:tasks.workunit.client.0.smithi050.stderr: 20500K .......... .......... .......... .......... .......... 12% 29.8M 7s 2023-10-26T06:44:53.044 INFO:tasks.workunit.client.0.smithi050.stderr: 20550K .......... .......... .......... .......... .......... 12% 24.0M 7s 2023-10-26T06:44:53.046 INFO:tasks.workunit.client.0.smithi050.stderr: 20600K .......... .......... .......... .......... .......... 12% 32.5M 7s 2023-10-26T06:44:53.048 INFO:tasks.workunit.client.0.smithi050.stderr: 20650K .......... .......... .......... .......... .......... 12% 24.4M 7s 2023-10-26T06:44:53.050 INFO:tasks.workunit.client.0.smithi050.stderr: 20700K .......... .......... .......... .......... .......... 12% 23.2M 7s 2023-10-26T06:44:53.050 INFO:tasks.workunit.client.0.smithi050.stderr: 20750K .......... .......... .......... .......... .......... 12% 59.9M 7s 2023-10-26T06:44:53.053 INFO:tasks.workunit.client.0.smithi050.stderr: 20800K .......... .......... .......... .......... .......... 12% 20.4M 7s 2023-10-26T06:44:53.054 INFO:tasks.workunit.client.0.smithi050.stderr: 20850K .......... .......... .......... .......... .......... 12% 33.8M 7s 2023-10-26T06:44:53.057 INFO:tasks.workunit.client.0.smithi050.stderr: 20900K .......... .......... .......... .......... .......... 12% 28.4M 7s 2023-10-26T06:44:53.060 INFO:tasks.workunit.client.0.smithi050.stderr: 20950K .......... .......... .......... .......... .......... 12% 24.3M 7s 2023-10-26T06:44:53.060 INFO:tasks.workunit.client.0.smithi050.stderr: 21000K .......... .......... .......... .......... .......... 12% 81.7M 7s 2023-10-26T06:44:53.061 INFO:tasks.workunit.client.0.smithi050.stderr: 21050K .......... .......... .......... .......... .......... 12% 24.4M 7s 2023-10-26T06:44:53.063 INFO:tasks.workunit.client.0.smithi050.stderr: 21100K .......... .......... .......... .......... .......... 12% 24.9M 7s 2023-10-26T06:44:53.065 INFO:tasks.workunit.client.0.smithi050.stderr: 21150K .......... .......... .......... .......... .......... 12% 26.7M 7s 2023-10-26T06:44:53.067 INFO:tasks.workunit.client.0.smithi050.stderr: 21200K .......... .......... .......... .......... .......... 12% 24.4M 7s 2023-10-26T06:44:53.068 INFO:tasks.workunit.client.0.smithi050.stderr: 21250K .......... .......... .......... .......... .......... 12% 66.3M 7s 2023-10-26T06:44:53.070 INFO:tasks.workunit.client.0.smithi050.stderr: 21300K .......... .......... .......... .......... .......... 12% 17.0M 7s 2023-10-26T06:44:53.072 INFO:tasks.workunit.client.0.smithi050.stderr: 21350K .......... .......... .......... .......... .......... 12% 34.6M 7s 2023-10-26T06:44:53.073 INFO:tasks.workunit.client.0.smithi050.stderr: 21400K .......... .......... .......... .......... .......... 12% 51.6M 7s 2023-10-26T06:44:53.075 INFO:tasks.workunit.client.0.smithi050.stderr: 21450K .......... .......... .......... .......... .......... 12% 20.6M 7s 2023-10-26T06:44:53.076 INFO:tasks.workunit.client.0.smithi050.stderr: 21500K .......... .......... .......... .......... .......... 12% 45.9M 7s 2023-10-26T06:44:53.080 INFO:tasks.workunit.client.0.smithi050.stderr: 21550K .......... .......... .......... .......... .......... 12% 23.9M 7s 2023-10-26T06:44:53.080 INFO:tasks.workunit.client.0.smithi050.stderr: 21600K .......... .......... .......... .......... .......... 12% 24.8M 7s 2023-10-26T06:44:53.084 INFO:tasks.workunit.client.0.smithi050.stderr: 21650K .......... .......... .......... .......... .......... 12% 42.0M 7s 2023-10-26T06:44:53.084 INFO:tasks.workunit.client.0.smithi050.stderr: 21700K .......... .......... .......... .......... .......... 12% 34.9M 7s 2023-10-26T06:44:53.084 INFO:tasks.workunit.client.0.smithi050.stderr: 21750K .......... .......... .......... .......... .......... 12% 30.2M 7s 2023-10-26T06:44:53.086 INFO:tasks.workunit.client.0.smithi050.stderr: 21800K .......... .......... .......... .......... .......... 12% 23.1M 7s 2023-10-26T06:44:53.088 INFO:tasks.workunit.client.0.smithi050.stderr: 21850K .......... .......... .......... .......... .......... 12% 32.3M 7s 2023-10-26T06:44:53.090 INFO:tasks.workunit.client.0.smithi050.stderr: 21900K .......... .......... .......... .......... .......... 13% 21.6M 7s 2023-10-26T06:44:53.092 INFO:tasks.workunit.client.0.smithi050.stderr: 21950K .......... .......... .......... .......... .......... 13% 27.7M 7s 2023-10-26T06:44:53.093 INFO:tasks.workunit.client.0.smithi050.stderr: 22000K .......... .......... .......... .......... .......... 13% 52.3M 7s 2023-10-26T06:44:53.094 INFO:tasks.workunit.client.0.smithi050.stderr: 22050K .......... .......... .......... .......... .......... 13% 33.9M 7s 2023-10-26T06:44:53.096 INFO:tasks.workunit.client.0.smithi050.stderr: 22100K .......... .......... .......... .......... .......... 13% 24.5M 7s 2023-10-26T06:44:53.099 INFO:tasks.workunit.client.0.smithi050.stderr: 22150K .......... .......... .......... .......... .......... 13% 23.8M 7s 2023-10-26T06:44:53.101 INFO:tasks.workunit.client.0.smithi050.stderr: 22200K .......... .......... .......... .......... .......... 13% 24.8M 7s 2023-10-26T06:44:53.101 INFO:tasks.workunit.client.0.smithi050.stderr: 22250K .......... .......... .......... .......... .......... 13% 56.5M 7s 2023-10-26T06:44:53.103 INFO:tasks.workunit.client.0.smithi050.stderr: 22300K .......... .......... .......... .......... .......... 13% 23.1M 7s 2023-10-26T06:44:53.105 INFO:tasks.workunit.client.0.smithi050.stderr: 22350K .......... .......... .......... .......... .......... 13% 34.2M 7s 2023-10-26T06:44:53.107 INFO:tasks.workunit.client.0.smithi050.stderr: 22400K .......... .......... .......... .......... .......... 13% 24.3M 7s 2023-10-26T06:44:53.109 INFO:tasks.workunit.client.0.smithi050.stderr: 22450K .......... .......... .......... .......... .......... 13% 25.1M 7s 2023-10-26T06:44:53.109 INFO:tasks.workunit.client.0.smithi050.stderr: 22500K .......... .......... .......... .......... .......... 13% 61.2M 7s 2023-10-26T06:44:53.111 INFO:tasks.workunit.client.0.smithi050.stderr: 22550K .......... .......... .......... .......... .......... 13% 23.5M 7s 2023-10-26T06:44:53.113 INFO:tasks.workunit.client.0.smithi050.stderr: 22600K .......... .......... .......... .......... .......... 13% 32.0M 7s 2023-10-26T06:44:53.115 INFO:tasks.workunit.client.0.smithi050.stderr: 22650K .......... .......... .......... .......... .......... 13% 24.7M 7s 2023-10-26T06:44:53.117 INFO:tasks.workunit.client.0.smithi050.stderr: 22700K .......... .......... .......... .......... .......... 13% 24.0M 7s 2023-10-26T06:44:53.118 INFO:tasks.workunit.client.0.smithi050.stderr: 22750K .......... .......... .......... .......... .......... 13% 47.0M 7s 2023-10-26T06:44:53.120 INFO:tasks.workunit.client.0.smithi050.stderr: 22800K .......... .......... .......... .......... .......... 13% 25.3M 7s 2023-10-26T06:44:53.122 INFO:tasks.workunit.client.0.smithi050.stderr: 22850K .......... .......... .......... .......... .......... 13% 31.1M 7s 2023-10-26T06:44:53.123 INFO:tasks.workunit.client.0.smithi050.stderr: 22900K .......... .......... .......... .......... .......... 13% 27.0M 7s 2023-10-26T06:44:53.157 INFO:tasks.workunit.client.0.smithi050.stderr: 22950K .......... .......... .......... .......... .......... 13% 26.5M 6s 2023-10-26T06:44:53.157 INFO:tasks.workunit.client.0.smithi050.stderr: 23000K .......... .......... .......... .......... .......... 13% 35.4M 6s 2023-10-26T06:44:53.158 INFO:tasks.workunit.client.0.smithi050.stderr: 23050K .......... .......... .......... .......... .......... 13% 25.1M 6s 2023-10-26T06:44:53.158 INFO:tasks.workunit.client.0.smithi050.stderr: 23100K .......... .......... .......... .......... .......... 13% 26.9M 6s 2023-10-26T06:44:53.158 INFO:tasks.workunit.client.0.smithi050.stderr: 23150K .......... .......... .......... .......... .......... 13% 24.0M 6s 2023-10-26T06:44:53.158 INFO:tasks.workunit.client.0.smithi050.stderr: 23200K .......... .......... .......... .......... .......... 13% 41.3M 6s 2023-10-26T06:44:53.158 INFO:tasks.workunit.client.0.smithi050.stderr: 23250K .......... .......... .......... .......... .......... 13% 34.0M 6s 2023-10-26T06:44:53.159 INFO:tasks.workunit.client.0.smithi050.stderr: 23300K .......... .......... .......... .......... .......... 13% 25.7M 6s 2023-10-26T06:44:53.159 INFO:tasks.workunit.client.0.smithi050.stderr: 23350K .......... .......... .......... .......... .......... 13% 37.0M 6s 2023-10-26T06:44:53.159 INFO:tasks.workunit.client.0.smithi050.stderr: 23400K .......... .......... .......... .......... .......... 13% 25.3M 6s 2023-10-26T06:44:53.159 INFO:tasks.workunit.client.0.smithi050.stderr: 23450K .......... .......... .......... .......... .......... 13% 23.4M 6s 2023-10-26T06:44:53.159 INFO:tasks.workunit.client.0.smithi050.stderr: 23500K .......... .......... .......... .......... .......... 13% 47.9M 6s 2023-10-26T06:44:53.160 INFO:tasks.workunit.client.0.smithi050.stderr: 23550K .......... .......... .......... .......... .......... 14% 24.8M 6s 2023-10-26T06:44:53.160 INFO:tasks.workunit.client.0.smithi050.stderr: 23600K .......... .......... .......... .......... .......... 14% 35.1M 6s 2023-10-26T06:44:53.160 INFO:tasks.workunit.client.0.smithi050.stderr: 23650K .......... .......... .......... .......... .......... 14% 20.4M 6s 2023-10-26T06:44:53.160 INFO:tasks.workunit.client.0.smithi050.stderr: 23700K .......... .......... .......... .......... .......... 14% 19.1M 6s 2023-10-26T06:44:53.160 INFO:tasks.workunit.client.0.smithi050.stderr: 23750K .......... .......... .......... .......... .......... 14% 195M 6s 2023-10-26T06:44:53.161 INFO:tasks.workunit.client.0.smithi050.stderr: 23800K .......... .......... .......... .......... .......... 14% 25.5M 6s 2023-10-26T06:44:53.161 INFO:tasks.workunit.client.0.smithi050.stderr: 23850K .......... .......... .......... .......... .......... 14% 19.5M 6s 2023-10-26T06:44:53.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:52 smithi125 ceph-mon[130643]: pgmap v355: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2023-10-26T06:44:53.199 INFO:tasks.workunit.client.0.smithi050.stderr: 23900K .......... .......... .......... .......... .......... 14% 22.8M 6s 2023-10-26T06:44:53.199 INFO:tasks.workunit.client.0.smithi050.stderr: 23950K .......... .......... .......... .......... .......... 14% 46.6M 6s 2023-10-26T06:44:53.199 INFO:tasks.workunit.client.0.smithi050.stderr: 24000K .......... .......... .......... .......... .......... 14% 25.2M 6s 2023-10-26T06:44:53.199 INFO:tasks.workunit.client.0.smithi050.stderr: 24050K .......... .......... .......... .......... .......... 14% 32.3M 6s 2023-10-26T06:44:53.200 INFO:tasks.workunit.client.0.smithi050.stderr: 24100K .......... .......... .......... .......... .......... 14% 25.2M 6s 2023-10-26T06:44:53.200 INFO:tasks.workunit.client.0.smithi050.stderr: 24150K .......... .......... .......... .......... .......... 14% 24.4M 6s 2023-10-26T06:44:53.200 INFO:tasks.workunit.client.0.smithi050.stderr: 24200K .......... .......... .......... .......... .......... 14% 46.9M 6s 2023-10-26T06:44:53.200 INFO:tasks.workunit.client.0.smithi050.stderr: 24250K .......... .......... .......... .......... .......... 14% 25.4M 6s 2023-10-26T06:44:53.200 INFO:tasks.workunit.client.0.smithi050.stderr: 24300K .......... .......... .......... .......... .......... 14% 25.6M 6s 2023-10-26T06:44:53.201 INFO:tasks.workunit.client.0.smithi050.stderr: 24350K .......... .......... .......... .......... .......... 14% 27.5M 6s 2023-10-26T06:44:53.201 INFO:tasks.workunit.client.0.smithi050.stderr: 24400K .......... .......... .......... .......... .......... 14% 37.4M 6s 2023-10-26T06:44:53.201 INFO:tasks.workunit.client.0.smithi050.stderr: 24450K .......... .......... .......... .......... .......... 14% 34.1M 6s 2023-10-26T06:44:53.201 INFO:tasks.workunit.client.0.smithi050.stderr: 24500K .......... .......... .......... .......... .......... 14% 21.6M 6s 2023-10-26T06:44:53.201 INFO:tasks.workunit.client.0.smithi050.stderr: 24550K .......... .......... .......... .......... .......... 14% 37.3M 6s 2023-10-26T06:44:53.202 INFO:tasks.workunit.client.0.smithi050.stderr: 24600K .......... .......... .......... .......... .......... 14% 37.0M 6s 2023-10-26T06:44:53.202 INFO:tasks.workunit.client.0.smithi050.stderr: 24650K .......... .......... .......... .......... .......... 14% 21.5M 6s 2023-10-26T06:44:53.202 INFO:tasks.workunit.client.0.smithi050.stderr: 24700K .......... .......... .......... .......... .......... 14% 33.1M 6s 2023-10-26T06:44:53.202 INFO:tasks.workunit.client.0.smithi050.stderr: 24750K .......... .......... .......... .......... .......... 14% 27.8M 6s 2023-10-26T06:44:53.202 INFO:tasks.workunit.client.0.smithi050.stderr: 24800K .......... .......... .......... .......... .......... 14% 25.3M 6s 2023-10-26T06:44:53.203 INFO:tasks.workunit.client.0.smithi050.stderr: 24850K .......... .......... .......... .......... .......... 14% 41.0M 6s 2023-10-26T06:44:53.203 INFO:tasks.workunit.client.0.smithi050.stderr: 24900K .......... .......... .......... .......... .......... 14% 23.9M 6s 2023-10-26T06:44:53.203 INFO:tasks.workunit.client.0.smithi050.stderr: 24950K .......... .......... .......... .......... .......... 14% 26.1M 6s 2023-10-26T06:44:53.203 INFO:tasks.workunit.client.0.smithi050.stderr: 25000K .......... .......... .......... .......... .......... 14% 24.0M 6s 2023-10-26T06:44:53.203 INFO:tasks.workunit.client.0.smithi050.stderr: 25050K .......... .......... .......... .......... .......... 14% 42.0M 6s 2023-10-26T06:44:53.204 INFO:tasks.workunit.client.0.smithi050.stderr: 25100K .......... .......... .......... .......... .......... 14% 24.4M 6s 2023-10-26T06:44:53.216 INFO:tasks.workunit.client.0.smithi050.stderr: 25150K .......... .......... .......... .......... .......... 14% 21.4M 6s 2023-10-26T06:44:53.217 INFO:tasks.workunit.client.0.smithi050.stderr: 25200K .......... .......... .......... .......... .......... 14% 34.4M 6s 2023-10-26T06:44:53.217 INFO:tasks.workunit.client.0.smithi050.stderr: 25250K .......... .......... .......... .......... .......... 15% 24.4M 6s 2023-10-26T06:44:53.217 INFO:tasks.workunit.client.0.smithi050.stderr: 25300K .......... .......... .......... .......... .......... 15% 50.6M 6s 2023-10-26T06:44:53.217 INFO:tasks.workunit.client.0.smithi050.stderr: 25350K .......... .......... .......... .......... .......... 15% 32.3M 6s 2023-10-26T06:44:53.217 INFO:tasks.workunit.client.0.smithi050.stderr: 25400K .......... .......... .......... .......... .......... 15% 24.2M 6s 2023-10-26T06:44:53.218 INFO:tasks.workunit.client.0.smithi050.stderr: 25450K .......... .......... .......... .......... .......... 15% 24.1M 6s 2023-10-26T06:44:53.218 INFO:tasks.workunit.client.0.smithi050.stderr: 25500K .......... .......... .......... .......... .......... 15% 37.1M 6s 2023-10-26T06:44:53.218 INFO:tasks.workunit.client.0.smithi050.stderr: 25550K .......... .......... .......... .......... .......... 15% 25.7M 6s 2023-10-26T06:44:53.218 INFO:tasks.workunit.client.0.smithi050.stderr: 25600K .......... .......... .......... .......... .......... 15% 39.9M 6s 2023-10-26T06:44:53.224 INFO:tasks.workunit.client.0.smithi050.stderr: 25650K .......... .......... .......... .......... .......... 15% 23.9M 6s 2023-10-26T06:44:53.224 INFO:tasks.workunit.client.0.smithi050.stderr: 25700K .......... .......... .......... .......... .......... 15% 37.0M 6s 2023-10-26T06:44:53.224 INFO:tasks.workunit.client.0.smithi050.stderr: 25750K .......... .......... .......... .......... .......... 15% 23.5M 6s 2023-10-26T06:44:53.224 INFO:tasks.workunit.client.0.smithi050.stderr: 25800K .......... .......... .......... .......... .......... 15% 24.6M 6s 2023-10-26T06:44:53.225 INFO:tasks.workunit.client.0.smithi050.stderr: 25850K .......... .......... .......... .......... .......... 15% 50.9M 6s 2023-10-26T06:44:53.228 INFO:tasks.workunit.client.0.smithi050.stderr: 25900K .......... .......... .......... .......... .......... 15% 24.1M 6s 2023-10-26T06:44:53.228 INFO:tasks.workunit.client.0.smithi050.stderr: 25950K .......... .......... .......... .......... .......... 15% 26.0M 6s 2023-10-26T06:44:53.231 INFO:tasks.workunit.client.0.smithi050.stderr: 26000K .......... .......... .......... .......... .......... 15% 18.8M 6s 2023-10-26T06:44:53.234 INFO:tasks.workunit.client.0.smithi050.stderr: 26050K .......... .......... .......... .......... .......... 15% 28.0M 6s 2023-10-26T06:44:53.234 INFO:tasks.workunit.client.0.smithi050.stderr: 26100K .......... .......... .......... .......... .......... 15% 157M 6s 2023-10-26T06:44:53.234 INFO:tasks.workunit.client.0.smithi050.stderr: 26150K .......... .......... .......... .......... .......... 15% 28.1M 6s 2023-10-26T06:44:53.236 INFO:tasks.workunit.client.0.smithi050.stderr: 26200K .......... .......... .......... .......... .......... 15% 28.9M 6s 2023-10-26T06:44:53.237 INFO:tasks.workunit.client.0.smithi050.stderr: 26250K .......... .......... .......... .......... .......... 15% 25.5M 6s 2023-10-26T06:44:53.241 INFO:tasks.workunit.client.0.smithi050.stderr: 26300K .......... .......... .......... .......... .......... 15% 23.3M 6s 2023-10-26T06:44:53.241 INFO:tasks.workunit.client.0.smithi050.stderr: 26350K .......... .......... .......... .......... .......... 15% 50.3M 6s 2023-10-26T06:44:53.243 INFO:tasks.workunit.client.0.smithi050.stderr: 26400K .......... .......... .......... .......... .......... 15% 23.3M 6s 2023-10-26T06:44:53.245 INFO:tasks.workunit.client.0.smithi050.stderr: 26450K .......... .......... .......... .......... .......... 15% 33.0M 6s 2023-10-26T06:44:53.247 INFO:tasks.workunit.client.0.smithi050.stderr: 26500K .......... .......... .......... .......... .......... 15% 26.3M 6s 2023-10-26T06:44:53.248 INFO:tasks.workunit.client.0.smithi050.stderr: 26550K .......... .......... .......... .......... .......... 15% 23.9M 6s 2023-10-26T06:44:53.250 INFO:tasks.workunit.client.0.smithi050.stderr: 26600K .......... .......... .......... .......... .......... 15% 36.2M 6s 2023-10-26T06:44:53.255 INFO:tasks.workunit.client.0.smithi050.stderr: 26650K .......... .......... .......... .......... .......... 15% 21.7M 6s 2023-10-26T06:44:53.255 INFO:tasks.workunit.client.0.smithi050.stderr: 26700K .......... .......... .......... .......... .......... 15% 50.3M 6s 2023-10-26T06:44:53.255 INFO:tasks.workunit.client.0.smithi050.stderr: 26750K .......... .......... .......... .......... .......... 15% 21.2M 6s 2023-10-26T06:44:53.257 INFO:tasks.workunit.client.0.smithi050.stderr: 26800K .......... .......... .......... .......... .......... 15% 47.1M 6s 2023-10-26T06:44:53.258 INFO:tasks.workunit.client.0.smithi050.stderr: 26850K .......... .......... .......... .......... .......... 15% 24.2M 6s 2023-10-26T06:44:53.260 INFO:tasks.workunit.client.0.smithi050.stderr: 26900K .......... .......... .......... .......... .......... 15% 38.5M 6s 2023-10-26T06:44:53.262 INFO:tasks.workunit.client.0.smithi050.stderr: 26950K .......... .......... .......... .......... .......... 16% 21.7M 6s 2023-10-26T06:44:53.264 INFO:tasks.workunit.client.0.smithi050.stderr: 27000K .......... .......... .......... .......... .......... 16% 23.9M 6s 2023-10-26T06:44:53.265 INFO:tasks.workunit.client.0.smithi050.stderr: 27050K .......... .......... .......... .......... .......... 16% 51.2M 6s 2023-10-26T06:44:53.267 INFO:tasks.workunit.client.0.smithi050.stderr: 27100K .......... .......... .......... .......... .......... 16% 24.2M 6s 2023-10-26T06:44:53.268 INFO:tasks.workunit.client.0.smithi050.stderr: 27150K .......... .......... .......... .......... .......... 16% 29.7M 6s 2023-10-26T06:44:53.271 INFO:tasks.workunit.client.0.smithi050.stderr: 27200K .......... .......... .......... .......... .......... 16% 23.4M 6s 2023-10-26T06:44:53.273 INFO:tasks.workunit.client.0.smithi050.stderr: 27250K .......... .......... .......... .......... .......... 16% 25.6M 6s 2023-10-26T06:44:53.273 INFO:tasks.workunit.client.0.smithi050.stderr: 27300K .......... .......... .......... .......... .......... 16% 57.7M 6s 2023-10-26T06:44:53.276 INFO:tasks.workunit.client.0.smithi050.stderr: 27350K .......... .......... .......... .......... .......... 16% 22.8M 6s 2023-10-26T06:44:53.278 INFO:tasks.workunit.client.0.smithi050.stderr: 27400K .......... .......... .......... .......... .......... 16% 31.2M 6s 2023-10-26T06:44:53.278 INFO:tasks.workunit.client.0.smithi050.stderr: 27450K .......... .......... .......... .......... .......... 16% 31.0M 6s 2023-10-26T06:44:53.280 INFO:tasks.workunit.client.0.smithi050.stderr: 27500K .......... .......... .......... .......... .......... 16% 26.1M 6s 2023-10-26T06:44:53.282 INFO:tasks.workunit.client.0.smithi050.stderr: 27550K .......... .......... .......... .......... .......... 16% 31.4M 6s 2023-10-26T06:44:53.284 INFO:tasks.workunit.client.0.smithi050.stderr: 27600K .......... .......... .......... .......... .......... 16% 25.0M 6s 2023-10-26T06:44:53.286 INFO:tasks.workunit.client.0.smithi050.stderr: 27650K .......... .......... .......... .......... .......... 16% 22.2M 6s 2023-10-26T06:44:53.287 INFO:tasks.workunit.client.0.smithi050.stderr: 27700K .......... .......... .......... .......... .......... 16% 43.1M 6s 2023-10-26T06:44:53.290 INFO:tasks.workunit.client.0.smithi050.stderr: 27750K .......... .......... .......... .......... .......... 16% 22.4M 6s 2023-10-26T06:44:53.291 INFO:tasks.workunit.client.0.smithi050.stderr: 27800K .......... .......... .......... .......... .......... 16% 55.6M 6s 2023-10-26T06:44:53.292 INFO:tasks.workunit.client.0.smithi050.stderr: 27850K .......... .......... .......... .......... .......... 16% 25.1M 6s 2023-10-26T06:44:53.294 INFO:tasks.workunit.client.0.smithi050.stderr: 27900K .......... .......... .......... .......... .......... 16% 31.7M 6s 2023-10-26T06:44:53.296 INFO:tasks.workunit.client.0.smithi050.stderr: 27950K .......... .......... .......... .......... .......... 16% 21.3M 6s 2023-10-26T06:44:53.297 INFO:tasks.workunit.client.0.smithi050.stderr: 28000K .......... .......... .......... .......... .......... 16% 37.1M 6s 2023-10-26T06:44:53.299 INFO:tasks.workunit.client.0.smithi050.stderr: 28050K .......... .......... .......... .......... .......... 16% 22.9M 6s 2023-10-26T06:44:53.301 INFO:tasks.workunit.client.0.smithi050.stderr: 28100K .......... .......... .......... .......... .......... 16% 24.2M 6s 2023-10-26T06:44:53.302 INFO:tasks.workunit.client.0.smithi050.stderr: 28150K .......... .......... .......... .......... .......... 16% 47.5M 6s 2023-10-26T06:44:53.423 INFO:tasks.workunit.client.0.smithi050.stderr: 28200K .......... .......... .......... .......... .......... 16% 475K 7s 2023-10-26T06:44:53.423 INFO:tasks.workunit.client.0.smithi050.stderr: 28250K .......... .......... .......... .......... .......... 16% 133M 6s 2023-10-26T06:44:53.423 INFO:tasks.workunit.client.0.smithi050.stderr: 28300K .......... .......... .......... .......... .......... 16% 189M 6s 2023-10-26T06:44:53.424 INFO:tasks.workunit.client.0.smithi050.stderr: 28350K .......... .......... .......... .......... .......... 16% 222M 6s 2023-10-26T06:44:53.424 INFO:tasks.workunit.client.0.smithi050.stderr: 28400K .......... .......... .......... .......... .......... 16% 169M 6s 2023-10-26T06:44:53.424 INFO:tasks.workunit.client.0.smithi050.stderr: 28450K .......... .......... .......... .......... .......... 16% 221M 6s 2023-10-26T06:44:53.424 INFO:tasks.workunit.client.0.smithi050.stderr: 28500K .......... .......... .......... .......... .......... 16% 222M 6s 2023-10-26T06:44:53.424 INFO:tasks.workunit.client.0.smithi050.stderr: 28550K .......... .......... .......... .......... .......... 16% 221M 6s 2023-10-26T06:44:53.425 INFO:tasks.workunit.client.0.smithi050.stderr: 28600K .......... .......... .......... .......... .......... 16% 9.33M 6s 2023-10-26T06:44:53.425 INFO:tasks.workunit.client.0.smithi050.stderr: 28650K .......... .......... .......... .......... .......... 17% 214M 6s 2023-10-26T06:44:53.425 INFO:tasks.workunit.client.0.smithi050.stderr: 28700K .......... .......... .......... .......... .......... 17% 194M 6s 2023-10-26T06:44:53.425 INFO:tasks.workunit.client.0.smithi050.stderr: 28750K .......... .......... .......... .......... .......... 17% 209M 6s 2023-10-26T06:44:53.425 INFO:tasks.workunit.client.0.smithi050.stderr: 28800K .......... .......... .......... .......... .......... 17% 208M 6s 2023-10-26T06:44:53.426 INFO:tasks.workunit.client.0.smithi050.stderr: 28850K .......... .......... .......... .......... .......... 17% 214M 6s 2023-10-26T06:44:53.426 INFO:tasks.workunit.client.0.smithi050.stderr: 28900K .......... .......... .......... .......... .......... 17% 188M 6s 2023-10-26T06:44:53.426 INFO:tasks.workunit.client.0.smithi050.stderr: 28950K .......... .......... .......... .......... .......... 17% 218M 6s 2023-10-26T06:44:53.546 INFO:tasks.workunit.client.0.smithi050.stderr: 29000K .......... .......... .......... .......... .......... 17% 6.17M 6s 2023-10-26T06:44:53.547 INFO:tasks.workunit.client.0.smithi050.stderr: 29050K .......... .......... .......... .......... .......... 17% 202M 6s 2023-10-26T06:44:53.547 INFO:tasks.workunit.client.0.smithi050.stderr: 29100K .......... .......... .......... .......... .......... 17% 189M 6s 2023-10-26T06:44:53.547 INFO:tasks.workunit.client.0.smithi050.stderr: 29150K .......... .......... .......... .......... .......... 17% 220M 6s 2023-10-26T06:44:53.547 INFO:tasks.workunit.client.0.smithi050.stderr: 29200K .......... .......... .......... .......... .......... 17% 231M 6s 2023-10-26T06:44:53.548 INFO:tasks.workunit.client.0.smithi050.stderr: 29250K .......... .......... .......... .......... .......... 17% 209M 6s 2023-10-26T06:44:53.548 INFO:tasks.workunit.client.0.smithi050.stderr: 29300K .......... .......... .......... .......... .......... 17% 196M 6s 2023-10-26T06:44:53.548 INFO:tasks.workunit.client.0.smithi050.stderr: 29350K .......... .......... .......... .......... .......... 17% 229M 6s 2023-10-26T06:44:53.548 INFO:tasks.workunit.client.0.smithi050.stderr: 29400K .......... .......... .......... .......... .......... 17% 222M 6s 2023-10-26T06:44:53.548 INFO:tasks.workunit.client.0.smithi050.stderr: 29450K .......... .......... .......... .......... .......... 17% 219M 6s 2023-10-26T06:44:53.549 INFO:tasks.workunit.client.0.smithi050.stderr: 29500K .......... .......... .......... .......... .......... 17% 186M 6s 2023-10-26T06:44:53.549 INFO:tasks.workunit.client.0.smithi050.stderr: 29550K .......... .......... .......... .......... .......... 17% 223M 6s 2023-10-26T06:44:53.549 INFO:tasks.workunit.client.0.smithi050.stderr: 29600K .......... .......... .......... .......... .......... 17% 224M 6s 2023-10-26T06:44:53.549 INFO:tasks.workunit.client.0.smithi050.stderr: 29650K .......... .......... .......... .......... .......... 17% 5.25M 6s 2023-10-26T06:44:53.549 INFO:tasks.workunit.client.0.smithi050.stderr: 29700K .......... .......... .......... .......... .......... 17% 217M 6s 2023-10-26T06:44:53.550 INFO:tasks.workunit.client.0.smithi050.stderr: 29750K .......... .......... .......... .......... .......... 17% 222M 6s 2023-10-26T06:44:53.550 INFO:tasks.workunit.client.0.smithi050.stderr: 29800K .......... .......... .......... .......... .......... 17% 132M 6s 2023-10-26T06:44:53.550 INFO:tasks.workunit.client.0.smithi050.stderr: 29850K .......... .......... .......... .......... .......... 17% 182M 6s 2023-10-26T06:44:53.550 INFO:tasks.workunit.client.0.smithi050.stderr: 29900K .......... .......... .......... .......... .......... 17% 229M 6s 2023-10-26T06:44:53.550 INFO:tasks.workunit.client.0.smithi050.stderr: 29950K .......... .......... .......... .......... .......... 17% 226M 6s 2023-10-26T06:44:53.550 INFO:tasks.workunit.client.0.smithi050.stderr: 30000K .......... .......... .......... .......... .......... 17% 229M 6s 2023-10-26T06:44:53.551 INFO:tasks.workunit.client.0.smithi050.stderr: 30050K .......... .......... .......... .......... .......... 17% 186M 6s 2023-10-26T06:44:53.551 INFO:tasks.workunit.client.0.smithi050.stderr: 30100K .......... .......... .......... .......... .......... 17% 196M 6s 2023-10-26T06:44:53.551 INFO:tasks.workunit.client.0.smithi050.stderr: 30150K .......... .......... .......... .......... .......... 17% 228M 6s 2023-10-26T06:44:53.551 INFO:tasks.workunit.client.0.smithi050.stderr: 30200K .......... .......... .......... .......... .......... 17% 203M 6s 2023-10-26T06:44:53.551 INFO:tasks.workunit.client.0.smithi050.stderr: 30250K .......... .......... .......... .......... .......... 17% 184M 6s 2023-10-26T06:44:53.552 INFO:tasks.workunit.client.0.smithi050.stderr: 30300K .......... .......... .......... .......... .......... 18% 232M 6s 2023-10-26T06:44:53.552 INFO:tasks.workunit.client.0.smithi050.stderr: 30350K .......... .......... .......... .......... .......... 18% 237M 6s 2023-10-26T06:44:53.552 INFO:tasks.workunit.client.0.smithi050.stderr: 30400K .......... .......... .......... .......... .......... 18% 233M 6s 2023-10-26T06:44:53.552 INFO:tasks.workunit.client.0.smithi050.stderr: 30450K .......... .......... .......... .......... .......... 18% 197M 6s 2023-10-26T06:44:53.552 INFO:tasks.workunit.client.0.smithi050.stderr: 30500K .......... .......... .......... .......... .......... 18% 219M 6s 2023-10-26T06:44:53.553 INFO:tasks.workunit.client.0.smithi050.stderr: 30550K .......... .......... .......... .......... .......... 18% 165M 6s 2023-10-26T06:44:53.553 INFO:tasks.workunit.client.0.smithi050.stderr: 30600K .......... .......... .......... .......... .......... 18% 219M 6s 2023-10-26T06:44:53.553 INFO:tasks.workunit.client.0.smithi050.stderr: 30650K .......... .......... .......... .......... .......... 18% 200M 6s 2023-10-26T06:44:53.553 INFO:tasks.workunit.client.0.smithi050.stderr: 30700K .......... .......... .......... .......... .......... 18% 217M 6s 2023-10-26T06:44:53.553 INFO:tasks.workunit.client.0.smithi050.stderr: 30750K .......... .......... .......... .......... .......... 18% 230M 6s 2023-10-26T06:44:53.553 INFO:tasks.workunit.client.0.smithi050.stderr: 30800K .......... .......... .......... .......... .......... 18% 221M 6s 2023-10-26T06:44:53.554 INFO:tasks.workunit.client.0.smithi050.stderr: 30850K .......... .......... .......... .......... .......... 18% 199M 6s 2023-10-26T06:44:53.554 INFO:tasks.workunit.client.0.smithi050.stderr: 30900K .......... .......... .......... .......... .......... 18% 224M 6s 2023-10-26T06:44:53.554 INFO:tasks.workunit.client.0.smithi050.stderr: 30950K .......... .......... .......... .......... .......... 18% 230M 6s 2023-10-26T06:44:53.554 INFO:tasks.workunit.client.0.smithi050.stderr: 31000K .......... .......... .......... .......... .......... 18% 224M 6s 2023-10-26T06:44:53.554 INFO:tasks.workunit.client.0.smithi050.stderr: 31050K .......... .......... .......... .......... .......... 18% 192M 6s 2023-10-26T06:44:53.555 INFO:tasks.workunit.client.0.smithi050.stderr: 31100K .......... .......... .......... .......... .......... 18% 227M 6s 2023-10-26T06:44:53.555 INFO:tasks.workunit.client.0.smithi050.stderr: 31150K .......... .......... .......... .......... .......... 18% 222M 6s 2023-10-26T06:44:53.555 INFO:tasks.workunit.client.0.smithi050.stderr: 31200K .......... .......... .......... .......... .......... 18% 211M 6s 2023-10-26T06:44:53.555 INFO:tasks.workunit.client.0.smithi050.stderr: 31250K .......... .......... .......... .......... .......... 18% 199M 6s 2023-10-26T06:44:53.555 INFO:tasks.workunit.client.0.smithi050.stderr: 31300K .......... .......... .......... .......... .......... 18% 228M 6s 2023-10-26T06:44:53.555 INFO:tasks.workunit.client.0.smithi050.stderr: 31350K .......... .......... .......... .......... .......... 18% 226M 6s 2023-10-26T06:44:53.556 INFO:tasks.workunit.client.0.smithi050.stderr: 31400K .......... .......... .......... .......... .......... 18% 228M 6s 2023-10-26T06:44:53.556 INFO:tasks.workunit.client.0.smithi050.stderr: 31450K .......... .......... .......... .......... .......... 18% 195M 6s 2023-10-26T06:44:53.556 INFO:tasks.workunit.client.0.smithi050.stderr: 31500K .......... .......... .......... .......... .......... 18% 235M 6s 2023-10-26T06:44:53.556 INFO:tasks.workunit.client.0.smithi050.stderr: 31550K .......... .......... .......... .......... .......... 18% 230M 6s 2023-10-26T06:44:53.556 INFO:tasks.workunit.client.0.smithi050.stderr: 31600K .......... .......... .......... .......... .......... 18% 224M 6s 2023-10-26T06:44:53.557 INFO:tasks.workunit.client.0.smithi050.stderr: 31650K .......... .......... .......... .......... .......... 18% 203M 6s 2023-10-26T06:44:53.557 INFO:tasks.workunit.client.0.smithi050.stderr: 31700K .......... .......... .......... .......... .......... 18% 214M 6s 2023-10-26T06:44:53.557 INFO:tasks.workunit.client.0.smithi050.stderr: 31750K .......... .......... .......... .......... .......... 18% 219M 6s 2023-10-26T06:44:53.557 INFO:tasks.workunit.client.0.smithi050.stderr: 31800K .......... .......... .......... .......... .......... 18% 205M 6s 2023-10-26T06:44:53.557 INFO:tasks.workunit.client.0.smithi050.stderr: 31850K .......... .......... .......... .......... .......... 18% 199M 6s 2023-10-26T06:44:53.557 INFO:tasks.workunit.client.0.smithi050.stderr: 31900K .......... .......... .......... .......... .......... 18% 235M 6s 2023-10-26T06:44:53.558 INFO:tasks.workunit.client.0.smithi050.stderr: 31950K .......... .......... .......... .......... .......... 18% 232M 6s 2023-10-26T06:44:53.558 INFO:tasks.workunit.client.0.smithi050.stderr: 32000K .......... .......... .......... .......... .......... 19% 226M 6s 2023-10-26T06:44:53.558 INFO:tasks.workunit.client.0.smithi050.stderr: 32050K .......... .......... .......... .......... .......... 19% 190M 6s 2023-10-26T06:44:53.558 INFO:tasks.workunit.client.0.smithi050.stderr: 32100K .......... .......... .......... .......... .......... 19% 233M 6s 2023-10-26T06:44:53.558 INFO:tasks.workunit.client.0.smithi050.stderr: 32150K .......... .......... .......... .......... .......... 19% 1.86M 6s 2023-10-26T06:44:53.559 INFO:tasks.workunit.client.0.smithi050.stderr: 32200K .......... .......... .......... .......... .......... 19% 180M 6s 2023-10-26T06:44:53.559 INFO:tasks.workunit.client.0.smithi050.stderr: 32250K .......... .......... .......... .......... .......... 19% 156M 6s 2023-10-26T06:44:53.559 INFO:tasks.workunit.client.0.smithi050.stderr: 32300K .......... .......... .......... .......... .......... 19% 176M 6s 2023-10-26T06:44:53.559 INFO:tasks.workunit.client.0.smithi050.stderr: 32350K .......... .......... .......... .......... .......... 19% 174M 6s 2023-10-26T06:44:53.559 INFO:tasks.workunit.client.0.smithi050.stderr: 32400K .......... .......... .......... .......... .......... 19% 121M 6s 2023-10-26T06:44:53.559 INFO:tasks.workunit.client.0.smithi050.stderr: 32450K .......... .......... .......... .......... .......... 19% 109M 6s 2023-10-26T06:44:53.560 INFO:tasks.workunit.client.0.smithi050.stderr: 32500K .......... .......... .......... .......... .......... 19% 85.8M 6s 2023-10-26T06:44:53.560 INFO:tasks.workunit.client.0.smithi050.stderr: 32550K .......... .......... .......... .......... .......... 19% 24.9M 6s 2023-10-26T06:44:53.560 INFO:tasks.workunit.client.0.smithi050.stderr: 32600K .......... .......... .......... .......... .......... 19% 45.3M 6s 2023-10-26T06:44:53.560 INFO:tasks.workunit.client.0.smithi050.stderr: 32650K .......... .......... .......... .......... .......... 19% 23.9M 6s 2023-10-26T06:44:53.560 INFO:tasks.workunit.client.0.smithi050.stderr: 32700K .......... .......... .......... .......... .......... 19% 24.1M 6s 2023-10-26T06:44:53.561 INFO:tasks.workunit.client.0.smithi050.stderr: 32750K .......... .......... .......... .......... .......... 19% 38.6M 6s 2023-10-26T06:44:53.561 INFO:tasks.workunit.client.0.smithi050.stderr: 32800K .......... .......... .......... .......... .......... 19% 23.2M 6s 2023-10-26T06:44:53.561 INFO:tasks.workunit.client.0.smithi050.stderr: 32850K .......... .......... .......... .......... .......... 19% 38.8M 6s 2023-10-26T06:44:53.561 INFO:tasks.workunit.client.0.smithi050.stderr: 32900K .......... .......... .......... .......... .......... 19% 30.7M 6s 2023-10-26T06:44:53.561 INFO:tasks.workunit.client.0.smithi050.stderr: 32950K .......... .......... .......... .......... .......... 19% 21.4M 6s 2023-10-26T06:44:53.561 INFO:tasks.workunit.client.0.smithi050.stderr: 33000K .......... .......... .......... .......... .......... 19% 24.9M 6s 2023-10-26T06:44:53.562 INFO:tasks.workunit.client.0.smithi050.stderr: 33050K .......... .......... .......... .......... .......... 19% 25.2M 6s 2023-10-26T06:44:53.562 INFO:tasks.workunit.client.0.smithi050.stderr: 33100K .......... .......... .......... .......... .......... 19% 113M 6s 2023-10-26T06:44:53.562 INFO:tasks.workunit.client.0.smithi050.stderr: 33150K .......... .......... .......... .......... .......... 19% 25.3M 6s 2023-10-26T06:44:53.562 INFO:tasks.workunit.client.0.smithi050.stderr: 33200K .......... .......... .......... .......... .......... 19% 21.9M 6s 2023-10-26T06:44:53.562 INFO:tasks.workunit.client.0.smithi050.stderr: 33250K .......... .......... .......... .......... .......... 19% 26.9M 6s 2023-10-26T06:44:53.563 INFO:tasks.workunit.client.0.smithi050.stderr: 33300K .......... .......... .......... .......... .......... 19% 23.6M 6s 2023-10-26T06:44:53.563 INFO:tasks.workunit.client.0.smithi050.stderr: 33350K .......... .......... .......... .......... .......... 19% 144M 6s 2023-10-26T06:44:53.563 INFO:tasks.workunit.client.0.smithi050.stderr: 33400K .......... .......... .......... .......... .......... 19% 25.0M 6s 2023-10-26T06:44:53.563 INFO:tasks.workunit.client.0.smithi050.stderr: 33450K .......... .......... .......... .......... .......... 19% 25.2M 6s 2023-10-26T06:44:53.563 INFO:tasks.workunit.client.0.smithi050.stderr: 33500K .......... .......... .......... .......... .......... 19% 25.0M 6s 2023-10-26T06:44:53.564 INFO:tasks.workunit.client.0.smithi050.stderr: 33550K .......... .......... .......... .......... .......... 19% 24.6M 6s 2023-10-26T06:44:53.564 INFO:tasks.workunit.client.0.smithi050.stderr: 33600K .......... .......... .......... .......... .......... 19% 101M 6s 2023-10-26T06:44:53.564 INFO:tasks.workunit.client.0.smithi050.stderr: 33650K .......... .......... .......... .......... .......... 19% 25.3M 6s 2023-10-26T06:44:53.564 INFO:tasks.workunit.client.0.smithi050.stderr: 33700K .......... .......... .......... .......... .......... 20% 24.4M 6s 2023-10-26T06:44:53.564 INFO:tasks.workunit.client.0.smithi050.stderr: 33750K .......... .......... .......... .......... .......... 20% 24.7M 6s 2023-10-26T06:44:53.564 INFO:tasks.workunit.client.0.smithi050.stderr: 33800K .......... .......... .......... .......... .......... 20% 44.6M 6s 2023-10-26T06:44:53.565 INFO:tasks.workunit.client.0.smithi050.stderr: 33850K .......... .......... .......... .......... .......... 20% 31.2M 6s 2023-10-26T06:44:53.565 INFO:tasks.workunit.client.0.smithi050.stderr: 33900K .......... .......... .......... .......... .......... 20% 25.9M 6s 2023-10-26T06:44:53.565 INFO:tasks.workunit.client.0.smithi050.stderr: 33950K .......... .......... .......... .......... .......... 20% 21.5M 6s 2023-10-26T06:44:53.565 INFO:tasks.workunit.client.0.smithi050.stderr: 34000K .......... .......... .......... .......... .......... 20% 27.6M 6s 2023-10-26T06:44:53.565 INFO:tasks.workunit.client.0.smithi050.stderr: 34050K .......... .......... .......... .......... .......... 20% 24.2M 6s 2023-10-26T06:44:53.566 INFO:tasks.workunit.client.0.smithi050.stderr: 34100K .......... .......... .......... .......... .......... 20% 114M 6s 2023-10-26T06:44:53.566 INFO:tasks.workunit.client.0.smithi050.stderr: 34150K .......... .......... .......... .......... .......... 20% 25.5M 6s 2023-10-26T06:44:53.566 INFO:tasks.workunit.client.0.smithi050.stderr: 34200K .......... .......... .......... .......... .......... 20% 24.8M 6s 2023-10-26T06:44:53.566 INFO:tasks.workunit.client.0.smithi050.stderr: 34250K .......... .......... .......... .......... .......... 20% 33.1M 6s 2023-10-26T06:44:53.566 INFO:tasks.workunit.client.0.smithi050.stderr: 34300K .......... .......... .......... .......... .......... 20% 24.4M 6s 2023-10-26T06:44:53.567 INFO:tasks.workunit.client.0.smithi050.stderr: 34350K .......... .......... .......... .......... .......... 20% 50.1M 6s 2023-10-26T06:44:53.569 INFO:tasks.workunit.client.0.smithi050.stderr: 34400K .......... .......... .......... .......... .......... 20% 24.4M 6s 2023-10-26T06:44:53.569 INFO:tasks.workunit.client.0.smithi050.stderr: 34450K .......... .......... .......... .......... .......... 20% 35.1M 6s 2023-10-26T06:44:53.569 INFO:tasks.workunit.client.0.smithi050.stderr: 34500K .......... .......... .......... .......... .......... 20% 23.6M 6s 2023-10-26T06:44:53.569 INFO:tasks.workunit.client.0.smithi050.stderr: 34550K .......... .......... .......... .......... .......... 20% 27.9M 6s 2023-10-26T06:44:53.569 INFO:tasks.workunit.client.0.smithi050.stderr: 34600K .......... .......... .......... .......... .......... 20% 40.9M 6s 2023-10-26T06:44:53.606 INFO:tasks.workunit.client.0.smithi050.stderr: 34650K .......... .......... .......... .......... .......... 20% 25.3M 6s 2023-10-26T06:44:53.606 INFO:tasks.workunit.client.0.smithi050.stderr: 34700K .......... .......... .......... .......... .......... 20% 26.4M 6s 2023-10-26T06:44:53.607 INFO:tasks.workunit.client.0.smithi050.stderr: 34750K .......... .......... .......... .......... .......... 20% 24.9M 6s 2023-10-26T06:44:53.607 INFO:tasks.workunit.client.0.smithi050.stderr: 34800K .......... .......... .......... .......... .......... 20% 26.3M 6s 2023-10-26T06:44:53.607 INFO:tasks.workunit.client.0.smithi050.stderr: 34850K .......... .......... .......... .......... .......... 20% 20.3M 6s 2023-10-26T06:44:53.607 INFO:tasks.workunit.client.0.smithi050.stderr: 34900K .......... .......... .......... .......... .......... 20% 16.9M 6s 2023-10-26T06:44:53.607 INFO:tasks.workunit.client.0.smithi050.stderr: 34950K .......... .......... .......... .......... .......... 20% 22.3M 6s 2023-10-26T06:44:53.608 INFO:tasks.workunit.client.0.smithi050.stderr: 35000K .......... .......... .......... .......... .......... 20% 29.6M 6s 2023-10-26T06:44:53.608 INFO:tasks.workunit.client.0.smithi050.stderr: 35050K .......... .......... .......... .......... .......... 20% 21.3M 6s 2023-10-26T06:44:53.608 INFO:tasks.workunit.client.0.smithi050.stderr: 35100K .......... .......... .......... .......... .......... 20% 38.3M 6s 2023-10-26T06:44:53.608 INFO:tasks.workunit.client.0.smithi050.stderr: 35150K .......... .......... .......... .......... .......... 20% 24.4M 6s 2023-10-26T06:44:53.608 INFO:tasks.workunit.client.0.smithi050.stderr: 35200K .......... .......... .......... .......... .......... 20% 32.7M 6s 2023-10-26T06:44:53.609 INFO:tasks.workunit.client.0.smithi050.stderr: 35250K .......... .......... .......... .......... .......... 20% 28.5M 6s 2023-10-26T06:44:53.609 INFO:tasks.workunit.client.0.smithi050.stderr: 35300K .......... .......... .......... .......... .......... 20% 25.5M 6s 2023-10-26T06:44:53.609 INFO:tasks.workunit.client.0.smithi050.stderr: 35350K .......... .......... .......... .......... .......... 21% 38.8M 6s 2023-10-26T06:44:53.609 INFO:tasks.workunit.client.0.smithi050.stderr: 35400K .......... .......... .......... .......... .......... 21% 21.9M 6s 2023-10-26T06:44:53.609 INFO:tasks.workunit.client.0.smithi050.stderr: 35450K .......... .......... .......... .......... .......... 21% 30.4M 6s 2023-10-26T06:44:53.610 INFO:tasks.workunit.client.0.smithi050.stderr: 35500K .......... .......... .......... .......... .......... 21% 32.0M 6s 2023-10-26T06:44:53.610 INFO:tasks.workunit.client.0.smithi050.stderr: 35550K .......... .......... .......... .......... .......... 21% 27.5M 6s 2023-10-26T06:44:53.610 INFO:tasks.workunit.client.0.smithi050.stderr: 35600K .......... .......... .......... .......... .......... 21% 27.7M 6s 2023-10-26T06:44:53.610 INFO:tasks.workunit.client.0.smithi050.stderr: 35650K .......... .......... .......... .......... .......... 21% 25.7M 6s 2023-10-26T06:44:53.610 INFO:tasks.workunit.client.0.smithi050.stderr: 35700K .......... .......... .......... .......... .......... 21% 28.0M 6s 2023-10-26T06:44:53.610 INFO:tasks.workunit.client.0.smithi050.stderr: 35750K .......... .......... .......... .......... .......... 21% 25.0M 6s 2023-10-26T06:44:53.611 INFO:tasks.workunit.client.0.smithi050.stderr: 35800K .......... .......... .......... .......... .......... 21% 25.2M 6s 2023-10-26T06:44:53.611 INFO:tasks.workunit.client.0.smithi050.stderr: 35850K .......... .......... .......... .......... .......... 21% 52.0M 6s 2023-10-26T06:44:53.611 INFO:tasks.workunit.client.0.smithi050.stderr: 35900K .......... .......... .......... .......... .......... 21% 23.7M 6s 2023-10-26T06:44:53.611 INFO:tasks.workunit.client.0.smithi050.stderr: 35950K .......... .......... .......... .......... .......... 21% 28.8M 6s 2023-10-26T06:44:53.611 INFO:tasks.workunit.client.0.smithi050.stderr: 36000K .......... .......... .......... .......... .......... 21% 21.8M 6s 2023-10-26T06:44:53.612 INFO:tasks.workunit.client.0.smithi050.stderr: 36050K .......... .......... .......... .......... .......... 21% 24.4M 6s 2023-10-26T06:44:53.612 INFO:tasks.workunit.client.0.smithi050.stderr: 36100K .......... .......... .......... .......... .......... 21% 59.2M 6s 2023-10-26T06:44:53.612 INFO:tasks.workunit.client.0.smithi050.stderr: 36150K .......... .......... .......... .......... .......... 21% 26.3M 6s 2023-10-26T06:44:53.612 INFO:tasks.workunit.client.0.smithi050.stderr: 36200K .......... .......... .......... .......... .......... 21% 25.0M 6s 2023-10-26T06:44:53.624 INFO:tasks.workunit.client.0.smithi050.stderr: 36250K .......... .......... .......... .......... .......... 21% 28.8M 5s 2023-10-26T06:44:53.625 INFO:tasks.workunit.client.0.smithi050.stderr: 36300K .......... .......... .......... .......... .......... 21% 24.4M 5s 2023-10-26T06:44:53.625 INFO:tasks.workunit.client.0.smithi050.stderr: 36350K .......... .......... .......... .......... .......... 21% 24.7M 5s 2023-10-26T06:44:53.625 INFO:tasks.workunit.client.0.smithi050.stderr: 36400K .......... .......... .......... .......... .......... 21% 66.6M 5s 2023-10-26T06:44:53.625 INFO:tasks.workunit.client.0.smithi050.stderr: 36450K .......... .......... .......... .......... .......... 21% 25.2M 5s 2023-10-26T06:44:53.626 INFO:tasks.workunit.client.0.smithi050.stderr: 36500K .......... .......... .......... .......... .......... 21% 24.4M 5s 2023-10-26T06:44:53.626 INFO:tasks.workunit.client.0.smithi050.stderr: 36550K .......... .......... .......... .......... .......... 21% 31.7M 5s 2023-10-26T06:44:53.626 INFO:tasks.workunit.client.0.smithi050.stderr: 36600K .......... .......... .......... .......... .......... 21% 24.9M 5s 2023-10-26T06:44:53.626 INFO:tasks.workunit.client.0.smithi050.stderr: 36650K .......... .......... .......... .......... .......... 21% 40.9M 5s 2023-10-26T06:44:53.626 INFO:tasks.workunit.client.0.smithi050.stderr: 36700K .......... .......... .......... .......... .......... 21% 26.7M 5s 2023-10-26T06:44:53.627 INFO:tasks.workunit.client.0.smithi050.stderr: 36750K .......... .......... .......... .......... .......... 21% 32.5M 5s 2023-10-26T06:44:53.629 INFO:tasks.workunit.client.0.smithi050.stderr: 36800K .......... .......... .......... .......... .......... 21% 24.6M 5s 2023-10-26T06:44:53.629 INFO:tasks.workunit.client.0.smithi050.stderr: 36850K .......... .......... .......... .......... .......... 21% 23.4M 5s 2023-10-26T06:44:53.630 INFO:tasks.workunit.client.0.smithi050.stderr: 36900K .......... .......... .......... .......... .......... 21% 47.2M 5s 2023-10-26T06:44:53.632 INFO:tasks.workunit.client.0.smithi050.stderr: 36950K .......... .......... .......... .......... .......... 21% 17.3M 5s 2023-10-26T06:44:53.635 INFO:tasks.workunit.client.0.smithi050.stderr: 37000K .......... .......... .......... .......... .......... 21% 28.9M 5s 2023-10-26T06:44:53.635 INFO:tasks.workunit.client.0.smithi050.stderr: 37050K .......... .......... .......... .......... .......... 22% 56.6M 5s 2023-10-26T06:44:53.636 INFO:tasks.workunit.client.0.smithi050.stderr: 37100K .......... .......... .......... .......... .......... 22% 25.0M 5s 2023-10-26T06:44:53.637 INFO:tasks.workunit.client.0.smithi050.stderr: 37150K .......... .......... .......... .......... .......... 22% 42.5M 5s 2023-10-26T06:44:53.639 INFO:tasks.workunit.client.0.smithi050.stderr: 37200K .......... .......... .......... .......... .......... 22% 23.4M 5s 2023-10-26T06:44:53.640 INFO:tasks.workunit.client.0.smithi050.stderr: 37250K .......... .......... .......... .......... .......... 22% 40.6M 5s 2023-10-26T06:44:53.644 INFO:tasks.workunit.client.0.smithi050.stderr: 37300K .......... .......... .......... .......... .......... 22% 20.7M 5s 2023-10-26T06:44:53.645 INFO:tasks.workunit.client.0.smithi050.stderr: 37350K .......... .......... .......... .......... .......... 22% 28.0M 5s 2023-10-26T06:44:53.646 INFO:tasks.workunit.client.0.smithi050.stderr: 37400K .......... .......... .......... .......... .......... 22% 32.2M 5s 2023-10-26T06:44:53.648 INFO:tasks.workunit.client.0.smithi050.stderr: 37450K .......... .......... .......... .......... .......... 22% 24.8M 5s 2023-10-26T06:44:53.651 INFO:tasks.workunit.client.0.smithi050.stderr: 37500K .......... .......... .......... .......... .......... 22% 40.2M 5s 2023-10-26T06:44:53.653 INFO:tasks.workunit.client.0.smithi050.stderr: 37550K .......... .......... .......... .......... .......... 22% 24.5M 5s 2023-10-26T06:44:53.654 INFO:tasks.workunit.client.0.smithi050.stderr: 37600K .......... .......... .......... .......... .......... 22% 24.6M 5s 2023-10-26T06:44:53.655 INFO:tasks.workunit.client.0.smithi050.stderr: 37650K .......... .......... .......... .......... .......... 22% 42.1M 5s 2023-10-26T06:44:53.657 INFO:tasks.workunit.client.0.smithi050.stderr: 37700K .......... .......... .......... .......... .......... 22% 24.8M 5s 2023-10-26T06:44:53.659 INFO:tasks.workunit.client.0.smithi050.stderr: 37750K .......... .......... .......... .......... .......... 22% 35.3M 5s 2023-10-26T06:44:53.660 INFO:tasks.workunit.client.0.smithi050.stderr: 37800K .......... .......... .......... .......... .......... 22% 24.7M 5s 2023-10-26T06:44:53.661 INFO:tasks.workunit.client.0.smithi050.stderr: 37850K .......... .......... .......... .......... .......... 22% 48.7M 5s 2023-10-26T06:44:53.663 INFO:tasks.workunit.client.0.smithi050.stderr: 37900K .......... .......... .......... .......... .......... 22% 24.7M 5s 2023-10-26T06:44:53.665 INFO:tasks.workunit.client.0.smithi050.stderr: 37950K .......... .......... .......... .......... .......... 22% 24.4M 5s 2023-10-26T06:44:53.667 INFO:tasks.workunit.client.0.smithi050.stderr: 38000K .......... .......... .......... .......... .......... 22% 32.4M 5s 2023-10-26T06:44:53.669 INFO:tasks.workunit.client.0.smithi050.stderr: 38050K .......... .......... .......... .......... .......... 22% 24.2M 5s 2023-10-26T06:44:53.670 INFO:tasks.workunit.client.0.smithi050.stderr: 38100K .......... .......... .......... .......... .......... 22% 49.7M 5s 2023-10-26T06:44:53.671 INFO:tasks.workunit.client.0.smithi050.stderr: 38150K .......... .......... .......... .......... .......... 22% 26.5M 5s 2023-10-26T06:44:53.673 INFO:tasks.workunit.client.0.smithi050.stderr: 38200K .......... .......... .......... .......... .......... 22% 24.5M 5s 2023-10-26T06:44:53.676 INFO:tasks.workunit.client.0.smithi050.stderr: 38250K .......... .......... .......... .......... .......... 22% 24.6M 5s 2023-10-26T06:44:53.677 INFO:tasks.workunit.client.0.smithi050.stderr: 38300K .......... .......... .......... .......... .......... 22% 31.1M 5s 2023-10-26T06:44:53.679 INFO:tasks.workunit.client.0.smithi050.stderr: 38350K .......... .......... .......... .......... .......... 22% 23.3M 5s 2023-10-26T06:44:53.680 INFO:tasks.workunit.client.0.smithi050.stderr: 38400K .......... .......... .......... .......... .......... 22% 41.6M 5s 2023-10-26T06:44:53.683 INFO:tasks.workunit.client.0.smithi050.stderr: 38450K .......... .......... .......... .......... .......... 22% 26.6M 5s 2023-10-26T06:44:53.685 INFO:tasks.workunit.client.0.smithi050.stderr: 38500K .......... .......... .......... .......... .......... 22% 21.4M 5s 2023-10-26T06:44:53.687 INFO:tasks.workunit.client.0.smithi050.stderr: 38550K .......... .......... .......... .......... .......... 22% 21.5M 5s 2023-10-26T06:44:53.688 INFO:tasks.workunit.client.0.smithi050.stderr: 38600K .......... .......... .......... .......... .......... 22% 50.7M 5s 2023-10-26T06:44:53.689 INFO:tasks.workunit.client.0.smithi050.stderr: 38650K .......... .......... .......... .......... .......... 22% 28.1M 5s 2023-10-26T06:44:53.691 INFO:tasks.workunit.client.0.smithi050.stderr: 38700K .......... .......... .......... .......... .......... 22% 24.4M 5s 2023-10-26T06:44:53.693 INFO:tasks.workunit.client.0.smithi050.stderr: 38750K .......... .......... .......... .......... .......... 23% 28.2M 5s 2023-10-26T06:44:53.695 INFO:tasks.workunit.client.0.smithi050.stderr: 38800K .......... .......... .......... .......... .......... 23% 24.7M 5s 2023-10-26T06:44:53.696 INFO:tasks.workunit.client.0.smithi050.stderr: 38850K .......... .......... .......... .......... .......... 23% 30.1M 5s 2023-10-26T06:44:53.698 INFO:tasks.workunit.client.0.smithi050.stderr: 38900K .......... .......... .......... .......... .......... 23% 36.2M 5s 2023-10-26T06:44:53.700 INFO:tasks.workunit.client.0.smithi050.stderr: 38950K .......... .......... .......... .......... .......... 23% 24.2M 5s 2023-10-26T06:44:53.701 INFO:tasks.workunit.client.0.smithi050.stderr: 39000K .......... .......... .......... .......... .......... 23% 32.2M 5s 2023-10-26T06:44:53.703 INFO:tasks.workunit.client.0.smithi050.stderr: 39050K .......... .......... .......... .......... .......... 23% 27.5M 5s 2023-10-26T06:44:53.705 INFO:tasks.workunit.client.0.smithi050.stderr: 39100K .......... .......... .......... .......... .......... 23% 25.3M 5s 2023-10-26T06:44:53.706 INFO:tasks.workunit.client.0.smithi050.stderr: 39150K .......... .......... .......... .......... .......... 23% 42.0M 5s 2023-10-26T06:44:53.708 INFO:tasks.workunit.client.0.smithi050.stderr: 39200K .......... .......... .......... .......... .......... 23% 22.4M 5s 2023-10-26T06:44:53.714 INFO:tasks.workunit.client.0.smithi050.stderr: 39250K .......... .......... .......... .......... .......... 23% 23.0M 5s 2023-10-26T06:44:53.714 INFO:tasks.workunit.client.0.smithi050.stderr: 39300K .......... .......... .......... .......... .......... 23% 44.2M 5s 2023-10-26T06:44:53.714 INFO:tasks.workunit.client.0.smithi050.stderr: 39350K .......... .......... .......... .......... .......... 23% 23.8M 5s 2023-10-26T06:44:53.718 INFO:tasks.workunit.client.0.smithi050.stderr: 39400K .......... .......... .......... .......... .......... 23% 41.1M 5s 2023-10-26T06:44:53.718 INFO:tasks.workunit.client.0.smithi050.stderr: 39450K .......... .......... .......... .......... .......... 23% 24.3M 5s 2023-10-26T06:44:53.720 INFO:tasks.workunit.client.0.smithi050.stderr: 39500K .......... .......... .......... .......... .......... 23% 24.6M 5s 2023-10-26T06:44:53.720 INFO:tasks.workunit.client.0.smithi050.stderr: 39550K .......... .......... .......... .......... .......... 23% 43.8M 5s 2023-10-26T06:44:53.722 INFO:tasks.workunit.client.0.smithi050.stderr: 39600K .......... .......... .......... .......... .......... 23% 22.5M 5s 2023-10-26T06:44:53.724 INFO:tasks.workunit.client.0.smithi050.stderr: 39650K .......... .......... .......... .......... .......... 23% 38.8M 5s 2023-10-26T06:44:53.727 INFO:tasks.workunit.client.0.smithi050.stderr: 39700K .......... .......... .......... .......... .......... 23% 20.7M 5s 2023-10-26T06:44:53.728 INFO:tasks.workunit.client.0.smithi050.stderr: 39750K .......... .......... .......... .......... .......... 23% 24.5M 5s 2023-10-26T06:44:53.729 INFO:tasks.workunit.client.0.smithi050.stderr: 39800K .......... .......... .......... .......... .......... 23% 39.7M 5s 2023-10-26T06:44:53.732 INFO:tasks.workunit.client.0.smithi050.stderr: 39850K .......... .......... .......... .......... .......... 23% 23.3M 5s 2023-10-26T06:44:53.732 INFO:tasks.workunit.client.0.smithi050.stderr: 39900K .......... .......... .......... .......... .......... 23% 44.2M 5s 2023-10-26T06:44:53.734 INFO:tasks.workunit.client.0.smithi050.stderr: 39950K .......... .......... .......... .......... .......... 23% 24.5M 5s 2023-10-26T06:44:53.736 INFO:tasks.workunit.client.0.smithi050.stderr: 40000K .......... .......... .......... .......... .......... 23% 36.6M 5s 2023-10-26T06:44:53.737 INFO:tasks.workunit.client.0.smithi050.stderr: 40050K .......... .......... .......... .......... .......... 23% 29.3M 5s 2023-10-26T06:44:53.739 INFO:tasks.workunit.client.0.smithi050.stderr: 40100K .......... .......... .......... .......... .......... 23% 24.6M 5s 2023-10-26T06:44:53.740 INFO:tasks.workunit.client.0.smithi050.stderr: 40150K .......... .......... .......... .......... .......... 23% 39.2M 5s 2023-10-26T06:44:53.742 INFO:tasks.workunit.client.0.smithi050.stderr: 40200K .......... .......... .......... .......... .......... 23% 23.4M 5s 2023-10-26T06:44:53.745 INFO:tasks.workunit.client.0.smithi050.stderr: 40250K .......... .......... .......... .......... .......... 23% 24.1M 5s 2023-10-26T06:44:53.746 INFO:tasks.workunit.client.0.smithi050.stderr: 40300K .......... .......... .......... .......... .......... 23% 42.3M 5s 2023-10-26T06:44:53.748 INFO:tasks.workunit.client.0.smithi050.stderr: 40350K .......... .......... .......... .......... .......... 23% 22.7M 5s 2023-10-26T06:44:53.749 INFO:tasks.workunit.client.0.smithi050.stderr: 40400K .......... .......... .......... .......... .......... 23% 47.4M 5s 2023-10-26T06:44:53.751 INFO:tasks.workunit.client.0.smithi050.stderr: 40450K .......... .......... .......... .......... .......... 24% 30.4M 5s 2023-10-26T06:44:53.753 INFO:tasks.workunit.client.0.smithi050.stderr: 40500K .......... .......... .......... .......... .......... 24% 19.9M 5s 2023-10-26T06:44:53.754 INFO:tasks.workunit.client.0.smithi050.stderr: 40550K .......... .......... .......... .......... .......... 24% 42.6M 5s 2023-10-26T06:44:53.757 INFO:tasks.workunit.client.0.smithi050.stderr: 40600K .......... .......... .......... .......... .......... 24% 23.1M 5s 2023-10-26T06:44:53.757 INFO:tasks.workunit.client.0.smithi050.stderr: 40650K .......... .......... .......... .......... .......... 24% 54.9M 5s 2023-10-26T06:44:53.767 INFO:tasks.workunit.client.0.smithi050.stderr: 40700K .......... .......... .......... .......... .......... 24% 25.8M 5s 2023-10-26T06:44:53.767 INFO:tasks.workunit.client.0.smithi050.stderr: 40750K .......... .......... .......... .......... .......... 24% 21.4M 5s 2023-10-26T06:44:53.767 INFO:tasks.workunit.client.0.smithi050.stderr: 40800K .......... .......... .......... .......... .......... 24% 31.9M 5s 2023-10-26T06:44:53.768 INFO:tasks.workunit.client.0.smithi050.stderr: 40850K .......... .......... .......... .......... .......... 24% 26.5M 5s 2023-10-26T06:44:53.768 INFO:tasks.workunit.client.0.smithi050.stderr: 40900K .......... .......... .......... .......... .......... 24% 40.8M 5s 2023-10-26T06:44:53.771 INFO:tasks.workunit.client.0.smithi050.stderr: 40950K .......... .......... .......... .......... .......... 24% 17.7M 5s 2023-10-26T06:44:53.771 INFO:tasks.workunit.client.0.smithi050.stderr: 41000K .......... .......... .......... .......... .......... 24% 25.3M 5s 2023-10-26T06:44:53.773 INFO:tasks.workunit.client.0.smithi050.stderr: 41050K .......... .......... .......... .......... .......... 24% 30.8M 5s 2023-10-26T06:44:53.779 INFO:tasks.workunit.client.0.smithi050.stderr: 41100K .......... .......... .......... .......... .......... 24% 13.9M 5s 2023-10-26T06:44:53.779 INFO:tasks.workunit.client.0.smithi050.stderr: 41150K .......... .......... .......... .......... .......... 24% 196M 5s 2023-10-26T06:44:53.780 INFO:tasks.workunit.client.0.smithi050.stderr: 41200K .......... .......... .......... .......... .......... 24% 50.5M 5s 2023-10-26T06:44:53.780 INFO:tasks.workunit.client.0.smithi050.stderr: 41250K .......... .......... .......... .......... .......... 24% 23.0M 5s 2023-10-26T06:44:53.782 INFO:tasks.workunit.client.0.smithi050.stderr: 41300K .......... .......... .......... .......... .......... 24% 37.4M 5s 2023-10-26T06:44:53.786 INFO:tasks.workunit.client.0.smithi050.stderr: 41350K .......... .......... .......... .......... .......... 24% 19.1M 5s 2023-10-26T06:44:53.786 INFO:tasks.workunit.client.0.smithi050.stderr: 41400K .......... .......... .......... .......... .......... 24% 30.4M 5s 2023-10-26T06:44:53.786 INFO:tasks.workunit.client.0.smithi050.stderr: 41450K .......... .......... .......... .......... .......... 24% 55.2M 5s 2023-10-26T06:44:53.789 INFO:tasks.workunit.client.0.smithi050.stderr: 41500K .......... .......... .......... .......... .......... 24% 31.8M 5s 2023-10-26T06:44:53.790 INFO:tasks.workunit.client.0.smithi050.stderr: 41550K .......... .......... .......... .......... .......... 24% 24.2M 5s 2023-10-26T06:44:53.792 INFO:tasks.workunit.client.0.smithi050.stderr: 41600K .......... .......... .......... .......... .......... 24% 28.4M 5s 2023-10-26T06:44:53.794 INFO:tasks.workunit.client.0.smithi050.stderr: 41650K .......... .......... .......... .......... .......... 24% 15.4M 5s 2023-10-26T06:44:53.795 INFO:tasks.workunit.client.0.smithi050.stderr: 41700K .......... .......... .......... .......... .......... 24% 36.1M 5s 2023-10-26T06:44:53.806 INFO:tasks.workunit.client.0.smithi050.stderr: 41750K .......... .......... .......... .......... .......... 24% 23.3M 5s 2023-10-26T06:44:53.806 INFO:tasks.workunit.client.0.smithi050.stderr: 41800K .......... .......... .......... .......... .......... 24% 31.5M 5s 2023-10-26T06:44:53.806 INFO:tasks.workunit.client.0.smithi050.stderr: 41850K .......... .......... .......... .......... .......... 24% 102M 5s 2023-10-26T06:44:53.807 INFO:tasks.workunit.client.0.smithi050.stderr: 41900K .......... .......... .......... .......... .......... 24% 28.4M 5s 2023-10-26T06:44:53.807 INFO:tasks.workunit.client.0.smithi050.stderr: 41950K .......... .......... .......... .......... .......... 24% 39.1M 5s 2023-10-26T06:44:53.807 INFO:tasks.workunit.client.0.smithi050.stderr: 42000K .......... .......... .......... .......... .......... 24% 34.4M 5s 2023-10-26T06:44:53.809 INFO:tasks.workunit.client.0.smithi050.stderr: 42050K .......... .......... .......... .......... .......... 24% 10.4M 5s 2023-10-26T06:44:53.814 INFO:tasks.workunit.client.0.smithi050.stderr: 42100K .......... .......... .......... .......... .......... 25% 11.0M 5s 2023-10-26T06:44:53.882 INFO:tasks.workunit.client.0.smithi050.stderr: 42150K .......... .......... .......... .......... .......... 25% 15.7M 5s 2023-10-26T06:44:53.883 INFO:tasks.workunit.client.0.smithi050.stderr: 42200K .......... .......... .......... .......... .......... 25% 124M 5s 2023-10-26T06:44:53.883 INFO:tasks.workunit.client.0.smithi050.stderr: 42250K .......... .......... .......... .......... .......... 25% 131M 5s 2023-10-26T06:44:53.883 INFO:tasks.workunit.client.0.smithi050.stderr: 42300K .......... .......... .......... .......... .......... 25% 103M 5s 2023-10-26T06:44:53.884 INFO:tasks.workunit.client.0.smithi050.stderr: 42350K .......... .......... .......... .......... .......... 25% 30.9M 5s 2023-10-26T06:44:53.884 INFO:tasks.workunit.client.0.smithi050.stderr: 42400K .......... .......... .......... .......... .......... 25% 10.7M 5s 2023-10-26T06:44:53.884 INFO:tasks.workunit.client.0.smithi050.stderr: 42450K .......... .......... .......... .......... .......... 25% 64.2M 5s 2023-10-26T06:44:53.884 INFO:tasks.workunit.client.0.smithi050.stderr: 42500K .......... .......... .......... .......... .......... 25% 34.6M 5s 2023-10-26T06:44:53.885 INFO:tasks.workunit.client.0.smithi050.stderr: 42550K .......... .......... .......... .......... .......... 25% 24.4M 5s 2023-10-26T06:44:53.885 INFO:tasks.workunit.client.0.smithi050.stderr: 42600K .......... .......... .......... .......... .......... 25% 47.6M 5s 2023-10-26T06:44:53.885 INFO:tasks.workunit.client.0.smithi050.stderr: 42650K .......... .......... .......... .......... .......... 25% 108M 5s 2023-10-26T06:44:53.885 INFO:tasks.workunit.client.0.smithi050.stderr: 42700K .......... .......... .......... .......... .......... 25% 47.9M 5s 2023-10-26T06:44:53.885 INFO:tasks.workunit.client.0.smithi050.stderr: 42750K .......... .......... .......... .......... .......... 25% 49.2M 5s 2023-10-26T06:44:53.886 INFO:tasks.workunit.client.0.smithi050.stderr: 42800K .......... .......... .......... .......... .......... 25% 45.1M 5s 2023-10-26T06:44:53.886 INFO:tasks.workunit.client.0.smithi050.stderr: 42850K .......... .......... .......... .......... .......... 25% 33.5M 5s 2023-10-26T06:44:53.886 INFO:tasks.workunit.client.0.smithi050.stderr: 42900K .......... .......... .......... .......... .......... 25% 21.1M 5s 2023-10-26T06:44:53.886 INFO:tasks.workunit.client.0.smithi050.stderr: 42950K .......... .......... .......... .......... .......... 25% 64.4M 5s 2023-10-26T06:44:53.887 INFO:tasks.workunit.client.0.smithi050.stderr: 43000K .......... .......... .......... .......... .......... 25% 24.1M 5s 2023-10-26T06:44:53.887 INFO:tasks.workunit.client.0.smithi050.stderr: 43050K .......... .......... .......... .......... .......... 25% 23.2M 5s 2023-10-26T06:44:53.887 INFO:tasks.workunit.client.0.smithi050.stderr: 43100K .......... .......... .......... .......... .......... 25% 31.0M 5s 2023-10-26T06:44:53.887 INFO:tasks.workunit.client.0.smithi050.stderr: 43150K .......... .......... .......... .......... .......... 25% 24.7M 5s 2023-10-26T06:44:53.887 INFO:tasks.workunit.client.0.smithi050.stderr: 43200K .......... .......... .......... .......... .......... 25% 44.7M 5s 2023-10-26T06:44:53.888 INFO:tasks.workunit.client.0.smithi050.stderr: 43250K .......... .......... .......... .......... .......... 25% 20.0M 5s 2023-10-26T06:44:53.888 INFO:tasks.workunit.client.0.smithi050.stderr: 43300K .......... .......... .......... .......... .......... 25% 52.4M 5s 2023-10-26T06:44:53.888 INFO:tasks.workunit.client.0.smithi050.stderr: 43350K .......... .......... .......... .......... .......... 25% 20.5M 5s 2023-10-26T06:44:53.888 INFO:tasks.workunit.client.0.smithi050.stderr: 43400K .......... .......... .......... .......... .......... 25% 35.6M 5s 2023-10-26T06:44:53.889 INFO:tasks.workunit.client.0.smithi050.stderr: 43450K .......... .......... .......... .......... .......... 25% 34.2M 5s 2023-10-26T06:44:53.889 INFO:tasks.workunit.client.0.smithi050.stderr: 43500K .......... .......... .......... .......... .......... 25% 25.6M 5s 2023-10-26T06:44:53.890 INFO:tasks.workunit.client.0.smithi050.stderr: 43550K .......... .......... .......... .......... .......... 25% 33.8M 5s 2023-10-26T06:44:53.890 INFO:tasks.workunit.client.0.smithi050.stderr: 43600K .......... .......... .......... .......... .......... 25% 24.9M 5s 2023-10-26T06:44:53.890 INFO:tasks.workunit.client.0.smithi050.stderr: 43650K .......... .......... .......... .......... .......... 25% 21.2M 5s 2023-10-26T06:44:53.890 INFO:tasks.workunit.client.0.smithi050.stderr: 43700K .......... .......... .......... .......... .......... 25% 45.9M 5s 2023-10-26T06:44:53.891 INFO:tasks.workunit.client.0.smithi050.stderr: 43750K .......... .......... .......... .......... .......... 25% 17.8M 5s 2023-10-26T06:44:53.891 INFO:tasks.workunit.client.0.smithi050.stderr: 43800K .......... .......... .......... .......... .......... 26% 35.7M 5s 2023-10-26T06:44:53.891 INFO:tasks.workunit.client.0.smithi050.stderr: 43850K .......... .......... .......... .......... .......... 26% 24.8M 5s 2023-10-26T06:44:53.891 INFO:tasks.workunit.client.0.smithi050.stderr: 43900K .......... .......... .......... .......... .......... 26% 25.2M 5s 2023-10-26T06:44:53.892 INFO:tasks.workunit.client.0.smithi050.stderr: 43950K .......... .......... .......... .......... .......... 26% 23.7M 5s 2023-10-26T06:44:53.892 INFO:tasks.workunit.client.0.smithi050.stderr: 44000K .......... .......... .......... .......... .......... 26% 26.7M 5s 2023-10-26T06:44:53.892 INFO:tasks.workunit.client.0.smithi050.stderr: 44050K .......... .......... .......... .......... .......... 26% 39.0M 5s 2023-10-26T06:44:53.892 INFO:tasks.workunit.client.0.smithi050.stderr: 44100K .......... .......... .......... .......... .......... 26% 39.9M 5s 2023-10-26T06:44:53.893 INFO:tasks.workunit.client.0.smithi050.stderr: 44150K .......... .......... .......... .......... .......... 26% 23.5M 5s 2023-10-26T06:44:53.893 INFO:tasks.workunit.client.0.smithi050.stderr: 44200K .......... .......... .......... .......... .......... 26% 49.3M 5s 2023-10-26T06:44:53.893 INFO:tasks.workunit.client.0.smithi050.stderr: 44250K .......... .......... .......... .......... .......... 26% 21.8M 5s 2023-10-26T06:44:53.958 INFO:tasks.workunit.client.0.smithi050.stderr: 44300K .......... .......... .......... .......... .......... 26% 23.6M 5s 2023-10-26T06:44:53.958 INFO:tasks.workunit.client.0.smithi050.stderr: 44350K .......... .......... .......... .......... .......... 26% 31.1M 5s 2023-10-26T06:44:53.959 INFO:tasks.workunit.client.0.smithi050.stderr: 44400K .......... .......... .......... .......... .......... 26% 13.6M 5s 2023-10-26T06:44:53.959 INFO:tasks.workunit.client.0.smithi050.stderr: 44450K .......... .......... .......... .......... .......... 26% 47.5M 5s 2023-10-26T06:44:53.959 INFO:tasks.workunit.client.0.smithi050.stderr: 44500K .......... .......... .......... .......... .......... 26% 30.1M 5s 2023-10-26T06:44:53.959 INFO:tasks.workunit.client.0.smithi050.stderr: 44550K .......... .......... .......... .......... .......... 26% 34.3M 5s 2023-10-26T06:44:53.960 INFO:tasks.workunit.client.0.smithi050.stderr: 44600K .......... .......... .......... .......... .......... 26% 19.5M 5s 2023-10-26T06:44:53.960 INFO:tasks.workunit.client.0.smithi050.stderr: 44650K .......... .......... .......... .......... .......... 26% 30.2M 5s 2023-10-26T06:44:53.960 INFO:tasks.workunit.client.0.smithi050.stderr: 44700K .......... .......... .......... .......... .......... 26% 55.1M 5s 2023-10-26T06:44:53.960 INFO:tasks.workunit.client.0.smithi050.stderr: 44750K .......... .......... .......... .......... .......... 26% 19.9M 5s 2023-10-26T06:44:53.961 INFO:tasks.workunit.client.0.smithi050.stderr: 44800K .......... .......... .......... .......... .......... 26% 44.8M 5s 2023-10-26T06:44:53.961 INFO:tasks.workunit.client.0.smithi050.stderr: 44850K .......... .......... .......... .......... .......... 26% 25.2M 5s 2023-10-26T06:44:53.961 INFO:tasks.workunit.client.0.smithi050.stderr: 44900K .......... .......... .......... .......... .......... 26% 13.7M 5s 2023-10-26T06:44:53.961 INFO:tasks.workunit.client.0.smithi050.stderr: 44950K .......... .......... .......... .......... .......... 26% 112M 5s 2023-10-26T06:44:53.961 INFO:tasks.workunit.client.0.smithi050.stderr: 45000K .......... .......... .......... .......... .......... 26% 46.7M 5s 2023-10-26T06:44:53.962 INFO:tasks.workunit.client.0.smithi050.stderr: 45050K .......... .......... .......... .......... .......... 26% 30.8M 5s 2023-10-26T06:44:53.962 INFO:tasks.workunit.client.0.smithi050.stderr: 45100K .......... .......... .......... .......... .......... 26% 31.2M 5s 2023-10-26T06:44:53.962 INFO:tasks.workunit.client.0.smithi050.stderr: 45150K .......... .......... .......... .......... .......... 26% 30.8M 5s 2023-10-26T06:44:53.962 INFO:tasks.workunit.client.0.smithi050.stderr: 45200K .......... .......... .......... .......... .......... 26% 29.3M 5s 2023-10-26T06:44:53.962 INFO:tasks.workunit.client.0.smithi050.stderr: 45250K .......... .......... .......... .......... .......... 26% 14.1M 5s 2023-10-26T06:44:53.963 INFO:tasks.workunit.client.0.smithi050.stderr: 45300K .......... .......... .......... .......... .......... 26% 15.6M 5s 2023-10-26T06:44:53.963 INFO:tasks.workunit.client.0.smithi050.stderr: 45350K .......... .......... .......... .......... .......... 26% 33.9M 5s 2023-10-26T06:44:53.963 INFO:tasks.workunit.client.0.smithi050.stderr: 45400K .......... .......... .......... .......... .......... 26% 77.4M 5s 2023-10-26T06:44:53.963 INFO:tasks.workunit.client.0.smithi050.stderr: 45450K .......... .......... .......... .......... .......... 26% 84.2M 5s 2023-10-26T06:44:53.963 INFO:tasks.workunit.client.0.smithi050.stderr: 45500K .......... .......... .......... .......... .......... 27% 51.7M 5s 2023-10-26T06:44:53.964 INFO:tasks.workunit.client.0.smithi050.stderr: 45550K .......... .......... .......... .......... .......... 27% 28.4M 5s 2023-10-26T06:44:53.964 INFO:tasks.workunit.client.0.smithi050.stderr: 45600K .......... .......... .......... .......... .......... 27% 19.9M 5s 2023-10-26T06:44:53.964 INFO:tasks.workunit.client.0.smithi050.stderr: 45650K .......... .......... .......... .......... .......... 27% 46.7M 5s 2023-10-26T06:44:53.964 INFO:tasks.workunit.client.0.smithi050.stderr: 45700K .......... .......... .......... .......... .......... 27% 45.9M 5s 2023-10-26T06:44:53.965 INFO:tasks.workunit.client.0.smithi050.stderr: 45750K .......... .......... .......... .......... .......... 27% 21.6M 5s 2023-10-26T06:44:53.965 INFO:tasks.workunit.client.0.smithi050.stderr: 45800K .......... .......... .......... .......... .......... 27% 25.8M 5s 2023-10-26T06:44:53.965 INFO:tasks.workunit.client.0.smithi050.stderr: 45850K .......... .......... .......... .......... .......... 27% 29.7M 5s 2023-10-26T06:44:53.965 INFO:tasks.workunit.client.0.smithi050.stderr: 45900K .......... .......... .......... .......... .......... 27% 25.2M 5s 2023-10-26T06:44:53.965 INFO:tasks.workunit.client.0.smithi050.stderr: 45950K .......... .......... .......... .......... .......... 27% 25.9M 5s 2023-10-26T06:44:53.966 INFO:tasks.workunit.client.0.smithi050.stderr: 46000K .......... .......... .......... .......... .......... 27% 28.1M 5s 2023-10-26T06:44:53.966 INFO:tasks.workunit.client.0.smithi050.stderr: 46050K .......... .......... .......... .......... .......... 27% 22.8M 5s 2023-10-26T06:44:53.966 INFO:tasks.workunit.client.0.smithi050.stderr: 46100K .......... .......... .......... .......... .......... 27% 44.0M 5s 2023-10-26T06:44:53.966 INFO:tasks.workunit.client.0.smithi050.stderr: 46150K .......... .......... .......... .......... .......... 27% 25.9M 5s 2023-10-26T06:44:53.966 INFO:tasks.workunit.client.0.smithi050.stderr: 46200K .......... .......... .......... .......... .......... 27% 32.6M 5s 2023-10-26T06:44:53.967 INFO:tasks.workunit.client.0.smithi050.stderr: 46250K .......... .......... .......... .......... .......... 27% 18.1M 5s 2023-10-26T06:44:53.967 INFO:tasks.workunit.client.0.smithi050.stderr: 46300K .......... .......... .......... .......... .......... 27% 21.3M 5s 2023-10-26T06:44:53.967 INFO:tasks.workunit.client.0.smithi050.stderr: 46350K .......... .......... .......... .......... .......... 27% 45.5M 5s 2023-10-26T06:44:53.967 INFO:tasks.workunit.client.0.smithi050.stderr: 46400K .......... .......... .......... .......... .......... 27% 35.7M 5s 2023-10-26T06:44:53.996 INFO:tasks.workunit.client.0.smithi050.stderr: 46450K .......... .......... .......... .......... .......... 27% 32.5M 5s 2023-10-26T06:44:53.997 INFO:tasks.workunit.client.0.smithi050.stderr: 46500K .......... .......... .......... .......... .......... 27% 30.8M 5s 2023-10-26T06:44:53.997 INFO:tasks.workunit.client.0.smithi050.stderr: 46550K .......... .......... .......... .......... .......... 27% 23.9M 5s 2023-10-26T06:44:53.997 INFO:tasks.workunit.client.0.smithi050.stderr: 46600K .......... .......... .......... .......... .......... 27% 36.3M 5s 2023-10-26T06:44:53.997 INFO:tasks.workunit.client.0.smithi050.stderr: 46650K .......... .......... .......... .......... .......... 27% 17.6M 5s 2023-10-26T06:44:53.998 INFO:tasks.workunit.client.0.smithi050.stderr: 46700K .......... .......... .......... .......... .......... 27% 41.7M 5s 2023-10-26T06:44:53.998 INFO:tasks.workunit.client.0.smithi050.stderr: 46750K .......... .......... .......... .......... .......... 27% 31.7M 5s 2023-10-26T06:44:53.998 INFO:tasks.workunit.client.0.smithi050.stderr: 46800K .......... .......... .......... .......... .......... 27% 30.0M 5s 2023-10-26T06:44:53.998 INFO:tasks.workunit.client.0.smithi050.stderr: 46850K .......... .......... .......... .......... .......... 27% 38.3M 5s 2023-10-26T06:44:53.998 INFO:tasks.workunit.client.0.smithi050.stderr: 46900K .......... .......... .......... .......... .......... 27% 27.6M 5s 2023-10-26T06:44:53.999 INFO:tasks.workunit.client.0.smithi050.stderr: 46950K .......... .......... .......... .......... .......... 27% 15.6M 5s 2023-10-26T06:44:53.999 INFO:tasks.workunit.client.0.smithi050.stderr: 47000K .......... .......... .......... .......... .......... 27% 118M 5s 2023-10-26T06:44:53.999 INFO:tasks.workunit.client.0.smithi050.stderr: 47050K .......... .......... .......... .......... .......... 27% 23.0M 5s 2023-10-26T06:44:53.999 INFO:tasks.workunit.client.0.smithi050.stderr: 47100K .......... .......... .......... .......... .......... 27% 69.8M 5s 2023-10-26T06:44:53.999 INFO:tasks.workunit.client.0.smithi050.stderr: 47150K .......... .......... .......... .......... .......... 28% 22.4M 5s 2023-10-26T06:44:53.999 INFO:tasks.workunit.client.0.smithi050.stderr: 47200K .......... .......... .......... .......... .......... 28% 24.4M 5s 2023-10-26T06:44:54.000 INFO:tasks.workunit.client.0.smithi050.stderr: 47250K .......... .......... .......... .......... .......... 28% 42.4M 5s 2023-10-26T06:44:54.000 INFO:tasks.workunit.client.0.smithi050.stderr: 47300K .......... .......... .......... .......... .......... 28% 20.5M 5s 2023-10-26T06:44:54.000 INFO:tasks.workunit.client.0.smithi050.stderr: 47350K .......... .......... .......... .......... .......... 28% 43.8M 5s 2023-10-26T06:44:54.000 INFO:tasks.workunit.client.0.smithi050.stderr: 47400K .......... .......... .......... .......... .......... 28% 27.8M 5s 2023-10-26T06:44:54.000 INFO:tasks.workunit.client.0.smithi050.stderr: 47450K .......... .......... .......... .......... .......... 28% 19.7M 5s 2023-10-26T06:44:54.001 INFO:tasks.workunit.client.0.smithi050.stderr: 47500K .......... .......... .......... .......... .......... 28% 45.1M 5s 2023-10-26T06:44:54.001 INFO:tasks.workunit.client.0.smithi050.stderr: 47550K .......... .......... .......... .......... .......... 28% 29.3M 5s 2023-10-26T06:44:54.009 INFO:tasks.workunit.client.0.smithi050.stderr: 47600K .......... .......... .......... .......... .......... 28% 22.6M 5s 2023-10-26T06:44:54.010 INFO:tasks.workunit.client.0.smithi050.stderr: 47650K .......... .......... .......... .......... .......... 28% 33.3M 5s 2023-10-26T06:44:54.010 INFO:tasks.workunit.client.0.smithi050.stderr: 47700K .......... .......... .......... .......... .......... 28% 24.5M 5s 2023-10-26T06:44:54.010 INFO:tasks.workunit.client.0.smithi050.stderr: 47750K .......... .......... .......... .......... .......... 28% 36.0M 5s 2023-10-26T06:44:54.010 INFO:tasks.workunit.client.0.smithi050.stderr: 47800K .......... .......... .......... .......... .......... 28% 29.3M 5s 2023-10-26T06:44:54.010 INFO:tasks.workunit.client.0.smithi050.stderr: 47850K .......... .......... .......... .......... .......... 28% 35.8M 5s 2023-10-26T06:44:54.011 INFO:tasks.workunit.client.0.smithi050.stderr: 47900K .......... .......... .......... .......... .......... 28% 18.5M 5s 2023-10-26T06:44:54.013 INFO:tasks.workunit.client.0.smithi050.stderr: 47950K .......... .......... .......... .......... .......... 28% 35.6M 5s 2023-10-26T06:44:54.013 INFO:tasks.workunit.client.0.smithi050.stderr: 48000K .......... .......... .......... .......... .......... 28% 59.9M 5s 2023-10-26T06:44:54.015 INFO:tasks.workunit.client.0.smithi050.stderr: 48050K .......... .......... .......... .......... .......... 28% 12.4M 5s 2023-10-26T06:44:54.017 INFO:tasks.workunit.client.0.smithi050.stderr: 48100K .......... .......... .......... .......... .......... 28% 37.7M 5s 2023-10-26T06:44:54.023 INFO:tasks.workunit.client.0.smithi050.stderr: 48150K .......... .......... .......... .......... .......... 28% 16.7M 5s 2023-10-26T06:44:54.024 INFO:tasks.workunit.client.0.smithi050.stderr: 48200K .......... .......... .......... .......... .......... 28% 60.8M 5s 2023-10-26T06:44:54.024 INFO:tasks.workunit.client.0.smithi050.stderr: 48250K .......... .......... .......... .......... .......... 28% 50.3M 5s 2023-10-26T06:44:54.024 INFO:tasks.workunit.client.0.smithi050.stderr: 48300K .......... .......... .......... .......... .......... 28% 29.2M 5s 2023-10-26T06:44:54.026 INFO:tasks.workunit.client.0.smithi050.stderr: 48350K .......... .......... .......... .......... .......... 28% 18.2M 5s 2023-10-26T06:44:54.030 INFO:tasks.workunit.client.0.smithi050.stderr: 48400K .......... .......... .......... .......... .......... 28% 45.0M 5s 2023-10-26T06:44:54.030 INFO:tasks.workunit.client.0.smithi050.stderr: 48450K .......... .......... .......... .......... .......... 28% 24.5M 5s 2023-10-26T06:44:54.030 INFO:tasks.workunit.client.0.smithi050.stderr: 48500K .......... .......... .......... .......... .......... 28% 31.6M 5s 2023-10-26T06:44:54.033 INFO:tasks.workunit.client.0.smithi050.stderr: 48550K .......... .......... .......... .......... .......... 28% 31.5M 5s 2023-10-26T06:44:54.035 INFO:tasks.workunit.client.0.smithi050.stderr: 48600K .......... .......... .......... .......... .......... 28% 18.9M 5s 2023-10-26T06:44:54.035 INFO:tasks.workunit.client.0.smithi050.stderr: 48650K .......... .......... .......... .......... .......... 28% 47.5M 5s 2023-10-26T06:44:54.037 INFO:tasks.workunit.client.0.smithi050.stderr: 48700K .......... .......... .......... .......... .......... 28% 29.1M 5s 2023-10-26T06:44:54.038 INFO:tasks.workunit.client.0.smithi050.stderr: 48750K .......... .......... .......... .......... .......... 28% 43.8M 5s 2023-10-26T06:44:54.040 INFO:tasks.workunit.client.0.smithi050.stderr: 48800K .......... .......... .......... .......... .......... 28% 31.2M 5s 2023-10-26T06:44:54.043 INFO:tasks.workunit.client.0.smithi050.stderr: 48850K .......... .......... .......... .......... .......... 29% 23.2M 5s 2023-10-26T06:44:54.044 INFO:tasks.workunit.client.0.smithi050.stderr: 48900K .......... .......... .......... .......... .......... 29% 25.2M 5s 2023-10-26T06:44:54.045 INFO:tasks.workunit.client.0.smithi050.stderr: 48950K .......... .......... .......... .......... .......... 29% 34.3M 5s 2023-10-26T06:44:54.046 INFO:tasks.workunit.client.0.smithi050.stderr: 49000K .......... .......... .......... .......... .......... 29% 36.5M 5s 2023-10-26T06:44:54.050 INFO:tasks.workunit.client.0.smithi050.stderr: 49050K .......... .......... .......... .......... .......... 29% 30.1M 5s 2023-10-26T06:44:54.050 INFO:tasks.workunit.client.0.smithi050.stderr: 49100K .......... .......... .......... .......... .......... 29% 30.3M 5s 2023-10-26T06:44:54.051 INFO:tasks.workunit.client.0.smithi050.stderr: 49150K .......... .......... .......... .......... .......... 29% 31.3M 5s 2023-10-26T06:44:54.054 INFO:tasks.workunit.client.0.smithi050.stderr: 49200K .......... .......... .......... .......... .......... 29% 19.5M 5s 2023-10-26T06:44:54.055 INFO:tasks.workunit.client.0.smithi050.stderr: 49250K .......... .......... .......... .......... .......... 29% 37.0M 5s 2023-10-26T06:44:54.056 INFO:tasks.workunit.client.0.smithi050.stderr: 49300K .......... .......... .......... .......... .......... 29% 29.9M 5s 2023-10-26T06:44:54.058 INFO:tasks.workunit.client.0.smithi050.stderr: 49350K .......... .......... .......... .......... .......... 29% 35.6M 5s 2023-10-26T06:44:54.061 INFO:tasks.workunit.client.0.smithi050.stderr: 49400K .......... .......... .......... .......... .......... 29% 19.3M 5s 2023-10-26T06:44:54.070 INFO:tasks.workunit.client.0.smithi050.stderr: 49450K .......... .......... .......... .......... .......... 29% 29.5M 5s 2023-10-26T06:44:54.070 INFO:tasks.workunit.client.0.smithi050.stderr: 49500K .......... .......... .......... .......... .......... 29% 55.6M 5s 2023-10-26T06:44:54.070 INFO:tasks.workunit.client.0.smithi050.stderr: 49550K .......... .......... .......... .......... .......... 29% 19.4M 5s 2023-10-26T06:44:54.071 INFO:tasks.workunit.client.0.smithi050.stderr: 49600K .......... .......... .......... .......... .......... 29% 32.7M 5s 2023-10-26T06:44:54.071 INFO:tasks.workunit.client.0.smithi050.stderr: 49650K .......... .......... .......... .......... .......... 29% 33.5M 5s 2023-10-26T06:44:54.074 INFO:tasks.workunit.client.0.smithi050.stderr: 49700K .......... .......... .......... .......... .......... 29% 24.0M 5s 2023-10-26T06:44:54.074 INFO:tasks.workunit.client.0.smithi050.stderr: 49750K .......... .......... .......... .......... .......... 29% 39.5M 5s 2023-10-26T06:44:54.074 INFO:tasks.workunit.client.0.smithi050.stderr: 49800K .......... .......... .......... .......... .......... 29% 30.3M 5s 2023-10-26T06:44:54.076 INFO:tasks.workunit.client.0.smithi050.stderr: 49850K .......... .......... .......... .......... .......... 29% 27.1M 5s 2023-10-26T06:44:54.079 INFO:tasks.workunit.client.0.smithi050.stderr: 49900K .......... .......... .......... .......... .......... 29% 17.5M 5s 2023-10-26T06:44:54.081 INFO:tasks.workunit.client.0.smithi050.stderr: 49950K .......... .......... .......... .......... .......... 29% 30.3M 5s 2023-10-26T06:44:54.081 INFO:tasks.workunit.client.0.smithi050.stderr: 50000K .......... .......... .......... .......... .......... 29% 48.5M 5s 2023-10-26T06:44:54.083 INFO:tasks.workunit.client.0.smithi050.stderr: 50050K .......... .......... .......... .......... .......... 29% 23.9M 5s 2023-10-26T06:44:54.085 INFO:tasks.workunit.client.0.smithi050.stderr: 50100K .......... .......... .......... .......... .......... 29% 36.1M 5s 2023-10-26T06:44:54.087 INFO:tasks.workunit.client.0.smithi050.stderr: 50150K .......... .......... .......... .......... .......... 29% 18.7M 5s 2023-10-26T06:44:54.088 INFO:tasks.workunit.client.0.smithi050.stderr: 50200K .......... .......... .......... .......... .......... 29% 30.2M 5s 2023-10-26T06:44:54.089 INFO:tasks.workunit.client.0.smithi050.stderr: 50250K .......... .......... .......... .......... .......... 29% 42.2M 5s 2023-10-26T06:44:54.092 INFO:tasks.workunit.client.0.smithi050.stderr: 50300K .......... .......... .......... .......... .......... 29% 32.2M 5s 2023-10-26T06:44:54.093 INFO:tasks.workunit.client.0.smithi050.stderr: 50350K .......... .......... .......... .......... .......... 29% 25.9M 5s 2023-10-26T06:44:54.095 INFO:tasks.workunit.client.0.smithi050.stderr: 50400K .......... .......... .......... .......... .......... 29% 26.1M 5s 2023-10-26T06:44:54.096 INFO:tasks.workunit.client.0.smithi050.stderr: 50450K .......... .......... .......... .......... .......... 29% 36.6M 5s 2023-10-26T06:44:54.098 INFO:tasks.workunit.client.0.smithi050.stderr: 50500K .......... .......... .......... .......... .......... 29% 28.0M 5s 2023-10-26T06:44:54.100 INFO:tasks.workunit.client.0.smithi050.stderr: 50550K .......... .......... .......... .......... .......... 30% 24.7M 5s 2023-10-26T06:44:54.102 INFO:tasks.workunit.client.0.smithi050.stderr: 50600K .......... .......... .......... .......... .......... 30% 23.3M 5s 2023-10-26T06:44:54.105 INFO:tasks.workunit.client.0.smithi050.stderr: 50650K .......... .......... .......... .......... .......... 30% 37.4M 5s 2023-10-26T06:44:54.106 INFO:tasks.workunit.client.0.smithi050.stderr: 50700K .......... .......... .......... .......... .......... 30% 23.7M 5s 2023-10-26T06:44:54.109 INFO:tasks.workunit.client.0.smithi050.stderr: 50750K .......... .......... .......... .......... .......... 30% 43.3M 5s 2023-10-26T06:44:54.110 INFO:tasks.workunit.client.0.smithi050.stderr: 50800K .......... .......... .......... .......... .......... 30% 26.7M 5s 2023-10-26T06:44:54.119 INFO:tasks.workunit.client.0.smithi050.stderr: 50850K .......... .......... .......... .......... .......... 30% 23.3M 5s 2023-10-26T06:44:54.119 INFO:tasks.workunit.client.0.smithi050.stderr: 50900K .......... .......... .......... .......... .......... 30% 37.4M 5s 2023-10-26T06:44:54.119 INFO:tasks.workunit.client.0.smithi050.stderr: 50950K .......... .......... .......... .......... .......... 30% 16.9M 5s 2023-10-26T06:44:54.119 INFO:tasks.workunit.client.0.smithi050.stderr: 51000K .......... .......... .......... .......... .......... 30% 49.5M 5s 2023-10-26T06:44:54.120 INFO:tasks.workunit.client.0.smithi050.stderr: 51050K .......... .......... .......... .......... .......... 30% 41.8M 5s 2023-10-26T06:44:54.120 INFO:tasks.workunit.client.0.smithi050.stderr: 51100K .......... .......... .......... .......... .......... 30% 24.4M 5s 2023-10-26T06:44:54.123 INFO:tasks.workunit.client.0.smithi050.stderr: 51150K .......... .......... .......... .......... .......... 30% 29.8M 5s 2023-10-26T06:44:54.123 INFO:tasks.workunit.client.0.smithi050.stderr: 51200K .......... .......... .......... .......... .......... 30% 23.9M 5s 2023-10-26T06:44:54.124 INFO:tasks.workunit.client.0.smithi050.stderr: 51250K .......... .......... .......... .......... .......... 30% 48.9M 5s 2023-10-26T06:44:54.127 INFO:tasks.workunit.client.0.smithi050.stderr: 51300K .......... .......... .......... .......... .......... 30% 29.0M 5s 2023-10-26T06:44:54.145 INFO:tasks.workunit.client.0.smithi050.stderr: 51350K .......... .......... .......... .......... .......... 30% 21.2M 5s 2023-10-26T06:44:54.146 INFO:tasks.workunit.client.0.smithi050.stderr: 51400K .......... .......... .......... .......... .......... 30% 47.5M 5s 2023-10-26T06:44:54.146 INFO:tasks.workunit.client.0.smithi050.stderr: 51450K .......... .......... .......... .......... .......... 30% 22.0M 5s 2023-10-26T06:44:54.146 INFO:tasks.workunit.client.0.smithi050.stderr: 51500K .......... .......... .......... .......... .......... 30% 40.0M 5s 2023-10-26T06:44:54.147 INFO:tasks.workunit.client.0.smithi050.stderr: 51550K .......... .......... .......... .......... .......... 30% 25.9M 5s 2023-10-26T06:44:54.147 INFO:tasks.workunit.client.0.smithi050.stderr: 51600K .......... .......... .......... .......... .......... 30% 24.6M 5s 2023-10-26T06:44:54.147 INFO:tasks.workunit.client.0.smithi050.stderr: 51650K .......... .......... .......... .......... .......... 30% 22.9M 5s 2023-10-26T06:44:54.147 INFO:tasks.workunit.client.0.smithi050.stderr: 51700K .......... .......... .......... .......... .......... 30% 51.6M 5s 2023-10-26T06:44:54.148 INFO:tasks.workunit.client.0.smithi050.stderr: 51750K .......... .......... .......... .......... .......... 30% 30.5M 5s 2023-10-26T06:44:54.148 INFO:tasks.workunit.client.0.smithi050.stderr: 51800K .......... .......... .......... .......... .......... 30% 24.5M 5s 2023-10-26T06:44:54.148 INFO:tasks.workunit.client.0.smithi050.stderr: 51850K .......... .......... .......... .......... .......... 30% 26.2M 5s 2023-10-26T06:44:54.162 INFO:tasks.workunit.client.0.smithi050.stderr: 51900K .......... .......... .......... .......... .......... 30% 23.3M 5s 2023-10-26T06:44:54.162 INFO:tasks.workunit.client.0.smithi050.stderr: 51950K .......... .......... .......... .......... .......... 30% 35.5M 5s 2023-10-26T06:44:54.163 INFO:tasks.workunit.client.0.smithi050.stderr: 52000K .......... .......... .......... .......... .......... 30% 39.7M 5s 2023-10-26T06:44:54.163 INFO:tasks.workunit.client.0.smithi050.stderr: 52050K .......... .......... .......... .......... .......... 30% 25.9M 5s 2023-10-26T06:44:54.163 INFO:tasks.workunit.client.0.smithi050.stderr: 52100K .......... .......... .......... .......... .......... 30% 23.9M 5s 2023-10-26T06:44:54.163 INFO:tasks.workunit.client.0.smithi050.stderr: 52150K .......... .......... .......... .......... .......... 30% 44.2M 5s 2023-10-26T06:44:54.164 INFO:tasks.workunit.client.0.smithi050.stderr: 52200K .......... .......... .......... .......... .......... 30% 23.6M 5s 2023-10-26T06:44:54.164 INFO:tasks.workunit.client.0.smithi050.stderr: 52250K .......... .......... .......... .......... .......... 31% 35.3M 5s 2023-10-26T06:44:54.164 INFO:tasks.workunit.client.0.smithi050.stderr: 52300K .......... .......... .......... .......... .......... 31% 28.7M 5s 2023-10-26T06:44:54.164 INFO:tasks.workunit.client.0.smithi050.stderr: 52350K .......... .......... .......... .......... .......... 31% 22.9M 5s 2023-10-26T06:44:54.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:53 smithi125 ceph-mon[130643]: pgmap v356: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2023-10-26T06:44:54.178 INFO:tasks.workunit.client.0.smithi050.stderr: 52400K .......... .......... .......... .......... .......... 31% 25.5M 5s 2023-10-26T06:44:54.179 INFO:tasks.workunit.client.0.smithi050.stderr: 52450K .......... .......... .......... .......... .......... 31% 57.6M 5s 2023-10-26T06:44:54.179 INFO:tasks.workunit.client.0.smithi050.stderr: 52500K .......... .......... .......... .......... .......... 31% 25.2M 5s 2023-10-26T06:44:54.179 INFO:tasks.workunit.client.0.smithi050.stderr: 52550K .......... .......... .......... .......... .......... 31% 29.7M 5s 2023-10-26T06:44:54.179 INFO:tasks.workunit.client.0.smithi050.stderr: 52600K .......... .......... .......... .......... .......... 31% 25.1M 5s 2023-10-26T06:44:54.179 INFO:tasks.workunit.client.0.smithi050.stderr: 52650K .......... .......... .......... .......... .......... 31% 23.4M 5s 2023-10-26T06:44:54.180 INFO:tasks.workunit.client.0.smithi050.stderr: 52700K .......... .......... .......... .......... .......... 31% 60.1M 5s 2023-10-26T06:44:54.180 INFO:tasks.workunit.client.0.smithi050.stderr: 52750K .......... .......... .......... .......... .......... 31% 25.0M 5s 2023-10-26T06:44:54.180 INFO:tasks.workunit.client.0.smithi050.stderr: 52800K .......... .......... .......... .......... .......... 31% 31.2M 5s 2023-10-26T06:44:54.180 INFO:tasks.workunit.client.0.smithi050.stderr: 52850K .......... .......... .......... .......... .......... 31% 25.1M 5s 2023-10-26T06:44:54.191 INFO:tasks.workunit.client.0.smithi050.stderr: 52900K .......... .......... .......... .......... .......... 31% 32.3M 5s 2023-10-26T06:44:54.191 INFO:tasks.workunit.client.0.smithi050.stderr: 52950K .......... .......... .......... .......... .......... 31% 32.0M 5s 2023-10-26T06:44:54.192 INFO:tasks.workunit.client.0.smithi050.stderr: 53000K .......... .......... .......... .......... .......... 31% 24.9M 5s 2023-10-26T06:44:54.192 INFO:tasks.workunit.client.0.smithi050.stderr: 53050K .......... .......... .......... .......... .......... 31% 35.5M 5s 2023-10-26T06:44:54.192 INFO:tasks.workunit.client.0.smithi050.stderr: 53100K .......... .......... .......... .......... .......... 31% 24.6M 5s 2023-10-26T06:44:54.192 INFO:tasks.workunit.client.0.smithi050.stderr: 53150K .......... .......... .......... .......... .......... 31% 23.9M 5s 2023-10-26T06:44:54.193 INFO:tasks.workunit.client.0.smithi050.stderr: 53200K .......... .......... .......... .......... .......... 31% 44.9M 5s 2023-10-26T06:44:54.199 INFO:tasks.workunit.client.0.smithi050.stderr: 53250K .......... .......... .......... .......... .......... 31% 18.1M 5s 2023-10-26T06:44:54.199 INFO:tasks.workunit.client.0.smithi050.stderr: 53300K .......... .......... .......... .......... .......... 31% 32.3M 5s 2023-10-26T06:44:54.199 INFO:tasks.workunit.client.0.smithi050.stderr: 53350K .......... .......... .......... .......... .......... 31% 23.8M 5s 2023-10-26T06:44:54.200 INFO:tasks.workunit.client.0.smithi050.stderr: 53400K .......... .......... .......... .......... .......... 31% 26.7M 5s 2023-10-26T06:44:54.200 INFO:tasks.workunit.client.0.smithi050.stderr: 53450K .......... .......... .......... .......... .......... 31% 30.7M 5s 2023-10-26T06:44:54.202 INFO:tasks.workunit.client.0.smithi050.stderr: 53500K .......... .......... .......... .......... .......... 31% 24.2M 5s 2023-10-26T06:44:54.203 INFO:tasks.workunit.client.0.smithi050.stderr: 53550K .......... .......... .......... .......... .......... 31% 47.3M 5s 2023-10-26T06:44:54.204 INFO:tasks.workunit.client.0.smithi050.stderr: 53600K .......... .......... .......... .......... .......... 31% 21.6M 5s 2023-10-26T06:44:54.206 INFO:tasks.workunit.client.0.smithi050.stderr: 53650K .......... .......... .......... .......... .......... 31% 37.2M 5s 2023-10-26T06:44:54.208 INFO:tasks.workunit.client.0.smithi050.stderr: 53700K .......... .......... .......... .......... .......... 31% 24.5M 5s 2023-10-26T06:44:54.210 INFO:tasks.workunit.client.0.smithi050.stderr: 53750K .......... .......... .......... .......... .......... 31% 24.3M 5s 2023-10-26T06:44:54.210 INFO:tasks.workunit.client.0.smithi050.stderr: 53800K .......... .......... .......... .......... .......... 31% 50.3M 5s 2023-10-26T06:44:54.213 INFO:tasks.workunit.client.0.smithi050.stderr: 53850K .......... .......... .......... .......... .......... 31% 22.2M 4s 2023-10-26T06:44:54.214 INFO:tasks.workunit.client.0.smithi050.stderr: 53900K .......... .......... .......... .......... .......... 32% 35.7M 4s 2023-10-26T06:44:54.215 INFO:tasks.workunit.client.0.smithi050.stderr: 53950K .......... .......... .......... .......... .......... 32% 29.1M 4s 2023-10-26T06:44:54.218 INFO:tasks.workunit.client.0.smithi050.stderr: 54000K .......... .......... .......... .......... .......... 32% 21.8M 4s 2023-10-26T06:44:54.219 INFO:tasks.workunit.client.0.smithi050.stderr: 54050K .......... .......... .......... .......... .......... 32% 45.1M 4s 2023-10-26T06:44:54.221 INFO:tasks.workunit.client.0.smithi050.stderr: 54100K .......... .......... .......... .......... .......... 32% 22.9M 4s 2023-10-26T06:44:54.222 INFO:tasks.workunit.client.0.smithi050.stderr: 54150K .......... .......... .......... .......... .......... 32% 37.1M 4s 2023-10-26T06:44:54.224 INFO:tasks.workunit.client.0.smithi050.stderr: 54200K .......... .......... .......... .......... .......... 32% 25.3M 4s 2023-10-26T06:44:54.227 INFO:tasks.workunit.client.0.smithi050.stderr: 54250K .......... .......... .......... .......... .......... 32% 24.2M 4s 2023-10-26T06:44:54.227 INFO:tasks.workunit.client.0.smithi050.stderr: 54300K .......... .......... .......... .......... .......... 32% 55.0M 4s 2023-10-26T06:44:54.229 INFO:tasks.workunit.client.0.smithi050.stderr: 54350K .......... .......... .......... .......... .......... 32% 27.2M 4s 2023-10-26T06:44:54.233 INFO:tasks.workunit.client.0.smithi050.stderr: 54400K .......... .......... .......... .......... .......... 32% 21.8M 4s 2023-10-26T06:44:54.234 INFO:tasks.workunit.client.0.smithi050.stderr: 54450K .......... .......... .......... .......... .......... 32% 34.0M 4s 2023-10-26T06:44:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:53 smithi153 ceph-mon[131657]: pgmap v356: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2023-10-26T06:44:54.236 INFO:tasks.workunit.client.0.smithi050.stderr: 54500K .......... .......... .......... .......... .......... 32% 24.3M 4s 2023-10-26T06:44:54.236 INFO:tasks.workunit.client.0.smithi050.stderr: 54550K .......... .......... .......... .......... .......... 32% 57.2M 4s 2023-10-26T06:44:54.238 INFO:tasks.workunit.client.0.smithi050.stderr: 54600K .......... .......... .......... .......... .......... 32% 27.9M 4s 2023-10-26T06:44:54.240 INFO:tasks.workunit.client.0.smithi050.stderr: 54650K .......... .......... .......... .......... .......... 32% 26.2M 4s 2023-10-26T06:44:54.244 INFO:tasks.workunit.client.0.smithi050.stderr: 54700K .......... .......... .......... .......... .......... 32% 24.0M 4s 2023-10-26T06:44:54.244 INFO:tasks.workunit.client.0.smithi050.stderr: 54750K .......... .......... .......... .......... .......... 32% 26.7M 4s 2023-10-26T06:44:54.244 INFO:tasks.workunit.client.0.smithi050.stderr: 54800K .......... .......... .......... .......... .......... 32% 43.4M 4s 2023-10-26T06:44:54.247 INFO:tasks.workunit.client.0.smithi050.stderr: 54850K .......... .......... .......... .......... .......... 32% 29.1M 4s 2023-10-26T06:44:54.249 INFO:tasks.workunit.client.0.smithi050.stderr: 54900K .......... .......... .......... .......... .......... 32% 29.3M 4s 2023-10-26T06:44:54.251 INFO:tasks.workunit.client.0.smithi050.stderr: 54950K .......... .......... .......... .......... .......... 32% 21.8M 4s 2023-10-26T06:44:54.253 INFO:tasks.workunit.client.0.smithi050.stderr: 55000K .......... .......... .......... .......... .......... 32% 27.1M 4s 2023-10-26T06:44:54.253 INFO:tasks.workunit.client.0.smithi050.stderr: 55050K .......... .......... .......... .......... .......... 32% 64.4M 4s 2023-10-26T06:44:54.257 INFO:tasks.workunit.client.0.smithi050.stderr: 55100K .......... .......... .......... .......... .......... 32% 25.4M 4s 2023-10-26T06:44:54.258 INFO:tasks.workunit.client.0.smithi050.stderr: 55150K .......... .......... .......... .......... .......... 32% 25.4M 4s 2023-10-26T06:44:54.259 INFO:tasks.workunit.client.0.smithi050.stderr: 55200K .......... .......... .......... .......... .......... 32% 26.2M 4s 2023-10-26T06:44:54.261 INFO:tasks.workunit.client.0.smithi050.stderr: 55250K .......... .......... .......... .......... .......... 32% 27.4M 4s 2023-10-26T06:44:54.261 INFO:tasks.workunit.client.0.smithi050.stderr: 55300K .......... .......... .......... .......... .......... 32% 45.0M 4s 2023-10-26T06:44:54.263 INFO:tasks.workunit.client.0.smithi050.stderr: 55350K .......... .......... .......... .......... .......... 32% 24.1M 4s 2023-10-26T06:44:54.265 INFO:tasks.workunit.client.0.smithi050.stderr: 55400K .......... .......... .......... .......... .......... 32% 35.0M 4s 2023-10-26T06:44:54.267 INFO:tasks.workunit.client.0.smithi050.stderr: 55450K .......... .......... .......... .......... .......... 32% 24.7M 4s 2023-10-26T06:44:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:53 smithi050 ceph-mon[94997]: pgmap v356: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2023-10-26T06:44:54.286 INFO:tasks.workunit.client.0.smithi050.stderr: 55500K .......... .......... .......... .......... .......... 32% 24.7M 4s 2023-10-26T06:44:54.286 INFO:tasks.workunit.client.0.smithi050.stderr: 55550K .......... .......... .......... .......... .......... 32% 48.3M 4s 2023-10-26T06:44:54.286 INFO:tasks.workunit.client.0.smithi050.stderr: 55600K .......... .......... .......... .......... .......... 33% 24.8M 4s 2023-10-26T06:44:54.287 INFO:tasks.workunit.client.0.smithi050.stderr: 55650K .......... .......... .......... .......... .......... 33% 25.2M 4s 2023-10-26T06:44:54.287 INFO:tasks.workunit.client.0.smithi050.stderr: 55700K .......... .......... .......... .......... .......... 33% 24.1M 4s 2023-10-26T06:44:54.287 INFO:tasks.workunit.client.0.smithi050.stderr: 55750K .......... .......... .......... .......... .......... 33% 30.9M 4s 2023-10-26T06:44:54.287 INFO:tasks.workunit.client.0.smithi050.stderr: 55800K .......... .......... .......... .......... .......... 33% 44.8M 4s 2023-10-26T06:44:54.287 INFO:tasks.workunit.client.0.smithi050.stderr: 55850K .......... .......... .......... .......... .......... 33% 27.2M 4s 2023-10-26T06:44:54.288 INFO:tasks.workunit.client.0.smithi050.stderr: 55900K .......... .......... .......... .......... .......... 33% 32.8M 4s 2023-10-26T06:44:54.288 INFO:tasks.workunit.client.0.smithi050.stderr: 55950K .......... .......... .......... .......... .......... 33% 26.6M 4s 2023-10-26T06:44:54.288 INFO:tasks.workunit.client.0.smithi050.stderr: 56000K .......... .......... .......... .......... .......... 33% 21.8M 4s 2023-10-26T06:44:54.288 INFO:tasks.workunit.client.0.smithi050.stderr: 56050K .......... .......... .......... .......... .......... 33% 65.9M 4s 2023-10-26T06:44:54.297 INFO:tasks.workunit.client.0.smithi050.stderr: 56100K .......... .......... .......... .......... .......... 33% 23.8M 4s 2023-10-26T06:44:54.297 INFO:tasks.workunit.client.0.smithi050.stderr: 56150K .......... .......... .......... .......... .......... 33% 32.3M 4s 2023-10-26T06:44:54.297 INFO:tasks.workunit.client.0.smithi050.stderr: 56200K .......... .......... .......... .......... .......... 33% 26.5M 4s 2023-10-26T06:44:54.297 INFO:tasks.workunit.client.0.smithi050.stderr: 56250K .......... .......... .......... .......... .......... 33% 24.9M 4s 2023-10-26T06:44:54.298 INFO:tasks.workunit.client.0.smithi050.stderr: 56300K .......... .......... .......... .......... .......... 33% 54.3M 4s 2023-10-26T06:44:54.298 INFO:tasks.workunit.client.0.smithi050.stderr: 56350K .......... .......... .......... .......... .......... 33% 23.8M 4s 2023-10-26T06:44:54.303 INFO:tasks.workunit.client.0.smithi050.stderr: 56400K .......... .......... .......... .......... .......... 33% 27.3M 4s 2023-10-26T06:44:54.304 INFO:tasks.workunit.client.0.smithi050.stderr: 56450K .......... .......... .......... .......... .......... 33% 29.3M 4s 2023-10-26T06:44:54.304 INFO:tasks.workunit.client.0.smithi050.stderr: 56500K .......... .......... .......... .......... .......... 33% 19.7M 4s 2023-10-26T06:44:54.304 INFO:tasks.workunit.client.0.smithi050.stderr: 56550K .......... .......... .......... .......... .......... 33% 37.5M 4s 2023-10-26T06:44:54.311 INFO:tasks.workunit.client.0.smithi050.stderr: 56600K .......... .......... .......... .......... .......... 33% 43.9M 4s 2023-10-26T06:44:54.311 INFO:tasks.workunit.client.0.smithi050.stderr: 56650K .......... .......... .......... .......... .......... 33% 27.7M 4s 2023-10-26T06:44:54.312 INFO:tasks.workunit.client.0.smithi050.stderr: 56700K .......... .......... .......... .......... .......... 33% 26.7M 4s 2023-10-26T06:44:54.312 INFO:tasks.workunit.client.0.smithi050.stderr: 56750K .......... .......... .......... .......... .......... 33% 25.0M 4s 2023-10-26T06:44:54.316 INFO:tasks.workunit.client.0.smithi050.stderr: 56800K .......... .......... .......... .......... .......... 33% 48.0M 4s 2023-10-26T06:44:54.316 INFO:tasks.workunit.client.0.smithi050.stderr: 56850K .......... .......... .......... .......... .......... 33% 22.1M 4s 2023-10-26T06:44:54.316 INFO:tasks.workunit.client.0.smithi050.stderr: 56900K .......... .......... .......... .......... .......... 33% 27.3M 4s 2023-10-26T06:44:54.318 INFO:tasks.workunit.client.0.smithi050.stderr: 56950K .......... .......... .......... .......... .......... 33% 30.8M 4s 2023-10-26T06:44:54.320 INFO:tasks.workunit.client.0.smithi050.stderr: 57000K .......... .......... .......... .......... .......... 33% 24.7M 4s 2023-10-26T06:44:54.322 INFO:tasks.workunit.client.0.smithi050.stderr: 57050K .......... .......... .......... .......... .......... 33% 54.2M 4s 2023-10-26T06:44:54.322 INFO:tasks.workunit.client.0.smithi050.stderr: 57100K .......... .......... .......... .......... .......... 33% 22.4M 4s 2023-10-26T06:44:54.326 INFO:tasks.workunit.client.0.smithi050.stderr: 57150K .......... .......... .......... .......... .......... 33% 21.4M 4s 2023-10-26T06:44:54.326 INFO:tasks.workunit.client.0.smithi050.stderr: 57200K .......... .......... .......... .......... .......... 33% 64.6M 4s 2023-10-26T06:44:54.328 INFO:tasks.workunit.client.0.smithi050.stderr: 57250K .......... .......... .......... .......... .......... 33% 21.7M 4s 2023-10-26T06:44:54.329 INFO:tasks.workunit.client.0.smithi050.stderr: 57300K .......... .......... .......... .......... .......... 34% 24.5M 4s 2023-10-26T06:44:54.331 INFO:tasks.workunit.client.0.smithi050.stderr: 57350K .......... .......... .......... .......... .......... 34% 45.0M 4s 2023-10-26T06:44:54.333 INFO:tasks.workunit.client.0.smithi050.stderr: 57400K .......... .......... .......... .......... .......... 34% 22.3M 4s 2023-10-26T06:44:54.335 INFO:tasks.workunit.client.0.smithi050.stderr: 57450K .......... .......... .......... .......... .......... 34% 28.2M 4s 2023-10-26T06:44:54.337 INFO:tasks.workunit.client.0.smithi050.stderr: 57500K .......... .......... .......... .......... .......... 34% 19.5M 4s 2023-10-26T06:44:54.340 INFO:tasks.workunit.client.0.smithi050.stderr: 57550K .......... .......... .......... .......... .......... 34% 29.6M 4s 2023-10-26T06:44:54.340 INFO:tasks.workunit.client.0.smithi050.stderr: 57600K .......... .......... .......... .......... .......... 34% 55.0M 4s 2023-10-26T06:44:54.345 INFO:tasks.workunit.client.0.smithi050.stderr: 57650K .......... .......... .......... .......... .......... 34% 19.3M 4s 2023-10-26T06:44:54.346 INFO:tasks.workunit.client.0.smithi050.stderr: 57700K .......... .......... .......... .......... .......... 34% 38.8M 4s 2023-10-26T06:44:54.346 INFO:tasks.workunit.client.0.smithi050.stderr: 57750K .......... .......... .......... .......... .......... 34% 21.9M 4s 2023-10-26T06:44:54.348 INFO:tasks.workunit.client.0.smithi050.stderr: 57800K .......... .......... .......... .......... .......... 34% 28.3M 4s 2023-10-26T06:44:54.349 INFO:tasks.workunit.client.0.smithi050.stderr: 57850K .......... .......... .......... .......... .......... 34% 44.1M 4s 2023-10-26T06:44:54.353 INFO:tasks.workunit.client.0.smithi050.stderr: 57900K .......... .......... .......... .......... .......... 34% 22.8M 4s 2023-10-26T06:44:54.353 INFO:tasks.workunit.client.0.smithi050.stderr: 57950K .......... .......... .......... .......... .......... 34% 33.1M 4s 2023-10-26T06:44:54.355 INFO:tasks.workunit.client.0.smithi050.stderr: 58000K .......... .......... .......... .......... .......... 34% 20.5M 4s 2023-10-26T06:44:54.356 INFO:tasks.workunit.client.0.smithi050.stderr: 58050K .......... .......... .......... .......... .......... 34% 28.3M 4s 2023-10-26T06:44:54.357 INFO:tasks.workunit.client.0.smithi050.stderr: 58100K .......... .......... .......... .......... .......... 34% 36.6M 4s 2023-10-26T06:44:54.360 INFO:tasks.workunit.client.0.smithi050.stderr: 58150K .......... .......... .......... .......... .......... 34% 20.4M 4s 2023-10-26T06:44:54.363 INFO:tasks.workunit.client.0.smithi050.stderr: 58200K .......... .......... .......... .......... .......... 34% 36.8M 4s 2023-10-26T06:44:54.363 INFO:tasks.workunit.client.0.smithi050.stderr: 58250K .......... .......... .......... .......... .......... 34% 23.6M 4s 2023-10-26T06:44:54.366 INFO:tasks.workunit.client.0.smithi050.stderr: 58300K .......... .......... .......... .......... .......... 34% 25.2M 4s 2023-10-26T06:44:54.367 INFO:tasks.workunit.client.0.smithi050.stderr: 58350K .......... .......... .......... .......... .......... 34% 45.5M 4s 2023-10-26T06:44:54.369 INFO:tasks.workunit.client.0.smithi050.stderr: 58400K .......... .......... .......... .......... .......... 34% 22.0M 4s 2023-10-26T06:44:54.371 INFO:tasks.workunit.client.0.smithi050.stderr: 58450K .......... .......... .......... .......... .......... 34% 29.3M 4s 2023-10-26T06:44:54.373 INFO:tasks.workunit.client.0.smithi050.stderr: 58500K .......... .......... .......... .......... .......... 34% 21.9M 4s 2023-10-26T06:44:54.376 INFO:tasks.workunit.client.0.smithi050.stderr: 58550K .......... .......... .......... .......... .......... 34% 19.8M 4s 2023-10-26T06:44:54.376 INFO:tasks.workunit.client.0.smithi050.stderr: 58600K .......... .......... .......... .......... .......... 34% 36.9M 4s 2023-10-26T06:44:54.379 INFO:tasks.workunit.client.0.smithi050.stderr: 58650K .......... .......... .......... .......... .......... 34% 22.1M 4s 2023-10-26T06:44:54.381 INFO:tasks.workunit.client.0.smithi050.stderr: 58700K .......... .......... .......... .......... .......... 34% 31.6M 4s 2023-10-26T06:44:54.383 INFO:tasks.workunit.client.0.smithi050.stderr: 58750K .......... .......... .......... .......... .......... 34% 18.2M 4s 2023-10-26T06:44:54.384 INFO:tasks.workunit.client.0.smithi050.stderr: 58800K .......... .......... .......... .......... .......... 34% 45.4M 4s 2023-10-26T06:44:54.386 INFO:tasks.workunit.client.0.smithi050.stderr: 58850K .......... .......... .......... .......... .......... 34% 20.3M 4s 2023-10-26T06:44:54.388 INFO:tasks.workunit.client.0.smithi050.stderr: 58900K .......... .......... .......... .......... .......... 34% 28.5M 4s 2023-10-26T06:44:54.391 INFO:tasks.workunit.client.0.smithi050.stderr: 58950K .......... .......... .......... .......... .......... 35% 16.4M 4s 2023-10-26T06:44:54.392 INFO:tasks.workunit.client.0.smithi050.stderr: 59000K .......... .......... .......... .......... .......... 35% 27.0M 4s 2023-10-26T06:44:54.393 INFO:tasks.workunit.client.0.smithi050.stderr: 59050K .......... .......... .......... .......... .......... 35% 43.4M 4s 2023-10-26T06:44:54.395 INFO:tasks.workunit.client.0.smithi050.stderr: 59100K .......... .......... .......... .......... .......... 35% 23.5M 4s 2023-10-26T06:44:54.399 INFO:tasks.workunit.client.0.smithi050.stderr: 59150K .......... .......... .......... .......... .......... 35% 20.2M 4s 2023-10-26T06:44:54.401 INFO:tasks.workunit.client.0.smithi050.stderr: 59200K .......... .......... .......... .......... .......... 35% 26.4M 4s 2023-10-26T06:44:54.403 INFO:tasks.workunit.client.0.smithi050.stderr: 59250K .......... .......... .......... .......... .......... 35% 20.4M 4s 2023-10-26T06:44:54.404 INFO:tasks.workunit.client.0.smithi050.stderr: 59300K .......... .......... .......... .......... .......... 35% 35.4M 4s 2023-10-26T06:44:54.408 INFO:tasks.workunit.client.0.smithi050.stderr: 59350K .......... .......... .......... .......... .......... 35% 27.3M 4s 2023-10-26T06:44:54.409 INFO:tasks.workunit.client.0.smithi050.stderr: 59400K .......... .......... .......... .......... .......... 35% 25.8M 4s 2023-10-26T06:44:54.413 INFO:tasks.workunit.client.0.smithi050.stderr: 59450K .......... .......... .......... .......... .......... 35% 20.9M 4s 2023-10-26T06:44:54.413 INFO:tasks.workunit.client.0.smithi050.stderr: 59500K .......... .......... .......... .......... .......... 35% 28.4M 4s 2023-10-26T06:44:54.413 INFO:tasks.workunit.client.0.smithi050.stderr: 59550K .......... .......... .......... .......... .......... 35% 30.7M 4s 2023-10-26T06:44:54.415 INFO:tasks.workunit.client.0.smithi050.stderr: 59600K .......... .......... .......... .......... .......... 35% 30.3M 4s 2023-10-26T06:44:54.417 INFO:tasks.workunit.client.0.smithi050.stderr: 59650K .......... .......... .......... .......... .......... 35% 27.4M 4s 2023-10-26T06:44:54.444 INFO:tasks.workunit.client.0.smithi050.stderr: 59700K .......... .......... .......... .......... .......... 35% 24.1M 4s 2023-10-26T06:44:54.444 INFO:tasks.workunit.client.0.smithi050.stderr: 59750K .......... .......... .......... .......... .......... 35% 43.0M 4s 2023-10-26T06:44:54.445 INFO:tasks.workunit.client.0.smithi050.stderr: 59800K .......... .......... .......... .......... .......... 35% 59.4M 4s 2023-10-26T06:44:54.445 INFO:tasks.workunit.client.0.smithi050.stderr: 59850K .......... .......... .......... .......... .......... 35% 49.0M 4s 2023-10-26T06:44:54.445 INFO:tasks.workunit.client.0.smithi050.stderr: 59900K .......... .......... .......... .......... .......... 35% 32.1M 4s 2023-10-26T06:44:54.445 INFO:tasks.workunit.client.0.smithi050.stderr: 59950K .......... .......... .......... .......... .......... 35% 56.5M 4s 2023-10-26T06:44:54.446 INFO:tasks.workunit.client.0.smithi050.stderr: 60000K .......... .......... .......... .......... .......... 35% 39.9M 4s 2023-10-26T06:44:54.446 INFO:tasks.workunit.client.0.smithi050.stderr: 60050K .......... .......... .......... .......... .......... 35% 48.0M 4s 2023-10-26T06:44:54.446 INFO:tasks.workunit.client.0.smithi050.stderr: 60100K .......... .......... .......... .......... .......... 35% 46.1M 4s 2023-10-26T06:44:54.446 INFO:tasks.workunit.client.0.smithi050.stderr: 60150K .......... .......... .......... .......... .......... 35% 31.7M 4s 2023-10-26T06:44:54.446 INFO:tasks.workunit.client.0.smithi050.stderr: 60200K .......... .......... .......... .......... .......... 35% 25.7M 4s 2023-10-26T06:44:54.447 INFO:tasks.workunit.client.0.smithi050.stderr: 60250K .......... .......... .......... .......... .......... 35% 34.5M 4s 2023-10-26T06:44:54.447 INFO:tasks.workunit.client.0.smithi050.stderr: 60300K .......... .......... .......... .......... .......... 35% 33.2M 4s 2023-10-26T06:44:54.447 INFO:tasks.workunit.client.0.smithi050.stderr: 60350K .......... .......... .......... .......... .......... 35% 35.7M 4s 2023-10-26T06:44:54.447 INFO:tasks.workunit.client.0.smithi050.stderr: 60400K .......... .......... .......... .......... .......... 35% 23.1M 4s 2023-10-26T06:44:54.448 INFO:tasks.workunit.client.0.smithi050.stderr: 60450K .......... .......... .......... .......... .......... 35% 64.2M 4s 2023-10-26T06:44:54.448 INFO:tasks.workunit.client.0.smithi050.stderr: 60500K .......... .......... .......... .......... .......... 35% 79.3M 4s 2023-10-26T06:44:54.448 INFO:tasks.workunit.client.0.smithi050.stderr: 60550K .......... .......... .......... .......... .......... 35% 36.4M 4s 2023-10-26T06:44:54.448 INFO:tasks.workunit.client.0.smithi050.stderr: 60600K .......... .......... .......... .......... .......... 35% 36.2M 4s 2023-10-26T06:44:54.448 INFO:tasks.workunit.client.0.smithi050.stderr: 60650K .......... .......... .......... .......... .......... 36% 26.1M 4s 2023-10-26T06:44:54.454 INFO:tasks.workunit.client.0.smithi050.stderr: 60700K .......... .......... .......... .......... .......... 36% 19.8M 4s 2023-10-26T06:44:54.455 INFO:tasks.workunit.client.0.smithi050.stderr: 60750K .......... .......... .......... .......... .......... 36% 50.0M 4s 2023-10-26T06:44:54.455 INFO:tasks.workunit.client.0.smithi050.stderr: 60800K .......... .......... .......... .......... .......... 36% 15.7M 4s 2023-10-26T06:44:54.455 INFO:tasks.workunit.client.0.smithi050.stderr: 60850K .......... .......... .......... .......... .......... 36% 50.4M 4s 2023-10-26T06:44:54.455 INFO:tasks.workunit.client.0.smithi050.stderr: 60900K .......... .......... .......... .......... .......... 36% 22.6M 4s 2023-10-26T06:44:54.456 INFO:tasks.workunit.client.0.smithi050.stderr: 60950K .......... .......... .......... .......... .......... 36% 25.7M 4s 2023-10-26T06:44:54.459 INFO:tasks.workunit.client.0.smithi050.stderr: 61000K .......... .......... .......... .......... .......... 36% 35.6M 4s 2023-10-26T06:44:54.459 INFO:tasks.workunit.client.0.smithi050.stderr: 61050K .......... .......... .......... .......... .......... 36% 28.3M 4s 2023-10-26T06:44:54.459 INFO:tasks.workunit.client.0.smithi050.stderr: 61100K .......... .......... .......... .......... .......... 36% 31.6M 4s 2023-10-26T06:44:54.461 INFO:tasks.workunit.client.0.smithi050.stderr: 61150K .......... .......... .......... .......... .......... 36% 24.8M 4s 2023-10-26T06:44:54.463 INFO:tasks.workunit.client.0.smithi050.stderr: 61200K .......... .......... .......... .......... .......... 36% 27.5M 4s 2023-10-26T06:44:54.464 INFO:tasks.workunit.client.0.smithi050.stderr: 61250K .......... .......... .......... .......... .......... 36% 30.4M 4s 2023-10-26T06:44:54.466 INFO:tasks.workunit.client.0.smithi050.stderr: 61300K .......... .......... .......... .......... .......... 36% 21.8M 4s 2023-10-26T06:44:54.467 INFO:tasks.workunit.client.0.smithi050.stderr: 61350K .......... .......... .......... .......... .......... 36% 53.3M 4s 2023-10-26T06:44:54.469 INFO:tasks.workunit.client.0.smithi050.stderr: 61400K .......... .......... .......... .......... .......... 36% 24.0M 4s 2023-10-26T06:44:54.472 INFO:tasks.workunit.client.0.smithi050.stderr: 61450K .......... .......... .......... .......... .......... 36% 24.2M 4s 2023-10-26T06:44:54.473 INFO:tasks.workunit.client.0.smithi050.stderr: 61500K .......... .......... .......... .......... .......... 36% 38.3M 4s 2023-10-26T06:44:54.475 INFO:tasks.workunit.client.0.smithi050.stderr: 61550K .......... .......... .......... .......... .......... 36% 25.4M 4s 2023-10-26T06:44:54.476 INFO:tasks.workunit.client.0.smithi050.stderr: 61600K .......... .......... .......... .......... .......... 36% 39.4M 4s 2023-10-26T06:44:54.477 INFO:tasks.workunit.client.0.smithi050.stderr: 61650K .......... .......... .......... .......... .......... 36% 27.5M 4s 2023-10-26T06:44:54.480 INFO:tasks.workunit.client.0.smithi050.stderr: 61700K .......... .......... .......... .......... .......... 36% 22.0M 4s 2023-10-26T06:44:54.481 INFO:tasks.workunit.client.0.smithi050.stderr: 61750K .......... .......... .......... .......... .......... 36% 41.0M 4s 2023-10-26T06:44:54.483 INFO:tasks.workunit.client.0.smithi050.stderr: 61800K .......... .......... .......... .......... .......... 36% 23.6M 4s 2023-10-26T06:44:54.484 INFO:tasks.workunit.client.0.smithi050.stderr: 61850K .......... .......... .......... .......... .......... 36% 41.8M 4s 2023-10-26T06:44:54.486 INFO:tasks.workunit.client.0.smithi050.stderr: 61900K .......... .......... .......... .......... .......... 36% 25.2M 4s 2023-10-26T06:44:54.488 INFO:tasks.workunit.client.0.smithi050.stderr: 61950K .......... .......... .......... .......... .......... 36% 25.0M 4s 2023-10-26T06:44:54.489 INFO:tasks.workunit.client.0.smithi050.stderr: 62000K .......... .......... .......... .......... .......... 36% 37.0M 4s 2023-10-26T06:44:54.492 INFO:tasks.workunit.client.0.smithi050.stderr: 62050K .......... .......... .......... .......... .......... 36% 21.8M 4s 2023-10-26T06:44:54.494 INFO:tasks.workunit.client.0.smithi050.stderr: 62100K .......... .......... .......... .......... .......... 36% 79.4M 4s 2023-10-26T06:44:54.495 INFO:tasks.workunit.client.0.smithi050.stderr: 62150K .......... .......... .......... .......... .......... 36% 21.5M 4s 2023-10-26T06:44:54.497 INFO:tasks.workunit.client.0.smithi050.stderr: 62200K .......... .......... .......... .......... .......... 36% 25.3M 4s 2023-10-26T06:44:54.499 INFO:tasks.workunit.client.0.smithi050.stderr: 62250K .......... .......... .......... .......... .......... 36% 36.4M 4s 2023-10-26T06:44:54.500 INFO:tasks.workunit.client.0.smithi050.stderr: 62300K .......... .......... .......... .......... .......... 36% 23.9M 4s 2023-10-26T06:44:54.502 INFO:tasks.workunit.client.0.smithi050.stderr: 62350K .......... .......... .......... .......... .......... 37% 47.3M 4s 2023-10-26T06:44:54.503 INFO:tasks.workunit.client.0.smithi050.stderr: 62400K .......... .......... .......... .......... .......... 37% 21.9M 4s 2023-10-26T06:44:54.505 INFO:tasks.workunit.client.0.smithi050.stderr: 62450K .......... .......... .......... .......... .......... 37% 31.3M 4s 2023-10-26T06:44:54.507 INFO:tasks.workunit.client.0.smithi050.stderr: 62500K .......... .......... .......... .......... .......... 37% 27.7M 4s 2023-10-26T06:44:54.509 INFO:tasks.workunit.client.0.smithi050.stderr: 62550K .......... .......... .......... .......... .......... 37% 28.5M 4s 2023-10-26T06:44:54.511 INFO:tasks.workunit.client.0.smithi050.stderr: 62600K .......... .......... .......... .......... .......... 37% 24.9M 4s 2023-10-26T06:44:54.512 INFO:tasks.workunit.client.0.smithi050.stderr: 62650K .......... .......... .......... .......... .......... 37% 53.0M 4s 2023-10-26T06:44:54.514 INFO:tasks.workunit.client.0.smithi050.stderr: 62700K .......... .......... .......... .......... .......... 37% 21.9M 4s 2023-10-26T06:44:54.515 INFO:tasks.workunit.client.0.smithi050.stderr: 62750K .......... .......... .......... .......... .......... 37% 31.8M 4s 2023-10-26T06:44:54.517 INFO:tasks.workunit.client.0.smithi050.stderr: 62800K .......... .......... .......... .......... .......... 37% 26.1M 4s 2023-10-26T06:44:54.519 INFO:tasks.workunit.client.0.smithi050.stderr: 62850K .......... .......... .......... .......... .......... 37% 23.9M 4s 2023-10-26T06:44:54.520 INFO:tasks.workunit.client.0.smithi050.stderr: 62900K .......... .......... .......... .......... .......... 37% 56.4M 4s 2023-10-26T06:44:54.522 INFO:tasks.workunit.client.0.smithi050.stderr: 62950K .......... .......... .......... .......... .......... 37% 23.7M 4s 2023-10-26T06:44:54.524 INFO:tasks.workunit.client.0.smithi050.stderr: 63000K .......... .......... .......... .......... .......... 37% 25.0M 4s 2023-10-26T06:44:54.526 INFO:tasks.workunit.client.0.smithi050.stderr: 63050K .......... .......... .......... .......... .......... 37% 28.2M 4s 2023-10-26T06:44:54.527 INFO:tasks.workunit.client.0.smithi050.stderr: 63100K .......... .......... .......... .......... .......... 37% 24.6M 4s 2023-10-26T06:44:54.529 INFO:tasks.workunit.client.0.smithi050.stderr: 63150K .......... .......... .......... .......... .......... 37% 53.7M 4s 2023-10-26T06:44:54.530 INFO:tasks.workunit.client.0.smithi050.stderr: 63200K .......... .......... .......... .......... .......... 37% 33.7M 4s 2023-10-26T06:44:54.532 INFO:tasks.workunit.client.0.smithi050.stderr: 63250K .......... .......... .......... .......... .......... 37% 25.0M 4s 2023-10-26T06:44:54.534 INFO:tasks.workunit.client.0.smithi050.stderr: 63300K .......... .......... .......... .......... .......... 37% 24.6M 4s 2023-10-26T06:44:54.536 INFO:tasks.workunit.client.0.smithi050.stderr: 63350K .......... .......... .......... .......... .......... 37% 23.4M 4s 2023-10-26T06:44:54.537 INFO:tasks.workunit.client.0.smithi050.stderr: 63400K .......... .......... .......... .......... .......... 37% 51.8M 4s 2023-10-26T06:44:54.538 INFO:tasks.workunit.client.0.smithi050.stderr: 63450K .......... .......... .......... .......... .......... 37% 33.8M 4s 2023-10-26T06:44:54.541 INFO:tasks.workunit.client.0.smithi050.stderr: 63500K .......... .......... .......... .......... .......... 37% 24.4M 4s 2023-10-26T06:44:54.543 INFO:tasks.workunit.client.0.smithi050.stderr: 63550K .......... .......... .......... .......... .......... 37% 24.7M 4s 2023-10-26T06:44:54.545 INFO:tasks.workunit.client.0.smithi050.stderr: 63600K .......... .......... .......... .......... .......... 37% 24.8M 4s 2023-10-26T06:44:54.546 INFO:tasks.workunit.client.0.smithi050.stderr: 63650K .......... .......... .......... .......... .......... 37% 51.9M 4s 2023-10-26T06:44:54.547 INFO:tasks.workunit.client.0.smithi050.stderr: 63700K .......... .......... .......... .......... .......... 37% 26.3M 4s 2023-10-26T06:44:54.549 INFO:tasks.workunit.client.0.smithi050.stderr: 63750K .......... .......... .......... .......... .......... 37% 31.6M 4s 2023-10-26T06:44:54.551 INFO:tasks.workunit.client.0.smithi050.stderr: 63800K .......... .......... .......... .......... .......... 37% 22.4M 4s 2023-10-26T06:44:54.553 INFO:tasks.workunit.client.0.smithi050.stderr: 63850K .......... .......... .......... .......... .......... 37% 24.6M 4s 2023-10-26T06:44:54.554 INFO:tasks.workunit.client.0.smithi050.stderr: 63900K .......... .......... .......... .......... .......... 37% 49.6M 4s 2023-10-26T06:44:54.555 INFO:tasks.workunit.client.0.smithi050.stderr: 63950K .......... .......... .......... .......... .......... 37% 24.9M 4s 2023-10-26T06:44:54.558 INFO:tasks.workunit.client.0.smithi050.stderr: 64000K .......... .......... .......... .......... .......... 37% 33.2M 4s 2023-10-26T06:44:54.560 INFO:tasks.workunit.client.0.smithi050.stderr: 64050K .......... .......... .......... .......... .......... 38% 25.4M 4s 2023-10-26T06:44:54.561 INFO:tasks.workunit.client.0.smithi050.stderr: 64100K .......... .......... .......... .......... .......... 38% 25.1M 4s 2023-10-26T06:44:54.562 INFO:tasks.workunit.client.0.smithi050.stderr: 64150K .......... .......... .......... .......... .......... 38% 47.2M 4s 2023-10-26T06:44:54.564 INFO:tasks.workunit.client.0.smithi050.stderr: 64200K .......... .......... .......... .......... .......... 38% 23.9M 4s 2023-10-26T06:44:54.566 INFO:tasks.workunit.client.0.smithi050.stderr: 64250K .......... .......... .......... .......... .......... 38% 36.0M 4s 2023-10-26T06:44:54.568 INFO:tasks.workunit.client.0.smithi050.stderr: 64300K .......... .......... .......... .......... .......... 38% 24.5M 4s 2023-10-26T06:44:54.570 INFO:tasks.workunit.client.0.smithi050.stderr: 64350K .......... .......... .......... .......... .......... 38% 25.0M 4s 2023-10-26T06:44:54.570 INFO:tasks.workunit.client.0.smithi050.stderr: 64400K .......... .......... .......... .......... .......... 38% 47.7M 4s 2023-10-26T06:44:54.573 INFO:tasks.workunit.client.0.smithi050.stderr: 64450K .......... .......... .......... .......... .......... 38% 27.2M 4s 2023-10-26T06:44:54.575 INFO:tasks.workunit.client.0.smithi050.stderr: 64500K .......... .......... .......... .......... .......... 38% 30.9M 4s 2023-10-26T06:44:54.576 INFO:tasks.workunit.client.0.smithi050.stderr: 64550K .......... .......... .......... .......... .......... 38% 22.6M 4s 2023-10-26T06:44:54.578 INFO:tasks.workunit.client.0.smithi050.stderr: 64600K .......... .......... .......... .......... .......... 38% 24.3M 4s 2023-10-26T06:44:54.579 INFO:tasks.workunit.client.0.smithi050.stderr: 64650K .......... .......... .......... .......... .......... 38% 46.9M 4s 2023-10-26T06:44:54.581 INFO:tasks.workunit.client.0.smithi050.stderr: 64700K .......... .......... .......... .......... .......... 38% 24.9M 4s 2023-10-26T06:44:54.583 INFO:tasks.workunit.client.0.smithi050.stderr: 64750K .......... .......... .......... .......... .......... 38% 35.2M 4s 2023-10-26T06:44:54.584 INFO:tasks.workunit.client.0.smithi050.stderr: 64800K .......... .......... .......... .......... .......... 38% 25.0M 4s 2023-10-26T06:44:54.587 INFO:tasks.workunit.client.0.smithi050.stderr: 64850K .......... .......... .......... .......... .......... 38% 23.1M 4s 2023-10-26T06:44:54.587 INFO:tasks.workunit.client.0.smithi050.stderr: 64900K .......... .......... .......... .......... .......... 38% 51.4M 4s 2023-10-26T06:44:54.590 INFO:tasks.workunit.client.0.smithi050.stderr: 64950K .......... .......... .......... .......... .......... 38% 24.4M 4s 2023-10-26T06:44:54.592 INFO:tasks.workunit.client.0.smithi050.stderr: 65000K .......... .......... .......... .......... .......... 38% 23.9M 4s 2023-10-26T06:44:54.594 INFO:tasks.workunit.client.0.smithi050.stderr: 65050K .......... .......... .......... .......... .......... 38% 23.6M 4s 2023-10-26T06:44:54.596 INFO:tasks.workunit.client.0.smithi050.stderr: 65100K .......... .......... .......... .......... .......... 38% 20.9M 4s 2023-10-26T06:44:54.597 INFO:tasks.workunit.client.0.smithi050.stderr: 65150K .......... .......... .......... .......... .......... 38% 53.5M 4s 2023-10-26T06:44:54.598 INFO:tasks.workunit.client.0.smithi050.stderr: 65200K .......... .......... .......... .......... .......... 38% 26.6M 4s 2023-10-26T06:44:54.600 INFO:tasks.workunit.client.0.smithi050.stderr: 65250K .......... .......... .......... .......... .......... 38% 37.0M 4s 2023-10-26T06:44:54.603 INFO:tasks.workunit.client.0.smithi050.stderr: 65300K .......... .......... .......... .......... .......... 38% 24.8M 4s 2023-10-26T06:44:54.604 INFO:tasks.workunit.client.0.smithi050.stderr: 65350K .......... .......... .......... .......... .......... 38% 25.0M 4s 2023-10-26T06:44:54.605 INFO:tasks.workunit.client.0.smithi050.stderr: 65400K .......... .......... .......... .......... .......... 38% 42.5M 4s 2023-10-26T06:44:54.607 INFO:tasks.workunit.client.0.smithi050.stderr: 65450K .......... .......... .......... .......... .......... 38% 25.2M 4s 2023-10-26T06:44:54.609 INFO:tasks.workunit.client.0.smithi050.stderr: 65500K .......... .......... .......... .......... .......... 38% 35.9M 4s 2023-10-26T06:44:54.610 INFO:tasks.workunit.client.0.smithi050.stderr: 65550K .......... .......... .......... .......... .......... 38% 23.7M 4s 2023-10-26T06:44:54.612 INFO:tasks.workunit.client.0.smithi050.stderr: 65600K .......... .......... .......... .......... .......... 38% 23.8M 4s 2023-10-26T06:44:54.614 INFO:tasks.workunit.client.0.smithi050.stderr: 65650K .......... .......... .......... .......... .......... 38% 47.8M 4s 2023-10-26T06:44:54.615 INFO:tasks.workunit.client.0.smithi050.stderr: 65700K .......... .......... .......... .......... .......... 39% 27.3M 4s 2023-10-26T06:44:54.617 INFO:tasks.workunit.client.0.smithi050.stderr: 65750K .......... .......... .......... .......... .......... 39% 28.4M 4s 2023-10-26T06:44:54.619 INFO:tasks.workunit.client.0.smithi050.stderr: 65800K .......... .......... .......... .......... .......... 39% 23.5M 4s 2023-10-26T06:44:54.621 INFO:tasks.workunit.client.0.smithi050.stderr: 65850K .......... .......... .......... .......... .......... 39% 24.7M 4s 2023-10-26T06:44:54.622 INFO:tasks.workunit.client.0.smithi050.stderr: 65900K .......... .......... .......... .......... .......... 39% 46.0M 4s 2023-10-26T06:44:54.624 INFO:tasks.workunit.client.0.smithi050.stderr: 65950K .......... .......... .......... .......... .......... 39% 23.1M 4s 2023-10-26T06:44:54.643 INFO:tasks.workunit.client.0.smithi050.stderr: 66000K .......... .......... .......... .......... .......... 39% 35.4M 4s 2023-10-26T06:44:54.644 INFO:tasks.workunit.client.0.smithi050.stderr: 66050K .......... .......... .......... .......... .......... 39% 24.3M 4s 2023-10-26T06:44:54.644 INFO:tasks.workunit.client.0.smithi050.stderr: 66100K .......... .......... .......... .......... .......... 39% 25.5M 4s 2023-10-26T06:44:54.644 INFO:tasks.workunit.client.0.smithi050.stderr: 66150K .......... .......... .......... .......... .......... 39% 40.0M 4s 2023-10-26T06:44:54.644 INFO:tasks.workunit.client.0.smithi050.stderr: 66200K .......... .......... .......... .......... .......... 39% 27.7M 4s 2023-10-26T06:44:54.644 INFO:tasks.workunit.client.0.smithi050.stderr: 66250K .......... .......... .......... .......... .......... 39% 23.3M 4s 2023-10-26T06:44:54.645 INFO:tasks.workunit.client.0.smithi050.stderr: 66300K .......... .......... .......... .......... .......... 39% 34.5M 4s 2023-10-26T06:44:54.645 INFO:tasks.workunit.client.0.smithi050.stderr: 66350K .......... .......... .......... .......... .......... 39% 24.0M 4s 2023-10-26T06:44:54.645 INFO:tasks.workunit.client.0.smithi050.stderr: 66400K .......... .......... .......... .......... .......... 39% 58.9M 4s 2023-10-26T06:44:54.645 INFO:tasks.workunit.client.0.smithi050.stderr: 66450K .......... .......... .......... .......... .......... 39% 24.3M 4s 2023-10-26T06:44:54.645 INFO:tasks.workunit.client.0.smithi050.stderr: 66500K .......... .......... .......... .......... .......... 39% 32.1M 4s 2023-10-26T06:44:54.649 INFO:tasks.workunit.client.0.smithi050.stderr: 66550K .......... .......... .......... .......... .......... 39% 24.1M 4s 2023-10-26T06:44:54.649 INFO:tasks.workunit.client.0.smithi050.stderr: 66600K .......... .......... .......... .......... .......... 39% 23.3M 4s 2023-10-26T06:44:54.650 INFO:tasks.workunit.client.0.smithi050.stderr: 66650K .......... .......... .......... .......... .......... 39% 42.9M 4s 2023-10-26T06:44:54.650 INFO:tasks.workunit.client.0.smithi050.stderr: 66700K .......... .......... .......... .......... .......... 39% 33.3M 4s 2023-10-26T06:44:54.651 INFO:tasks.workunit.client.0.smithi050.stderr: 66750K .......... .......... .......... .......... .......... 39% 21.5M 4s 2023-10-26T06:44:54.652 INFO:tasks.workunit.client.0.smithi050.stderr: 66800K .......... .......... .......... .......... .......... 39% 43.0M 4s 2023-10-26T06:44:54.656 INFO:tasks.workunit.client.0.smithi050.stderr: 66850K .......... .......... .......... .......... .......... 39% 38.6M 4s 2023-10-26T06:44:54.656 INFO:tasks.workunit.client.0.smithi050.stderr: 66900K .......... .......... .......... .......... .......... 39% 24.8M 4s 2023-10-26T06:44:54.658 INFO:tasks.workunit.client.0.smithi050.stderr: 66950K .......... .......... .......... .......... .......... 39% 22.5M 4s 2023-10-26T06:44:54.660 INFO:tasks.workunit.client.0.smithi050.stderr: 67000K .......... .......... .......... .......... .......... 39% 24.8M 4s 2023-10-26T06:44:54.662 INFO:tasks.workunit.client.0.smithi050.stderr: 67050K .......... .......... .......... .......... .......... 39% 32.9M 4s 2023-10-26T06:44:54.663 INFO:tasks.workunit.client.0.smithi050.stderr: 67100K .......... .......... .......... .......... .......... 39% 26.5M 4s 2023-10-26T06:44:54.664 INFO:tasks.workunit.client.0.smithi050.stderr: 67150K .......... .......... .......... .......... .......... 39% 47.2M 4s 2023-10-26T06:44:54.666 INFO:tasks.workunit.client.0.smithi050.stderr: 67200K .......... .......... .......... .......... .......... 39% 23.7M 4s 2023-10-26T06:44:54.668 INFO:tasks.workunit.client.0.smithi050.stderr: 67250K .......... .......... .......... .......... .......... 39% 32.2M 4s 2023-10-26T06:44:54.670 INFO:tasks.workunit.client.0.smithi050.stderr: 67300K .......... .......... .......... .......... .......... 39% 23.3M 4s 2023-10-26T06:44:54.673 INFO:tasks.workunit.client.0.smithi050.stderr: 67350K .......... .......... .......... .......... .......... 39% 53.2M 4s 2023-10-26T06:44:54.673 INFO:tasks.workunit.client.0.smithi050.stderr: 67400K .......... .......... .......... .......... .......... 40% 28.4M 4s 2023-10-26T06:44:54.675 INFO:tasks.workunit.client.0.smithi050.stderr: 67450K .......... .......... .......... .......... .......... 40% 17.7M 4s 2023-10-26T06:44:54.677 INFO:tasks.workunit.client.0.smithi050.stderr: 67500K .......... .......... .......... .......... .......... 40% 38.6M 4s 2023-10-26T06:44:54.679 INFO:tasks.workunit.client.0.smithi050.stderr: 67550K .......... .......... .......... .......... .......... 40% 27.2M 4s 2023-10-26T06:44:54.680 INFO:tasks.workunit.client.0.smithi050.stderr: 67600K .......... .......... .......... .......... .......... 40% 31.1M 4s 2023-10-26T06:44:54.682 INFO:tasks.workunit.client.0.smithi050.stderr: 67650K .......... .......... .......... .......... .......... 40% 24.5M 4s 2023-10-26T06:44:54.683 INFO:tasks.workunit.client.0.smithi050.stderr: 67700K .......... .......... .......... .......... .......... 40% 46.0M 4s 2023-10-26T06:44:54.685 INFO:tasks.workunit.client.0.smithi050.stderr: 67750K .......... .......... .......... .......... .......... 40% 28.5M 4s 2023-10-26T06:44:54.688 INFO:tasks.workunit.client.0.smithi050.stderr: 67800K .......... .......... .......... .......... .......... 40% 23.5M 4s 2023-10-26T06:44:54.688 INFO:tasks.workunit.client.0.smithi050.stderr: 67850K .......... .......... .......... .......... .......... 40% 48.3M 4s 2023-10-26T06:44:54.690 INFO:tasks.workunit.client.0.smithi050.stderr: 67900K .......... .......... .......... .......... .......... 40% 24.0M 4s 2023-10-26T06:44:54.691 INFO:tasks.workunit.client.0.smithi050.stderr: 67950K .......... .......... .......... .......... .......... 40% 35.7M 4s 2023-10-26T06:44:54.693 INFO:tasks.workunit.client.0.smithi050.stderr: 68000K .......... .......... .......... .......... .......... 40% 23.9M 4s 2023-10-26T06:44:54.694 INFO:tasks.workunit.client.0.smithi050.stderr: 68050K .......... .......... .......... .......... .......... 40% 34.3M 4s 2023-10-26T06:44:54.696 INFO:tasks.workunit.client.0.smithi050.stderr: 68100K .......... .......... .......... .......... .......... 40% 31.7M 4s 2023-10-26T06:44:54.699 INFO:tasks.workunit.client.0.smithi050.stderr: 68150K .......... .......... .......... .......... .......... 40% 19.5M 4s 2023-10-26T06:44:54.699 INFO:tasks.workunit.client.0.smithi050.stderr: 68200K .......... .......... .......... .......... .......... 40% 44.5M 4s 2023-10-26T06:44:54.701 INFO:tasks.workunit.client.0.smithi050.stderr: 68250K .......... .......... .......... .......... .......... 40% 34.0M 4s 2023-10-26T06:44:54.704 INFO:tasks.workunit.client.0.smithi050.stderr: 68300K .......... .......... .......... .......... .......... 40% 19.8M 4s 2023-10-26T06:44:54.705 INFO:tasks.workunit.client.0.smithi050.stderr: 68350K .......... .......... .......... .......... .......... 40% 37.1M 4s 2023-10-26T06:44:54.707 INFO:tasks.workunit.client.0.smithi050.stderr: 68400K .......... .......... .......... .......... .......... 40% 25.1M 4s 2023-10-26T06:44:54.708 INFO:tasks.workunit.client.0.smithi050.stderr: 68450K .......... .......... .......... .......... .......... 40% 35.0M 4s 2023-10-26T06:44:54.711 INFO:tasks.workunit.client.0.smithi050.stderr: 68500K .......... .......... .......... .......... .......... 40% 20.2M 4s 2023-10-26T06:44:54.712 INFO:tasks.workunit.client.0.smithi050.stderr: 68550K .......... .......... .......... .......... .......... 40% 40.4M 4s 2023-10-26T06:44:54.714 INFO:tasks.workunit.client.0.smithi050.stderr: 68600K .......... .......... .......... .......... .......... 40% 21.8M 4s 2023-10-26T06:44:54.717 INFO:tasks.workunit.client.0.smithi050.stderr: 68650K .......... .......... .......... .......... .......... 40% 22.8M 4s 2023-10-26T06:44:54.717 INFO:tasks.workunit.client.0.smithi050.stderr: 68700K .......... .......... .......... .......... .......... 40% 57.9M 4s 2023-10-26T06:44:54.720 INFO:tasks.workunit.client.0.smithi050.stderr: 68750K .......... .......... .......... .......... .......... 40% 20.9M 4s 2023-10-26T06:44:54.721 INFO:tasks.workunit.client.0.smithi050.stderr: 68800K .......... .......... .......... .......... .......... 40% 33.9M 4s 2023-10-26T06:44:54.723 INFO:tasks.workunit.client.0.smithi050.stderr: 68850K .......... .......... .......... .......... .......... 40% 24.7M 4s 2023-10-26T06:44:54.725 INFO:tasks.workunit.client.0.smithi050.stderr: 68900K .......... .......... .......... .......... .......... 40% 22.7M 4s 2023-10-26T06:44:54.726 INFO:tasks.workunit.client.0.smithi050.stderr: 68950K .......... .......... .......... .......... .......... 40% 43.4M 4s 2023-10-26T06:44:54.728 INFO:tasks.workunit.client.0.smithi050.stderr: 69000K .......... .......... .......... .......... .......... 40% 23.5M 4s 2023-10-26T06:44:54.729 INFO:tasks.workunit.client.0.smithi050.stderr: 69050K .......... .......... .......... .......... .......... 40% 40.4M 4s 2023-10-26T06:44:54.731 INFO:tasks.workunit.client.0.smithi050.stderr: 69100K .......... .......... .......... .......... .......... 41% 26.3M 4s 2023-10-26T06:44:54.733 INFO:tasks.workunit.client.0.smithi050.stderr: 69150K .......... .......... .......... .......... .......... 41% 25.6M 4s 2023-10-26T06:44:54.735 INFO:tasks.workunit.client.0.smithi050.stderr: 69200K .......... .......... .......... .......... .......... 41% 38.9M 4s 2023-10-26T06:44:54.736 INFO:tasks.workunit.client.0.smithi050.stderr: 69250K .......... .......... .......... .......... .......... 41% 22.6M 4s 2023-10-26T06:44:54.738 INFO:tasks.workunit.client.0.smithi050.stderr: 69300K .......... .......... .......... .......... .......... 41% 37.5M 4s 2023-10-26T06:44:54.741 INFO:tasks.workunit.client.0.smithi050.stderr: 69350K .......... .......... .......... .......... .......... 41% 24.7M 4s 2023-10-26T06:44:54.743 INFO:tasks.workunit.client.0.smithi050.stderr: 69400K .......... .......... .......... .......... .......... 41% 23.5M 4s 2023-10-26T06:44:54.743 INFO:tasks.workunit.client.0.smithi050.stderr: 69450K .......... .......... .......... .......... .......... 41% 48.6M 4s 2023-10-26T06:44:54.745 INFO:tasks.workunit.client.0.smithi050.stderr: 69500K .......... .......... .......... .......... .......... 41% 23.7M 4s 2023-10-26T06:44:54.747 INFO:tasks.workunit.client.0.smithi050.stderr: 69550K .......... .......... .......... .......... .......... 41% 37.4M 4s 2023-10-26T06:44:54.748 INFO:tasks.workunit.client.0.smithi050.stderr: 69600K .......... .......... .......... .......... .......... 41% 25.2M 4s 2023-10-26T06:44:54.750 INFO:tasks.workunit.client.0.smithi050.stderr: 69650K .......... .......... .......... .......... .......... 41% 25.1M 4s 2023-10-26T06:44:54.751 INFO:tasks.workunit.client.0.smithi050.stderr: 69700K .......... .......... .......... .......... .......... 41% 39.5M 4s 2023-10-26T06:44:54.753 INFO:tasks.workunit.client.0.smithi050.stderr: 69750K .......... .......... .......... .......... .......... 41% 37.0M 4s 2023-10-26T06:44:54.757 INFO:tasks.workunit.client.0.smithi050.stderr: 69800K .......... .......... .......... .......... .......... 41% 14.1M 4s 2023-10-26T06:44:54.760 INFO:tasks.workunit.client.0.smithi050.stderr: 69850K .......... .......... .......... .......... .......... 41% 29.7M 4s 2023-10-26T06:44:54.760 INFO:tasks.workunit.client.0.smithi050.stderr: 69900K .......... .......... .......... .......... .......... 41% 49.1M 4s 2023-10-26T06:44:54.760 INFO:tasks.workunit.client.0.smithi050.stderr: 69950K .......... .......... .......... .......... .......... 41% 52.4M 4s 2023-10-26T06:44:54.762 INFO:tasks.workunit.client.0.smithi050.stderr: 70000K .......... .......... .......... .......... .......... 41% 24.8M 4s 2023-10-26T06:44:54.763 INFO:tasks.workunit.client.0.smithi050.stderr: 70050K .......... .......... .......... .......... .......... 41% 32.3M 4s 2023-10-26T06:44:54.766 INFO:tasks.workunit.client.0.smithi050.stderr: 70100K .......... .......... .......... .......... .......... 41% 21.3M 4s 2023-10-26T06:44:54.767 INFO:tasks.workunit.client.0.smithi050.stderr: 70150K .......... .......... .......... .......... .......... 41% 28.6M 4s 2023-10-26T06:44:54.768 INFO:tasks.workunit.client.0.smithi050.stderr: 70200K .......... .......... .......... .......... .......... 41% 38.4M 4s 2023-10-26T06:44:54.770 INFO:tasks.workunit.client.0.smithi050.stderr: 70250K .......... .......... .......... .......... .......... 41% 27.0M 4s 2023-10-26T06:44:54.772 INFO:tasks.workunit.client.0.smithi050.stderr: 70300K .......... .......... .......... .......... .......... 41% 36.4M 4s 2023-10-26T06:44:54.778 INFO:tasks.workunit.client.0.smithi050.stderr: 70350K .......... .......... .......... .......... .......... 41% 10.7M 4s 2023-10-26T06:44:54.778 INFO:tasks.workunit.client.0.smithi050.stderr: 70400K .......... .......... .......... .......... .......... 41% 199M 4s 2023-10-26T06:44:54.779 INFO:tasks.workunit.client.0.smithi050.stderr: 70450K .......... .......... .......... .......... .......... 41% 167M 4s 2023-10-26T06:44:54.780 INFO:tasks.workunit.client.0.smithi050.stderr: 70500K .......... .......... .......... .......... .......... 41% 23.1M 4s 2023-10-26T06:44:54.780 INFO:tasks.workunit.client.0.smithi050.stderr: 70550K .......... .......... .......... .......... .......... 41% 36.1M 4s 2023-10-26T06:44:54.782 INFO:tasks.workunit.client.0.smithi050.stderr: 70600K .......... .......... .......... .......... .......... 41% 31.3M 4s 2023-10-26T06:44:54.783 INFO:tasks.workunit.client.0.smithi050.stderr: 70650K .......... .......... .......... .......... .......... 41% 26.6M 4s 2023-10-26T06:44:54.785 INFO:tasks.workunit.client.0.smithi050.stderr: 70700K .......... .......... .......... .......... .......... 41% 30.8M 4s 2023-10-26T06:44:54.787 INFO:tasks.workunit.client.0.smithi050.stderr: 70750K .......... .......... .......... .......... .......... 42% 33.2M 4s 2023-10-26T06:44:54.789 INFO:tasks.workunit.client.0.smithi050.stderr: 70800K .......... .......... .......... .......... .......... 42% 26.1M 4s 2023-10-26T06:44:54.791 INFO:tasks.workunit.client.0.smithi050.stderr: 70850K .......... .......... .......... .......... .......... 42% 24.3M 4s 2023-10-26T06:44:54.793 INFO:tasks.workunit.client.0.smithi050.stderr: 70900K .......... .......... .......... .......... .......... 42% 25.7M 4s 2023-10-26T06:44:54.793 INFO:tasks.workunit.client.0.smithi050.stderr: 70950K .......... .......... .......... .......... .......... 42% 42.6M 4s 2023-10-26T06:44:54.795 INFO:tasks.workunit.client.0.smithi050.stderr: 71000K .......... .......... .......... .......... .......... 42% 23.9M 4s 2023-10-26T06:44:54.797 INFO:tasks.workunit.client.0.smithi050.stderr: 71050K .......... .......... .......... .......... .......... 42% 31.8M 4s 2023-10-26T06:44:54.799 INFO:tasks.workunit.client.0.smithi050.stderr: 71100K .......... .......... .......... .......... .......... 42% 28.5M 4s 2023-10-26T06:44:54.800 INFO:tasks.workunit.client.0.smithi050.stderr: 71150K .......... .......... .......... .......... .......... 42% 42.1M 4s 2023-10-26T06:44:54.802 INFO:tasks.workunit.client.0.smithi050.stderr: 71200K .......... .......... .......... .......... .......... 42% 26.2M 4s 2023-10-26T06:44:54.804 INFO:tasks.workunit.client.0.smithi050.stderr: 71250K .......... .......... .......... .......... .......... 42% 24.4M 4s 2023-10-26T06:44:54.806 INFO:tasks.workunit.client.0.smithi050.stderr: 71300K .......... .......... .......... .......... .......... 42% 25.4M 4s 2023-10-26T06:44:54.808 INFO:tasks.workunit.client.0.smithi050.stderr: 71350K .......... .......... .......... .......... .......... 42% 33.7M 4s 2023-10-26T06:44:54.810 INFO:tasks.workunit.client.0.smithi050.stderr: 71400K .......... .......... .......... .......... .......... 42% 24.8M 4s 2023-10-26T06:44:54.811 INFO:tasks.workunit.client.0.smithi050.stderr: 71450K .......... .......... .......... .......... .......... 42% 49.0M 4s 2023-10-26T06:44:54.815 INFO:tasks.workunit.client.0.smithi050.stderr: 71500K .......... .......... .......... .......... .......... 42% 24.5M 4s 2023-10-26T06:44:54.815 INFO:tasks.workunit.client.0.smithi050.stderr: 71550K .......... .......... .......... .......... .......... 42% 28.2M 4s 2023-10-26T06:44:54.817 INFO:tasks.workunit.client.0.smithi050.stderr: 71600K .......... .......... .......... .......... .......... 42% 28.9M 4s 2023-10-26T06:44:54.819 INFO:tasks.workunit.client.0.smithi050.stderr: 71650K .......... .......... .......... .......... .......... 42% 24.3M 4s 2023-10-26T06:44:54.819 INFO:tasks.workunit.client.0.smithi050.stderr: 71700K .......... .......... .......... .......... .......... 42% 46.0M 4s 2023-10-26T06:44:54.821 INFO:tasks.workunit.client.0.smithi050.stderr: 71750K .......... .......... .......... .......... .......... 42% 25.2M 4s 2023-10-26T06:44:54.823 INFO:tasks.workunit.client.0.smithi050.stderr: 71800K .......... .......... .......... .......... .......... 42% 23.2M 4s 2023-10-26T06:44:54.824 INFO:tasks.workunit.client.0.smithi050.stderr: 71850K .......... .......... .......... .......... .......... 42% 38.2M 4s 2023-10-26T06:44:54.826 INFO:tasks.workunit.client.0.smithi050.stderr: 71900K .......... .......... .......... .......... .......... 42% 25.0M 4s 2023-10-26T06:44:54.827 INFO:tasks.workunit.client.0.smithi050.stderr: 71950K .......... .......... .......... .......... .......... 42% 45.8M 4s 2023-10-26T06:44:54.829 INFO:tasks.workunit.client.0.smithi050.stderr: 72000K .......... .......... .......... .......... .......... 42% 25.3M 4s 2023-10-26T06:44:54.831 INFO:tasks.workunit.client.0.smithi050.stderr: 72050K .......... .......... .......... .......... .......... 42% 27.5M 4s 2023-10-26T06:44:54.833 INFO:tasks.workunit.client.0.smithi050.stderr: 72100K .......... .......... .......... .......... .......... 42% 30.0M 4s 2023-10-26T06:44:54.836 INFO:tasks.workunit.client.0.smithi050.stderr: 72150K .......... .......... .......... .......... .......... 42% 19.6M 4s 2023-10-26T06:44:54.837 INFO:tasks.workunit.client.0.smithi050.stderr: 72200K .......... .......... .......... .......... .......... 42% 55.0M 4s 2023-10-26T06:44:54.838 INFO:tasks.workunit.client.0.smithi050.stderr: 72250K .......... .......... .......... .......... .......... 42% 26.4M 4s 2023-10-26T06:44:54.840 INFO:tasks.workunit.client.0.smithi050.stderr: 72300K .......... .......... .......... .......... .......... 42% 30.0M 4s 2023-10-26T06:44:54.842 INFO:tasks.workunit.client.0.smithi050.stderr: 72350K .......... .......... .......... .......... .......... 42% 26.9M 4s 2023-10-26T06:44:54.843 INFO:tasks.workunit.client.0.smithi050.stderr: 72400K .......... .......... .......... .......... .......... 42% 23.0M 4s 2023-10-26T06:44:54.844 INFO:tasks.workunit.client.0.smithi050.stderr: 72450K .......... .......... .......... .......... .......... 43% 40.7M 4s 2023-10-26T06:44:54.846 INFO:tasks.workunit.client.0.smithi050.stderr: 72500K .......... .......... .......... .......... .......... 43% 28.4M 4s 2023-10-26T06:44:54.848 INFO:tasks.workunit.client.0.smithi050.stderr: 72550K .......... .......... .......... .......... .......... 43% 26.5M 4s 2023-10-26T06:44:54.850 INFO:tasks.workunit.client.0.smithi050.stderr: 72600K .......... .......... .......... .......... .......... 43% 35.6M 4s 2023-10-26T06:44:54.851 INFO:tasks.workunit.client.0.smithi050.stderr: 72650K .......... .......... .......... .......... .......... 43% 24.3M 4s 2023-10-26T06:44:54.855 INFO:tasks.workunit.client.0.smithi050.stderr: 72700K .......... .......... .......... .......... .......... 43% 35.4M 4s 2023-10-26T06:44:54.855 INFO:tasks.workunit.client.0.smithi050.stderr: 72750K .......... .......... .......... .......... .......... 43% 24.5M 4s 2023-10-26T06:44:54.857 INFO:tasks.workunit.client.0.smithi050.stderr: 72800K .......... .......... .......... .......... .......... 43% 23.8M 4s 2023-10-26T06:44:54.859 INFO:tasks.workunit.client.0.smithi050.stderr: 72850K .......... .......... .......... .......... .......... 43% 29.3M 4s 2023-10-26T06:44:54.861 INFO:tasks.workunit.client.0.smithi050.stderr: 72900K .......... .......... .......... .......... .......... 43% 24.6M 4s 2023-10-26T06:44:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 72950K .......... .......... .......... .......... .......... 43% 24.9M 4s 2023-10-26T06:44:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 73000K .......... .......... .......... .......... .......... 43% 52.0M 4s 2023-10-26T06:44:54.865 INFO:tasks.workunit.client.0.smithi050.stderr: 73050K .......... .......... .......... .......... .......... 43% 22.4M 4s 2023-10-26T06:44:54.868 INFO:tasks.workunit.client.0.smithi050.stderr: 73100K .......... .......... .......... .......... .......... 43% 37.0M 4s 2023-10-26T06:44:54.869 INFO:tasks.workunit.client.0.smithi050.stderr: 73150K .......... .......... .......... .......... .......... 43% 23.4M 4s 2023-10-26T06:44:54.870 INFO:tasks.workunit.client.0.smithi050.stderr: 73200K .......... .......... .......... .......... .......... 43% 43.3M 4s 2023-10-26T06:44:54.872 INFO:tasks.workunit.client.0.smithi050.stderr: 73250K .......... .......... .......... .......... .......... 43% 24.4M 4s 2023-10-26T06:44:54.874 INFO:tasks.workunit.client.0.smithi050.stderr: 73300K .......... .......... .......... .......... .......... 43% 24.8M 4s 2023-10-26T06:44:54.876 INFO:tasks.workunit.client.0.smithi050.stderr: 73350K .......... .......... .......... .......... .......... 43% 35.6M 4s 2023-10-26T06:44:54.877 INFO:tasks.workunit.client.0.smithi050.stderr: 73400K .......... .......... .......... .......... .......... 43% 24.5M 4s 2023-10-26T06:44:54.887 INFO:tasks.workunit.client.0.smithi050.stderr: 73450K .......... .......... .......... .......... .......... 43% 22.3M 4s 2023-10-26T06:44:54.887 INFO:tasks.workunit.client.0.smithi050.stderr: 73500K .......... .......... .......... .......... .......... 43% 44.6M 4s 2023-10-26T06:44:54.888 INFO:tasks.workunit.client.0.smithi050.stderr: 73550K .......... .......... .......... .......... .......... 43% 23.5M 4s 2023-10-26T06:44:54.888 INFO:tasks.workunit.client.0.smithi050.stderr: 73600K .......... .......... .......... .......... .......... 43% 36.6M 4s 2023-10-26T06:44:54.888 INFO:tasks.workunit.client.0.smithi050.stderr: 73650K .......... .......... .......... .......... .......... 43% 25.0M 4s 2023-10-26T06:44:54.890 INFO:tasks.workunit.client.0.smithi050.stderr: 73700K .......... .......... .......... .......... .......... 43% 22.5M 4s 2023-10-26T06:44:54.890 INFO:tasks.workunit.client.0.smithi050.stderr: 73750K .......... .......... .......... .......... .......... 43% 46.3M 4s 2023-10-26T06:44:54.892 INFO:tasks.workunit.client.0.smithi050.stderr: 73800K .......... .......... .......... .......... .......... 43% 24.6M 4s 2023-10-26T06:44:54.893 INFO:tasks.workunit.client.0.smithi050.stderr: 73850K .......... .......... .......... .......... .......... 43% 41.6M 4s 2023-10-26T06:44:54.894 INFO:tasks.workunit.client.0.smithi050.stderr: 73900K .......... .......... .......... .......... .......... 43% 22.9M 4s 2023-10-26T06:44:54.897 INFO:tasks.workunit.client.0.smithi050.stderr: 73950K .......... .......... .......... .......... .......... 43% 24.9M 4s 2023-10-26T06:44:54.898 INFO:tasks.workunit.client.0.smithi050.stderr: 74000K .......... .......... .......... .......... .......... 43% 46.5M 4s 2023-10-26T06:44:54.900 INFO:tasks.workunit.client.0.smithi050.stderr: 74050K .......... .......... .......... .......... .......... 43% 24.8M 4s 2023-10-26T06:44:54.902 INFO:tasks.workunit.client.0.smithi050.stderr: 74100K .......... .......... .......... .......... .......... 43% 35.4M 4s 2023-10-26T06:44:54.904 INFO:tasks.workunit.client.0.smithi050.stderr: 74150K .......... .......... .......... .......... .......... 44% 23.0M 4s 2023-10-26T06:44:54.904 INFO:tasks.workunit.client.0.smithi050.stderr: 74200K .......... .......... .......... .......... .......... 44% 48.1M 4s 2023-10-26T06:44:54.906 INFO:tasks.workunit.client.0.smithi050.stderr: 74250K .......... .......... .......... .......... .......... 44% 26.8M 4s 2023-10-26T06:44:54.908 INFO:tasks.workunit.client.0.smithi050.stderr: 74300K .......... .......... .......... .......... .......... 44% 23.9M 4s 2023-10-26T06:44:54.910 INFO:tasks.workunit.client.0.smithi050.stderr: 74350K .......... .......... .......... .......... .......... 44% 32.5M 4s 2023-10-26T06:44:54.911 INFO:tasks.workunit.client.0.smithi050.stderr: 74400K .......... .......... .......... .......... .......... 44% 38.5M 4s 2023-10-26T06:44:54.913 INFO:tasks.workunit.client.0.smithi050.stderr: 74450K .......... .......... .......... .......... .......... 44% 24.1M 4s 2023-10-26T06:44:54.914 INFO:tasks.workunit.client.0.smithi050.stderr: 74500K .......... .......... .......... .......... .......... 44% 29.8M 4s 2023-10-26T06:44:54.919 INFO:tasks.workunit.client.0.smithi050.stderr: 74550K .......... .......... .......... .......... .......... 44% 17.9M 4s 2023-10-26T06:44:54.919 INFO:tasks.workunit.client.0.smithi050.stderr: 74600K .......... .......... .......... .......... .......... 44% 31.5M 4s 2023-10-26T06:44:54.921 INFO:tasks.workunit.client.0.smithi050.stderr: 74650K .......... .......... .......... .......... .......... 44% 28.1M 4s 2023-10-26T06:44:54.921 INFO:tasks.workunit.client.0.smithi050.stderr: 74700K .......... .......... .......... .......... .......... 44% 70.4M 4s 2023-10-26T06:44:54.923 INFO:tasks.workunit.client.0.smithi050.stderr: 74750K .......... .......... .......... .......... .......... 44% 26.4M 4s 2023-10-26T06:44:54.925 INFO:tasks.workunit.client.0.smithi050.stderr: 74800K .......... .......... .......... .......... .......... 44% 30.5M 4s 2023-10-26T06:44:54.927 INFO:tasks.workunit.client.0.smithi050.stderr: 74850K .......... .......... .......... .......... .......... 44% 24.1M 4s 2023-10-26T06:44:54.929 INFO:tasks.workunit.client.0.smithi050.stderr: 74900K .......... .......... .......... .......... .......... 44% 24.3M 4s 2023-10-26T06:44:54.930 INFO:tasks.workunit.client.0.smithi050.stderr: 74950K .......... .......... .......... .......... .......... 44% 46.0M 4s 2023-10-26T06:44:54.932 INFO:tasks.workunit.client.0.smithi050.stderr: 75000K .......... .......... .......... .......... .......... 44% 29.2M 4s 2023-10-26T06:44:54.934 INFO:tasks.workunit.client.0.smithi050.stderr: 75050K .......... .......... .......... .......... .......... 44% 28.3M 4s 2023-10-26T06:44:54.936 INFO:tasks.workunit.client.0.smithi050.stderr: 75100K .......... .......... .......... .......... .......... 44% 24.2M 4s 2023-10-26T06:44:54.938 INFO:tasks.workunit.client.0.smithi050.stderr: 75150K .......... .......... .......... .......... .......... 44% 22.3M 4s 2023-10-26T06:44:54.938 INFO:tasks.workunit.client.0.smithi050.stderr: 75200K .......... .......... .......... .......... .......... 44% 61.7M 4s 2023-10-26T06:44:54.940 INFO:tasks.workunit.client.0.smithi050.stderr: 75250K .......... .......... .......... .......... .......... 44% 28.3M 4s 2023-10-26T06:44:54.942 INFO:tasks.workunit.client.0.smithi050.stderr: 75300K .......... .......... .......... .......... .......... 44% 25.2M 4s 2023-10-26T06:44:54.944 INFO:tasks.workunit.client.0.smithi050.stderr: 75350K .......... .......... .......... .......... .......... 44% 28.1M 4s 2023-10-26T06:44:54.945 INFO:tasks.workunit.client.0.smithi050.stderr: 75400K .......... .......... .......... .......... .......... 44% 37.9M 4s 2023-10-26T06:44:54.946 INFO:tasks.workunit.client.0.smithi050.stderr: 75450K .......... .......... .......... .......... .......... 44% 24.6M 4s 2023-10-26T06:44:54.948 INFO:tasks.workunit.client.0.smithi050.stderr: 75500K .......... .......... .......... .......... .......... 44% 35.0M 4s 2023-10-26T06:44:54.950 INFO:tasks.workunit.client.0.smithi050.stderr: 75550K .......... .......... .......... .......... .......... 44% 23.7M 4s 2023-10-26T06:44:54.953 INFO:tasks.workunit.client.0.smithi050.stderr: 75600K .......... .......... .......... .......... .......... 44% 24.7M 4s 2023-10-26T06:44:54.954 INFO:tasks.workunit.client.0.smithi050.stderr: 75650K .......... .......... .......... .......... .......... 44% 25.8M 4s 2023-10-26T06:44:54.956 INFO:tasks.workunit.client.0.smithi050.stderr: 75700K .......... .......... .......... .......... .......... 44% 31.0M 4s 2023-10-26T06:44:54.957 INFO:tasks.workunit.client.0.smithi050.stderr: 75750K .......... .......... .......... .......... .......... 44% 44.0M 3s 2023-10-26T06:44:54.959 INFO:tasks.workunit.client.0.smithi050.stderr: 75800K .......... .......... .......... .......... .......... 44% 27.5M 3s 2023-10-26T06:44:54.961 INFO:tasks.workunit.client.0.smithi050.stderr: 75850K .......... .......... .......... .......... .......... 45% 30.5M 3s 2023-10-26T06:44:54.963 INFO:tasks.workunit.client.0.smithi050.stderr: 75900K .......... .......... .......... .......... .......... 45% 24.3M 3s 2023-10-26T06:44:54.963 INFO:tasks.workunit.client.0.smithi050.stderr: 75950K .......... .......... .......... .......... .......... 45% 34.6M 3s 2023-10-26T06:44:54.966 INFO:tasks.workunit.client.0.smithi050.stderr: 76000K .......... .......... .......... .......... .......... 45% 25.3M 3s 2023-10-26T06:44:54.968 INFO:tasks.workunit.client.0.smithi050.stderr: 76050K .......... .......... .......... .......... .......... 45% 32.0M 3s 2023-10-26T06:44:54.969 INFO:tasks.workunit.client.0.smithi050.stderr: 76100K .......... .......... .......... .......... .......... 45% 23.9M 3s 2023-10-26T06:44:54.971 INFO:tasks.workunit.client.0.smithi050.stderr: 76150K .......... .......... .......... .......... .......... 45% 22.8M 3s 2023-10-26T06:44:54.973 INFO:tasks.workunit.client.0.smithi050.stderr: 76200K .......... .......... .......... .......... .......... 45% 32.5M 3s 2023-10-26T06:44:54.974 INFO:tasks.workunit.client.0.smithi050.stderr: 76250K .......... .......... .......... .......... .......... 45% 35.8M 3s 2023-10-26T06:44:54.976 INFO:tasks.workunit.client.0.smithi050.stderr: 76300K .......... .......... .......... .......... .......... 45% 23.1M 3s 2023-10-26T06:44:54.979 INFO:tasks.workunit.client.0.smithi050.stderr: 76350K .......... .......... .......... .......... .......... 45% 21.4M 3s 2023-10-26T06:44:54.979 INFO:tasks.workunit.client.0.smithi050.stderr: 76400K .......... .......... .......... .......... .......... 45% 44.9M 3s 2023-10-26T06:44:54.983 INFO:tasks.workunit.client.0.smithi050.stderr: 76450K .......... .......... .......... .......... .......... 45% 20.3M 3s 2023-10-26T06:44:54.983 INFO:tasks.workunit.client.0.smithi050.stderr: 76500K .......... .......... .......... .......... .......... 45% 41.9M 3s 2023-10-26T06:44:54.985 INFO:tasks.workunit.client.0.smithi050.stderr: 76550K .......... .......... .......... .......... .......... 45% 24.5M 3s 2023-10-26T06:44:54.987 INFO:tasks.workunit.client.0.smithi050.stderr: 76600K .......... .......... .......... .......... .......... 45% 24.5M 3s 2023-10-26T06:44:54.988 INFO:tasks.workunit.client.0.smithi050.stderr: 76650K .......... .......... .......... .......... .......... 45% 35.0M 3s 2023-10-26T06:44:54.991 INFO:tasks.workunit.client.0.smithi050.stderr: 76700K .......... .......... .......... .......... .......... 45% 23.4M 3s 2023-10-26T06:44:54.991 INFO:tasks.workunit.client.0.smithi050.stderr: 76750K .......... .......... .......... .......... .......... 45% 48.9M 3s 2023-10-26T06:44:54.993 INFO:tasks.workunit.client.0.smithi050.stderr: 76800K .......... .......... .......... .......... .......... 45% 23.4M 3s 2023-10-26T06:44:54.998 INFO:tasks.workunit.client.0.smithi050.stderr: 76850K .......... .......... .......... .......... .......... 45% 18.9M 3s 2023-10-26T06:44:54.998 INFO:tasks.workunit.client.0.smithi050.stderr: 76900K .......... .......... .......... .......... .......... 45% 37.3M 3s 2023-10-26T06:44:55.000 INFO:tasks.workunit.client.0.smithi050.stderr: 76950K .......... .......... .......... .......... .......... 45% 35.6M 3s 2023-10-26T06:44:55.000 INFO:tasks.workunit.client.0.smithi050.stderr: 77000K .......... .......... .......... .......... .......... 45% 45.7M 3s 2023-10-26T06:44:55.002 INFO:tasks.workunit.client.0.smithi050.stderr: 77050K .......... .......... .......... .......... .......... 45% 22.5M 3s 2023-10-26T06:44:55.004 INFO:tasks.workunit.client.0.smithi050.stderr: 77100K .......... .......... .......... .......... .......... 45% 23.0M 3s 2023-10-26T06:44:55.005 INFO:tasks.workunit.client.0.smithi050.stderr: 77150K .......... .......... .......... .......... .......... 45% 43.1M 3s 2023-10-26T06:44:55.008 INFO:tasks.workunit.client.0.smithi050.stderr: 77200K .......... .......... .......... .......... .......... 45% 24.6M 3s 2023-10-26T06:44:55.008 INFO:tasks.workunit.client.0.smithi050.stderr: 77250K .......... .......... .......... .......... .......... 45% 48.0M 3s 2023-10-26T06:44:55.010 INFO:tasks.workunit.client.0.smithi050.stderr: 77300K .......... .......... .......... .......... .......... 45% 23.7M 3s 2023-10-26T06:44:55.012 INFO:tasks.workunit.client.0.smithi050.stderr: 77350K .......... .......... .......... .......... .......... 45% 29.7M 3s 2023-10-26T06:44:55.014 INFO:tasks.workunit.client.0.smithi050.stderr: 77400K .......... .......... .......... .......... .......... 45% 29.1M 3s 2023-10-26T06:44:55.017 INFO:tasks.workunit.client.0.smithi050.stderr: 77450K .......... .......... .......... .......... .......... 45% 27.0M 3s 2023-10-26T06:44:55.017 INFO:tasks.workunit.client.0.smithi050.stderr: 77500K .......... .......... .......... .......... .......... 46% 46.7M 3s 2023-10-26T06:44:55.019 INFO:tasks.workunit.client.0.smithi050.stderr: 77550K .......... .......... .......... .......... .......... 46% 22.5M 3s 2023-10-26T06:44:55.021 INFO:tasks.workunit.client.0.smithi050.stderr: 77600K .......... .......... .......... .......... .......... 46% 26.8M 3s 2023-10-26T06:44:55.023 INFO:tasks.workunit.client.0.smithi050.stderr: 77650K .......... .......... .......... .......... .......... 46% 32.9M 3s 2023-10-26T06:44:55.025 INFO:tasks.workunit.client.0.smithi050.stderr: 77700K .......... .......... .......... .......... .......... 46% 23.9M 3s 2023-10-26T06:44:55.026 INFO:tasks.workunit.client.0.smithi050.stderr: 77750K .......... .......... .......... .......... .......... 46% 52.7M 3s 2023-10-26T06:44:55.027 INFO:tasks.workunit.client.0.smithi050.stderr: 77800K .......... .......... .......... .......... .......... 46% 23.0M 3s 2023-10-26T06:44:55.029 INFO:tasks.workunit.client.0.smithi050.stderr: 77850K .......... .......... .......... .......... .......... 46% 32.1M 3s 2023-10-26T06:44:55.031 INFO:tasks.workunit.client.0.smithi050.stderr: 77900K .......... .......... .......... .......... .......... 46% 26.8M 3s 2023-10-26T06:44:55.032 INFO:tasks.workunit.client.0.smithi050.stderr: 77950K .......... .......... .......... .......... .......... 46% 25.9M 3s 2023-10-26T06:44:55.035 INFO:tasks.workunit.client.0.smithi050.stderr: 78000K .......... .......... .......... .......... .......... 46% 40.8M 3s 2023-10-26T06:44:55.035 INFO:tasks.workunit.client.0.smithi050.stderr: 78050K .......... .......... .......... .......... .......... 46% 32.5M 3s 2023-10-26T06:44:55.037 INFO:tasks.workunit.client.0.smithi050.stderr: 78100K .......... .......... .......... .......... .......... 46% 22.2M 3s 2023-10-26T06:44:55.040 INFO:tasks.workunit.client.0.smithi050.stderr: 78150K .......... .......... .......... .......... .......... 46% 31.3M 3s 2023-10-26T06:44:55.041 INFO:tasks.workunit.client.0.smithi050.stderr: 78200K .......... .......... .......... .......... .......... 46% 24.1M 3s 2023-10-26T06:44:55.043 INFO:tasks.workunit.client.0.smithi050.stderr: 78250K .......... .......... .......... .......... .......... 46% 24.9M 3s 2023-10-26T06:44:55.044 INFO:tasks.workunit.client.0.smithi050.stderr: 78300K .......... .......... .......... .......... .......... 46% 50.0M 3s 2023-10-26T06:44:55.048 INFO:tasks.workunit.client.0.smithi050.stderr: 78350K .......... .......... .......... .......... .......... 46% 24.3M 3s 2023-10-26T06:44:55.048 INFO:tasks.workunit.client.0.smithi050.stderr: 78400K .......... .......... .......... .......... .......... 46% 36.2M 3s 2023-10-26T06:44:55.049 INFO:tasks.workunit.client.0.smithi050.stderr: 78450K .......... .......... .......... .......... .......... 46% 23.2M 3s 2023-10-26T06:44:55.052 INFO:tasks.workunit.client.0.smithi050.stderr: 78500K .......... .......... .......... .......... .......... 46% 24.6M 3s 2023-10-26T06:44:55.053 INFO:tasks.workunit.client.0.smithi050.stderr: 78550K .......... .......... .......... .......... .......... 46% 46.8M 3s 2023-10-26T06:44:55.054 INFO:tasks.workunit.client.0.smithi050.stderr: 78600K .......... .......... .......... .......... .......... 46% 27.7M 3s 2023-10-26T06:44:55.057 INFO:tasks.workunit.client.0.smithi050.stderr: 78650K .......... .......... .......... .......... .......... 46% 26.7M 3s 2023-10-26T06:44:55.059 INFO:tasks.workunit.client.0.smithi050.stderr: 78700K .......... .......... .......... .......... .......... 46% 29.0M 3s 2023-10-26T06:44:55.059 INFO:tasks.workunit.client.0.smithi050.stderr: 78750K .......... .......... .......... .......... .......... 46% 30.4M 3s 2023-10-26T06:44:55.060 INFO:tasks.workunit.client.0.smithi050.stderr: 78800K .......... .......... .......... .......... .......... 46% 34.1M 3s 2023-10-26T06:44:55.062 INFO:tasks.workunit.client.0.smithi050.stderr: 78850K .......... .......... .......... .......... .......... 46% 35.4M 3s 2023-10-26T06:44:55.065 INFO:tasks.workunit.client.0.smithi050.stderr: 78900K .......... .......... .......... .......... .......... 46% 24.3M 3s 2023-10-26T06:44:55.066 INFO:tasks.workunit.client.0.smithi050.stderr: 78950K .......... .......... .......... .......... .......... 46% 22.9M 3s 2023-10-26T06:44:55.068 INFO:tasks.workunit.client.0.smithi050.stderr: 79000K .......... .......... .......... .......... .......... 46% 26.6M 3s 2023-10-26T06:44:55.069 INFO:tasks.workunit.client.0.smithi050.stderr: 79050K .......... .......... .......... .......... .......... 46% 45.9M 3s 2023-10-26T06:44:55.071 INFO:tasks.workunit.client.0.smithi050.stderr: 79100K .......... .......... .......... .......... .......... 46% 37.4M 3s 2023-10-26T06:44:55.073 INFO:tasks.workunit.client.0.smithi050.stderr: 79150K .......... .......... .......... .......... .......... 46% 24.3M 3s 2023-10-26T06:44:55.075 INFO:tasks.workunit.client.0.smithi050.stderr: 79200K .......... .......... .......... .......... .......... 47% 21.7M 3s 2023-10-26T06:44:55.079 INFO:tasks.workunit.client.0.smithi050.stderr: 79250K .......... .......... .......... .......... .......... 47% 16.5M 3s 2023-10-26T06:44:55.079 INFO:tasks.workunit.client.0.smithi050.stderr: 79300K .......... .......... .......... .......... .......... 47% 85.1M 3s 2023-10-26T06:44:55.080 INFO:tasks.workunit.client.0.smithi050.stderr: 79350K .......... .......... .......... .......... .......... 47% 55.9M 3s 2023-10-26T06:44:55.081 INFO:tasks.workunit.client.0.smithi050.stderr: 79400K .......... .......... .......... .......... .......... 47% 28.1M 3s 2023-10-26T06:44:55.083 INFO:tasks.workunit.client.0.smithi050.stderr: 79450K .......... .......... .......... .......... .......... 47% 24.9M 3s 2023-10-26T06:44:55.085 INFO:tasks.workunit.client.0.smithi050.stderr: 79500K .......... .......... .......... .......... .......... 47% 24.3M 3s 2023-10-26T06:44:55.086 INFO:tasks.workunit.client.0.smithi050.stderr: 79550K .......... .......... .......... .......... .......... 47% 48.4M 3s 2023-10-26T06:44:55.088 INFO:tasks.workunit.client.0.smithi050.stderr: 79600K .......... .......... .......... .......... .......... 47% 31.3M 3s 2023-10-26T06:44:55.090 INFO:tasks.workunit.client.0.smithi050.stderr: 79650K .......... .......... .......... .......... .......... 47% 27.1M 3s 2023-10-26T06:44:55.092 INFO:tasks.workunit.client.0.smithi050.stderr: 79700K .......... .......... .......... .......... .......... 47% 22.9M 3s 2023-10-26T06:44:55.094 INFO:tasks.workunit.client.0.smithi050.stderr: 79750K .......... .......... .......... .......... .......... 47% 25.3M 3s 2023-10-26T06:44:55.095 INFO:tasks.workunit.client.0.smithi050.stderr: 79800K .......... .......... .......... .......... .......... 47% 38.9M 3s 2023-10-26T06:44:55.099 INFO:tasks.workunit.client.0.smithi050.stderr: 79850K .......... .......... .......... .......... .......... 47% 38.5M 3s 2023-10-26T06:44:55.099 INFO:tasks.workunit.client.0.smithi050.stderr: 79900K .......... .......... .......... .......... .......... 47% 26.4M 3s 2023-10-26T06:44:55.105 INFO:tasks.workunit.client.0.smithi050.stderr: 79950K .......... .......... .......... .......... .......... 47% 21.0M 3s 2023-10-26T06:44:55.105 INFO:tasks.workunit.client.0.smithi050.stderr: 80000K .......... .......... .......... .......... .......... 47% 28.1M 3s 2023-10-26T06:44:55.106 INFO:tasks.workunit.client.0.smithi050.stderr: 80050K .......... .......... .......... .......... .......... 47% 55.3M 3s 2023-10-26T06:44:55.106 INFO:tasks.workunit.client.0.smithi050.stderr: 80100K .......... .......... .......... .......... .......... 47% 21.9M 3s 2023-10-26T06:44:55.109 INFO:tasks.workunit.client.0.smithi050.stderr: 80150K .......... .......... .......... .......... .......... 47% 31.9M 3s 2023-10-26T06:44:55.109 INFO:tasks.workunit.client.0.smithi050.stderr: 80200K .......... .......... .......... .......... .......... 47% 28.9M 3s 2023-10-26T06:44:55.111 INFO:tasks.workunit.client.0.smithi050.stderr: 80250K .......... .......... .......... .......... .......... 47% 23.4M 3s 2023-10-26T06:44:55.111 INFO:tasks.workunit.client.0.smithi050.stderr: 80300K .......... .......... .......... .......... .......... 47% 50.7M 3s 2023-10-26T06:44:55.113 INFO:tasks.workunit.client.0.smithi050.stderr: 80350K .......... .......... .......... .......... .......... 47% 27.9M 3s 2023-10-26T06:44:55.115 INFO:tasks.workunit.client.0.smithi050.stderr: 80400K .......... .......... .......... .......... .......... 47% 24.6M 3s 2023-10-26T06:44:55.117 INFO:tasks.workunit.client.0.smithi050.stderr: 80450K .......... .......... .......... .......... .......... 47% 22.2M 3s 2023-10-26T06:44:55.119 INFO:tasks.workunit.client.0.smithi050.stderr: 80500K .......... .......... .......... .......... .......... 47% 26.1M 3s 2023-10-26T06:44:55.120 INFO:tasks.workunit.client.0.smithi050.stderr: 80550K .......... .......... .......... .......... .......... 47% 41.8M 3s 2023-10-26T06:44:55.122 INFO:tasks.workunit.client.0.smithi050.stderr: 80600K .......... .......... .......... .......... .......... 47% 21.6M 3s 2023-10-26T06:44:55.124 INFO:tasks.workunit.client.0.smithi050.stderr: 80650K .......... .......... .......... .......... .......... 47% 37.0M 3s 2023-10-26T06:44:55.126 INFO:tasks.workunit.client.0.smithi050.stderr: 80700K .......... .......... .......... .......... .......... 47% 24.8M 3s 2023-10-26T06:44:55.127 INFO:tasks.workunit.client.0.smithi050.stderr: 80750K .......... .......... .......... .......... .......... 47% 25.2M 3s 2023-10-26T06:44:55.128 INFO:tasks.workunit.client.0.smithi050.stderr: 80800K .......... .......... .......... .......... .......... 47% 39.5M 3s 2023-10-26T06:44:55.131 INFO:tasks.workunit.client.0.smithi050.stderr: 80850K .......... .......... .......... .......... .......... 47% 23.5M 3s 2023-10-26T06:44:55.133 INFO:tasks.workunit.client.0.smithi050.stderr: 80900K .......... .......... .......... .......... .......... 48% 32.1M 3s 2023-10-26T06:44:55.135 INFO:tasks.workunit.client.0.smithi050.stderr: 80950K .......... .......... .......... .......... .......... 48% 26.7M 3s 2023-10-26T06:44:55.136 INFO:tasks.workunit.client.0.smithi050.stderr: 81000K .......... .......... .......... .......... .......... 48% 27.6M 3s 2023-10-26T06:44:55.137 INFO:tasks.workunit.client.0.smithi050.stderr: 81050K .......... .......... .......... .......... .......... 48% 45.0M 3s 2023-10-26T06:44:55.139 INFO:tasks.workunit.client.0.smithi050.stderr: 81100K .......... .......... .......... .......... .......... 48% 25.7M 3s 2023-10-26T06:44:55.140 INFO:tasks.workunit.client.0.smithi050.stderr: 81150K .......... .......... .......... .......... .......... 48% 31.4M 3s 2023-10-26T06:44:55.144 INFO:tasks.workunit.client.0.smithi050.stderr: 81200K .......... .......... .......... .......... .......... 48% 20.4M 3s 2023-10-26T06:44:55.147 INFO:tasks.workunit.client.0.smithi050.stderr: 81250K .......... .......... .......... .......... .......... 48% 23.5M 3s 2023-10-26T06:44:55.148 INFO:tasks.workunit.client.0.smithi050.stderr: 81300K .......... .......... .......... .......... .......... 48% 30.4M 3s 2023-10-26T06:44:55.149 INFO:tasks.workunit.client.0.smithi050.stderr: 81350K .......... .......... .......... .......... .......... 48% 22.0M 3s 2023-10-26T06:44:55.153 INFO:tasks.workunit.client.0.smithi050.stderr: 81400K .......... .......... .......... .......... .......... 48% 16.6M 3s 2023-10-26T06:44:55.154 INFO:tasks.workunit.client.0.smithi050.stderr: 81450K .......... .......... .......... .......... .......... 48% 35.1M 3s 2023-10-26T06:44:55.157 INFO:tasks.workunit.client.0.smithi050.stderr: 81500K .......... .......... .......... .......... .......... 48% 11.8M 3s 2023-10-26T06:44:55.158 INFO:tasks.workunit.client.0.smithi050.stderr: 81550K .......... .......... .......... .......... .......... 48% 40.1M 3s 2023-10-26T06:44:55.161 INFO:tasks.workunit.client.0.smithi050.stderr: 81600K .......... .......... .......... .......... .......... 48% 38.0M 3s 2023-10-26T06:44:55.162 INFO:tasks.workunit.client.0.smithi050.stderr: 81650K .......... .......... .......... .......... .......... 48% 50.6M 3s 2023-10-26T06:44:55.163 INFO:tasks.workunit.client.0.smithi050.stderr: 81700K .......... .......... .......... .......... .......... 48% 19.3M 3s 2023-10-26T06:44:55.167 INFO:tasks.workunit.client.0.smithi050.stderr: 81750K .......... .......... .......... .......... .......... 48% 12.4M 3s 2023-10-26T06:44:55.169 INFO:tasks.workunit.client.0.smithi050.stderr: 81800K .......... .......... .......... .......... .......... 48% 27.8M 3s 2023-10-26T06:44:55.186 INFO:tasks.workunit.client.0.smithi050.stderr: 81850K .......... .......... .......... .......... .......... 48% 31.6M 3s 2023-10-26T06:44:55.186 INFO:tasks.workunit.client.0.smithi050.stderr: 81900K .......... .......... .......... .......... .......... 48% 59.4M 3s 2023-10-26T06:44:55.186 INFO:tasks.workunit.client.0.smithi050.stderr: 81950K .......... .......... .......... .......... .......... 48% 34.5M 3s 2023-10-26T06:44:55.186 INFO:tasks.workunit.client.0.smithi050.stderr: 82000K .......... .......... .......... .......... .......... 48% 58.6M 3s 2023-10-26T06:44:55.187 INFO:tasks.workunit.client.0.smithi050.stderr: 82050K .......... .......... .......... .......... .......... 48% 75.0M 3s 2023-10-26T06:44:55.187 INFO:tasks.workunit.client.0.smithi050.stderr: 82100K .......... .......... .......... .......... .......... 48% 31.6M 3s 2023-10-26T06:44:55.187 INFO:tasks.workunit.client.0.smithi050.stderr: 82150K .......... .......... .......... .......... .......... 48% 35.6M 3s 2023-10-26T06:44:55.187 INFO:tasks.workunit.client.0.smithi050.stderr: 82200K .......... .......... .......... .......... .......... 48% 34.4M 3s 2023-10-26T06:44:55.188 INFO:tasks.workunit.client.0.smithi050.stderr: 82250K .......... .......... .......... .......... .......... 48% 34.8M 3s 2023-10-26T06:44:55.188 INFO:tasks.workunit.client.0.smithi050.stderr: 82300K .......... .......... .......... .......... .......... 48% 38.0M 3s 2023-10-26T06:44:55.188 INFO:tasks.workunit.client.0.smithi050.stderr: 82350K .......... .......... .......... .......... .......... 48% 22.2M 3s 2023-10-26T06:44:55.188 INFO:tasks.workunit.client.0.smithi050.stderr: 82400K .......... .......... .......... .......... .......... 48% 43.5M 3s 2023-10-26T06:44:55.190 INFO:tasks.workunit.client.0.smithi050.stderr: 82450K .......... .......... .......... .......... .......... 48% 28.2M 3s 2023-10-26T06:44:55.190 INFO:tasks.workunit.client.0.smithi050.stderr: 82500K .......... .......... .......... .......... .......... 48% 12.2M 3s 2023-10-26T06:44:55.192 INFO:tasks.workunit.client.0.smithi050.stderr: 82550K .......... .......... .......... .......... .......... 49% 57.1M 3s 2023-10-26T06:44:55.201 INFO:tasks.workunit.client.0.smithi050.stderr: 82600K .......... .......... .......... .......... .......... 49% 22.4M 3s 2023-10-26T06:44:55.201 INFO:tasks.workunit.client.0.smithi050.stderr: 82650K .......... .......... .......... .......... .......... 49% 48.4M 3s 2023-10-26T06:44:55.201 INFO:tasks.workunit.client.0.smithi050.stderr: 82700K .......... .......... .......... .......... .......... 49% 47.7M 3s 2023-10-26T06:44:55.201 INFO:tasks.workunit.client.0.smithi050.stderr: 82750K .......... .......... .......... .......... .......... 49% 45.9M 3s 2023-10-26T06:44:55.202 INFO:tasks.workunit.client.0.smithi050.stderr: 82800K .......... .......... .......... .......... .......... 49% 75.2M 3s 2023-10-26T06:44:55.202 INFO:tasks.workunit.client.0.smithi050.stderr: 82850K .......... .......... .......... .......... .......... 49% 35.7M 3s 2023-10-26T06:44:55.202 INFO:tasks.workunit.client.0.smithi050.stderr: 82900K .......... .......... .......... .......... .......... 49% 28.0M 3s 2023-10-26T06:44:55.206 INFO:tasks.workunit.client.0.smithi050.stderr: 82950K .......... .......... .......... .......... .......... 49% 31.1M 3s 2023-10-26T06:44:55.206 INFO:tasks.workunit.client.0.smithi050.stderr: 83000K .......... .......... .......... .......... .......... 49% 23.5M 3s 2023-10-26T06:44:55.206 INFO:tasks.workunit.client.0.smithi050.stderr: 83050K .......... .......... .......... .......... .......... 49% 42.9M 3s 2023-10-26T06:44:55.208 INFO:tasks.workunit.client.0.smithi050.stderr: 83100K .......... .......... .......... .......... .......... 49% 26.4M 3s 2023-10-26T06:44:55.209 INFO:tasks.workunit.client.0.smithi050.stderr: 83150K .......... .......... .......... .......... .......... 49% 23.0M 3s 2023-10-26T06:44:55.211 INFO:tasks.workunit.client.0.smithi050.stderr: 83200K .......... .......... .......... .......... .......... 49% 37.7M 3s 2023-10-26T06:44:55.212 INFO:tasks.workunit.client.0.smithi050.stderr: 83250K .......... .......... .......... .......... .......... 49% 27.0M 3s 2023-10-26T06:44:55.213 INFO:tasks.workunit.client.0.smithi050.stderr: 83300K .......... .......... .......... .......... .......... 49% 37.1M 3s 2023-10-26T06:44:55.215 INFO:tasks.workunit.client.0.smithi050.stderr: 83350K .......... .......... .......... .......... .......... 49% 22.0M 3s 2023-10-26T06:44:55.217 INFO:tasks.workunit.client.0.smithi050.stderr: 83400K .......... .......... .......... .......... .......... 49% 32.8M 3s 2023-10-26T06:44:55.218 INFO:tasks.workunit.client.0.smithi050.stderr: 83450K .......... .......... .......... .......... .......... 49% 30.4M 3s 2023-10-26T06:44:55.220 INFO:tasks.workunit.client.0.smithi050.stderr: 83500K .......... .......... .......... .......... .......... 49% 30.0M 3s 2023-10-26T06:44:55.224 INFO:tasks.workunit.client.0.smithi050.stderr: 83550K .......... .......... .......... .......... .......... 49% 20.8M 3s 2023-10-26T06:44:55.224 INFO:tasks.workunit.client.0.smithi050.stderr: 83600K .......... .......... .......... .......... .......... 49% 47.6M 3s 2023-10-26T06:44:55.226 INFO:tasks.workunit.client.0.smithi050.stderr: 83650K .......... .......... .......... .......... .......... 49% 27.6M 3s 2023-10-26T06:44:55.228 INFO:tasks.workunit.client.0.smithi050.stderr: 83700K .......... .......... .......... .......... .......... 49% 30.6M 3s 2023-10-26T06:44:55.229 INFO:tasks.workunit.client.0.smithi050.stderr: 83750K .......... .......... .......... .......... .......... 49% 30.3M 3s 2023-10-26T06:44:55.231 INFO:tasks.workunit.client.0.smithi050.stderr: 83800K .......... .......... .......... .......... .......... 49% 23.5M 3s 2023-10-26T06:44:55.233 INFO:tasks.workunit.client.0.smithi050.stderr: 83850K .......... .......... .......... .......... .......... 49% 31.9M 3s 2023-10-26T06:44:55.235 INFO:tasks.workunit.client.0.smithi050.stderr: 83900K .......... .......... .......... .......... .......... 49% 18.9M 3s 2023-10-26T06:44:55.237 INFO:tasks.workunit.client.0.smithi050.stderr: 83950K .......... .......... .......... .......... .......... 49% 23.7M 3s 2023-10-26T06:44:55.239 INFO:tasks.workunit.client.0.smithi050.stderr: 84000K .......... .......... .......... .......... .......... 49% 18.1M 3s 2023-10-26T06:44:55.242 INFO:tasks.workunit.client.0.smithi050.stderr: 84050K .......... .......... .......... .......... .......... 49% 20.2M 3s 2023-10-26T06:44:55.244 INFO:tasks.workunit.client.0.smithi050.stderr: 84100K .......... .......... .......... .......... .......... 49% 28.7M 3s 2023-10-26T06:44:55.247 INFO:tasks.workunit.client.0.smithi050.stderr: 84150K .......... .......... .......... .......... .......... 49% 17.8M 3s 2023-10-26T06:44:55.248 INFO:tasks.workunit.client.0.smithi050.stderr: 84200K .......... .......... .......... .......... .......... 49% 23.2M 3s 2023-10-26T06:44:55.253 INFO:tasks.workunit.client.0.smithi050.stderr: 84250K .......... .......... .......... .......... .......... 50% 12.1M 3s 2023-10-26T06:44:55.255 INFO:tasks.workunit.client.0.smithi050.stderr: 84300K .......... .......... .......... .......... .......... 50% 17.9M 3s 2023-10-26T06:44:55.258 INFO:tasks.workunit.client.0.smithi050.stderr: 84350K .......... .......... .......... .......... .......... 50% 23.9M 3s 2023-10-26T06:44:55.275 INFO:tasks.workunit.client.0.smithi050.stderr: 84400K .......... .......... .......... .......... .......... 50% 15.9M 3s 2023-10-26T06:44:55.276 INFO:tasks.workunit.client.0.smithi050.stderr: 84450K .......... .......... .......... .......... .......... 50% 107M 3s 2023-10-26T06:44:55.276 INFO:tasks.workunit.client.0.smithi050.stderr: 84500K .......... .......... .......... .......... .......... 50% 82.7M 3s 2023-10-26T06:44:55.276 INFO:tasks.workunit.client.0.smithi050.stderr: 84550K .......... .......... .......... .......... .......... 50% 83.2M 3s 2023-10-26T06:44:55.276 INFO:tasks.workunit.client.0.smithi050.stderr: 84600K .......... .......... .......... .......... .......... 50% 95.2M 3s 2023-10-26T06:44:55.277 INFO:tasks.workunit.client.0.smithi050.stderr: 84650K .......... .......... .......... .......... .......... 50% 87.9M 3s 2023-10-26T06:44:55.277 INFO:tasks.workunit.client.0.smithi050.stderr: 84700K .......... .......... .......... .......... .......... 50% 102M 3s 2023-10-26T06:44:55.277 INFO:tasks.workunit.client.0.smithi050.stderr: 84750K .......... .......... .......... .......... .......... 50% 46.0M 3s 2023-10-26T06:44:55.277 INFO:tasks.workunit.client.0.smithi050.stderr: 84800K .......... .......... .......... .......... .......... 50% 22.0M 3s 2023-10-26T06:44:55.278 INFO:tasks.workunit.client.0.smithi050.stderr: 84850K .......... .......... .......... .......... .......... 50% 30.9M 3s 2023-10-26T06:44:55.278 INFO:tasks.workunit.client.0.smithi050.stderr: 84900K .......... .......... .......... .......... .......... 50% 32.2M 3s 2023-10-26T06:44:55.278 INFO:tasks.workunit.client.0.smithi050.stderr: 84950K .......... .......... .......... .......... .......... 50% 31.6M 3s 2023-10-26T06:44:55.278 INFO:tasks.workunit.client.0.smithi050.stderr: 85000K .......... .......... .......... .......... .......... 50% 38.8M 3s 2023-10-26T06:44:55.279 INFO:tasks.workunit.client.0.smithi050.stderr: 85050K .......... .......... .......... .......... .......... 50% 28.9M 3s 2023-10-26T06:44:55.279 INFO:tasks.workunit.client.0.smithi050.stderr: 85100K .......... .......... .......... .......... .......... 50% 42.9M 3s 2023-10-26T06:44:55.287 INFO:tasks.workunit.client.0.smithi050.stderr: 85150K .......... .......... .......... .......... .......... 50% 22.1M 3s 2023-10-26T06:44:55.287 INFO:tasks.workunit.client.0.smithi050.stderr: 85200K .......... .......... .......... .......... .......... 50% 45.2M 3s 2023-10-26T06:44:55.287 INFO:tasks.workunit.client.0.smithi050.stderr: 85250K .......... .......... .......... .......... .......... 50% 22.8M 3s 2023-10-26T06:44:55.289 INFO:tasks.workunit.client.0.smithi050.stderr: 85300K .......... .......... .......... .......... .......... 50% 31.2M 3s 2023-10-26T06:44:55.289 INFO:tasks.workunit.client.0.smithi050.stderr: 85350K .......... .......... .......... .......... .......... 50% 36.4M 3s 2023-10-26T06:44:55.289 INFO:tasks.workunit.client.0.smithi050.stderr: 85400K .......... .......... .......... .......... .......... 50% 32.1M 3s 2023-10-26T06:44:55.290 INFO:tasks.workunit.client.0.smithi050.stderr: 85450K .......... .......... .......... .......... .......... 50% 26.1M 3s 2023-10-26T06:44:55.292 INFO:tasks.workunit.client.0.smithi050.stderr: 85500K .......... .......... .......... .......... .......... 50% 23.2M 3s 2023-10-26T06:44:55.293 INFO:tasks.workunit.client.0.smithi050.stderr: 85550K .......... .......... .......... .......... .......... 50% 23.0M 3s 2023-10-26T06:44:55.293 INFO:tasks.workunit.client.0.smithi050.stderr: 85600K .......... .......... .......... .......... .......... 50% 59.7M 3s 2023-10-26T06:44:55.295 INFO:tasks.workunit.client.0.smithi050.stderr: 85650K .......... .......... .......... .......... .......... 50% 32.8M 3s 2023-10-26T06:44:55.297 INFO:tasks.workunit.client.0.smithi050.stderr: 85700K .......... .......... .......... .......... .......... 50% 18.6M 3s 2023-10-26T06:44:55.298 INFO:tasks.workunit.client.0.smithi050.stderr: 85750K .......... .......... .......... .......... .......... 50% 46.6M 3s 2023-10-26T06:44:55.299 INFO:tasks.workunit.client.0.smithi050.stderr: 85800K .......... .......... .......... .......... .......... 50% 25.6M 3s 2023-10-26T06:44:55.301 INFO:tasks.workunit.client.0.smithi050.stderr: 85850K .......... .......... .......... .......... .......... 50% 35.3M 3s 2023-10-26T06:44:55.303 INFO:tasks.workunit.client.0.smithi050.stderr: 85900K .......... .......... .......... .......... .......... 50% 35.9M 3s 2023-10-26T06:44:55.305 INFO:tasks.workunit.client.0.smithi050.stderr: 85950K .......... .......... .......... .......... .......... 51% 24.0M 3s 2023-10-26T06:44:55.307 INFO:tasks.workunit.client.0.smithi050.stderr: 86000K .......... .......... .......... .......... .......... 51% 28.9M 3s 2023-10-26T06:44:55.308 INFO:tasks.workunit.client.0.smithi050.stderr: 86050K .......... .......... .......... .......... .......... 51% 26.7M 3s 2023-10-26T06:44:55.309 INFO:tasks.workunit.client.0.smithi050.stderr: 86100K .......... .......... .......... .......... .......... 51% 33.7M 3s 2023-10-26T06:44:55.312 INFO:tasks.workunit.client.0.smithi050.stderr: 86150K .......... .......... .......... .......... .......... 51% 17.8M 3s 2023-10-26T06:44:55.314 INFO:tasks.workunit.client.0.smithi050.stderr: 86200K .......... .......... .......... .......... .......... 51% 30.8M 3s 2023-10-26T06:44:55.316 INFO:tasks.workunit.client.0.smithi050.stderr: 86250K .......... .......... .......... .......... .......... 51% 19.5M 3s 2023-10-26T06:44:55.322 INFO:tasks.workunit.client.0.smithi050.stderr: 86300K .......... .......... .......... .......... .......... 51% 19.5M 3s 2023-10-26T06:44:55.322 INFO:tasks.workunit.client.0.smithi050.stderr: 86350K .......... .......... .......... .......... .......... 51% 45.5M 3s 2023-10-26T06:44:55.322 INFO:tasks.workunit.client.0.smithi050.stderr: 86400K .......... .......... .......... .......... .......... 51% 27.4M 3s 2023-10-26T06:44:55.324 INFO:tasks.workunit.client.0.smithi050.stderr: 86450K .......... .......... .......... .......... .......... 51% 76.1M 3s 2023-10-26T06:44:55.329 INFO:tasks.workunit.client.0.smithi050.stderr: 86500K .......... .......... .......... .......... .......... 51% 16.2M 3s 2023-10-26T06:44:55.329 INFO:tasks.workunit.client.0.smithi050.stderr: 86550K .......... .......... .......... .......... .......... 51% 63.4M 3s 2023-10-26T06:44:55.329 INFO:tasks.workunit.client.0.smithi050.stderr: 86600K .......... .......... .......... .......... .......... 51% 72.2M 3s 2023-10-26T06:44:55.329 INFO:tasks.workunit.client.0.smithi050.stderr: 86650K .......... .......... .......... .......... .......... 51% 21.3M 3s 2023-10-26T06:44:55.331 INFO:tasks.workunit.client.0.smithi050.stderr: 86700K .......... .......... .......... .......... .......... 51% 21.9M 3s 2023-10-26T06:44:55.332 INFO:tasks.workunit.client.0.smithi050.stderr: 86750K .......... .......... .......... .......... .......... 51% 33.5M 3s 2023-10-26T06:44:55.334 INFO:tasks.workunit.client.0.smithi050.stderr: 86800K .......... .......... .......... .......... .......... 51% 24.8M 3s 2023-10-26T06:44:55.336 INFO:tasks.workunit.client.0.smithi050.stderr: 86850K .......... .......... .......... .......... .......... 51% 45.9M 3s 2023-10-26T06:44:55.338 INFO:tasks.workunit.client.0.smithi050.stderr: 86900K .......... .......... .......... .......... .......... 51% 23.5M 3s 2023-10-26T06:44:55.340 INFO:tasks.workunit.client.0.smithi050.stderr: 86950K .......... .......... .......... .......... .......... 51% 20.2M 3s 2023-10-26T06:44:55.342 INFO:tasks.workunit.client.0.smithi050.stderr: 87000K .......... .......... .......... .......... .......... 51% 23.1M 3s 2023-10-26T06:44:55.344 INFO:tasks.workunit.client.0.smithi050.stderr: 87050K .......... .......... .......... .......... .......... 51% 26.5M 3s 2023-10-26T06:44:55.345 INFO:tasks.workunit.client.0.smithi050.stderr: 87100K .......... .......... .......... .......... .......... 51% 35.4M 3s 2023-10-26T06:44:55.349 INFO:tasks.workunit.client.0.smithi050.stderr: 87150K .......... .......... .......... .......... .......... 51% 48.1M 3s 2023-10-26T06:44:55.349 INFO:tasks.workunit.client.0.smithi050.stderr: 87200K .......... .......... .......... .......... .......... 51% 103M 3s 2023-10-26T06:44:55.350 INFO:tasks.workunit.client.0.smithi050.stderr: 87250K .......... .......... .......... .......... .......... 51% 49.4M 3s 2023-10-26T06:44:55.351 INFO:tasks.workunit.client.0.smithi050.stderr: 87300K .......... .......... .......... .......... .......... 51% 21.5M 3s 2023-10-26T06:44:55.351 INFO:tasks.workunit.client.0.smithi050.stderr: 87350K .......... .......... .......... .......... .......... 51% 32.5M 3s 2023-10-26T06:44:55.353 INFO:tasks.workunit.client.0.smithi050.stderr: 87400K .......... .......... .......... .......... .......... 51% 37.3M 3s 2023-10-26T06:44:55.355 INFO:tasks.workunit.client.0.smithi050.stderr: 87450K .......... .......... .......... .......... .......... 51% 20.6M 3s 2023-10-26T06:44:55.357 INFO:tasks.workunit.client.0.smithi050.stderr: 87500K .......... .......... .......... .......... .......... 51% 33.9M 3s 2023-10-26T06:44:55.360 INFO:tasks.workunit.client.0.smithi050.stderr: 87550K .......... .......... .......... .......... .......... 51% 15.6M 3s 2023-10-26T06:44:55.362 INFO:tasks.workunit.client.0.smithi050.stderr: 87600K .......... .......... .......... .......... .......... 51% 19.9M 3s 2023-10-26T06:44:55.367 INFO:tasks.workunit.client.0.smithi050.stderr: 87650K .......... .......... .......... .......... .......... 52% 9.94M 3s 2023-10-26T06:44:55.370 INFO:tasks.workunit.client.0.smithi050.stderr: 87700K .......... .......... .......... .......... .......... 52% 17.1M 3s 2023-10-26T06:44:55.372 INFO:tasks.workunit.client.0.smithi050.stderr: 87750K .......... .......... .......... .......... .......... 52% 23.2M 3s 2023-10-26T06:44:55.392 INFO:tasks.workunit.client.0.smithi050.stderr: 87800K .......... .......... .......... .......... .......... 52% 15.1M 3s 2023-10-26T06:44:55.392 INFO:tasks.workunit.client.0.smithi050.stderr: 87850K .......... .......... .......... .......... .......... 52% 112M 3s 2023-10-26T06:44:55.392 INFO:tasks.workunit.client.0.smithi050.stderr: 87900K .......... .......... .......... .......... .......... 52% 97.7M 3s 2023-10-26T06:44:55.392 INFO:tasks.workunit.client.0.smithi050.stderr: 87950K .......... .......... .......... .......... .......... 52% 108M 3s 2023-10-26T06:44:55.393 INFO:tasks.workunit.client.0.smithi050.stderr: 88000K .......... .......... .......... .......... .......... 52% 103M 3s 2023-10-26T06:44:55.393 INFO:tasks.workunit.client.0.smithi050.stderr: 88050K .......... .......... .......... .......... .......... 52% 33.8M 3s 2023-10-26T06:44:55.393 INFO:tasks.workunit.client.0.smithi050.stderr: 88100K .......... .......... .......... .......... .......... 52% 44.8M 3s 2023-10-26T06:44:55.393 INFO:tasks.workunit.client.0.smithi050.stderr: 88150K .......... .......... .......... .......... .......... 52% 28.6M 3s 2023-10-26T06:44:55.393 INFO:tasks.workunit.client.0.smithi050.stderr: 88200K .......... .......... .......... .......... .......... 52% 19.7M 3s 2023-10-26T06:44:55.394 INFO:tasks.workunit.client.0.smithi050.stderr: 88250K .......... .......... .......... .......... .......... 52% 27.5M 3s 2023-10-26T06:44:55.394 INFO:tasks.workunit.client.0.smithi050.stderr: 88300K .......... .......... .......... .......... .......... 52% 32.4M 3s 2023-10-26T06:44:55.394 INFO:tasks.workunit.client.0.smithi050.stderr: 88350K .......... .......... .......... .......... .......... 52% 40.3M 3s 2023-10-26T06:44:55.394 INFO:tasks.workunit.client.0.smithi050.stderr: 88400K .......... .......... .......... .......... .......... 52% 95.8M 3s 2023-10-26T06:44:55.394 INFO:tasks.workunit.client.0.smithi050.stderr: 88450K .......... .......... .......... .......... .......... 52% 53.8M 3s 2023-10-26T06:44:55.398 INFO:tasks.workunit.client.0.smithi050.stderr: 88500K .......... .......... .......... .......... .......... 52% 17.1M 3s 2023-10-26T06:44:55.398 INFO:tasks.workunit.client.0.smithi050.stderr: 88550K .......... .......... .......... .......... .......... 52% 16.1M 3s 2023-10-26T06:44:55.407 INFO:tasks.workunit.client.0.smithi050.stderr: 88600K .......... .......... .......... .......... .......... 52% 28.4M 3s 2023-10-26T06:44:55.407 INFO:tasks.workunit.client.0.smithi050.stderr: 88650K .......... .......... .......... .......... .......... 52% 22.5M 3s 2023-10-26T06:44:55.407 INFO:tasks.workunit.client.0.smithi050.stderr: 88700K .......... .......... .......... .......... .......... 52% 175M 3s 2023-10-26T06:44:55.407 INFO:tasks.workunit.client.0.smithi050.stderr: 88750K .......... .......... .......... .......... .......... 52% 72.0M 3s 2023-10-26T06:44:55.408 INFO:tasks.workunit.client.0.smithi050.stderr: 88800K .......... .......... .......... .......... .......... 52% 22.1M 3s 2023-10-26T06:44:55.408 INFO:tasks.workunit.client.0.smithi050.stderr: 88850K .......... .......... .......... .......... .......... 52% 104M 3s 2023-10-26T06:44:55.408 INFO:tasks.workunit.client.0.smithi050.stderr: 88900K .......... .......... .......... .......... .......... 52% 38.1M 3s 2023-10-26T06:44:55.408 INFO:tasks.workunit.client.0.smithi050.stderr: 88950K .......... .......... .......... .......... .......... 52% 30.6M 3s 2023-10-26T06:44:55.413 INFO:tasks.workunit.client.0.smithi050.stderr: 89000K .......... .......... .......... .......... .......... 52% 29.6M 3s 2023-10-26T06:44:55.414 INFO:tasks.workunit.client.0.smithi050.stderr: 89050K .......... .......... .......... .......... .......... 52% 22.3M 3s 2023-10-26T06:44:55.414 INFO:tasks.workunit.client.0.smithi050.stderr: 89100K .......... .......... .......... .......... .......... 52% 24.0M 3s 2023-10-26T06:44:55.414 INFO:tasks.workunit.client.0.smithi050.stderr: 89150K .......... .......... .......... .......... .......... 52% 59.1M 3s 2023-10-26T06:44:55.416 INFO:tasks.workunit.client.0.smithi050.stderr: 89200K .......... .......... .......... .......... .......... 52% 26.4M 3s 2023-10-26T06:44:55.417 INFO:tasks.workunit.client.0.smithi050.stderr: 89250K .......... .......... .......... .......... .......... 52% 31.5M 3s 2023-10-26T06:44:55.418 INFO:tasks.workunit.client.0.smithi050.stderr: 89300K .......... .......... .......... .......... .......... 53% 20.8M 3s 2023-10-26T06:44:55.420 INFO:tasks.workunit.client.0.smithi050.stderr: 89350K .......... .......... .......... .......... .......... 53% 24.6M 3s 2023-10-26T06:44:55.421 INFO:tasks.workunit.client.0.smithi050.stderr: 89400K .......... .......... .......... .......... .......... 53% 44.4M 3s 2023-10-26T06:44:55.423 INFO:tasks.workunit.client.0.smithi050.stderr: 89450K .......... .......... .......... .......... .......... 53% 25.4M 3s 2023-10-26T06:44:55.425 INFO:tasks.workunit.client.0.smithi050.stderr: 89500K .......... .......... .......... .......... .......... 53% 39.0M 3s 2023-10-26T06:44:55.427 INFO:tasks.workunit.client.0.smithi050.stderr: 89550K .......... .......... .......... .......... .......... 53% 23.2M 3s 2023-10-26T06:44:55.429 INFO:tasks.workunit.client.0.smithi050.stderr: 89600K .......... .......... .......... .......... .......... 53% 24.5M 3s 2023-10-26T06:44:55.430 INFO:tasks.workunit.client.0.smithi050.stderr: 89650K .......... .......... .......... .......... .......... 53% 41.2M 3s 2023-10-26T06:44:55.433 INFO:tasks.workunit.client.0.smithi050.stderr: 89700K .......... .......... .......... .......... .......... 53% 29.7M 3s 2023-10-26T06:44:55.433 INFO:tasks.workunit.client.0.smithi050.stderr: 89750K .......... .......... .......... .......... .......... 53% 30.7M 3s 2023-10-26T06:44:55.435 INFO:tasks.workunit.client.0.smithi050.stderr: 89800K .......... .......... .......... .......... .......... 53% 26.3M 3s 2023-10-26T06:44:55.437 INFO:tasks.workunit.client.0.smithi050.stderr: 89850K .......... .......... .......... .......... .......... 53% 24.6M 3s 2023-10-26T06:44:55.438 INFO:tasks.workunit.client.0.smithi050.stderr: 89900K .......... .......... .......... .......... .......... 53% 45.5M 3s 2023-10-26T06:44:55.441 INFO:tasks.workunit.client.0.smithi050.stderr: 89950K .......... .......... .......... .......... .......... 53% 21.5M 3s 2023-10-26T06:44:55.442 INFO:tasks.workunit.client.0.smithi050.stderr: 90000K .......... .......... .......... .......... .......... 53% 38.6M 3s 2023-10-26T06:44:55.444 INFO:tasks.workunit.client.0.smithi050.stderr: 90050K .......... .......... .......... .......... .......... 53% 24.6M 3s 2023-10-26T06:44:55.446 INFO:tasks.workunit.client.0.smithi050.stderr: 90100K .......... .......... .......... .......... .......... 53% 24.8M 3s 2023-10-26T06:44:55.447 INFO:tasks.workunit.client.0.smithi050.stderr: 90150K .......... .......... .......... .......... .......... 53% 39.7M 3s 2023-10-26T06:44:55.449 INFO:tasks.workunit.client.0.smithi050.stderr: 90200K .......... .......... .......... .......... .......... 53% 25.5M 3s 2023-10-26T06:44:55.451 INFO:tasks.workunit.client.0.smithi050.stderr: 90250K .......... .......... .......... .......... .......... 53% 34.8M 3s 2023-10-26T06:44:55.453 INFO:tasks.workunit.client.0.smithi050.stderr: 90300K .......... .......... .......... .......... .......... 53% 24.4M 3s 2023-10-26T06:44:55.454 INFO:tasks.workunit.client.0.smithi050.stderr: 90350K .......... .......... .......... .......... .......... 53% 24.6M 3s 2023-10-26T06:44:55.456 INFO:tasks.workunit.client.0.smithi050.stderr: 90400K .......... .......... .......... .......... .......... 53% 40.9M 3s 2023-10-26T06:44:55.457 INFO:tasks.workunit.client.0.smithi050.stderr: 90450K .......... .......... .......... .......... .......... 53% 26.1M 3s 2023-10-26T06:44:55.460 INFO:tasks.workunit.client.0.smithi050.stderr: 90500K .......... .......... .......... .......... .......... 53% 33.8M 3s 2023-10-26T06:44:55.462 INFO:tasks.workunit.client.0.smithi050.stderr: 90550K .......... .......... .......... .......... .......... 53% 25.0M 3s 2023-10-26T06:44:55.463 INFO:tasks.workunit.client.0.smithi050.stderr: 90600K .......... .......... .......... .......... .......... 53% 23.8M 3s 2023-10-26T06:44:55.464 INFO:tasks.workunit.client.0.smithi050.stderr: 90650K .......... .......... .......... .......... .......... 53% 41.7M 3s 2023-10-26T06:44:55.466 INFO:tasks.workunit.client.0.smithi050.stderr: 90700K .......... .......... .......... .......... .......... 53% 24.4M 3s 2023-10-26T06:44:55.467 INFO:tasks.workunit.client.0.smithi050.stderr: 90750K .......... .......... .......... .......... .......... 53% 37.1M 3s 2023-10-26T06:44:55.469 INFO:tasks.workunit.client.0.smithi050.stderr: 90800K .......... .......... .......... .......... .......... 53% 25.4M 3s 2023-10-26T06:44:55.471 INFO:tasks.workunit.client.0.smithi050.stderr: 90850K .......... .......... .......... .......... .......... 53% 23.8M 3s 2023-10-26T06:44:55.472 INFO:tasks.workunit.client.0.smithi050.stderr: 90900K .......... .......... .......... .......... .......... 53% 46.0M 3s 2023-10-26T06:44:55.474 INFO:tasks.workunit.client.0.smithi050.stderr: 90950K .......... .......... .......... .......... .......... 53% 23.9M 3s 2023-10-26T06:44:55.475 INFO:tasks.workunit.client.0.smithi050.stderr: 91000K .......... .......... .......... .......... .......... 54% 37.4M 3s 2023-10-26T06:44:55.481 INFO:tasks.workunit.client.0.smithi050.stderr: 91050K .......... .......... .......... .......... .......... 54% 22.9M 3s 2023-10-26T06:44:55.481 INFO:tasks.workunit.client.0.smithi050.stderr: 91100K .......... .......... .......... .......... .......... 54% 25.3M 3s 2023-10-26T06:44:55.482 INFO:tasks.workunit.client.0.smithi050.stderr: 91150K .......... .......... .......... .......... .......... 54% 52.5M 3s 2023-10-26T06:44:55.488 INFO:tasks.workunit.client.0.smithi050.stderr: 91200K .......... .......... .......... .......... .......... 54% 24.7M 3s 2023-10-26T06:44:55.488 INFO:tasks.workunit.client.0.smithi050.stderr: 91250K .......... .......... .......... .......... .......... 54% 32.7M 3s 2023-10-26T06:44:55.488 INFO:tasks.workunit.client.0.smithi050.stderr: 91300K .......... .......... .......... .......... .......... 54% 25.6M 3s 2023-10-26T06:44:55.488 INFO:tasks.workunit.client.0.smithi050.stderr: 91350K .......... .......... .......... .......... .......... 54% 34.7M 3s 2023-10-26T06:44:55.491 INFO:tasks.workunit.client.0.smithi050.stderr: 91400K .......... .......... .......... .......... .......... 54% 34.0M 3s 2023-10-26T06:44:55.491 INFO:tasks.workunit.client.0.smithi050.stderr: 91450K .......... .......... .......... .......... .......... 54% 22.5M 3s 2023-10-26T06:44:55.497 INFO:tasks.workunit.client.0.smithi050.stderr: 91500K .......... .......... .......... .......... .......... 54% 33.2M 3s 2023-10-26T06:44:55.498 INFO:tasks.workunit.client.0.smithi050.stderr: 91550K .......... .......... .......... .......... .......... 54% 21.8M 3s 2023-10-26T06:44:55.498 INFO:tasks.workunit.client.0.smithi050.stderr: 91600K .......... .......... .......... .......... .......... 54% 51.2M 3s 2023-10-26T06:44:55.498 INFO:tasks.workunit.client.0.smithi050.stderr: 91650K .......... .......... .......... .......... .......... 54% 27.2M 3s 2023-10-26T06:44:55.501 INFO:tasks.workunit.client.0.smithi050.stderr: 91700K .......... .......... .......... .......... .......... 54% 23.4M 3s 2023-10-26T06:44:55.503 INFO:tasks.workunit.client.0.smithi050.stderr: 91750K .......... .......... .......... .......... .......... 54% 24.0M 3s 2023-10-26T06:44:55.505 INFO:tasks.workunit.client.0.smithi050.stderr: 91800K .......... .......... .......... .......... .......... 54% 25.1M 3s 2023-10-26T06:44:55.507 INFO:tasks.workunit.client.0.smithi050.stderr: 91850K .......... .......... .......... .......... .......... 54% 44.1M 3s 2023-10-26T06:44:55.507 INFO:tasks.workunit.client.0.smithi050.stderr: 91900K .......... .......... .......... .......... .......... 54% 25.8M 3s 2023-10-26T06:44:55.509 INFO:tasks.workunit.client.0.smithi050.stderr: 91950K .......... .......... .......... .......... .......... 54% 27.6M 3s 2023-10-26T06:44:55.511 INFO:tasks.workunit.client.0.smithi050.stderr: 92000K .......... .......... .......... .......... .......... 54% 23.8M 3s 2023-10-26T06:44:55.512 INFO:tasks.workunit.client.0.smithi050.stderr: 92050K .......... .......... .......... .......... .......... 54% 32.7M 3s 2023-10-26T06:44:55.514 INFO:tasks.workunit.client.0.smithi050.stderr: 92100K .......... .......... .......... .......... .......... 54% 26.4M 3s 2023-10-26T06:44:55.516 INFO:tasks.workunit.client.0.smithi050.stderr: 92150K .......... .......... .......... .......... .......... 54% 27.9M 3s 2023-10-26T06:44:55.518 INFO:tasks.workunit.client.0.smithi050.stderr: 92200K .......... .......... .......... .......... .......... 54% 22.6M 3s 2023-10-26T06:44:55.520 INFO:tasks.workunit.client.0.smithi050.stderr: 92250K .......... .......... .......... .......... .......... 54% 30.9M 3s 2023-10-26T06:44:55.522 INFO:tasks.workunit.client.0.smithi050.stderr: 92300K .......... .......... .......... .......... .......... 54% 24.2M 3s 2023-10-26T06:44:55.523 INFO:tasks.workunit.client.0.smithi050.stderr: 92350K .......... .......... .......... .......... .......... 54% 26.4M 3s 2023-10-26T06:44:55.524 INFO:tasks.workunit.client.0.smithi050.stderr: 92400K .......... .......... .......... .......... .......... 54% 41.8M 3s 2023-10-26T06:44:55.526 INFO:tasks.workunit.client.0.smithi050.stderr: 92450K .......... .......... .......... .......... .......... 54% 29.4M 3s 2023-10-26T06:44:55.529 INFO:tasks.workunit.client.0.smithi050.stderr: 92500K .......... .......... .......... .......... .......... 54% 22.2M 3s 2023-10-26T06:44:55.530 INFO:tasks.workunit.client.0.smithi050.stderr: 92550K .......... .......... .......... .......... .......... 54% 22.3M 3s 2023-10-26T06:44:55.533 INFO:tasks.workunit.client.0.smithi050.stderr: 92600K .......... .......... .......... .......... .......... 54% 25.7M 3s 2023-10-26T06:44:55.533 INFO:tasks.workunit.client.0.smithi050.stderr: 92650K .......... .......... .......... .......... .......... 54% 60.4M 3s 2023-10-26T06:44:55.535 INFO:tasks.workunit.client.0.smithi050.stderr: 92700K .......... .......... .......... .......... .......... 55% 29.6M 3s 2023-10-26T06:44:55.537 INFO:tasks.workunit.client.0.smithi050.stderr: 92750K .......... .......... .......... .......... .......... 55% 22.1M 3s 2023-10-26T06:44:55.539 INFO:tasks.workunit.client.0.smithi050.stderr: 92800K .......... .......... .......... .......... .......... 55% 24.9M 3s 2023-10-26T06:44:55.540 INFO:tasks.workunit.client.0.smithi050.stderr: 92850K .......... .......... .......... .......... .......... 55% 57.9M 3s 2023-10-26T06:44:55.541 INFO:tasks.workunit.client.0.smithi050.stderr: 92900K .......... .......... .......... .......... .......... 55% 28.7M 3s 2023-10-26T06:44:55.543 INFO:tasks.workunit.client.0.smithi050.stderr: 92950K .......... .......... .......... .......... .......... 55% 23.3M 3s 2023-10-26T06:44:55.546 INFO:tasks.workunit.client.0.smithi050.stderr: 93000K .......... .......... .......... .......... .......... 55% 26.5M 3s 2023-10-26T06:44:55.548 INFO:tasks.workunit.client.0.smithi050.stderr: 93050K .......... .......... .......... .......... .......... 55% 24.9M 3s 2023-10-26T06:44:55.548 INFO:tasks.workunit.client.0.smithi050.stderr: 93100K .......... .......... .......... .......... .......... 55% 60.3M 3s 2023-10-26T06:44:55.549 INFO:tasks.workunit.client.0.smithi050.stderr: 93150K .......... .......... .......... .......... .......... 55% 33.0M 3s 2023-10-26T06:44:55.552 INFO:tasks.workunit.client.0.smithi050.stderr: 93200K .......... .......... .......... .......... .......... 55% 23.8M 3s 2023-10-26T06:44:55.554 INFO:tasks.workunit.client.0.smithi050.stderr: 93250K .......... .......... .......... .......... .......... 55% 26.6M 3s 2023-10-26T06:44:55.555 INFO:tasks.workunit.client.0.smithi050.stderr: 93300K .......... .......... .......... .......... .......... 55% 31.1M 3s 2023-10-26T06:44:55.556 INFO:tasks.workunit.client.0.smithi050.stderr: 93350K .......... .......... .......... .......... .......... 55% 31.8M 3s 2023-10-26T06:44:55.558 INFO:tasks.workunit.client.0.smithi050.stderr: 93400K .......... .......... .......... .......... .......... 55% 27.2M 3s 2023-10-26T06:44:55.560 INFO:tasks.workunit.client.0.smithi050.stderr: 93450K .......... .......... .......... .......... .......... 55% 22.1M 3s 2023-10-26T06:44:55.562 INFO:tasks.workunit.client.0.smithi050.stderr: 93500K .......... .......... .......... .......... .......... 55% 34.0M 3s 2023-10-26T06:44:55.563 INFO:tasks.workunit.client.0.smithi050.stderr: 93550K .......... .......... .......... .......... .......... 55% 34.7M 3s 2023-10-26T06:44:55.565 INFO:tasks.workunit.client.0.smithi050.stderr: 93600K .......... .......... .......... .......... .......... 55% 27.0M 3s 2023-10-26T06:44:55.567 INFO:tasks.workunit.client.0.smithi050.stderr: 93650K .......... .......... .......... .......... .......... 55% 37.5M 3s 2023-10-26T06:44:55.568 INFO:tasks.workunit.client.0.smithi050.stderr: 93700K .......... .......... .......... .......... .......... 55% 26.5M 3s 2023-10-26T06:44:55.569 INFO:tasks.workunit.client.0.smithi050.stderr: 93750K .......... .......... .......... .......... .......... 55% 35.4M 3s 2023-10-26T06:44:55.572 INFO:tasks.workunit.client.0.smithi050.stderr: 93800K .......... .......... .......... .......... .......... 55% 23.7M 3s 2023-10-26T06:44:55.574 INFO:tasks.workunit.client.0.smithi050.stderr: 93850K .......... .......... .......... .......... .......... 55% 26.1M 3s 2023-10-26T06:44:55.576 INFO:tasks.workunit.client.0.smithi050.stderr: 93900K .......... .......... .......... .......... .......... 55% 23.8M 3s 2023-10-26T06:44:55.576 INFO:tasks.workunit.client.0.smithi050.stderr: 93950K .......... .......... .......... .......... .......... 55% 47.0M 3s 2023-10-26T06:44:55.579 INFO:tasks.workunit.client.0.smithi050.stderr: 94000K .......... .......... .......... .......... .......... 55% 23.6M 3s 2023-10-26T06:44:55.580 INFO:tasks.workunit.client.0.smithi050.stderr: 94050K .......... .......... .......... .......... .......... 55% 39.2M 3s 2023-10-26T06:44:55.582 INFO:tasks.workunit.client.0.smithi050.stderr: 94100K .......... .......... .......... .......... .......... 55% 23.7M 3s 2023-10-26T06:44:55.585 INFO:tasks.workunit.client.0.smithi050.stderr: 94150K .......... .......... .......... .......... .......... 55% 24.7M 3s 2023-10-26T06:44:55.585 INFO:tasks.workunit.client.0.smithi050.stderr: 94200K .......... .......... .......... .......... .......... 55% 44.0M 3s 2023-10-26T06:44:55.587 INFO:tasks.workunit.client.0.smithi050.stderr: 94250K .......... .......... .......... .......... .......... 55% 27.5M 3s 2023-10-26T06:44:55.588 INFO:tasks.workunit.client.0.smithi050.stderr: 94300K .......... .......... .......... .......... .......... 55% 31.8M 3s 2023-10-26T06:44:55.591 INFO:tasks.workunit.client.0.smithi050.stderr: 94350K .......... .......... .......... .......... .......... 56% 25.4M 3s 2023-10-26T06:44:55.592 INFO:tasks.workunit.client.0.smithi050.stderr: 94400K .......... .......... .......... .......... .......... 56% 26.3M 3s 2023-10-26T06:44:55.594 INFO:tasks.workunit.client.0.smithi050.stderr: 94450K .......... .......... .......... .......... .......... 56% 38.9M 3s 2023-10-26T06:44:55.596 INFO:tasks.workunit.client.0.smithi050.stderr: 94500K .......... .......... .......... .......... .......... 56% 22.0M 3s 2023-10-26T06:44:55.597 INFO:tasks.workunit.client.0.smithi050.stderr: 94550K .......... .......... .......... .......... .......... 56% 43.5M 3s 2023-10-26T06:44:55.600 INFO:tasks.workunit.client.0.smithi050.stderr: 94600K .......... .......... .......... .......... .......... 56% 22.7M 3s 2023-10-26T06:44:55.602 INFO:tasks.workunit.client.0.smithi050.stderr: 94650K .......... .......... .......... .......... .......... 56% 24.6M 3s 2023-10-26T06:44:55.602 INFO:tasks.workunit.client.0.smithi050.stderr: 94700K .......... .......... .......... .......... .......... 56% 49.4M 3s 2023-10-26T06:44:55.604 INFO:tasks.workunit.client.0.smithi050.stderr: 94750K .......... .......... .......... .......... .......... 56% 30.2M 3s 2023-10-26T06:44:55.605 INFO:tasks.workunit.client.0.smithi050.stderr: 94800K .......... .......... .......... .......... .......... 56% 27.8M 3s 2023-10-26T06:44:55.608 INFO:tasks.workunit.client.0.smithi050.stderr: 94850K .......... .......... .......... .......... .......... 56% 25.1M 3s 2023-10-26T06:44:55.609 INFO:tasks.workunit.client.0.smithi050.stderr: 94900K .......... .......... .......... .......... .......... 56% 26.3M 3s 2023-10-26T06:44:55.610 INFO:tasks.workunit.client.0.smithi050.stderr: 94950K .......... .......... .......... .......... .......... 56% 40.6M 3s 2023-10-26T06:44:55.613 INFO:tasks.workunit.client.0.smithi050.stderr: 95000K .......... .......... .......... .......... .......... 56% 26.7M 3s 2023-10-26T06:44:55.615 INFO:tasks.workunit.client.0.smithi050.stderr: 95050K .......... .......... .......... .......... .......... 56% 29.4M 3s 2023-10-26T06:44:55.617 INFO:tasks.workunit.client.0.smithi050.stderr: 95100K .......... .......... .......... .......... .......... 56% 24.8M 3s 2023-10-26T06:44:55.618 INFO:tasks.workunit.client.0.smithi050.stderr: 95150K .......... .......... .......... .......... .......... 56% 25.3M 3s 2023-10-26T06:44:55.619 INFO:tasks.workunit.client.0.smithi050.stderr: 95200K .......... .......... .......... .......... .......... 56% 41.1M 3s 2023-10-26T06:44:55.621 INFO:tasks.workunit.client.0.smithi050.stderr: 95250K .......... .......... .......... .......... .......... 56% 24.9M 3s 2023-10-26T06:44:55.623 INFO:tasks.workunit.client.0.smithi050.stderr: 95300K .......... .......... .......... .......... .......... 56% 36.9M 3s 2023-10-26T06:44:55.625 INFO:tasks.workunit.client.0.smithi050.stderr: 95350K .......... .......... .......... .......... .......... 56% 24.7M 3s 2023-10-26T06:44:55.627 INFO:tasks.workunit.client.0.smithi050.stderr: 95400K .......... .......... .......... .......... .......... 56% 24.4M 3s 2023-10-26T06:44:55.627 INFO:tasks.workunit.client.0.smithi050.stderr: 95450K .......... .......... .......... .......... .......... 56% 53.1M 3s 2023-10-26T06:44:55.629 INFO:tasks.workunit.client.0.smithi050.stderr: 95500K .......... .......... .......... .......... .......... 56% 23.1M 3s 2023-10-26T06:44:55.631 INFO:tasks.workunit.client.0.smithi050.stderr: 95550K .......... .......... .......... .......... .......... 56% 39.3M 3s 2023-10-26T06:44:55.633 INFO:tasks.workunit.client.0.smithi050.stderr: 95600K .......... .......... .......... .......... .......... 56% 23.1M 3s 2023-10-26T06:44:55.635 INFO:tasks.workunit.client.0.smithi050.stderr: 95650K .......... .......... .......... .......... .......... 56% 24.3M 3s 2023-10-26T06:44:55.636 INFO:tasks.workunit.client.0.smithi050.stderr: 95700K .......... .......... .......... .......... .......... 56% 45.7M 3s 2023-10-26T06:44:55.638 INFO:tasks.workunit.client.0.smithi050.stderr: 95750K .......... .......... .......... .......... .......... 56% 24.9M 3s 2023-10-26T06:44:55.639 INFO:tasks.workunit.client.0.smithi050.stderr: 95800K .......... .......... .......... .......... .......... 56% 29.0M 3s 2023-10-26T06:44:55.643 INFO:tasks.workunit.client.0.smithi050.stderr: 95850K .......... .......... .......... .......... .......... 56% 26.2M 3s 2023-10-26T06:44:55.643 INFO:tasks.workunit.client.0.smithi050.stderr: 95900K .......... .......... .......... .......... .......... 56% 27.8M 3s 2023-10-26T06:44:55.644 INFO:tasks.workunit.client.0.smithi050.stderr: 95950K .......... .......... .......... .......... .......... 56% 39.2M 3s 2023-10-26T06:44:55.646 INFO:tasks.workunit.client.0.smithi050.stderr: 96000K .......... .......... .......... .......... .......... 56% 26.2M 3s 2023-10-26T06:44:55.647 INFO:tasks.workunit.client.0.smithi050.stderr: 96050K .......... .......... .......... .......... .......... 57% 36.2M 3s 2023-10-26T06:44:55.650 INFO:tasks.workunit.client.0.smithi050.stderr: 96100K .......... .......... .......... .......... .......... 57% 24.9M 3s 2023-10-26T06:44:55.652 INFO:tasks.workunit.client.0.smithi050.stderr: 96150K .......... .......... .......... .......... .......... 57% 23.3M 3s 2023-10-26T06:44:55.652 INFO:tasks.workunit.client.0.smithi050.stderr: 96200K .......... .......... .......... .......... .......... 57% 47.3M 3s 2023-10-26T06:44:55.655 INFO:tasks.workunit.client.0.smithi050.stderr: 96250K .......... .......... .......... .......... .......... 57% 23.3M 3s 2023-10-26T06:44:55.657 INFO:tasks.workunit.client.0.smithi050.stderr: 96300K .......... .......... .......... .......... .......... 57% 24.7M 3s 2023-10-26T06:44:55.659 INFO:tasks.workunit.client.0.smithi050.stderr: 96350K .......... .......... .......... .......... .......... 57% 27.3M 3s 2023-10-26T06:44:55.660 INFO:tasks.workunit.client.0.smithi050.stderr: 96400K .......... .......... .......... .......... .......... 57% 24.2M 3s 2023-10-26T06:44:55.662 INFO:tasks.workunit.client.0.smithi050.stderr: 96450K .......... .......... .......... .......... .......... 57% 46.7M 3s 2023-10-26T06:44:55.663 INFO:tasks.workunit.client.0.smithi050.stderr: 96500K .......... .......... .......... .......... .......... 57% 24.7M 3s 2023-10-26T06:44:55.665 INFO:tasks.workunit.client.0.smithi050.stderr: 96550K .......... .......... .......... .......... .......... 57% 35.7M 3s 2023-10-26T06:44:55.668 INFO:tasks.workunit.client.0.smithi050.stderr: 96600K .......... .......... .......... .......... .......... 57% 28.7M 3s 2023-10-26T06:44:55.670 INFO:tasks.workunit.client.0.smithi050.stderr: 96650K .......... .......... .......... .......... .......... 57% 23.7M 3s 2023-10-26T06:44:55.670 INFO:tasks.workunit.client.0.smithi050.stderr: 96700K .......... .......... .......... .......... .......... 57% 40.7M 3s 2023-10-26T06:44:55.672 INFO:tasks.workunit.client.0.smithi050.stderr: 96750K .......... .......... .......... .......... .......... 57% 23.2M 3s 2023-10-26T06:44:55.674 INFO:tasks.workunit.client.0.smithi050.stderr: 96800K .......... .......... .......... .......... .......... 57% 30.2M 3s 2023-10-26T06:44:55.676 INFO:tasks.workunit.client.0.smithi050.stderr: 96850K .......... .......... .......... .......... .......... 57% 27.0M 3s 2023-10-26T06:44:55.679 INFO:tasks.workunit.client.0.smithi050.stderr: 96900K .......... .......... .......... .......... .......... 57% 22.5M 3s 2023-10-26T06:44:55.679 INFO:tasks.workunit.client.0.smithi050.stderr: 96950K .......... .......... .......... .......... .......... 57% 42.7M 3s 2023-10-26T06:44:55.681 INFO:tasks.workunit.client.0.smithi050.stderr: 97000K .......... .......... .......... .......... .......... 57% 33.3M 3s 2023-10-26T06:44:55.683 INFO:tasks.workunit.client.0.smithi050.stderr: 97050K .......... .......... .......... .......... .......... 57% 24.9M 3s 2023-10-26T06:44:55.685 INFO:tasks.workunit.client.0.smithi050.stderr: 97100K .......... .......... .......... .......... .......... 57% 24.9M 3s 2023-10-26T06:44:55.687 INFO:tasks.workunit.client.0.smithi050.stderr: 97150K .......... .......... .......... .......... .......... 57% 24.8M 3s 2023-10-26T06:44:55.687 INFO:tasks.workunit.client.0.smithi050.stderr: 97200K .......... .......... .......... .......... .......... 57% 46.0M 3s 2023-10-26T06:44:55.689 INFO:tasks.workunit.client.0.smithi050.stderr: 97250K .......... .......... .......... .......... .......... 57% 23.5M 3s 2023-10-26T06:44:55.691 INFO:tasks.workunit.client.0.smithi050.stderr: 97300K .......... .......... .......... .......... .......... 57% 33.7M 3s 2023-10-26T06:44:55.693 INFO:tasks.workunit.client.0.smithi050.stderr: 97350K .......... .......... .......... .......... .......... 57% 24.8M 3s 2023-10-26T06:44:55.695 INFO:tasks.workunit.client.0.smithi050.stderr: 97400K .......... .......... .......... .......... .......... 57% 24.3M 3s 2023-10-26T06:44:55.706 INFO:tasks.workunit.client.0.smithi050.stderr: 97450K .......... .......... .......... .......... .......... 57% 52.3M 3s 2023-10-26T06:44:55.706 INFO:tasks.workunit.client.0.smithi050.stderr: 97500K .......... .......... .......... .......... .......... 57% 31.4M 3s 2023-10-26T06:44:55.707 INFO:tasks.workunit.client.0.smithi050.stderr: 97550K .......... .......... .......... .......... .......... 57% 23.7M 3s 2023-10-26T06:44:55.707 INFO:tasks.workunit.client.0.smithi050.stderr: 97600K .......... .......... .......... .......... .......... 57% 24.6M 3s 2023-10-26T06:44:55.707 INFO:tasks.workunit.client.0.smithi050.stderr: 97650K .......... .......... .......... .......... .......... 57% 24.7M 3s 2023-10-26T06:44:55.707 INFO:tasks.workunit.client.0.smithi050.stderr: 97700K .......... .......... .......... .......... .......... 57% 55.4M 3s 2023-10-26T06:44:55.708 INFO:tasks.workunit.client.0.smithi050.stderr: 97750K .......... .......... .......... .......... .......... 58% 25.0M 3s 2023-10-26T06:44:55.717 INFO:tasks.workunit.client.0.smithi050.stderr: 97800K .......... .......... .......... .......... .......... 58% 30.4M 3s 2023-10-26T06:44:55.717 INFO:tasks.workunit.client.0.smithi050.stderr: 97850K .......... .......... .......... .......... .......... 58% 22.3M 3s 2023-10-26T06:44:55.718 INFO:tasks.workunit.client.0.smithi050.stderr: 97900K .......... .......... .......... .......... .......... 58% 23.7M 3s 2023-10-26T06:44:55.718 INFO:tasks.workunit.client.0.smithi050.stderr: 97950K .......... .......... .......... .......... .......... 58% 56.8M 3s 2023-10-26T06:44:55.718 INFO:tasks.workunit.client.0.smithi050.stderr: 98000K .......... .......... .......... .......... .......... 58% 23.8M 3s 2023-10-26T06:44:55.718 INFO:tasks.workunit.client.0.smithi050.stderr: 98050K .......... .......... .......... .......... .......... 58% 24.3M 3s 2023-10-26T06:44:55.731 INFO:tasks.workunit.client.0.smithi050.stderr: 98100K .......... .......... .......... .......... .......... 58% 30.8M 3s 2023-10-26T06:44:55.731 INFO:tasks.workunit.client.0.smithi050.stderr: 98150K .......... .......... .......... .......... .......... 58% 18.5M 3s 2023-10-26T06:44:55.731 INFO:tasks.workunit.client.0.smithi050.stderr: 98200K .......... .......... .......... .......... .......... 58% 61.9M 3s 2023-10-26T06:44:55.732 INFO:tasks.workunit.client.0.smithi050.stderr: 98250K .......... .......... .......... .......... .......... 58% 41.0M 3s 2023-10-26T06:44:55.732 INFO:tasks.workunit.client.0.smithi050.stderr: 98300K .......... .......... .......... .......... .......... 58% 23.4M 3s 2023-10-26T06:44:55.732 INFO:tasks.workunit.client.0.smithi050.stderr: 98350K .......... .......... .......... .......... .......... 58% 30.8M 3s 2023-10-26T06:44:55.732 INFO:tasks.workunit.client.0.smithi050.stderr: 98400K .......... .......... .......... .......... .......... 58% 24.0M 3s 2023-10-26T06:44:55.732 INFO:tasks.workunit.client.0.smithi050.stderr: 98450K .......... .......... .......... .......... .......... 58% 55.5M 3s 2023-10-26T06:44:55.736 INFO:tasks.workunit.client.0.smithi050.stderr: 98500K .......... .......... .......... .......... .......... 58% 21.9M 3s 2023-10-26T06:44:55.736 INFO:tasks.workunit.client.0.smithi050.stderr: 98550K .......... .......... .......... .......... .......... 58% 27.0M 3s 2023-10-26T06:44:55.737 INFO:tasks.workunit.client.0.smithi050.stderr: 98600K .......... .......... .......... .......... .......... 58% 30.7M 3s 2023-10-26T06:44:55.738 INFO:tasks.workunit.client.0.smithi050.stderr: 98650K .......... .......... .......... .......... .......... 58% 24.6M 3s 2023-10-26T06:44:55.739 INFO:tasks.workunit.client.0.smithi050.stderr: 98700K .......... .......... .......... .......... .......... 58% 60.7M 3s 2023-10-26T06:44:55.740 INFO:tasks.workunit.client.0.smithi050.stderr: 98750K .......... .......... .......... .......... .......... 58% 24.2M 3s 2023-10-26T06:44:55.742 INFO:tasks.workunit.client.0.smithi050.stderr: 98800K .......... .......... .......... .......... .......... 58% 22.6M 3s 2023-10-26T06:44:55.744 INFO:tasks.workunit.client.0.smithi050.stderr: 98850K .......... .......... .......... .......... .......... 58% 26.8M 3s 2023-10-26T06:44:55.746 INFO:tasks.workunit.client.0.smithi050.stderr: 98900K .......... .......... .......... .......... .......... 58% 32.8M 3s 2023-10-26T06:44:55.747 INFO:tasks.workunit.client.0.smithi050.stderr: 98950K .......... .......... .......... .......... .......... 58% 45.6M 3s 2023-10-26T06:44:55.749 INFO:tasks.workunit.client.0.smithi050.stderr: 99000K .......... .......... .......... .......... .......... 58% 24.2M 3s 2023-10-26T06:44:55.753 INFO:tasks.workunit.client.0.smithi050.stderr: 99050K .......... .......... .......... .......... .......... 58% 33.2M 3s 2023-10-26T06:44:55.753 INFO:tasks.workunit.client.0.smithi050.stderr: 99100K .......... .......... .......... .......... .......... 58% 26.6M 3s 2023-10-26T06:44:55.755 INFO:tasks.workunit.client.0.smithi050.stderr: 99150K .......... .......... .......... .......... .......... 58% 24.0M 3s 2023-10-26T06:44:55.757 INFO:tasks.workunit.client.0.smithi050.stderr: 99200K .......... .......... .......... .......... .......... 58% 24.7M 3s 2023-10-26T06:44:55.757 INFO:tasks.workunit.client.0.smithi050.stderr: 99250K .......... .......... .......... .......... .......... 58% 52.5M 3s 2023-10-26T06:44:55.759 INFO:tasks.workunit.client.0.smithi050.stderr: 99300K .......... .......... .......... .......... .......... 58% 23.8M 3s 2023-10-26T06:44:55.761 INFO:tasks.workunit.client.0.smithi050.stderr: 99350K .......... .......... .......... .......... .......... 58% 35.1M 3s 2023-10-26T06:44:55.763 INFO:tasks.workunit.client.0.smithi050.stderr: 99400K .......... .......... .......... .......... .......... 58% 24.5M 3s 2023-10-26T06:44:55.765 INFO:tasks.workunit.client.0.smithi050.stderr: 99450K .......... .......... .......... .......... .......... 59% 22.6M 3s 2023-10-26T06:44:55.765 INFO:tasks.workunit.client.0.smithi050.stderr: 99500K .......... .......... .......... .......... .......... 59% 41.2M 3s 2023-10-26T06:44:55.768 INFO:tasks.workunit.client.0.smithi050.stderr: 99550K .......... .......... .......... .......... .......... 59% 23.4M 3s 2023-10-26T06:44:55.769 INFO:tasks.workunit.client.0.smithi050.stderr: 99600K .......... .......... .......... .......... .......... 59% 34.6M 3s 2023-10-26T06:44:55.771 INFO:tasks.workunit.client.0.smithi050.stderr: 99650K .......... .......... .......... .......... .......... 59% 22.3M 3s 2023-10-26T06:44:55.777 INFO:tasks.workunit.client.0.smithi050.stderr: 99700K .......... .......... .......... .......... .......... 59% 11.7M 3s 2023-10-26T06:44:55.777 INFO:tasks.workunit.client.0.smithi050.stderr: 99750K .......... .......... .......... .......... .......... 59% 182M 3s 2023-10-26T06:44:55.777 INFO:tasks.workunit.client.0.smithi050.stderr: 99800K .......... .......... .......... .......... .......... 59% 63.1M 3s 2023-10-26T06:44:55.780 INFO:tasks.workunit.client.0.smithi050.stderr: 99850K .......... .......... .......... .......... .......... 59% 36.5M 3s 2023-10-26T06:44:55.780 INFO:tasks.workunit.client.0.smithi050.stderr: 99900K .......... .......... .......... .......... .......... 59% 23.9M 3s 2023-10-26T06:44:55.782 INFO:tasks.workunit.client.0.smithi050.stderr: 99950K .......... .......... .......... .......... .......... 59% 25.1M 3s 2023-10-26T06:44:55.783 INFO:tasks.workunit.client.0.smithi050.stderr:100000K .......... .......... .......... .......... .......... 59% 44.7M 3s 2023-10-26T06:44:55.785 INFO:tasks.workunit.client.0.smithi050.stderr:100050K .......... .......... .......... .......... .......... 59% 21.0M 3s 2023-10-26T06:44:55.786 INFO:tasks.workunit.client.0.smithi050.stderr:100100K .......... .......... .......... .......... .......... 59% 37.8M 3s 2023-10-26T06:44:55.789 INFO:tasks.workunit.client.0.smithi050.stderr:100150K .......... .......... .......... .......... .......... 59% 20.8M 3s 2023-10-26T06:44:55.790 INFO:tasks.workunit.client.0.smithi050.stderr:100200K .......... .......... .......... .......... .......... 59% 26.3M 3s 2023-10-26T06:44:55.792 INFO:tasks.workunit.client.0.smithi050.stderr:100250K .......... .......... .......... .......... .......... 59% 45.0M 3s 2023-10-26T06:44:55.794 INFO:tasks.workunit.client.0.smithi050.stderr:100300K .......... .......... .......... .......... .......... 59% 25.2M 3s 2023-10-26T06:44:55.796 INFO:tasks.workunit.client.0.smithi050.stderr:100350K .......... .......... .......... .......... .......... 59% 27.7M 3s 2023-10-26T06:44:55.797 INFO:tasks.workunit.client.0.smithi050.stderr:100400K .......... .......... .......... .......... .......... 59% 29.1M 3s 2023-10-26T06:44:55.801 INFO:tasks.workunit.client.0.smithi050.stderr:100450K .......... .......... .......... .......... .......... 59% 19.9M 3s 2023-10-26T06:44:55.801 INFO:tasks.workunit.client.0.smithi050.stderr:100500K .......... .......... .......... .......... .......... 59% 46.8M 3s 2023-10-26T06:44:55.805 INFO:tasks.workunit.client.0.smithi050.stderr:100550K .......... .......... .......... .......... .......... 59% 23.3M 3s 2023-10-26T06:44:55.805 INFO:tasks.workunit.client.0.smithi050.stderr:100600K .......... .......... .......... .......... .......... 59% 50.9M 3s 2023-10-26T06:44:55.808 INFO:tasks.workunit.client.0.smithi050.stderr:100650K .......... .......... .......... .......... .......... 59% 24.3M 2s 2023-10-26T06:44:55.808 INFO:tasks.workunit.client.0.smithi050.stderr:100700K .......... .......... .......... .......... .......... 59% 57.3M 2s 2023-10-26T06:44:55.811 INFO:tasks.workunit.client.0.smithi050.stderr:100750K .......... .......... .......... .......... .......... 59% 24.3M 2s 2023-10-26T06:44:55.811 INFO:tasks.workunit.client.0.smithi050.stderr:100800K .......... .......... .......... .......... .......... 59% 24.6M 2s 2023-10-26T06:44:55.813 INFO:tasks.workunit.client.0.smithi050.stderr:100850K .......... .......... .......... .......... .......... 59% 31.9M 2s 2023-10-26T06:44:55.816 INFO:tasks.workunit.client.0.smithi050.stderr:100900K .......... .......... .......... .......... .......... 59% 23.0M 2s 2023-10-26T06:44:55.816 INFO:tasks.workunit.client.0.smithi050.stderr:100950K .......... .......... .......... .......... .......... 59% 60.1M 2s 2023-10-26T06:44:55.817 INFO:tasks.workunit.client.0.smithi050.stderr:101000K .......... .......... .......... .......... .......... 59% 25.8M 2s 2023-10-26T06:44:55.819 INFO:tasks.workunit.client.0.smithi050.stderr:101050K .......... .......... .......... .......... .......... 59% 29.6M 2s 2023-10-26T06:44:55.821 INFO:tasks.workunit.client.0.smithi050.stderr:101100K .......... .......... .......... .......... .......... 60% 30.8M 2s 2023-10-26T06:44:55.823 INFO:tasks.workunit.client.0.smithi050.stderr:101150K .......... .......... .......... .......... .......... 60% 20.2M 2s 2023-10-26T06:44:55.824 INFO:tasks.workunit.client.0.smithi050.stderr:101200K .......... .......... .......... .......... .......... 60% 42.0M 2s 2023-10-26T06:44:55.826 INFO:tasks.workunit.client.0.smithi050.stderr:101250K .......... .......... .......... .......... .......... 60% 31.2M 2s 2023-10-26T06:44:55.828 INFO:tasks.workunit.client.0.smithi050.stderr:101300K .......... .......... .......... .......... .......... 60% 26.1M 2s 2023-10-26T06:44:55.830 INFO:tasks.workunit.client.0.smithi050.stderr:101350K .......... .......... .......... .......... .......... 60% 24.6M 2s 2023-10-26T06:44:55.832 INFO:tasks.workunit.client.0.smithi050.stderr:101400K .......... .......... .......... .......... .......... 60% 26.9M 2s 2023-10-26T06:44:55.832 INFO:tasks.workunit.client.0.smithi050.stderr:101450K .......... .......... .......... .......... .......... 60% 52.0M 2s 2023-10-26T06:44:55.834 INFO:tasks.workunit.client.0.smithi050.stderr:101500K .......... .......... .......... .......... .......... 60% 27.7M 2s 2023-10-26T06:44:55.836 INFO:tasks.workunit.client.0.smithi050.stderr:101550K .......... .......... .......... .......... .......... 60% 28.7M 2s 2023-10-26T06:44:55.838 INFO:tasks.workunit.client.0.smithi050.stderr:101600K .......... .......... .......... .......... .......... 60% 23.5M 2s 2023-10-26T06:44:55.840 INFO:tasks.workunit.client.0.smithi050.stderr:101650K .......... .......... .......... .......... .......... 60% 25.0M 2s 2023-10-26T06:44:55.841 INFO:tasks.workunit.client.0.smithi050.stderr:101700K .......... .......... .......... .......... .......... 60% 50.4M 2s 2023-10-26T06:44:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:101750K .......... .......... .......... .......... .......... 60% 28.2M 2s 2023-10-26T06:44:55.845 INFO:tasks.workunit.client.0.smithi050.stderr:101800K .......... .......... .......... .......... .......... 60% 26.7M 2s 2023-10-26T06:44:55.847 INFO:tasks.workunit.client.0.smithi050.stderr:101850K .......... .......... .......... .......... .......... 60% 24.8M 2s 2023-10-26T06:44:55.853 INFO:tasks.workunit.client.0.smithi050.stderr:101900K .......... .......... .......... .......... .......... 60% 24.8M 2s 2023-10-26T06:44:55.853 INFO:tasks.workunit.client.0.smithi050.stderr:101950K .......... .......... .......... .......... .......... 60% 34.2M 2s 2023-10-26T06:44:55.853 INFO:tasks.workunit.client.0.smithi050.stderr:102000K .......... .......... .......... .......... .......... 60% 37.3M 2s 2023-10-26T06:44:55.854 INFO:tasks.workunit.client.0.smithi050.stderr:102050K .......... .......... .......... .......... .......... 60% 23.3M 2s 2023-10-26T06:44:55.858 INFO:tasks.workunit.client.0.smithi050.stderr:102100K .......... .......... .......... .......... .......... 60% 28.7M 2s 2023-10-26T06:44:55.858 INFO:tasks.workunit.client.0.smithi050.stderr:102150K .......... .......... .......... .......... .......... 60% 23.3M 2s 2023-10-26T06:44:55.858 INFO:tasks.workunit.client.0.smithi050.stderr:102200K .......... .......... .......... .......... .......... 60% 42.0M 2s 2023-10-26T06:44:55.861 INFO:tasks.workunit.client.0.smithi050.stderr:102250K .......... .......... .......... .......... .......... 60% 35.7M 2s 2023-10-26T06:44:55.861 INFO:tasks.workunit.client.0.smithi050.stderr:102300K .......... .......... .......... .......... .......... 60% 27.8M 2s 2023-10-26T06:44:55.863 INFO:tasks.workunit.client.0.smithi050.stderr:102350K .......... .......... .......... .......... .......... 60% 24.1M 2s 2023-10-26T06:44:55.866 INFO:tasks.workunit.client.0.smithi050.stderr:102400K .......... .......... .......... .......... .......... 60% 44.7M 2s 2023-10-26T06:44:55.866 INFO:tasks.workunit.client.0.smithi050.stderr:102450K .......... .......... .......... .......... .......... 60% 24.1M 2s 2023-10-26T06:44:55.868 INFO:tasks.workunit.client.0.smithi050.stderr:102500K .......... .......... .......... .......... .......... 60% 36.4M 2s 2023-10-26T06:44:55.869 INFO:tasks.workunit.client.0.smithi050.stderr:102550K .......... .......... .......... .......... .......... 60% 23.6M 2s 2023-10-26T06:44:55.872 INFO:tasks.workunit.client.0.smithi050.stderr:102600K .......... .......... .......... .......... .......... 60% 23.2M 2s 2023-10-26T06:44:55.874 INFO:tasks.workunit.client.0.smithi050.stderr:102650K .......... .......... .......... .......... .......... 60% 26.8M 2s 2023-10-26T06:44:55.874 INFO:tasks.workunit.client.0.smithi050.stderr:102700K .......... .......... .......... .......... .......... 60% 55.0M 2s 2023-10-26T06:44:55.876 INFO:tasks.workunit.client.0.smithi050.stderr:102750K .......... .......... .......... .......... .......... 60% 32.7M 2s 2023-10-26T06:44:55.878 INFO:tasks.workunit.client.0.smithi050.stderr:102800K .......... .......... .......... .......... .......... 61% 23.0M 2s 2023-10-26T06:44:55.881 INFO:tasks.workunit.client.0.smithi050.stderr:102850K .......... .......... .......... .......... .......... 61% 33.0M 2s 2023-10-26T06:44:55.882 INFO:tasks.workunit.client.0.smithi050.stderr:102900K .......... .......... .......... .......... .......... 61% 20.9M 2s 2023-10-26T06:44:55.884 INFO:tasks.workunit.client.0.smithi050.stderr:102950K .......... .......... .......... .......... .......... 61% 41.4M 2s 2023-10-26T06:44:55.884 INFO:tasks.workunit.client.0.smithi050.stderr:103000K .......... .......... .......... .......... .......... 61% 36.3M 2s 2023-10-26T06:44:55.887 INFO:tasks.workunit.client.0.smithi050.stderr:103050K .......... .......... .......... .......... .......... 61% 21.3M 2s 2023-10-26T06:44:55.888 INFO:tasks.workunit.client.0.smithi050.stderr:103100K .......... .......... .......... .......... .......... 61% 27.8M 2s 2023-10-26T06:44:55.890 INFO:tasks.workunit.client.0.smithi050.stderr:103150K .......... .......... .......... .......... .......... 61% 37.4M 2s 2023-10-26T06:44:55.892 INFO:tasks.workunit.client.0.smithi050.stderr:103200K .......... .......... .......... .......... .......... 61% 25.6M 2s 2023-10-26T06:44:55.894 INFO:tasks.workunit.client.0.smithi050.stderr:103250K .......... .......... .......... .......... .......... 61% 39.7M 2s 2023-10-26T06:44:55.895 INFO:tasks.workunit.client.0.smithi050.stderr:103300K .......... .......... .......... .......... .......... 61% 25.0M 2s 2023-10-26T06:44:55.897 INFO:tasks.workunit.client.0.smithi050.stderr:103350K .......... .......... .......... .......... .......... 61% 26.5M 2s 2023-10-26T06:44:55.898 INFO:tasks.workunit.client.0.smithi050.stderr:103400K .......... .......... .......... .......... .......... 61% 32.5M 2s 2023-10-26T06:44:55.901 INFO:tasks.workunit.client.0.smithi050.stderr:103450K .......... .......... .......... .......... .......... 61% 21.6M 2s 2023-10-26T06:44:55.901 INFO:tasks.workunit.client.0.smithi050.stderr:103500K .......... .......... .......... .......... .......... 61% 47.4M 2s 2023-10-26T06:44:55.903 INFO:tasks.workunit.client.0.smithi050.stderr:103550K .......... .......... .......... .......... .......... 61% 23.8M 2s 2023-10-26T06:44:55.905 INFO:tasks.workunit.client.0.smithi050.stderr:103600K .......... .......... .......... .......... .......... 61% 23.9M 2s 2023-10-26T06:44:55.906 INFO:tasks.workunit.client.0.smithi050.stderr:103650K .......... .......... .......... .......... .......... 61% 38.6M 2s 2023-10-26T06:44:55.908 INFO:tasks.workunit.client.0.smithi050.stderr:103700K .......... .......... .......... .......... .......... 61% 24.4M 2s 2023-10-26T06:44:55.910 INFO:tasks.workunit.client.0.smithi050.stderr:103750K .......... .......... .......... .......... .......... 61% 45.7M 2s 2023-10-26T06:44:55.912 INFO:tasks.workunit.client.0.smithi050.stderr:103800K .......... .......... .......... .......... .......... 61% 24.4M 2s 2023-10-26T06:44:55.914 INFO:tasks.workunit.client.0.smithi050.stderr:103850K .......... .......... .......... .......... .......... 61% 36.1M 2s 2023-10-26T06:44:55.918 INFO:tasks.workunit.client.0.smithi050.stderr:103900K .......... .......... .......... .......... .......... 61% 24.5M 2s 2023-10-26T06:44:55.918 INFO:tasks.workunit.client.0.smithi050.stderr:103950K .......... .......... .......... .......... .......... 61% 25.1M 2s 2023-10-26T06:44:55.920 INFO:tasks.workunit.client.0.smithi050.stderr:104000K .......... .......... .......... .......... .......... 61% 46.6M 2s 2023-10-26T06:44:55.920 INFO:tasks.workunit.client.0.smithi050.stderr:104050K .......... .......... .......... .......... .......... 61% 24.8M 2s 2023-10-26T06:44:55.924 INFO:tasks.workunit.client.0.smithi050.stderr:104100K .......... .......... .......... .......... .......... 61% 34.8M 2s 2023-10-26T06:44:55.924 INFO:tasks.workunit.client.0.smithi050.stderr:104150K .......... .......... .......... .......... .......... 61% 23.7M 2s 2023-10-26T06:44:55.926 INFO:tasks.workunit.client.0.smithi050.stderr:104200K .......... .......... .......... .......... .......... 61% 25.0M 2s 2023-10-26T06:44:55.928 INFO:tasks.workunit.client.0.smithi050.stderr:104250K .......... .......... .......... .......... .......... 61% 40.2M 2s 2023-10-26T06:44:55.929 INFO:tasks.workunit.client.0.smithi050.stderr:104300K .......... .......... .......... .......... .......... 61% 20.1M 2s 2023-10-26T06:44:55.931 INFO:tasks.workunit.client.0.smithi050.stderr:104350K .......... .......... .......... .......... .......... 61% 37.2M 2s 2023-10-26T06:44:55.933 INFO:tasks.workunit.client.0.smithi050.stderr:104400K .......... .......... .......... .......... .......... 61% 25.0M 2s 2023-10-26T06:44:55.935 INFO:tasks.workunit.client.0.smithi050.stderr:104450K .......... .......... .......... .......... .......... 61% 23.8M 2s 2023-10-26T06:44:55.937 INFO:tasks.workunit.client.0.smithi050.stderr:104500K .......... .......... .......... .......... .......... 62% 22.9M 2s 2023-10-26T06:44:55.938 INFO:tasks.workunit.client.0.smithi050.stderr:104550K .......... .......... .......... .......... .......... 62% 45.9M 2s 2023-10-26T06:44:55.940 INFO:tasks.workunit.client.0.smithi050.stderr:104600K .......... .......... .......... .......... .......... 62% 30.3M 2s 2023-10-26T06:44:55.941 INFO:tasks.workunit.client.0.smithi050.stderr:104650K .......... .......... .......... .......... .......... 62% 26.5M 2s 2023-10-26T06:44:55.944 INFO:tasks.workunit.client.0.smithi050.stderr:104700K .......... .......... .......... .......... .......... 62% 24.7M 2s 2023-10-26T06:44:55.945 INFO:tasks.workunit.client.0.smithi050.stderr:104750K .......... .......... .......... .......... .......... 62% 24.8M 2s 2023-10-26T06:44:55.946 INFO:tasks.workunit.client.0.smithi050.stderr:104800K .......... .......... .......... .......... .......... 62% 45.4M 2s 2023-10-26T06:44:55.948 INFO:tasks.workunit.client.0.smithi050.stderr:104850K .......... .......... .......... .......... .......... 62% 22.5M 2s 2023-10-26T06:44:55.950 INFO:tasks.workunit.client.0.smithi050.stderr:104900K .......... .......... .......... .......... .......... 62% 36.0M 2s 2023-10-26T06:44:55.952 INFO:tasks.workunit.client.0.smithi050.stderr:104950K .......... .......... .......... .......... .......... 62% 24.0M 2s 2023-10-26T06:44:55.953 INFO:tasks.workunit.client.0.smithi050.stderr:105000K .......... .......... .......... .......... .......... 62% 24.1M 2s 2023-10-26T06:44:55.955 INFO:tasks.workunit.client.0.smithi050.stderr:105050K .......... .......... .......... .......... .......... 62% 50.1M 2s 2023-10-26T06:44:55.957 INFO:tasks.workunit.client.0.smithi050.stderr:105100K .......... .......... .......... .......... .......... 62% 23.4M 2s 2023-10-26T06:44:55.961 INFO:tasks.workunit.client.0.smithi050.stderr:105150K .......... .......... .......... .......... .......... 62% 32.3M 2s 2023-10-26T06:44:55.961 INFO:tasks.workunit.client.0.smithi050.stderr:105200K .......... .......... .......... .......... .......... 62% 23.9M 2s 2023-10-26T06:44:55.964 INFO:tasks.workunit.client.0.smithi050.stderr:105250K .......... .......... .......... .......... .......... 62% 18.3M 2s 2023-10-26T06:44:55.964 INFO:tasks.workunit.client.0.smithi050.stderr:105300K .......... .......... .......... .......... .......... 62% 96.6M 2s 2023-10-26T06:44:55.967 INFO:tasks.workunit.client.0.smithi050.stderr:105350K .......... .......... .......... .......... .......... 62% 27.2M 2s 2023-10-26T06:44:55.967 INFO:tasks.workunit.client.0.smithi050.stderr:105400K .......... .......... .......... .......... .......... 62% 33.2M 2s 2023-10-26T06:44:55.969 INFO:tasks.workunit.client.0.smithi050.stderr:105450K .......... .......... .......... .......... .......... 62% 25.7M 2s 2023-10-26T06:44:55.970 INFO:tasks.workunit.client.0.smithi050.stderr:105500K .......... .......... .......... .......... .......... 62% 46.4M 2s 2023-10-26T06:44:55.972 INFO:tasks.workunit.client.0.smithi050.stderr:105550K .......... .......... .......... .......... .......... 62% 24.0M 2s 2023-10-26T06:44:55.973 INFO:tasks.workunit.client.0.smithi050.stderr:105600K .......... .......... .......... .......... .......... 62% 25.3M 2s 2023-10-26T06:44:55.975 INFO:tasks.workunit.client.0.smithi050.stderr:105650K .......... .......... .......... .......... .......... 62% 35.1M 2s 2023-10-26T06:44:55.978 INFO:tasks.workunit.client.0.smithi050.stderr:105700K .......... .......... .......... .......... .......... 62% 25.1M 2s 2023-10-26T06:44:55.979 INFO:tasks.workunit.client.0.smithi050.stderr:105750K .......... .......... .......... .......... .......... 62% 23.6M 2s 2023-10-26T06:44:55.980 INFO:tasks.workunit.client.0.smithi050.stderr:105800K .......... .......... .......... .......... .......... 62% 38.5M 2s 2023-10-26T06:44:55.982 INFO:tasks.workunit.client.0.smithi050.stderr:105850K .......... .......... .......... .......... .......... 62% 24.3M 2s 2023-10-26T06:44:55.984 INFO:tasks.workunit.client.0.smithi050.stderr:105900K .......... .......... .......... .......... .......... 62% 35.9M 2s 2023-10-26T06:44:55.987 INFO:tasks.workunit.client.0.smithi050.stderr:105950K .......... .......... .......... .......... .......... 62% 26.7M 2s 2023-10-26T06:44:55.988 INFO:tasks.workunit.client.0.smithi050.stderr:106000K .......... .......... .......... .......... .......... 62% 23.8M 2s 2023-10-26T06:44:55.989 INFO:tasks.workunit.client.0.smithi050.stderr:106050K .......... .......... .......... .......... .......... 62% 42.4M 2s 2023-10-26T06:44:55.991 INFO:tasks.workunit.client.0.smithi050.stderr:106100K .......... .......... .......... .......... .......... 62% 25.1M 2s 2023-10-26T06:44:55.995 INFO:tasks.workunit.client.0.smithi050.stderr:106150K .......... .......... .......... .......... .......... 63% 33.0M 2s 2023-10-26T06:44:55.995 INFO:tasks.workunit.client.0.smithi050.stderr:106200K .......... .......... .......... .......... .......... 63% 24.5M 2s 2023-10-26T06:44:55.997 INFO:tasks.workunit.client.0.smithi050.stderr:106250K .......... .......... .......... .......... .......... 63% 23.4M 2s 2023-10-26T06:44:55.997 INFO:tasks.workunit.client.0.smithi050.stderr:106300K .......... .......... .......... .......... .......... 63% 56.1M 2s 2023-10-26T06:44:55.999 INFO:tasks.workunit.client.0.smithi050.stderr:106350K .......... .......... .......... .......... .......... 63% 32.0M 2s 2023-10-26T06:44:56.002 INFO:tasks.workunit.client.0.smithi050.stderr:106400K .......... .......... .......... .......... .......... 63% 26.0M 2s 2023-10-26T06:44:56.002 INFO:tasks.workunit.client.0.smithi050.stderr:106450K .......... .......... .......... .......... .......... 63% 30.1M 2s 2023-10-26T06:44:56.005 INFO:tasks.workunit.client.0.smithi050.stderr:106500K .......... .......... .......... .......... .......... 63% 20.6M 2s 2023-10-26T06:44:56.005 INFO:tasks.workunit.client.0.smithi050.stderr:106550K .......... .......... .......... .......... .......... 63% 44.4M 2s 2023-10-26T06:44:56.007 INFO:tasks.workunit.client.0.smithi050.stderr:106600K .......... .......... .......... .......... .......... 63% 29.2M 2s 2023-10-26T06:44:56.009 INFO:tasks.workunit.client.0.smithi050.stderr:106650K .......... .......... .......... .......... .......... 63% 28.7M 2s 2023-10-26T06:44:56.012 INFO:tasks.workunit.client.0.smithi050.stderr:106700K .......... .......... .......... .......... .......... 63% 24.4M 2s 2023-10-26T06:44:56.013 INFO:tasks.workunit.client.0.smithi050.stderr:106750K .......... .......... .......... .......... .......... 63% 24.1M 2s 2023-10-26T06:44:56.014 INFO:tasks.workunit.client.0.smithi050.stderr:106800K .......... .......... .......... .......... .......... 63% 50.2M 2s 2023-10-26T06:44:56.016 INFO:tasks.workunit.client.0.smithi050.stderr:106850K .......... .......... .......... .......... .......... 63% 33.3M 2s 2023-10-26T06:44:56.018 INFO:tasks.workunit.client.0.smithi050.stderr:106900K .......... .......... .......... .......... .......... 63% 24.2M 2s 2023-10-26T06:44:56.020 INFO:tasks.workunit.client.0.smithi050.stderr:106950K .......... .......... .......... .......... .......... 63% 24.8M 2s 2023-10-26T06:44:56.022 INFO:tasks.workunit.client.0.smithi050.stderr:107000K .......... .......... .......... .......... .......... 63% 24.1M 2s 2023-10-26T06:44:56.023 INFO:tasks.workunit.client.0.smithi050.stderr:107050K .......... .......... .......... .......... .......... 63% 51.3M 2s 2023-10-26T06:44:56.029 INFO:tasks.workunit.client.0.smithi050.stderr:107100K .......... .......... .......... .......... .......... 63% 30.6M 2s 2023-10-26T06:44:56.029 INFO:tasks.workunit.client.0.smithi050.stderr:107150K .......... .......... .......... .......... .......... 63% 28.3M 2s 2023-10-26T06:44:56.029 INFO:tasks.workunit.client.0.smithi050.stderr:107200K .......... .......... .......... .......... .......... 63% 23.8M 2s 2023-10-26T06:44:56.033 INFO:tasks.workunit.client.0.smithi050.stderr:107250K .......... .......... .......... .......... .......... 63% 23.1M 2s 2023-10-26T06:44:56.033 INFO:tasks.workunit.client.0.smithi050.stderr:107300K .......... .......... .......... .......... .......... 63% 52.0M 2s 2023-10-26T06:44:56.033 INFO:tasks.workunit.client.0.smithi050.stderr:107350K .......... .......... .......... .......... .......... 63% 28.9M 2s 2023-10-26T06:44:56.037 INFO:tasks.workunit.client.0.smithi050.stderr:107400K .......... .......... .......... .......... .......... 63% 25.2M 2s 2023-10-26T06:44:56.037 INFO:tasks.workunit.client.0.smithi050.stderr:107450K .......... .......... .......... .......... .......... 63% 24.0M 2s 2023-10-26T06:44:56.039 INFO:tasks.workunit.client.0.smithi050.stderr:107500K .......... .......... .......... .......... .......... 63% 21.9M 2s 2023-10-26T06:44:56.040 INFO:tasks.workunit.client.0.smithi050.stderr:107550K .......... .......... .......... .......... .......... 63% 41.3M 2s 2023-10-26T06:44:56.043 INFO:tasks.workunit.client.0.smithi050.stderr:107600K .......... .......... .......... .......... .......... 63% 15.7M 2s 2023-10-26T06:44:56.044 INFO:tasks.workunit.client.0.smithi050.stderr:107650K .......... .......... .......... .......... .......... 63% 45.1M 2s 2023-10-26T06:44:56.046 INFO:tasks.workunit.client.0.smithi050.stderr:107700K .......... .......... .......... .......... .......... 63% 36.6M 2s 2023-10-26T06:44:56.048 INFO:tasks.workunit.client.0.smithi050.stderr:107750K .......... .......... .......... .......... .......... 63% 24.4M 2s 2023-10-26T06:44:56.048 INFO:tasks.workunit.client.0.smithi050.stderr:107800K .......... .......... .......... .......... .......... 63% 53.8M 2s 2023-10-26T06:44:56.050 INFO:tasks.workunit.client.0.smithi050.stderr:107850K .......... .......... .......... .......... .......... 64% 26.4M 2s 2023-10-26T06:44:56.052 INFO:tasks.workunit.client.0.smithi050.stderr:107900K .......... .......... .......... .......... .......... 64% 29.7M 2s 2023-10-26T06:44:56.054 INFO:tasks.workunit.client.0.smithi050.stderr:107950K .......... .......... .......... .......... .......... 64% 25.0M 2s 2023-10-26T06:44:56.057 INFO:tasks.workunit.client.0.smithi050.stderr:108000K .......... .......... .......... .......... .......... 64% 24.2M 2s 2023-10-26T06:44:56.057 INFO:tasks.workunit.client.0.smithi050.stderr:108050K .......... .......... .......... .......... .......... 64% 54.0M 2s 2023-10-26T06:44:56.059 INFO:tasks.workunit.client.0.smithi050.stderr:108100K .......... .......... .......... .......... .......... 64% 21.1M 2s 2023-10-26T06:44:56.061 INFO:tasks.workunit.client.0.smithi050.stderr:108150K .......... .......... .......... .......... .......... 64% 29.5M 2s 2023-10-26T06:44:56.063 INFO:tasks.workunit.client.0.smithi050.stderr:108200K .......... .......... .......... .......... .......... 64% 24.8M 2s 2023-10-26T06:44:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:108250K .......... .......... .......... .......... .......... 64% 24.4M 2s 2023-10-26T06:44:56.066 INFO:tasks.workunit.client.0.smithi050.stderr:108300K .......... .......... .......... .......... .......... 64% 55.9M 2s 2023-10-26T06:44:56.067 INFO:tasks.workunit.client.0.smithi050.stderr:108350K .......... .......... .......... .......... .......... 64% 23.8M 2s 2023-10-26T06:44:56.070 INFO:tasks.workunit.client.0.smithi050.stderr:108400K .......... .......... .......... .......... .......... 64% 25.8M 2s 2023-10-26T06:44:56.072 INFO:tasks.workunit.client.0.smithi050.stderr:108450K .......... .......... .......... .......... .......... 64% 30.6M 2s 2023-10-26T06:44:56.073 INFO:tasks.workunit.client.0.smithi050.stderr:108500K .......... .......... .......... .......... .......... 64% 25.4M 2s 2023-10-26T06:44:56.074 INFO:tasks.workunit.client.0.smithi050.stderr:108550K .......... .......... .......... .......... .......... 64% 41.3M 2s 2023-10-26T06:44:56.076 INFO:tasks.workunit.client.0.smithi050.stderr:108600K .......... .......... .......... .......... .......... 64% 24.5M 2s 2023-10-26T06:44:56.078 INFO:tasks.workunit.client.0.smithi050.stderr:108650K .......... .......... .......... .......... .......... 64% 24.1M 2s 2023-10-26T06:44:56.080 INFO:tasks.workunit.client.0.smithi050.stderr:108700K .......... .......... .......... .......... .......... 64% 33.2M 2s 2023-10-26T06:44:56.081 INFO:tasks.workunit.client.0.smithi050.stderr:108750K .......... .......... .......... .......... .......... 64% 32.1M 2s 2023-10-26T06:44:56.082 INFO:tasks.workunit.client.0.smithi050.stderr:108800K .......... .......... .......... .......... .......... 64% 34.5M 2s 2023-10-26T06:44:56.085 INFO:tasks.workunit.client.0.smithi050.stderr:108850K .......... .......... .......... .......... .......... 64% 23.8M 2s 2023-10-26T06:44:56.087 INFO:tasks.workunit.client.0.smithi050.stderr:108900K .......... .......... .......... .......... .......... 64% 27.2M 2s 2023-10-26T06:44:56.088 INFO:tasks.workunit.client.0.smithi050.stderr:108950K .......... .......... .......... .......... .......... 64% 30.4M 2s 2023-10-26T06:44:56.091 INFO:tasks.workunit.client.0.smithi050.stderr:109000K .......... .......... .......... .......... .......... 64% 24.3M 2s 2023-10-26T06:44:56.091 INFO:tasks.workunit.client.0.smithi050.stderr:109050K .......... .......... .......... .......... .......... 64% 46.7M 2s 2023-10-26T06:44:56.092 INFO:tasks.workunit.client.0.smithi050.stderr:109100K .......... .......... .......... .......... .......... 64% 26.4M 2s 2023-10-26T06:44:56.095 INFO:tasks.workunit.client.0.smithi050.stderr:109150K .......... .......... .......... .......... .......... 64% 23.5M 2s 2023-10-26T06:44:56.097 INFO:tasks.workunit.client.0.smithi050.stderr:109200K .......... .......... .......... .......... .......... 64% 35.0M 2s 2023-10-26T06:44:56.099 INFO:tasks.workunit.client.0.smithi050.stderr:109250K .......... .......... .......... .......... .......... 64% 22.3M 2s 2023-10-26T06:44:56.101 INFO:tasks.workunit.client.0.smithi050.stderr:109300K .......... .......... .......... .......... .......... 64% 59.7M 2s 2023-10-26T06:44:56.101 INFO:tasks.workunit.client.0.smithi050.stderr:109350K .......... .......... .......... .......... .......... 64% 24.7M 2s 2023-10-26T06:44:56.103 INFO:tasks.workunit.client.0.smithi050.stderr:109400K .......... .......... .......... .......... .......... 64% 24.4M 2s 2023-10-26T06:44:56.105 INFO:tasks.workunit.client.0.smithi050.stderr:109450K .......... .......... .......... .......... .......... 64% 37.4M 2s 2023-10-26T06:44:56.108 INFO:tasks.workunit.client.0.smithi050.stderr:109500K .......... .......... .......... .......... .......... 64% 24.4M 2s 2023-10-26T06:44:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:109550K .......... .......... .......... .......... .......... 65% 44.5M 2s 2023-10-26T06:44:56.110 INFO:tasks.workunit.client.0.smithi050.stderr:109600K .......... .......... .......... .......... .......... 65% 24.2M 2s 2023-10-26T06:44:56.112 INFO:tasks.workunit.client.0.smithi050.stderr:109650K .......... .......... .......... .......... .......... 65% 23.9M 2s 2023-10-26T06:44:56.114 INFO:tasks.workunit.client.0.smithi050.stderr:109700K .......... .......... .......... .......... .......... 65% 36.9M 2s 2023-10-26T06:44:56.115 INFO:tasks.workunit.client.0.smithi050.stderr:109750K .......... .......... .......... .......... .......... 65% 24.5M 2s 2023-10-26T06:44:56.117 INFO:tasks.workunit.client.0.smithi050.stderr:109800K .......... .......... .......... .......... .......... 65% 24.6M 2s 2023-10-26T06:44:56.118 INFO:tasks.workunit.client.0.smithi050.stderr:109850K .......... .......... .......... .......... .......... 65% 42.3M 2s 2023-10-26T06:44:56.120 INFO:tasks.workunit.client.0.smithi050.stderr:109900K .......... .......... .......... .......... .......... 65% 24.7M 2s 2023-10-26T06:44:56.122 INFO:tasks.workunit.client.0.smithi050.stderr:109950K .......... .......... .......... .......... .......... 65% 29.3M 2s 2023-10-26T06:44:56.125 INFO:tasks.workunit.client.0.smithi050.stderr:110000K .......... .......... .......... .......... .......... 65% 18.3M 2s 2023-10-26T06:44:56.125 INFO:tasks.workunit.client.0.smithi050.stderr:110050K .......... .......... .......... .......... .......... 65% 194M 2s 2023-10-26T06:44:56.129 INFO:tasks.workunit.client.0.smithi050.stderr:110100K .......... .......... .......... .......... .......... 65% 27.4M 2s 2023-10-26T06:44:56.129 INFO:tasks.workunit.client.0.smithi050.stderr:110150K .......... .......... .......... .......... .......... 65% 24.4M 2s 2023-10-26T06:44:56.131 INFO:tasks.workunit.client.0.smithi050.stderr:110200K .......... .......... .......... .......... .......... 65% 33.9M 2s 2023-10-26T06:44:56.135 INFO:tasks.workunit.client.0.smithi050.stderr:110250K .......... .......... .......... .......... .......... 65% 24.7M 2s 2023-10-26T06:44:56.135 INFO:tasks.workunit.client.0.smithi050.stderr:110300K .......... .......... .......... .......... .......... 65% 51.4M 2s 2023-10-26T06:44:56.135 INFO:tasks.workunit.client.0.smithi050.stderr:110350K .......... .......... .......... .......... .......... 65% 24.1M 2s 2023-10-26T06:44:56.137 INFO:tasks.workunit.client.0.smithi050.stderr:110400K .......... .......... .......... .......... .......... 65% 32.6M 2s 2023-10-26T06:44:56.139 INFO:tasks.workunit.client.0.smithi050.stderr:110450K .......... .......... .......... .......... .......... 65% 25.1M 2s 2023-10-26T06:44:56.141 INFO:tasks.workunit.client.0.smithi050.stderr:110500K .......... .......... .......... .......... .......... 65% 24.7M 2s 2023-10-26T06:44:56.141 INFO:tasks.workunit.client.0.smithi050.stderr:110550K .......... .......... .......... .......... .......... 65% 46.4M 2s 2023-10-26T06:44:56.143 INFO:tasks.workunit.client.0.smithi050.stderr:110600K .......... .......... .......... .......... .......... 65% 26.5M 2s 2023-10-26T06:44:56.145 INFO:tasks.workunit.client.0.smithi050.stderr:110650K .......... .......... .......... .......... .......... 65% 23.2M 2s 2023-10-26T06:44:56.148 INFO:tasks.workunit.client.0.smithi050.stderr:110700K .......... .......... .......... .......... .......... 65% 33.0M 2s 2023-10-26T06:44:56.149 INFO:tasks.workunit.client.0.smithi050.stderr:110750K .......... .......... .......... .......... .......... 65% 24.5M 2s 2023-10-26T06:44:56.150 INFO:tasks.workunit.client.0.smithi050.stderr:110800K .......... .......... .......... .......... .......... 65% 58.0M 2s 2023-10-26T06:44:56.152 INFO:tasks.workunit.client.0.smithi050.stderr:110850K .......... .......... .......... .......... .......... 65% 25.1M 2s 2023-10-26T06:44:56.154 INFO:tasks.workunit.client.0.smithi050.stderr:110900K .......... .......... .......... .......... .......... 65% 28.9M 2s 2023-10-26T06:44:56.156 INFO:tasks.workunit.client.0.smithi050.stderr:110950K .......... .......... .......... .......... .......... 65% 24.3M 2s 2023-10-26T06:44:56.158 INFO:tasks.workunit.client.0.smithi050.stderr:111000K .......... .......... .......... .......... .......... 65% 24.2M 2s 2023-10-26T06:44:56.159 INFO:tasks.workunit.client.0.smithi050.stderr:111050K .......... .......... .......... .......... .......... 65% 28.4M 2s 2023-10-26T06:44:56.161 INFO:tasks.workunit.client.0.smithi050.stderr:111100K .......... .......... .......... .......... .......... 65% 40.3M 2s 2023-10-26T06:44:56.162 INFO:tasks.workunit.client.0.smithi050.stderr:111150K .......... .......... .......... .......... .......... 65% 31.3M 2s 2023-10-26T06:44:56.165 INFO:tasks.workunit.client.0.smithi050.stderr:111200K .......... .......... .......... .......... .......... 65% 19.9M 2s 2023-10-26T06:44:56.167 INFO:tasks.workunit.client.0.smithi050.stderr:111250K .......... .......... .......... .......... .......... 66% 31.4M 2s 2023-10-26T06:44:56.167 INFO:tasks.workunit.client.0.smithi050.stderr:111300K .......... .......... .......... .......... .......... 66% 54.0M 2s 2023-10-26T06:44:56.169 INFO:tasks.workunit.client.0.smithi050.stderr:111350K .......... .......... .......... .......... .......... 66% 27.5M 2s 2023-10-26T06:44:56.171 INFO:tasks.workunit.client.0.smithi050.stderr:111400K .......... .......... .......... .......... .......... 66% 25.0M 2s 2023-10-26T06:44:56.173 INFO:tasks.workunit.client.0.smithi050.stderr:111450K .......... .......... .......... .......... .......... 66% 24.3M 2s 2023-10-26T06:44:56.176 INFO:tasks.workunit.client.0.smithi050.stderr:111500K .......... .......... .......... .......... .......... 66% 26.0M 2s 2023-10-26T06:44:56.176 INFO:tasks.workunit.client.0.smithi050.stderr:111550K .......... .......... .......... .......... .......... 66% 35.9M 2s 2023-10-26T06:44:56.179 INFO:tasks.workunit.client.0.smithi050.stderr:111600K .......... .......... .......... .......... .......... 66% 36.4M 2s 2023-10-26T06:44:56.180 INFO:tasks.workunit.client.0.smithi050.stderr:111650K .......... .......... .......... .......... .......... 66% 28.6M 2s 2023-10-26T06:44:56.182 INFO:tasks.workunit.client.0.smithi050.stderr:111700K .......... .......... .......... .......... .......... 66% 25.2M 2s 2023-10-26T06:44:56.187 INFO:tasks.workunit.client.0.smithi050.stderr:111750K .......... .......... .......... .......... .......... 66% 24.1M 2s 2023-10-26T06:44:56.187 INFO:tasks.workunit.client.0.smithi050.stderr:111800K .......... .......... .......... .......... .......... 66% 50.9M 2s 2023-10-26T06:44:56.188 INFO:tasks.workunit.client.0.smithi050.stderr:111850K .......... .......... .......... .......... .......... 66% 28.7M 2s 2023-10-26T06:44:56.188 INFO:tasks.workunit.client.0.smithi050.stderr:111900K .......... .......... .......... .......... .......... 66% 22.8M 2s 2023-10-26T06:44:56.190 INFO:tasks.workunit.client.0.smithi050.stderr:111950K .......... .......... .......... .......... .......... 66% 27.8M 2s 2023-10-26T06:44:56.190 INFO:tasks.workunit.client.0.smithi050.stderr:112000K .......... .......... .......... .......... .......... 66% 43.8M 2s 2023-10-26T06:44:56.192 INFO:tasks.workunit.client.0.smithi050.stderr:112050K .......... .......... .......... .......... .......... 66% 26.4M 2s 2023-10-26T06:44:56.194 INFO:tasks.workunit.client.0.smithi050.stderr:112100K .......... .......... .......... .......... .......... 66% 30.7M 2s 2023-10-26T06:44:56.197 INFO:tasks.workunit.client.0.smithi050.stderr:112150K .......... .......... .......... .......... .......... 66% 25.7M 2s 2023-10-26T06:44:56.199 INFO:tasks.workunit.client.0.smithi050.stderr:112200K .......... .......... .......... .......... .......... 66% 21.3M 2s 2023-10-26T06:44:56.201 INFO:tasks.workunit.client.0.smithi050.stderr:112250K .......... .......... .......... .......... .......... 66% 23.3M 2s 2023-10-26T06:44:56.202 INFO:tasks.workunit.client.0.smithi050.stderr:112300K .......... .......... .......... .......... .......... 66% 28.0M 2s 2023-10-26T06:44:56.206 INFO:tasks.workunit.client.0.smithi050.stderr:112350K .......... .......... .......... .......... .......... 66% 30.4M 2s 2023-10-26T06:44:56.206 INFO:tasks.workunit.client.0.smithi050.stderr:112400K .......... .......... .......... .......... .......... 66% 34.0M 2s 2023-10-26T06:44:56.209 INFO:tasks.workunit.client.0.smithi050.stderr:112450K .......... .......... .......... .......... .......... 66% 27.5M 2s 2023-10-26T06:44:56.210 INFO:tasks.workunit.client.0.smithi050.stderr:112500K .......... .......... .......... .......... .......... 66% 45.4M 2s 2023-10-26T06:44:56.210 INFO:tasks.workunit.client.0.smithi050.stderr:112550K .......... .......... .......... .......... .......... 66% 24.0M 2s 2023-10-26T06:44:56.211 INFO:tasks.workunit.client.0.smithi050.stderr:112600K .......... .......... .......... .......... .......... 66% 36.7M 2s 2023-10-26T06:44:56.214 INFO:tasks.workunit.client.0.smithi050.stderr:112650K .......... .......... .......... .......... .......... 66% 22.1M 2s 2023-10-26T06:44:56.216 INFO:tasks.workunit.client.0.smithi050.stderr:112700K .......... .......... .......... .......... .......... 66% 24.1M 2s 2023-10-26T06:44:56.217 INFO:tasks.workunit.client.0.smithi050.stderr:112750K .......... .......... .......... .......... .......... 66% 43.1M 2s 2023-10-26T06:44:56.221 INFO:tasks.workunit.client.0.smithi050.stderr:112800K .......... .......... .......... .......... .......... 66% 23.3M 2s 2023-10-26T06:44:56.221 INFO:tasks.workunit.client.0.smithi050.stderr:112850K .......... .......... .......... .......... .......... 66% 37.4M 2s 2023-10-26T06:44:56.223 INFO:tasks.workunit.client.0.smithi050.stderr:112900K .......... .......... .......... .......... .......... 67% 24.0M 2s 2023-10-26T06:44:56.224 INFO:tasks.workunit.client.0.smithi050.stderr:112950K .......... .......... .......... .......... .......... 67% 28.1M 2s 2023-10-26T06:44:56.225 INFO:tasks.workunit.client.0.smithi050.stderr:113000K .......... .......... .......... .......... .......... 67% 30.2M 2s 2023-10-26T06:44:56.227 INFO:tasks.workunit.client.0.smithi050.stderr:113050K .......... .......... .......... .......... .......... 67% 26.4M 2s 2023-10-26T06:44:56.228 INFO:tasks.workunit.client.0.smithi050.stderr:113100K .......... .......... .......... .......... .......... 67% 37.9M 2s 2023-10-26T06:44:56.230 INFO:tasks.workunit.client.0.smithi050.stderr:113150K .......... .......... .......... .......... .......... 67% 24.8M 2s 2023-10-26T06:44:56.232 INFO:tasks.workunit.client.0.smithi050.stderr:113200K .......... .......... .......... .......... .......... 67% 24.6M 2s 2023-10-26T06:44:56.234 INFO:tasks.workunit.client.0.smithi050.stderr:113250K .......... .......... .......... .......... .......... 67% 36.9M 2s 2023-10-26T06:44:56.236 INFO:tasks.workunit.client.0.smithi050.stderr:113300K .......... .......... .......... .......... .......... 67% 22.9M 2s 2023-10-26T06:44:56.237 INFO:tasks.workunit.client.0.smithi050.stderr:113350K .......... .......... .......... .......... .......... 67% 49.6M 2s 2023-10-26T06:44:56.239 INFO:tasks.workunit.client.0.smithi050.stderr:113400K .......... .......... .......... .......... .......... 67% 26.0M 2s 2023-10-26T06:44:56.241 INFO:tasks.workunit.client.0.smithi050.stderr:113450K .......... .......... .......... .......... .......... 67% 23.0M 2s 2023-10-26T06:44:56.242 INFO:tasks.workunit.client.0.smithi050.stderr:113500K .......... .......... .......... .......... .......... 67% 45.1M 2s 2023-10-26T06:44:56.244 INFO:tasks.workunit.client.0.smithi050.stderr:113550K .......... .......... .......... .......... .......... 67% 20.2M 2s 2023-10-26T06:44:56.245 INFO:tasks.workunit.client.0.smithi050.stderr:113600K .......... .......... .......... .......... .......... 67% 48.2M 2s 2023-10-26T06:44:56.247 INFO:tasks.workunit.client.0.smithi050.stderr:113650K .......... .......... .......... .......... .......... 67% 23.9M 2s 2023-10-26T06:44:56.249 INFO:tasks.workunit.client.0.smithi050.stderr:113700K .......... .......... .......... .......... .......... 67% 33.2M 2s 2023-10-26T06:44:56.251 INFO:tasks.workunit.client.0.smithi050.stderr:113750K .......... .......... .......... .......... .......... 67% 23.5M 2s 2023-10-26T06:44:56.254 INFO:tasks.workunit.client.0.smithi050.stderr:113800K .......... .......... .......... .......... .......... 67% 23.5M 2s 2023-10-26T06:44:56.254 INFO:tasks.workunit.client.0.smithi050.stderr:113850K .......... .......... .......... .......... .......... 67% 47.4M 2s 2023-10-26T06:44:56.256 INFO:tasks.workunit.client.0.smithi050.stderr:113900K .......... .......... .......... .......... .......... 67% 25.8M 2s 2023-10-26T06:44:56.258 INFO:tasks.workunit.client.0.smithi050.stderr:113950K .......... .......... .......... .......... .......... 67% 32.5M 2s 2023-10-26T06:44:56.260 INFO:tasks.workunit.client.0.smithi050.stderr:114000K .......... .......... .......... .......... .......... 67% 22.9M 2s 2023-10-26T06:44:56.262 INFO:tasks.workunit.client.0.smithi050.stderr:114050K .......... .......... .......... .......... .......... 67% 25.5M 2s 2023-10-26T06:44:56.262 INFO:tasks.workunit.client.0.smithi050.stderr:114100K .......... .......... .......... .......... .......... 67% 47.4M 2s 2023-10-26T06:44:56.264 INFO:tasks.workunit.client.0.smithi050.stderr:114150K .......... .......... .......... .......... .......... 67% 24.3M 2s 2023-10-26T06:44:56.266 INFO:tasks.workunit.client.0.smithi050.stderr:114200K .......... .......... .......... .......... .......... 67% 23.3M 2s 2023-10-26T06:44:56.268 INFO:tasks.workunit.client.0.smithi050.stderr:114250K .......... .......... .......... .......... .......... 67% 38.9M 2s 2023-10-26T06:44:56.271 INFO:tasks.workunit.client.0.smithi050.stderr:114300K .......... .......... .......... .......... .......... 67% 23.9M 2s 2023-10-26T06:44:56.271 INFO:tasks.workunit.client.0.smithi050.stderr:114350K .......... .......... .......... .......... .......... 67% 57.8M 2s 2023-10-26T06:44:56.273 INFO:tasks.workunit.client.0.smithi050.stderr:114400K .......... .......... .......... .......... .......... 67% 18.4M 2s 2023-10-26T06:44:56.275 INFO:tasks.workunit.client.0.smithi050.stderr:114450K .......... .......... .......... .......... .......... 67% 25.1M 2s 2023-10-26T06:44:56.277 INFO:tasks.workunit.client.0.smithi050.stderr:114500K .......... .......... .......... .......... .......... 67% 47.7M 2s 2023-10-26T06:44:56.279 INFO:tasks.workunit.client.0.smithi050.stderr:114550K .......... .......... .......... .......... .......... 67% 26.0M 2s 2023-10-26T06:44:56.280 INFO:tasks.workunit.client.0.smithi050.stderr:114600K .......... .......... .......... .......... .......... 68% 48.4M 2s 2023-10-26T06:44:56.281 INFO:tasks.workunit.client.0.smithi050.stderr:114650K .......... .......... .......... .......... .......... 68% 22.8M 2s 2023-10-26T06:44:56.284 INFO:tasks.workunit.client.0.smithi050.stderr:114700K .......... .......... .......... .......... .......... 68% 18.2M 2s 2023-10-26T06:44:56.286 INFO:tasks.workunit.client.0.smithi050.stderr:114750K .......... .......... .......... .......... .......... 68% 34.6M 2s 2023-10-26T06:44:56.287 INFO:tasks.workunit.client.0.smithi050.stderr:114800K .......... .......... .......... .......... .......... 68% 41.5M 2s 2023-10-26T06:44:56.289 INFO:tasks.workunit.client.0.smithi050.stderr:114850K .......... .......... .......... .......... .......... 68% 52.9M 2s 2023-10-26T06:44:56.289 INFO:tasks.workunit.client.0.smithi050.stderr:114900K .......... .......... .......... .......... .......... 68% 23.8M 2s 2023-10-26T06:44:56.291 INFO:tasks.workunit.client.0.smithi050.stderr:114950K .......... .......... .......... .......... .......... 68% 24.5M 2s 2023-10-26T06:44:56.294 INFO:tasks.workunit.client.0.smithi050.stderr:115000K .......... .......... .......... .......... .......... 68% 34.9M 2s 2023-10-26T06:44:56.296 INFO:tasks.workunit.client.0.smithi050.stderr:115050K .......... .......... .......... .......... .......... 68% 24.6M 2s 2023-10-26T06:44:56.297 INFO:tasks.workunit.client.0.smithi050.stderr:115100K .......... .......... .......... .......... .......... 68% 24.6M 2s 2023-10-26T06:44:56.298 INFO:tasks.workunit.client.0.smithi050.stderr:115150K .......... .......... .......... .......... .......... 68% 45.3M 2s 2023-10-26T06:44:56.300 INFO:tasks.workunit.client.0.smithi050.stderr:115200K .......... .......... .......... .......... .......... 68% 24.1M 2s 2023-10-26T06:44:56.301 INFO:tasks.workunit.client.0.smithi050.stderr:115250K .......... .......... .......... .......... .......... 68% 40.0M 2s 2023-10-26T06:44:56.304 INFO:tasks.workunit.client.0.smithi050.stderr:115300K .......... .......... .......... .......... .......... 68% 23.9M 2s 2023-10-26T06:44:56.306 INFO:tasks.workunit.client.0.smithi050.stderr:115350K .......... .......... .......... .......... .......... 68% 24.3M 2s 2023-10-26T06:44:56.307 INFO:tasks.workunit.client.0.smithi050.stderr:115400K .......... .......... .......... .......... .......... 68% 37.9M 2s 2023-10-26T06:44:56.309 INFO:tasks.workunit.client.0.smithi050.stderr:115450K .......... .......... .......... .......... .......... 68% 24.7M 2s 2023-10-26T06:44:56.311 INFO:tasks.workunit.client.0.smithi050.stderr:115500K .......... .......... .......... .......... .......... 68% 30.2M 2s 2023-10-26T06:44:56.313 INFO:tasks.workunit.client.0.smithi050.stderr:115550K .......... .......... .......... .......... .......... 68% 24.1M 2s 2023-10-26T06:44:56.315 INFO:tasks.workunit.client.0.smithi050.stderr:115600K .......... .......... .......... .......... .......... 68% 22.9M 2s 2023-10-26T06:44:56.315 INFO:tasks.workunit.client.0.smithi050.stderr:115650K .......... .......... .......... .......... .......... 68% 41.2M 2s 2023-10-26T06:44:56.318 INFO:tasks.workunit.client.0.smithi050.stderr:115700K .......... .......... .......... .......... .......... 68% 22.7M 2s 2023-10-26T06:44:56.319 INFO:tasks.workunit.client.0.smithi050.stderr:115750K .......... .......... .......... .......... .......... 68% 38.6M 2s 2023-10-26T06:44:56.322 INFO:tasks.workunit.client.0.smithi050.stderr:115800K .......... .......... .......... .......... .......... 68% 23.3M 2s 2023-10-26T06:44:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:115850K .......... .......... .......... .......... .......... 68% 25.8M 2s 2023-10-26T06:44:56.324 INFO:tasks.workunit.client.0.smithi050.stderr:115900K .......... .......... .......... .......... .......... 68% 46.5M 2s 2023-10-26T06:44:56.326 INFO:tasks.workunit.client.0.smithi050.stderr:115950K .......... .......... .......... .......... .......... 68% 31.2M 2s 2023-10-26T06:44:56.327 INFO:tasks.workunit.client.0.smithi050.stderr:116000K .......... .......... .......... .......... .......... 68% 27.2M 2s 2023-10-26T06:44:56.329 INFO:tasks.workunit.client.0.smithi050.stderr:116050K .......... .......... .......... .......... .......... 68% 24.9M 2s 2023-10-26T06:44:56.332 INFO:tasks.workunit.client.0.smithi050.stderr:116100K .......... .......... .......... .......... .......... 68% 18.9M 2s 2023-10-26T06:44:56.333 INFO:tasks.workunit.client.0.smithi050.stderr:116150K .......... .......... .......... .......... .......... 68% 57.2M 2s 2023-10-26T06:44:56.335 INFO:tasks.workunit.client.0.smithi050.stderr:116200K .......... .......... .......... .......... .......... 68% 22.9M 2s 2023-10-26T06:44:56.337 INFO:tasks.workunit.client.0.smithi050.stderr:116250K .......... .......... .......... .......... .......... 68% 38.2M 2s 2023-10-26T06:44:56.339 INFO:tasks.workunit.client.0.smithi050.stderr:116300K .......... .......... .......... .......... .......... 69% 24.1M 2s 2023-10-26T06:44:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:116350K .......... .......... .......... .......... .......... 69% 24.6M 2s 2023-10-26T06:44:56.341 INFO:tasks.workunit.client.0.smithi050.stderr:116400K .......... .......... .......... .......... .......... 69% 48.7M 2s 2023-10-26T06:44:56.343 INFO:tasks.workunit.client.0.smithi050.stderr:116450K .......... .......... .......... .......... .......... 69% 34.5M 2s 2023-10-26T06:44:56.344 INFO:tasks.workunit.client.0.smithi050.stderr:116500K .......... .......... .......... .......... .......... 69% 24.8M 2s 2023-10-26T06:44:56.347 INFO:tasks.workunit.client.0.smithi050.stderr:116550K .......... .......... .......... .......... .......... 69% 25.4M 2s 2023-10-26T06:44:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:116600K .......... .......... .......... .......... .......... 69% 22.7M 2s 2023-10-26T06:44:56.349 INFO:tasks.workunit.client.0.smithi050.stderr:116650K .......... .......... .......... .......... .......... 69% 49.5M 2s 2023-10-26T06:44:56.353 INFO:tasks.workunit.client.0.smithi050.stderr:116700K .......... .......... .......... .......... .......... 69% 32.2M 2s 2023-10-26T06:44:56.354 INFO:tasks.workunit.client.0.smithi050.stderr:116750K .......... .......... .......... .......... .......... 69% 18.5M 2s 2023-10-26T06:44:56.355 INFO:tasks.workunit.client.0.smithi050.stderr:116800K .......... .......... .......... .......... .......... 69% 39.4M 2s 2023-10-26T06:44:56.358 INFO:tasks.workunit.client.0.smithi050.stderr:116850K .......... .......... .......... .......... .......... 69% 24.9M 2s 2023-10-26T06:44:56.358 INFO:tasks.workunit.client.0.smithi050.stderr:116900K .......... .......... .......... .......... .......... 69% 49.1M 2s 2023-10-26T06:44:56.360 INFO:tasks.workunit.client.0.smithi050.stderr:116950K .......... .......... .......... .......... .......... 69% 32.9M 2s 2023-10-26T06:44:56.361 INFO:tasks.workunit.client.0.smithi050.stderr:117000K .......... .......... .......... .......... .......... 69% 22.7M 2s 2023-10-26T06:44:56.368 INFO:tasks.workunit.client.0.smithi050.stderr:117050K .......... .......... .......... .......... .......... 69% 17.4M 2s 2023-10-26T06:44:56.368 INFO:tasks.workunit.client.0.smithi050.stderr:117100K .......... .......... .......... .......... .......... 69% 51.1M 2s 2023-10-26T06:44:56.368 INFO:tasks.workunit.client.0.smithi050.stderr:117150K .......... .......... .......... .......... .......... 69% 50.2M 2s 2023-10-26T06:44:56.369 INFO:tasks.workunit.client.0.smithi050.stderr:117200K .......... .......... .......... .......... .......... 69% 31.0M 2s 2023-10-26T06:44:56.370 INFO:tasks.workunit.client.0.smithi050.stderr:117250K .......... .......... .......... .......... .......... 69% 26.6M 2s 2023-10-26T06:44:56.372 INFO:tasks.workunit.client.0.smithi050.stderr:117300K .......... .......... .......... .......... .......... 69% 24.5M 2s 2023-10-26T06:44:56.375 INFO:tasks.workunit.client.0.smithi050.stderr:117350K .......... .......... .......... .......... .......... 69% 24.2M 2s 2023-10-26T06:44:56.375 INFO:tasks.workunit.client.0.smithi050.stderr:117400K .......... .......... .......... .......... .......... 69% 53.9M 2s 2023-10-26T06:44:56.379 INFO:tasks.workunit.client.0.smithi050.stderr:117450K .......... .......... .......... .......... .......... 69% 29.6M 2s 2023-10-26T06:44:56.379 INFO:tasks.workunit.client.0.smithi050.stderr:117500K .......... .......... .......... .......... .......... 69% 27.2M 2s 2023-10-26T06:44:56.381 INFO:tasks.workunit.client.0.smithi050.stderr:117550K .......... .......... .......... .......... .......... 69% 24.3M 2s 2023-10-26T06:44:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:117600K .......... .......... .......... .......... .......... 69% 24.7M 2s 2023-10-26T06:44:56.383 INFO:tasks.workunit.client.0.smithi050.stderr:117650K .......... .......... .......... .......... .......... 69% 51.2M 2s 2023-10-26T06:44:56.386 INFO:tasks.workunit.client.0.smithi050.stderr:117700K .......... .......... .......... .......... .......... 69% 26.8M 2s 2023-10-26T06:44:56.387 INFO:tasks.workunit.client.0.smithi050.stderr:117750K .......... .......... .......... .......... .......... 69% 21.2M 2s 2023-10-26T06:44:56.389 INFO:tasks.workunit.client.0.smithi050.stderr:117800K .......... .......... .......... .......... .......... 69% 31.6M 2s 2023-10-26T06:44:56.391 INFO:tasks.workunit.client.0.smithi050.stderr:117850K .......... .......... .......... .......... .......... 69% 24.3M 2s 2023-10-26T06:44:56.392 INFO:tasks.workunit.client.0.smithi050.stderr:117900K .......... .......... .......... .......... .......... 69% 51.2M 2s 2023-10-26T06:44:56.394 INFO:tasks.workunit.client.0.smithi050.stderr:117950K .......... .......... .......... .......... .......... 70% 27.3M 2s 2023-10-26T06:44:56.396 INFO:tasks.workunit.client.0.smithi050.stderr:118000K .......... .......... .......... .......... .......... 70% 28.4M 2s 2023-10-26T06:44:56.398 INFO:tasks.workunit.client.0.smithi050.stderr:118050K .......... .......... .......... .......... .......... 70% 27.2M 2s 2023-10-26T06:44:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:118100K .......... .......... .......... .......... .......... 70% 21.7M 2s 2023-10-26T06:44:56.400 INFO:tasks.workunit.client.0.smithi050.stderr:118150K .......... .......... .......... .......... .......... 70% 56.5M 2s 2023-10-26T06:44:56.402 INFO:tasks.workunit.client.0.smithi050.stderr:118200K .......... .......... .......... .......... .......... 70% 27.5M 2s 2023-10-26T06:44:56.404 INFO:tasks.workunit.client.0.smithi050.stderr:118250K .......... .......... .......... .......... .......... 70% 28.7M 2s 2023-10-26T06:44:56.406 INFO:tasks.workunit.client.0.smithi050.stderr:118300K .......... .......... .......... .......... .......... 70% 24.5M 2s 2023-10-26T06:44:56.408 INFO:tasks.workunit.client.0.smithi050.stderr:118350K .......... .......... .......... .......... .......... 70% 24.1M 2s 2023-10-26T06:44:56.409 INFO:tasks.workunit.client.0.smithi050.stderr:118400K .......... .......... .......... .......... .......... 70% 49.9M 2s 2023-10-26T06:44:56.411 INFO:tasks.workunit.client.0.smithi050.stderr:118450K .......... .......... .......... .......... .......... 70% 23.8M 2s 2023-10-26T06:44:56.412 INFO:tasks.workunit.client.0.smithi050.stderr:118500K .......... .......... .......... .......... .......... 70% 36.3M 2s 2023-10-26T06:44:56.415 INFO:tasks.workunit.client.0.smithi050.stderr:118550K .......... .......... .......... .......... .......... 70% 23.6M 2s 2023-10-26T06:44:56.416 INFO:tasks.workunit.client.0.smithi050.stderr:118600K .......... .......... .......... .......... .......... 70% 25.8M 2s 2023-10-26T06:44:56.417 INFO:tasks.workunit.client.0.smithi050.stderr:118650K .......... .......... .......... .......... .......... 70% 57.4M 2s 2023-10-26T06:44:56.419 INFO:tasks.workunit.client.0.smithi050.stderr:118700K .......... .......... .......... .......... .......... 70% 25.0M 2s 2023-10-26T06:44:56.421 INFO:tasks.workunit.client.0.smithi050.stderr:118750K .......... .......... .......... .......... .......... 70% 22.6M 2s 2023-10-26T06:44:56.423 INFO:tasks.workunit.client.0.smithi050.stderr:118800K .......... .......... .......... .......... .......... 70% 34.7M 2s 2023-10-26T06:44:56.424 INFO:tasks.workunit.client.0.smithi050.stderr:118850K .......... .......... .......... .......... .......... 70% 24.4M 2s 2023-10-26T06:44:56.425 INFO:tasks.workunit.client.0.smithi050.stderr:118900K .......... .......... .......... .......... .......... 70% 46.7M 2s 2023-10-26T06:44:56.427 INFO:tasks.workunit.client.0.smithi050.stderr:118950K .......... .......... .......... .......... .......... 70% 25.8M 2s 2023-10-26T06:44:56.429 INFO:tasks.workunit.client.0.smithi050.stderr:119000K .......... .......... .......... .......... .......... 70% 23.8M 2s 2023-10-26T06:44:56.431 INFO:tasks.workunit.client.0.smithi050.stderr:119050K .......... .......... .......... .......... .......... 70% 35.5M 2s 2023-10-26T06:44:56.432 INFO:tasks.workunit.client.0.smithi050.stderr:119100K .......... .......... .......... .......... .......... 70% 27.2M 2s 2023-10-26T06:44:56.434 INFO:tasks.workunit.client.0.smithi050.stderr:119150K .......... .......... .......... .......... .......... 70% 34.5M 2s 2023-10-26T06:44:56.436 INFO:tasks.workunit.client.0.smithi050.stderr:119200K .......... .......... .......... .......... .......... 70% 26.5M 2s 2023-10-26T06:44:56.438 INFO:tasks.workunit.client.0.smithi050.stderr:119250K .......... .......... .......... .......... .......... 70% 25.2M 2s 2023-10-26T06:44:56.440 INFO:tasks.workunit.client.0.smithi050.stderr:119300K .......... .......... .......... .......... .......... 70% 35.3M 2s 2023-10-26T06:44:56.441 INFO:tasks.workunit.client.0.smithi050.stderr:119350K .......... .......... .......... .......... .......... 70% 24.3M 2s 2023-10-26T06:44:56.443 INFO:tasks.workunit.client.0.smithi050.stderr:119400K .......... .......... .......... .......... .......... 70% 38.3M 2s 2023-10-26T06:44:56.445 INFO:tasks.workunit.client.0.smithi050.stderr:119450K .......... .......... .......... .......... .......... 70% 20.8M 2s 2023-10-26T06:44:56.446 INFO:tasks.workunit.client.0.smithi050.stderr:119500K .......... .......... .......... .......... .......... 70% 34.1M 2s 2023-10-26T06:44:56.448 INFO:tasks.workunit.client.0.smithi050.stderr:119550K .......... .......... .......... .......... .......... 70% 35.3M 2s 2023-10-26T06:44:56.450 INFO:tasks.workunit.client.0.smithi050.stderr:119600K .......... .......... .......... .......... .......... 70% 24.7M 2s 2023-10-26T06:44:56.451 INFO:tasks.workunit.client.0.smithi050.stderr:119650K .......... .......... .......... .......... .......... 71% 45.1M 2s 2023-10-26T06:44:56.452 INFO:tasks.workunit.client.0.smithi050.stderr:119700K .......... .......... .......... .......... .......... 71% 24.2M 2s 2023-10-26T06:44:56.454 INFO:tasks.workunit.client.0.smithi050.stderr:119750K .......... .......... .......... .......... .......... 71% 24.1M 2s 2023-10-26T06:44:56.456 INFO:tasks.workunit.client.0.smithi050.stderr:119800K .......... .......... .......... .......... .......... 71% 37.4M 2s 2023-10-26T06:44:56.459 INFO:tasks.workunit.client.0.smithi050.stderr:119850K .......... .......... .......... .......... .......... 71% 23.8M 2s 2023-10-26T06:44:56.460 INFO:tasks.workunit.client.0.smithi050.stderr:119900K .......... .......... .......... .......... .......... 71% 50.9M 2s 2023-10-26T06:44:56.461 INFO:tasks.workunit.client.0.smithi050.stderr:119950K .......... .......... .......... .......... .......... 71% 24.3M 2s 2023-10-26T06:44:56.463 INFO:tasks.workunit.client.0.smithi050.stderr:120000K .......... .......... .......... .......... .......... 71% 23.6M 2s 2023-10-26T06:44:56.464 INFO:tasks.workunit.client.0.smithi050.stderr:120050K .......... .......... .......... .......... .......... 71% 38.2M 2s 2023-10-26T06:44:56.466 INFO:tasks.workunit.client.0.smithi050.stderr:120100K .......... .......... .......... .......... .......... 71% 24.2M 2s 2023-10-26T06:44:56.469 INFO:tasks.workunit.client.0.smithi050.stderr:120150K .......... .......... .......... .......... .......... 71% 22.2M 2s 2023-10-26T06:44:56.470 INFO:tasks.workunit.client.0.smithi050.stderr:120200K .......... .......... .......... .......... .......... 71% 44.6M 2s 2023-10-26T06:44:56.472 INFO:tasks.workunit.client.0.smithi050.stderr:120250K .......... .......... .......... .......... .......... 71% 22.7M 2s 2023-10-26T06:44:56.474 INFO:tasks.workunit.client.0.smithi050.stderr:120300K .......... .......... .......... .......... .......... 71% 36.1M 2s 2023-10-26T06:44:56.476 INFO:tasks.workunit.client.0.smithi050.stderr:120350K .......... .......... .......... .......... .......... 71% 24.9M 2s 2023-10-26T06:44:56.476 INFO:tasks.workunit.client.0.smithi050.stderr:120400K .......... .......... .......... .......... .......... 71% 32.8M 2s 2023-10-26T06:44:56.478 INFO:tasks.workunit.client.0.smithi050.stderr:120450K .......... .......... .......... .......... .......... 71% 35.0M 2s 2023-10-26T06:44:56.480 INFO:tasks.workunit.client.0.smithi050.stderr:120500K .......... .......... .......... .......... .......... 71% 29.0M 2s 2023-10-26T06:44:56.482 INFO:tasks.workunit.client.0.smithi050.stderr:120550K .......... .......... .......... .......... .......... 71% 24.5M 2s 2023-10-26T06:44:56.485 INFO:tasks.workunit.client.0.smithi050.stderr:120600K .......... .......... .......... .......... .......... 71% 23.4M 2s 2023-10-26T06:44:56.485 INFO:tasks.workunit.client.0.smithi050.stderr:120650K .......... .......... .......... .......... .......... 71% 53.4M 2s 2023-10-26T06:44:56.487 INFO:tasks.workunit.client.0.smithi050.stderr:120700K .......... .......... .......... .......... .......... 71% 24.2M 2s 2023-10-26T06:44:56.488 INFO:tasks.workunit.client.0.smithi050.stderr:120750K .......... .......... .......... .......... .......... 71% 31.9M 2s 2023-10-26T06:44:56.490 INFO:tasks.workunit.client.0.smithi050.stderr:120800K .......... .......... .......... .......... .......... 71% 24.7M 2s 2023-10-26T06:44:56.494 INFO:tasks.workunit.client.0.smithi050.stderr:120850K .......... .......... .......... .......... .......... 71% 34.1M 2s 2023-10-26T06:44:56.494 INFO:tasks.workunit.client.0.smithi050.stderr:120900K .......... .......... .......... .......... .......... 71% 25.8M 2s 2023-10-26T06:44:56.496 INFO:tasks.workunit.client.0.smithi050.stderr:120950K .......... .......... .......... .......... .......... 71% 29.5M 2s 2023-10-26T06:44:56.498 INFO:tasks.workunit.client.0.smithi050.stderr:121000K .......... .......... .......... .......... .......... 71% 24.6M 2s 2023-10-26T06:44:56.499 INFO:tasks.workunit.client.0.smithi050.stderr:121050K .......... .......... .......... .......... .......... 71% 24.8M 2s 2023-10-26T06:44:56.502 INFO:tasks.workunit.client.0.smithi050.stderr:121100K .......... .......... .......... .......... .......... 71% 25.3M 2s 2023-10-26T06:44:56.502 INFO:tasks.workunit.client.0.smithi050.stderr:121150K .......... .......... .......... .......... .......... 71% 56.5M 2s 2023-10-26T06:44:56.504 INFO:tasks.workunit.client.0.smithi050.stderr:121200K .......... .......... .......... .......... .......... 71% 24.9M 2s 2023-10-26T06:44:56.506 INFO:tasks.workunit.client.0.smithi050.stderr:121250K .......... .......... .......... .......... .......... 71% 28.8M 2s 2023-10-26T06:44:56.508 INFO:tasks.workunit.client.0.smithi050.stderr:121300K .......... .......... .......... .......... .......... 71% 19.6M 2s 2023-10-26T06:44:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:121350K .......... .......... .......... .......... .......... 72% 31.9M 2s 2023-10-26T06:44:56.510 INFO:tasks.workunit.client.0.smithi050.stderr:121400K .......... .......... .......... .......... .......... 72% 42.0M 2s 2023-10-26T06:44:56.512 INFO:tasks.workunit.client.0.smithi050.stderr:121450K .......... .......... .......... .......... .......... 72% 33.3M 2s 2023-10-26T06:44:56.514 INFO:tasks.workunit.client.0.smithi050.stderr:121500K .......... .......... .......... .......... .......... 72% 23.1M 2s 2023-10-26T06:44:56.521 INFO:tasks.workunit.client.0.smithi050.stderr:121550K .......... .......... .......... .......... .......... 72% 29.3M 2s 2023-10-26T06:44:56.521 INFO:tasks.workunit.client.0.smithi050.stderr:121600K .......... .......... .......... .......... .......... 72% 25.6M 2s 2023-10-26T06:44:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:121650K .......... .......... .......... .......... .......... 72% 44.5M 2s 2023-10-26T06:44:56.522 INFO:tasks.workunit.client.0.smithi050.stderr:121700K .......... .......... .......... .......... .......... 72% 28.0M 2s 2023-10-26T06:44:56.524 INFO:tasks.workunit.client.0.smithi050.stderr:121750K .......... .......... .......... .......... .......... 72% 27.3M 2s 2023-10-26T06:44:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:121800K .......... .......... .......... .......... .......... 72% 14.6M 2s 2023-10-26T06:44:56.530 INFO:tasks.workunit.client.0.smithi050.stderr:121850K .......... .......... .......... .......... .......... 72% 83.6M 2s 2023-10-26T06:44:56.531 INFO:tasks.workunit.client.0.smithi050.stderr:121900K .......... .......... .......... .......... .......... 72% 38.2M 2s 2023-10-26T06:44:56.531 INFO:tasks.workunit.client.0.smithi050.stderr:121950K .......... .......... .......... .......... .......... 72% 28.6M 2s 2023-10-26T06:44:56.534 INFO:tasks.workunit.client.0.smithi050.stderr:122000K .......... .......... .......... .......... .......... 72% 25.9M 2s 2023-10-26T06:44:56.534 INFO:tasks.workunit.client.0.smithi050.stderr:122050K .......... .......... .......... .......... .......... 72% 23.7M 2s 2023-10-26T06:44:56.536 INFO:tasks.workunit.client.0.smithi050.stderr:122100K .......... .......... .......... .......... .......... 72% 24.8M 2s 2023-10-26T06:44:56.536 INFO:tasks.workunit.client.0.smithi050.stderr:122150K .......... .......... .......... .......... .......... 72% 42.3M 2s 2023-10-26T06:44:56.538 INFO:tasks.workunit.client.0.smithi050.stderr:122200K .......... .......... .......... .......... .......... 72% 33.7M 2s 2023-10-26T06:44:56.540 INFO:tasks.workunit.client.0.smithi050.stderr:122250K .......... .......... .......... .......... .......... 72% 22.6M 2s 2023-10-26T06:44:56.543 INFO:tasks.workunit.client.0.smithi050.stderr:122300K .......... .......... .......... .......... .......... 72% 28.4M 2s 2023-10-26T06:44:56.545 INFO:tasks.workunit.client.0.smithi050.stderr:122350K .......... .......... .......... .......... .......... 72% 24.0M 2s 2023-10-26T06:44:56.545 INFO:tasks.workunit.client.0.smithi050.stderr:122400K .......... .......... .......... .......... .......... 72% 43.9M 2s 2023-10-26T06:44:56.547 INFO:tasks.workunit.client.0.smithi050.stderr:122450K .......... .......... .......... .......... .......... 72% 35.9M 2s 2023-10-26T06:44:56.549 INFO:tasks.workunit.client.0.smithi050.stderr:122500K .......... .......... .......... .......... .......... 72% 27.1M 2s 2023-10-26T06:44:56.551 INFO:tasks.workunit.client.0.smithi050.stderr:122550K .......... .......... .......... .......... .......... 72% 22.5M 2s 2023-10-26T06:44:56.553 INFO:tasks.workunit.client.0.smithi050.stderr:122600K .......... .......... .......... .......... .......... 72% 24.3M 2s 2023-10-26T06:44:56.554 INFO:tasks.workunit.client.0.smithi050.stderr:122650K .......... .......... .......... .......... .......... 72% 47.1M 2s 2023-10-26T06:44:56.556 INFO:tasks.workunit.client.0.smithi050.stderr:122700K .......... .......... .......... .......... .......... 72% 34.0M 2s 2023-10-26T06:44:56.557 INFO:tasks.workunit.client.0.smithi050.stderr:122750K .......... .......... .......... .......... .......... 72% 25.0M 2s 2023-10-26T06:44:56.559 INFO:tasks.workunit.client.0.smithi050.stderr:122800K .......... .......... .......... .......... .......... 72% 30.9M 2s 2023-10-26T06:44:56.560 INFO:tasks.workunit.client.0.smithi050.stderr:122850K .......... .......... .......... .......... .......... 72% 29.8M 2s 2023-10-26T06:44:56.562 INFO:tasks.workunit.client.0.smithi050.stderr:122900K .......... .......... .......... .......... .......... 72% 21.5M 2s 2023-10-26T06:44:56.563 INFO:tasks.workunit.client.0.smithi050.stderr:122950K .......... .......... .......... .......... .......... 72% 36.4M 2s 2023-10-26T06:44:56.565 INFO:tasks.workunit.client.0.smithi050.stderr:123000K .......... .......... .......... .......... .......... 72% 27.9M 2s 2023-10-26T06:44:56.567 INFO:tasks.workunit.client.0.smithi050.stderr:123050K .......... .......... .......... .......... .......... 73% 24.1M 2s 2023-10-26T06:44:56.568 INFO:tasks.workunit.client.0.smithi050.stderr:123100K .......... .......... .......... .......... .......... 73% 43.6M 2s 2023-10-26T06:44:56.570 INFO:tasks.workunit.client.0.smithi050.stderr:123150K .......... .......... .......... .......... .......... 73% 25.2M 2s 2023-10-26T06:44:56.572 INFO:tasks.workunit.client.0.smithi050.stderr:123200K .......... .......... .......... .......... .......... 73% 37.0M 2s 2023-10-26T06:44:56.573 INFO:tasks.workunit.client.0.smithi050.stderr:123250K .......... .......... .......... .......... .......... 73% 25.0M 2s 2023-10-26T06:44:56.575 INFO:tasks.workunit.client.0.smithi050.stderr:123300K .......... .......... .......... .......... .......... 73% 35.9M 2s 2023-10-26T06:44:56.577 INFO:tasks.workunit.client.0.smithi050.stderr:123350K .......... .......... .......... .......... .......... 73% 21.6M 2s 2023-10-26T06:44:56.579 INFO:tasks.workunit.client.0.smithi050.stderr:123400K .......... .......... .......... .......... .......... 73% 29.5M 2s 2023-10-26T06:44:56.580 INFO:tasks.workunit.client.0.smithi050.stderr:123450K .......... .......... .......... .......... .......... 73% 36.8M 2s 2023-10-26T06:44:56.582 INFO:tasks.workunit.client.0.smithi050.stderr:123500K .......... .......... .......... .......... .......... 73% 22.4M 2s 2023-10-26T06:44:56.585 INFO:tasks.workunit.client.0.smithi050.stderr:123550K .......... .......... .......... .......... .......... 73% 22.7M 2s 2023-10-26T06:44:56.586 INFO:tasks.workunit.client.0.smithi050.stderr:123600K .......... .......... .......... .......... .......... 73% 35.3M 2s 2023-10-26T06:44:56.588 INFO:tasks.workunit.client.0.smithi050.stderr:123650K .......... .......... .......... .......... .......... 73% 20.7M 2s 2023-10-26T06:44:56.589 INFO:tasks.workunit.client.0.smithi050.stderr:123700K .......... .......... .......... .......... .......... 73% 49.0M 2s 2023-10-26T06:44:56.591 INFO:tasks.workunit.client.0.smithi050.stderr:123750K .......... .......... .......... .......... .......... 73% 22.8M 2s 2023-10-26T06:44:56.604 INFO:tasks.workunit.client.0.smithi050.stderr:123800K .......... .......... .......... .......... .......... 73% 37.5M 2s 2023-10-26T06:44:56.604 INFO:tasks.workunit.client.0.smithi050.stderr:123850K .......... .......... .......... .......... .......... 73% 26.4M 2s 2023-10-26T06:44:56.604 INFO:tasks.workunit.client.0.smithi050.stderr:123900K .......... .......... .......... .......... .......... 73% 19.9M 2s 2023-10-26T06:44:56.605 INFO:tasks.workunit.client.0.smithi050.stderr:123950K .......... .......... .......... .......... .......... 73% 65.8M 2s 2023-10-26T06:44:56.605 INFO:tasks.workunit.client.0.smithi050.stderr:124000K .......... .......... .......... .......... .......... 73% 22.9M 2s 2023-10-26T06:44:56.605 INFO:tasks.workunit.client.0.smithi050.stderr:124050K .......... .......... .......... .......... .......... 73% 23.2M 2s 2023-10-26T06:44:56.605 INFO:tasks.workunit.client.0.smithi050.stderr:124100K .......... .......... .......... .......... .......... 73% 34.0M 2s 2023-10-26T06:44:56.608 INFO:tasks.workunit.client.0.smithi050.stderr:124150K .......... .......... .......... .......... .......... 73% 21.0M 2s 2023-10-26T06:44:56.608 INFO:tasks.workunit.client.0.smithi050.stderr:124200K .......... .......... .......... .......... .......... 73% 49.0M 2s 2023-10-26T06:44:56.609 INFO:tasks.workunit.client.0.smithi050.stderr:124250K .......... .......... .......... .......... .......... 73% 23.5M 2s 2023-10-26T06:44:56.610 INFO:tasks.workunit.client.0.smithi050.stderr:124300K .......... .......... .......... .......... .......... 73% 39.5M 2s 2023-10-26T06:44:56.612 INFO:tasks.workunit.client.0.smithi050.stderr:124350K .......... .......... .......... .......... .......... 73% 25.3M 2s 2023-10-26T06:44:56.615 INFO:tasks.workunit.client.0.smithi050.stderr:124400K .......... .......... .......... .......... .......... 73% 24.3M 2s 2023-10-26T06:44:56.615 INFO:tasks.workunit.client.0.smithi050.stderr:124450K .......... .......... .......... .......... .......... 73% 48.5M 2s 2023-10-26T06:44:56.617 INFO:tasks.workunit.client.0.smithi050.stderr:124500K .......... .......... .......... .......... .......... 73% 23.5M 2s 2023-10-26T06:44:56.619 INFO:tasks.workunit.client.0.smithi050.stderr:124550K .......... .......... .......... .......... .......... 73% 30.0M 2s 2023-10-26T06:44:56.620 INFO:tasks.workunit.client.0.smithi050.stderr:124600K .......... .......... .......... .......... .......... 73% 32.1M 2s 2023-10-26T06:44:56.623 INFO:tasks.workunit.client.0.smithi050.stderr:124650K .......... .......... .......... .......... .......... 73% 22.5M 2s 2023-10-26T06:44:56.623 INFO:tasks.workunit.client.0.smithi050.stderr:124700K .......... .......... .......... .......... .......... 74% 47.8M 2s 2023-10-26T06:44:56.625 INFO:tasks.workunit.client.0.smithi050.stderr:124750K .......... .......... .......... .......... .......... 74% 25.0M 2s 2023-10-26T06:44:56.627 INFO:tasks.workunit.client.0.smithi050.stderr:124800K .......... .......... .......... .......... .......... 74% 26.8M 2s 2023-10-26T06:44:56.629 INFO:tasks.workunit.client.0.smithi050.stderr:124850K .......... .......... .......... .......... .......... 74% 29.1M 2s 2023-10-26T06:44:56.630 INFO:tasks.workunit.client.0.smithi050.stderr:124900K .......... .......... .......... .......... .......... 74% 28.0M 2s 2023-10-26T06:44:56.632 INFO:tasks.workunit.client.0.smithi050.stderr:124950K .......... .......... .......... .......... .......... 74% 39.8M 2s 2023-10-26T06:44:56.633 INFO:tasks.workunit.client.0.smithi050.stderr:125000K .......... .......... .......... .......... .......... 74% 23.8M 2s 2023-10-26T06:44:56.635 INFO:tasks.workunit.client.0.smithi050.stderr:125050K .......... .......... .......... .......... .......... 74% 35.7M 2s 2023-10-26T06:44:56.638 INFO:tasks.workunit.client.0.smithi050.stderr:125100K .......... .......... .......... .......... .......... 74% 24.1M 2s 2023-10-26T06:44:56.639 INFO:tasks.workunit.client.0.smithi050.stderr:125150K .......... .......... .......... .......... .......... 74% 25.2M 2s 2023-10-26T06:44:56.642 INFO:tasks.workunit.client.0.smithi050.stderr:125200K .......... .......... .......... .......... .......... 74% 41.9M 2s 2023-10-26T06:44:56.642 INFO:tasks.workunit.client.0.smithi050.stderr:125250K .......... .......... .......... .......... .......... 74% 30.3M 2s 2023-10-26T06:44:56.644 INFO:tasks.workunit.client.0.smithi050.stderr:125300K .......... .......... .......... .......... .......... 74% 21.6M 2s 2023-10-26T06:44:56.645 INFO:tasks.workunit.client.0.smithi050.stderr:125350K .......... .......... .......... .......... .......... 74% 40.0M 2s 2023-10-26T06:44:56.647 INFO:tasks.workunit.client.0.smithi050.stderr:125400K .......... .......... .......... .......... .......... 74% 23.8M 2s 2023-10-26T06:44:56.650 INFO:tasks.workunit.client.0.smithi050.stderr:125450K .......... .......... .......... .......... .......... 74% 24.6M 2s 2023-10-26T06:44:56.651 INFO:tasks.workunit.client.0.smithi050.stderr:125500K .......... .......... .......... .......... .......... 74% 35.9M 2s 2023-10-26T06:44:56.652 INFO:tasks.workunit.client.0.smithi050.stderr:125550K .......... .......... .......... .......... .......... 74% 28.6M 2s 2023-10-26T06:44:56.654 INFO:tasks.workunit.client.0.smithi050.stderr:125600K .......... .......... .......... .......... .......... 74% 34.5M 2s 2023-10-26T06:44:56.656 INFO:tasks.workunit.client.0.smithi050.stderr:125650K .......... .......... .......... .......... .......... 74% 23.3M 2s 2023-10-26T06:44:56.658 INFO:tasks.workunit.client.0.smithi050.stderr:125700K .......... .......... .......... .......... .......... 74% 24.5M 2s 2023-10-26T06:44:56.659 INFO:tasks.workunit.client.0.smithi050.stderr:125750K .......... .......... .......... .......... .......... 74% 50.4M 2s 2023-10-26T06:44:56.661 INFO:tasks.workunit.client.0.smithi050.stderr:125800K .......... .......... .......... .......... .......... 74% 23.8M 2s 2023-10-26T06:44:56.663 INFO:tasks.workunit.client.0.smithi050.stderr:125850K .......... .......... .......... .......... .......... 74% 36.5M 2s 2023-10-26T06:44:56.664 INFO:tasks.workunit.client.0.smithi050.stderr:125900K .......... .......... .......... .......... .......... 74% 28.2M 2s 2023-10-26T06:44:56.666 INFO:tasks.workunit.client.0.smithi050.stderr:125950K .......... .......... .......... .......... .......... 74% 21.6M 2s 2023-10-26T06:44:56.668 INFO:tasks.workunit.client.0.smithi050.stderr:126000K .......... .......... .......... .......... .......... 74% 46.2M 2s 2023-10-26T06:44:56.669 INFO:tasks.workunit.client.0.smithi050.stderr:126050K .......... .......... .......... .......... .......... 74% 24.3M 2s 2023-10-26T06:44:56.671 INFO:tasks.workunit.client.0.smithi050.stderr:126100K .......... .......... .......... .......... .......... 74% 37.0M 2s 2023-10-26T06:44:56.673 INFO:tasks.workunit.client.0.smithi050.stderr:126150K .......... .......... .......... .......... .......... 74% 22.8M 2s 2023-10-26T06:44:56.675 INFO:tasks.workunit.client.0.smithi050.stderr:126200K .......... .......... .......... .......... .......... 74% 25.7M 2s 2023-10-26T06:44:56.676 INFO:tasks.workunit.client.0.smithi050.stderr:126250K .......... .......... .......... .......... .......... 74% 43.8M 2s 2023-10-26T06:44:56.678 INFO:tasks.workunit.client.0.smithi050.stderr:126300K .......... .......... .......... .......... .......... 74% 32.7M 2s 2023-10-26T06:44:56.680 INFO:tasks.workunit.client.0.smithi050.stderr:126350K .......... .......... .......... .......... .......... 74% 29.2M 2s 2023-10-26T06:44:56.682 INFO:tasks.workunit.client.0.smithi050.stderr:126400K .......... .......... .......... .......... .......... 75% 24.4M 2s 2023-10-26T06:44:56.685 INFO:tasks.workunit.client.0.smithi050.stderr:126450K .......... .......... .......... .......... .......... 75% 24.5M 2s 2023-10-26T06:44:56.686 INFO:tasks.workunit.client.0.smithi050.stderr:126500K .......... .......... .......... .......... .......... 75% 33.4M 2s 2023-10-26T06:44:56.688 INFO:tasks.workunit.client.0.smithi050.stderr:126550K .......... .......... .......... .......... .......... 75% 23.7M 2s 2023-10-26T06:44:56.688 INFO:tasks.workunit.client.0.smithi050.stderr:126600K .......... .......... .......... .......... .......... 75% 56.2M 2s 2023-10-26T06:44:56.690 INFO:tasks.workunit.client.0.smithi050.stderr:126650K .......... .......... .......... .......... .......... 75% 24.8M 2s 2023-10-26T06:44:56.693 INFO:tasks.workunit.client.0.smithi050.stderr:126700K .......... .......... .......... .......... .......... 75% 24.7M 2s 2023-10-26T06:44:56.693 INFO:tasks.workunit.client.0.smithi050.stderr:126750K .......... .......... .......... .......... .......... 75% 45.6M 2s 2023-10-26T06:44:56.697 INFO:tasks.workunit.client.0.smithi050.stderr:126800K .......... .......... .......... .......... .......... 75% 33.2M 2s 2023-10-26T06:44:56.697 INFO:tasks.workunit.client.0.smithi050.stderr:126850K .......... .......... .......... .......... .......... 75% 26.3M 2s 2023-10-26T06:44:56.699 INFO:tasks.workunit.client.0.smithi050.stderr:126900K .......... .......... .......... .......... .......... 75% 24.4M 2s 2023-10-26T06:44:56.703 INFO:tasks.workunit.client.0.smithi050.stderr:126950K .......... .......... .......... .......... .......... 75% 24.8M 2s 2023-10-26T06:44:56.703 INFO:tasks.workunit.client.0.smithi050.stderr:127000K .......... .......... .......... .......... .......... 75% 55.4M 2s 2023-10-26T06:44:56.703 INFO:tasks.workunit.client.0.smithi050.stderr:127050K .......... .......... .......... .......... .......... 75% 30.0M 2s 2023-10-26T06:44:56.705 INFO:tasks.workunit.client.0.smithi050.stderr:127100K .......... .......... .......... .......... .......... 75% 25.9M 2s 2023-10-26T06:44:56.706 INFO:tasks.workunit.client.0.smithi050.stderr:127150K .......... .......... .......... .......... .......... 75% 24.7M 1s 2023-10-26T06:44:56.708 INFO:tasks.workunit.client.0.smithi050.stderr:127200K .......... .......... .......... .......... .......... 75% 21.2M 1s 2023-10-26T06:44:56.710 INFO:tasks.workunit.client.0.smithi050.stderr:127250K .......... .......... .......... .......... .......... 75% 50.1M 1s 2023-10-26T06:44:56.712 INFO:tasks.workunit.client.0.smithi050.stderr:127300K .......... .......... .......... .......... .......... 75% 22.1M 1s 2023-10-26T06:44:56.714 INFO:tasks.workunit.client.0.smithi050.stderr:127350K .......... .......... .......... .......... .......... 75% 35.8M 1s 2023-10-26T06:44:56.716 INFO:tasks.workunit.client.0.smithi050.stderr:127400K .......... .......... .......... .......... .......... 75% 25.1M 1s 2023-10-26T06:44:56.718 INFO:tasks.workunit.client.0.smithi050.stderr:127450K .......... .......... .......... .......... .......... 75% 24.8M 1s 2023-10-26T06:44:56.718 INFO:tasks.workunit.client.0.smithi050.stderr:127500K .......... .......... .......... .......... .......... 75% 48.2M 1s 2023-10-26T06:44:56.732 INFO:tasks.workunit.client.0.smithi050.stderr:127550K .......... .......... .......... .......... .......... 75% 23.7M 1s 2023-10-26T06:44:56.733 INFO:tasks.workunit.client.0.smithi050.stderr:127600K .......... .......... .......... .......... .......... 75% 23.9M 1s 2023-10-26T06:44:56.733 INFO:tasks.workunit.client.0.smithi050.stderr:127650K .......... .......... .......... .......... .......... 75% 27.6M 1s 2023-10-26T06:44:56.733 INFO:tasks.workunit.client.0.smithi050.stderr:127700K .......... .......... .......... .......... .......... 75% 24.4M 1s 2023-10-26T06:44:56.733 INFO:tasks.workunit.client.0.smithi050.stderr:127750K .......... .......... .......... .......... .......... 75% 45.9M 1s 2023-10-26T06:44:56.733 INFO:tasks.workunit.client.0.smithi050.stderr:127800K .......... .......... .......... .......... .......... 75% 32.4M 1s 2023-10-26T06:44:56.734 INFO:tasks.workunit.client.0.smithi050.stderr:127850K .......... .......... .......... .......... .......... 75% 26.1M 1s 2023-10-26T06:44:56.734 INFO:tasks.workunit.client.0.smithi050.stderr:127900K .......... .......... .......... .......... .......... 75% 25.3M 1s 2023-10-26T06:44:56.738 INFO:tasks.workunit.client.0.smithi050.stderr:127950K .......... .......... .......... .......... .......... 75% 24.6M 1s 2023-10-26T06:44:56.738 INFO:tasks.workunit.client.0.smithi050.stderr:128000K .......... .......... .......... .......... .......... 75% 39.3M 1s 2023-10-26T06:44:56.738 INFO:tasks.workunit.client.0.smithi050.stderr:128050K .......... .......... .......... .......... .......... 75% 26.4M 1s 2023-10-26T06:44:56.740 INFO:tasks.workunit.client.0.smithi050.stderr:128100K .......... .......... .......... .......... .......... 76% 29.5M 1s 2023-10-26T06:44:56.741 INFO:tasks.workunit.client.0.smithi050.stderr:128150K .......... .......... .......... .......... .......... 76% 24.6M 1s 2023-10-26T06:44:56.743 INFO:tasks.workunit.client.0.smithi050.stderr:128200K .......... .......... .......... .......... .......... 76% 27.4M 1s 2023-10-26T06:44:56.744 INFO:tasks.workunit.client.0.smithi050.stderr:128250K .......... .......... .......... .......... .......... 76% 37.8M 1s 2023-10-26T06:44:56.747 INFO:tasks.workunit.client.0.smithi050.stderr:128300K .......... .......... .......... .......... .......... 76% 20.7M 1s 2023-10-26T06:44:56.750 INFO:tasks.workunit.client.0.smithi050.stderr:128350K .......... .......... .......... .......... .......... 76% 18.1M 1s 2023-10-26T06:44:56.750 INFO:tasks.workunit.client.0.smithi050.stderr:128400K .......... .......... .......... .......... .......... 76% 53.6M 1s 2023-10-26T06:44:56.752 INFO:tasks.workunit.client.0.smithi050.stderr:128450K .......... .......... .......... .......... .......... 76% 32.4M 1s 2023-10-26T06:44:56.753 INFO:tasks.workunit.client.0.smithi050.stderr:128500K .......... .......... .......... .......... .......... 76% 45.3M 1s 2023-10-26T06:44:56.755 INFO:tasks.workunit.client.0.smithi050.stderr:128550K .......... .......... .......... .......... .......... 76% 22.6M 1s 2023-10-26T06:44:56.757 INFO:tasks.workunit.client.0.smithi050.stderr:128600K .......... .......... .......... .......... .......... 76% 34.3M 1s 2023-10-26T06:44:56.759 INFO:tasks.workunit.client.0.smithi050.stderr:128650K .......... .......... .......... .......... .......... 76% 28.1M 1s 2023-10-26T06:44:56.761 INFO:tasks.workunit.client.0.smithi050.stderr:128700K .......... .......... .......... .......... .......... 76% 25.5M 1s 2023-10-26T06:44:56.761 INFO:tasks.workunit.client.0.smithi050.stderr:128750K .......... .......... .......... .......... .......... 76% 43.4M 1s 2023-10-26T06:44:56.763 INFO:tasks.workunit.client.0.smithi050.stderr:128800K .......... .......... .......... .......... .......... 76% 26.6M 1s 2023-10-26T06:44:56.768 INFO:tasks.workunit.client.0.smithi050.stderr:128850K .......... .......... .......... .......... .......... 76% 21.0M 1s 2023-10-26T06:44:56.768 INFO:tasks.workunit.client.0.smithi050.stderr:128900K .......... .......... .......... .......... .......... 76% 24.4M 1s 2023-10-26T06:44:56.770 INFO:tasks.workunit.client.0.smithi050.stderr:128950K .......... .......... .......... .......... .......... 76% 33.6M 1s 2023-10-26T06:44:56.770 INFO:tasks.workunit.client.0.smithi050.stderr:129000K .......... .......... .......... .......... .......... 76% 37.6M 1s 2023-10-26T06:44:56.772 INFO:tasks.workunit.client.0.smithi050.stderr:129050K .......... .......... .......... .......... .......... 76% 31.2M 1s 2023-10-26T06:44:56.776 INFO:tasks.workunit.client.0.smithi050.stderr:129100K .......... .......... .......... .......... .......... 76% 14.2M 1s 2023-10-26T06:44:56.776 INFO:tasks.workunit.client.0.smithi050.stderr:129150K .......... .......... .......... .......... .......... 76% 200M 1s 2023-10-26T06:44:56.787 INFO:tasks.workunit.client.0.smithi050.stderr:129200K .......... .......... .......... .......... .......... 76% 24.1M 1s 2023-10-26T06:44:56.787 INFO:tasks.workunit.client.0.smithi050.stderr:129250K .......... .......... .......... .......... .......... 76% 55.4M 1s 2023-10-26T06:44:56.787 INFO:tasks.workunit.client.0.smithi050.stderr:129300K .......... .......... .......... .......... .......... 76% 25.3M 1s 2023-10-26T06:44:56.787 INFO:tasks.workunit.client.0.smithi050.stderr:129350K .......... .......... .......... .......... .......... 76% 25.1M 1s 2023-10-26T06:44:56.788 INFO:tasks.workunit.client.0.smithi050.stderr:129400K .......... .......... .......... .......... .......... 76% 27.9M 1s 2023-10-26T06:44:56.788 INFO:tasks.workunit.client.0.smithi050.stderr:129450K .......... .......... .......... .......... .......... 76% 22.4M 1s 2023-10-26T06:44:56.788 INFO:tasks.workunit.client.0.smithi050.stderr:129500K .......... .......... .......... .......... .......... 76% 57.8M 1s 2023-10-26T06:44:56.790 INFO:tasks.workunit.client.0.smithi050.stderr:129550K .......... .......... .......... .......... .......... 76% 25.0M 1s 2023-10-26T06:44:56.791 INFO:tasks.workunit.client.0.smithi050.stderr:129600K .......... .......... .......... .......... .......... 76% 22.5M 1s 2023-10-26T06:44:56.792 INFO:tasks.workunit.client.0.smithi050.stderr:129650K .......... .......... .......... .......... .......... 76% 35.3M 1s 2023-10-26T06:44:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:129700K .......... .......... .......... .......... .......... 76% 24.4M 1s 2023-10-26T06:44:56.795 INFO:tasks.workunit.client.0.smithi050.stderr:129750K .......... .......... .......... .......... .......... 77% 55.9M 1s 2023-10-26T06:44:56.797 INFO:tasks.workunit.client.0.smithi050.stderr:129800K .......... .......... .......... .......... .......... 77% 22.8M 1s 2023-10-26T06:44:56.807 INFO:tasks.workunit.client.0.smithi050.stderr:129850K .......... .......... .......... .......... .......... 77% 24.4M 1s 2023-10-26T06:44:56.807 INFO:tasks.workunit.client.0.smithi050.stderr:129900K .......... .......... .......... .......... .......... 77% 33.1M 1s 2023-10-26T06:44:56.807 INFO:tasks.workunit.client.0.smithi050.stderr:129950K .......... .......... .......... .......... .......... 77% 22.9M 1s 2023-10-26T06:44:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:130000K .......... .......... .......... .......... .......... 77% 44.1M 1s 2023-10-26T06:44:56.808 INFO:tasks.workunit.client.0.smithi050.stderr:130050K .......... .......... .......... .......... .......... 77% 23.9M 1s 2023-10-26T06:44:56.809 INFO:tasks.workunit.client.0.smithi050.stderr:130100K .......... .......... .......... .......... .......... 77% 21.7M 1s 2023-10-26T06:44:56.810 INFO:tasks.workunit.client.0.smithi050.stderr:130150K .......... .......... .......... .......... .......... 77% 38.1M 1s 2023-10-26T06:44:56.813 INFO:tasks.workunit.client.0.smithi050.stderr:130200K .......... .......... .......... .......... .......... 77% 24.0M 1s 2023-10-26T06:44:56.815 INFO:tasks.workunit.client.0.smithi050.stderr:130250K .......... .......... .......... .......... .......... 77% 48.8M 1s 2023-10-26T06:44:56.815 INFO:tasks.workunit.client.0.smithi050.stderr:130300K .......... .......... .......... .......... .......... 77% 25.6M 1s 2023-10-26T06:44:56.851 INFO:tasks.workunit.client.0.smithi050.stderr:130350K .......... .......... .......... .......... .......... 77% 24.5M 1s 2023-10-26T06:44:56.851 INFO:tasks.workunit.client.0.smithi050.stderr:130400K .......... .......... .......... .......... .......... 77% 32.9M 1s 2023-10-26T06:44:56.851 INFO:tasks.workunit.client.0.smithi050.stderr:130450K .......... .......... .......... .......... .......... 77% 25.1M 1s 2023-10-26T06:44:56.851 INFO:tasks.workunit.client.0.smithi050.stderr:130500K .......... .......... .......... .......... .......... 77% 47.2M 1s 2023-10-26T06:44:56.852 INFO:tasks.workunit.client.0.smithi050.stderr:130550K .......... .......... .......... .......... .......... 77% 24.0M 1s 2023-10-26T06:44:56.852 INFO:tasks.workunit.client.0.smithi050.stderr:130600K .......... .......... .......... .......... .......... 77% 24.7M 1s 2023-10-26T06:44:56.852 INFO:tasks.workunit.client.0.smithi050.stderr:130650K .......... .......... .......... .......... .......... 77% 37.5M 1s 2023-10-26T06:44:56.852 INFO:tasks.workunit.client.0.smithi050.stderr:130700K .......... .......... .......... .......... .......... 77% 24.0M 1s 2023-10-26T06:44:56.853 INFO:tasks.workunit.client.0.smithi050.stderr:130750K .......... .......... .......... .......... .......... 77% 27.4M 1s 2023-10-26T06:44:56.853 INFO:tasks.workunit.client.0.smithi050.stderr:130800K .......... .......... .......... .......... .......... 77% 37.2M 1s 2023-10-26T06:44:56.853 INFO:tasks.workunit.client.0.smithi050.stderr:130850K .......... .......... .......... .......... .......... 77% 23.8M 1s 2023-10-26T06:44:56.853 INFO:tasks.workunit.client.0.smithi050.stderr:130900K .......... .......... .......... .......... .......... 77% 38.0M 1s 2023-10-26T06:44:56.853 INFO:tasks.workunit.client.0.smithi050.stderr:130950K .......... .......... .......... .......... .......... 77% 22.6M 1s 2023-10-26T06:44:56.854 INFO:tasks.workunit.client.0.smithi050.stderr:131000K .......... .......... .......... .......... .......... 77% 24.7M 1s 2023-10-26T06:44:56.854 INFO:tasks.workunit.client.0.smithi050.stderr:131050K .......... .......... .......... .......... .......... 77% 40.6M 1s 2023-10-26T06:44:56.854 INFO:tasks.workunit.client.0.smithi050.stderr:131100K .......... .......... .......... .......... .......... 77% 27.8M 1s 2023-10-26T06:44:56.854 INFO:tasks.workunit.client.0.smithi050.stderr:131150K .......... .......... .......... .......... .......... 77% 34.9M 1s 2023-10-26T06:44:56.855 INFO:tasks.workunit.client.0.smithi050.stderr:131200K .......... .......... .......... .......... .......... 77% 20.0M 1s 2023-10-26T06:44:56.855 INFO:tasks.workunit.client.0.smithi050.stderr:131250K .......... .......... .......... .......... .......... 77% 31.6M 1s 2023-10-26T06:44:56.855 INFO:tasks.workunit.client.0.smithi050.stderr:131300K .......... .......... .......... .......... .......... 77% 45.1M 1s 2023-10-26T06:44:56.855 INFO:tasks.workunit.client.0.smithi050.stderr:131350K .......... .......... .......... .......... .......... 77% 25.3M 1s 2023-10-26T06:44:56.868 INFO:tasks.workunit.client.0.smithi050.stderr:131400K .......... .......... .......... .......... .......... 77% 35.5M 1s 2023-10-26T06:44:56.868 INFO:tasks.workunit.client.0.smithi050.stderr:131450K .......... .......... .......... .......... .......... 78% 33.2M 1s 2023-10-26T06:44:56.868 INFO:tasks.workunit.client.0.smithi050.stderr:131500K .......... .......... .......... .......... .......... 78% 23.6M 1s 2023-10-26T06:44:56.869 INFO:tasks.workunit.client.0.smithi050.stderr:131550K .......... .......... .......... .......... .......... 78% 35.4M 1s 2023-10-26T06:44:56.869 INFO:tasks.workunit.client.0.smithi050.stderr:131600K .......... .......... .......... .......... .......... 78% 23.0M 1s 2023-10-26T06:44:56.869 INFO:tasks.workunit.client.0.smithi050.stderr:131650K .......... .......... .......... .......... .......... 78% 34.3M 1s 2023-10-26T06:44:56.869 INFO:tasks.workunit.client.0.smithi050.stderr:131700K .......... .......... .......... .......... .......... 78% 19.8M 1s 2023-10-26T06:44:56.870 INFO:tasks.workunit.client.0.smithi050.stderr:131750K .......... .......... .......... .......... .......... 78% 27.3M 1s 2023-10-26T06:44:56.870 INFO:tasks.workunit.client.0.smithi050.stderr:131800K .......... .......... .......... .......... .......... 78% 38.2M 1s 2023-10-26T06:44:56.870 INFO:tasks.workunit.client.0.smithi050.stderr:131850K .......... .......... .......... .......... .......... 78% 28.7M 1s 2023-10-26T06:44:56.887 INFO:tasks.workunit.client.0.smithi050.stderr:131900K .......... .......... .......... .......... .......... 78% 22.6M 1s 2023-10-26T06:44:56.887 INFO:tasks.workunit.client.0.smithi050.stderr:131950K .......... .......... .......... .......... .......... 78% 23.0M 1s 2023-10-26T06:44:56.888 INFO:tasks.workunit.client.0.smithi050.stderr:132000K .......... .......... .......... .......... .......... 78% 60.7M 1s 2023-10-26T06:44:56.888 INFO:tasks.workunit.client.0.smithi050.stderr:132050K .......... .......... .......... .......... .......... 78% 25.5M 1s 2023-10-26T06:44:56.888 INFO:tasks.workunit.client.0.smithi050.stderr:132100K .......... .......... .......... .......... .......... 78% 28.5M 1s 2023-10-26T06:44:56.888 INFO:tasks.workunit.client.0.smithi050.stderr:132150K .......... .......... .......... .......... .......... 78% 26.4M 1s 2023-10-26T06:44:56.889 INFO:tasks.workunit.client.0.smithi050.stderr:132200K .......... .......... .......... .......... .......... 78% 24.7M 1s 2023-10-26T06:44:56.889 INFO:tasks.workunit.client.0.smithi050.stderr:132250K .......... .......... .......... .......... .......... 78% 45.5M 1s 2023-10-26T06:44:56.889 INFO:tasks.workunit.client.0.smithi050.stderr:132300K .......... .......... .......... .......... .......... 78% 22.5M 1s 2023-10-26T06:44:56.889 INFO:tasks.workunit.client.0.smithi050.stderr:132350K .......... .......... .......... .......... .......... 78% 27.8M 1s 2023-10-26T06:44:56.889 INFO:tasks.workunit.client.0.smithi050.stderr:132400K .......... .......... .......... .......... .......... 78% 23.7M 1s 2023-10-26T06:44:56.894 INFO:tasks.workunit.client.0.smithi050.stderr:132450K .......... .......... .......... .......... .......... 78% 28.4M 1s 2023-10-26T06:44:56.894 INFO:tasks.workunit.client.0.smithi050.stderr:132500K .......... .......... .......... .......... .......... 78% 30.8M 1s 2023-10-26T06:44:56.894 INFO:tasks.workunit.client.0.smithi050.stderr:132550K .......... .......... .......... .......... .......... 78% 35.9M 1s 2023-10-26T06:44:56.894 INFO:tasks.workunit.client.0.smithi050.stderr:132600K .......... .......... .......... .......... .......... 78% 27.1M 1s 2023-10-26T06:44:56.896 INFO:tasks.workunit.client.0.smithi050.stderr:132650K .......... .......... .......... .......... .......... 78% 22.3M 1s 2023-10-26T06:44:56.898 INFO:tasks.workunit.client.0.smithi050.stderr:132700K .......... .......... .......... .......... .......... 78% 27.7M 1s 2023-10-26T06:44:56.899 INFO:tasks.workunit.client.0.smithi050.stderr:132750K .......... .......... .......... .......... .......... 78% 51.0M 1s 2023-10-26T06:44:56.902 INFO:tasks.workunit.client.0.smithi050.stderr:132800K .......... .......... .......... .......... .......... 78% 27.5M 1s 2023-10-26T06:44:56.903 INFO:tasks.workunit.client.0.smithi050.stderr:132850K .......... .......... .......... .......... .......... 78% 29.1M 1s 2023-10-26T06:44:56.905 INFO:tasks.workunit.client.0.smithi050.stderr:132900K .......... .......... .......... .......... .......... 78% 23.8M 1s 2023-10-26T06:44:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:132950K .......... .......... .......... .......... .......... 78% 25.0M 1s 2023-10-26T06:44:56.911 INFO:tasks.workunit.client.0.smithi050.stderr:133000K .......... .......... .......... .......... .......... 78% 29.1M 1s 2023-10-26T06:44:56.912 INFO:tasks.workunit.client.0.smithi050.stderr:133050K .......... .......... .......... .......... .......... 78% 45.0M 1s 2023-10-26T06:44:56.912 INFO:tasks.workunit.client.0.smithi050.stderr:133100K .......... .......... .......... .......... .......... 78% 30.3M 1s 2023-10-26T06:44:56.917 INFO:tasks.workunit.client.0.smithi050.stderr:133150K .......... .......... .......... .......... .......... 79% 24.4M 1s 2023-10-26T06:44:56.917 INFO:tasks.workunit.client.0.smithi050.stderr:133200K .......... .......... .......... .......... .......... 79% 29.2M 1s 2023-10-26T06:44:56.917 INFO:tasks.workunit.client.0.smithi050.stderr:133250K .......... .......... .......... .......... .......... 79% 37.8M 1s 2023-10-26T06:44:56.918 INFO:tasks.workunit.client.0.smithi050.stderr:133300K .......... .......... .......... .......... .......... 79% 29.5M 1s 2023-10-26T06:44:56.922 INFO:tasks.workunit.client.0.smithi050.stderr:133350K .......... .......... .......... .......... .......... 79% 27.4M 1s 2023-10-26T06:44:56.922 INFO:tasks.workunit.client.0.smithi050.stderr:133400K .......... .......... .......... .......... .......... 79% 20.9M 1s 2023-10-26T06:44:56.922 INFO:tasks.workunit.client.0.smithi050.stderr:133450K .......... .......... .......... .......... .......... 79% 52.5M 1s 2023-10-26T06:44:56.923 INFO:tasks.workunit.client.0.smithi050.stderr:133500K .......... .......... .......... .......... .......... 79% 27.2M 1s 2023-10-26T06:44:56.931 INFO:tasks.workunit.client.0.smithi050.stderr:133550K .......... .......... .......... .......... .......... 79% 17.0M 1s 2023-10-26T06:44:56.931 INFO:tasks.workunit.client.0.smithi050.stderr:133600K .......... .......... .......... .......... .......... 79% 37.2M 1s 2023-10-26T06:44:56.932 INFO:tasks.workunit.client.0.smithi050.stderr:133650K .......... .......... .......... .......... .......... 79% 63.3M 1s 2023-10-26T06:44:56.932 INFO:tasks.workunit.client.0.smithi050.stderr:133700K .......... .......... .......... .......... .......... 79% 24.7M 1s 2023-10-26T06:44:56.934 INFO:tasks.workunit.client.0.smithi050.stderr:133750K .......... .......... .......... .......... .......... 79% 29.1M 1s 2023-10-26T06:44:56.934 INFO:tasks.workunit.client.0.smithi050.stderr:133800K .......... .......... .......... .......... .......... 79% 35.8M 1s 2023-10-26T06:44:56.936 INFO:tasks.workunit.client.0.smithi050.stderr:133850K .......... .......... .......... .......... .......... 79% 27.7M 1s 2023-10-26T06:44:56.938 INFO:tasks.workunit.client.0.smithi050.stderr:133900K .......... .......... .......... .......... .......... 79% 30.7M 1s 2023-10-26T06:44:56.939 INFO:tasks.workunit.client.0.smithi050.stderr:133950K .......... .......... .......... .......... .......... 79% 23.9M 1s 2023-10-26T06:44:56.941 INFO:tasks.workunit.client.0.smithi050.stderr:134000K .......... .......... .......... .......... .......... 79% 27.5M 1s 2023-10-26T06:44:56.943 INFO:tasks.workunit.client.0.smithi050.stderr:134050K .......... .......... .......... .......... .......... 79% 32.1M 1s 2023-10-26T06:44:56.945 INFO:tasks.workunit.client.0.smithi050.stderr:134100K .......... .......... .......... .......... .......... 79% 27.2M 1s 2023-10-26T06:44:56.946 INFO:tasks.workunit.client.0.smithi050.stderr:134150K .......... .......... .......... .......... .......... 79% 24.3M 1s 2023-10-26T06:44:56.948 INFO:tasks.workunit.client.0.smithi050.stderr:134200K .......... .......... .......... .......... .......... 79% 37.0M 1s 2023-10-26T06:44:56.949 INFO:tasks.workunit.client.0.smithi050.stderr:134250K .......... .......... .......... .......... .......... 79% 25.9M 1s 2023-10-26T06:44:56.951 INFO:tasks.workunit.client.0.smithi050.stderr:134300K .......... .......... .......... .......... .......... 79% 36.5M 1s 2023-10-26T06:44:56.953 INFO:tasks.workunit.client.0.smithi050.stderr:134350K .......... .......... .......... .......... .......... 79% 25.1M 1s 2023-10-26T06:44:56.955 INFO:tasks.workunit.client.0.smithi050.stderr:134400K .......... .......... .......... .......... .......... 79% 24.2M 1s 2023-10-26T06:44:56.956 INFO:tasks.workunit.client.0.smithi050.stderr:134450K .......... .......... .......... .......... .......... 79% 38.3M 1s 2023-10-26T06:44:56.957 INFO:tasks.workunit.client.0.smithi050.stderr:134500K .......... .......... .......... .......... .......... 79% 25.4M 1s 2023-10-26T06:44:56.960 INFO:tasks.workunit.client.0.smithi050.stderr:134550K .......... .......... .......... .......... .......... 79% 41.0M 1s 2023-10-26T06:44:56.962 INFO:tasks.workunit.client.0.smithi050.stderr:134600K .......... .......... .......... .......... .......... 79% 24.3M 1s 2023-10-26T06:44:56.964 INFO:tasks.workunit.client.0.smithi050.stderr:134650K .......... .......... .......... .......... .......... 79% 24.8M 1s 2023-10-26T06:44:56.964 INFO:tasks.workunit.client.0.smithi050.stderr:134700K .......... .......... .......... .......... .......... 79% 38.0M 1s 2023-10-26T06:44:56.966 INFO:tasks.workunit.client.0.smithi050.stderr:134750K .......... .......... .......... .......... .......... 79% 25.0M 1s 2023-10-26T06:44:56.967 INFO:tasks.workunit.client.0.smithi050.stderr:134800K .......... .......... .......... .......... .......... 79% 39.2M 1s 2023-10-26T06:44:56.969 INFO:tasks.workunit.client.0.smithi050.stderr:134850K .......... .......... .......... .......... .......... 80% 23.3M 1s 2023-10-26T06:44:56.972 INFO:tasks.workunit.client.0.smithi050.stderr:134900K .......... .......... .......... .......... .......... 80% 23.2M 1s 2023-10-26T06:44:56.973 INFO:tasks.workunit.client.0.smithi050.stderr:134950K .......... .......... .......... .......... .......... 80% 38.0M 1s 2023-10-26T06:44:56.975 INFO:tasks.workunit.client.0.smithi050.stderr:135000K .......... .......... .......... .......... .......... 80% 23.0M 1s 2023-10-26T06:44:56.978 INFO:tasks.workunit.client.0.smithi050.stderr:135050K .......... .......... .......... .......... .......... 80% 44.3M 1s 2023-10-26T06:44:56.979 INFO:tasks.workunit.client.0.smithi050.stderr:135100K .......... .......... .......... .......... .......... 80% 23.8M 1s 2023-10-26T06:44:56.980 INFO:tasks.workunit.client.0.smithi050.stderr:135150K .......... .......... .......... .......... .......... 80% 24.6M 1s 2023-10-26T06:44:56.982 INFO:tasks.workunit.client.0.smithi050.stderr:135200K .......... .......... .......... .......... .......... 80% 29.2M 1s 2023-10-26T06:44:56.985 INFO:tasks.workunit.client.0.smithi050.stderr:135250K .......... .......... .......... .......... .......... 80% 24.0M 1s 2023-10-26T06:44:56.985 INFO:tasks.workunit.client.0.smithi050.stderr:135300K .......... .......... .......... .......... .......... 80% 48.2M 1s 2023-10-26T06:44:56.986 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:56 smithi153 ceph-mon[131657]: pgmap v357: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-10-26T06:44:56.989 INFO:tasks.workunit.client.0.smithi050.stderr:135350K .......... .......... .......... .......... .......... 80% 25.0M 1s 2023-10-26T06:44:56.989 INFO:tasks.workunit.client.0.smithi050.stderr:135400K .......... .......... .......... .......... .......... 80% 35.8M 1s 2023-10-26T06:44:56.991 INFO:tasks.workunit.client.0.smithi050.stderr:135450K .......... .......... .......... .......... .......... 80% 28.2M 1s 2023-10-26T06:44:56.992 INFO:tasks.workunit.client.0.smithi050.stderr:135500K .......... .......... .......... .......... .......... 80% 21.8M 1s 2023-10-26T06:44:56.995 INFO:tasks.workunit.client.0.smithi050.stderr:135550K .......... .......... .......... .......... .......... 80% 46.6M 1s 2023-10-26T06:44:56.995 INFO:tasks.workunit.client.0.smithi050.stderr:135600K .......... .......... .......... .......... .......... 80% 24.7M 1s 2023-10-26T06:44:56.998 INFO:tasks.workunit.client.0.smithi050.stderr:135650K .......... .......... .......... .......... .......... 80% 23.6M 1s 2023-10-26T06:44:56.999 INFO:tasks.workunit.client.0.smithi050.stderr:135700K .......... .......... .......... .......... .......... 80% 47.4M 1s 2023-10-26T06:44:57.001 INFO:tasks.workunit.client.0.smithi050.stderr:135750K .......... .......... .......... .......... .......... 80% 21.6M 1s 2023-10-26T06:44:57.003 INFO:tasks.workunit.client.0.smithi050.stderr:135800K .......... .......... .......... .......... .......... 80% 48.7M 1s 2023-10-26T06:44:57.004 INFO:tasks.workunit.client.0.smithi050.stderr:135850K .......... .......... .......... .......... .......... 80% 26.8M 1s 2023-10-26T06:44:57.006 INFO:tasks.workunit.client.0.smithi050.stderr:135900K .......... .......... .......... .......... .......... 80% 20.2M 1s 2023-10-26T06:44:57.009 INFO:tasks.workunit.client.0.smithi050.stderr:135950K .......... .......... .......... .......... .......... 80% 28.1M 1s 2023-10-26T06:44:57.009 INFO:tasks.workunit.client.0.smithi050.stderr:136000K .......... .......... .......... .......... .......... 80% 35.4M 1s 2023-10-26T06:44:57.011 INFO:tasks.workunit.client.0.smithi050.stderr:136050K .......... .......... .......... .......... .......... 80% 23.0M 1s 2023-10-26T06:44:57.012 INFO:tasks.workunit.client.0.smithi050.stderr:136100K .......... .......... .......... .......... .......... 80% 47.4M 1s 2023-10-26T06:44:57.014 INFO:tasks.workunit.client.0.smithi050.stderr:136150K .......... .......... .......... .......... .......... 80% 24.1M 1s 2023-10-26T06:44:57.015 INFO:tasks.workunit.client.0.smithi050.stderr:136200K .......... .......... .......... .......... .......... 80% 39.5M 1s 2023-10-26T06:44:57.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:56 smithi050 ceph-mon[94997]: pgmap v357: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-10-26T06:44:57.020 INFO:tasks.workunit.client.0.smithi050.stderr:136250K .......... .......... .......... .......... .......... 80% 21.6M 1s 2023-10-26T06:44:57.020 INFO:tasks.workunit.client.0.smithi050.stderr:136300K .......... .......... .......... .......... .......... 80% 25.6M 1s 2023-10-26T06:44:57.023 INFO:tasks.workunit.client.0.smithi050.stderr:136350K .......... .......... .......... .......... .......... 80% 39.8M 1s 2023-10-26T06:44:57.024 INFO:tasks.workunit.client.0.smithi050.stderr:136400K .......... .......... .......... .......... .......... 80% 22.3M 1s 2023-10-26T06:44:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:136450K .......... .......... .......... .......... .......... 80% 29.3M 1s 2023-10-26T06:44:57.027 INFO:tasks.workunit.client.0.smithi050.stderr:136500K .......... .......... .......... .......... .......... 81% 30.4M 1s 2023-10-26T06:44:57.029 INFO:tasks.workunit.client.0.smithi050.stderr:136550K .......... .......... .......... .......... .......... 81% 24.7M 1s 2023-10-26T06:44:57.029 INFO:tasks.workunit.client.0.smithi050.stderr:136600K .......... .......... .......... .......... .......... 81% 55.8M 1s 2023-10-26T06:44:57.031 INFO:tasks.workunit.client.0.smithi050.stderr:136650K .......... .......... .......... .......... .......... 81% 21.2M 1s 2023-10-26T06:44:57.033 INFO:tasks.workunit.client.0.smithi050.stderr:136700K .......... .......... .......... .......... .......... 81% 41.8M 1s 2023-10-26T06:44:57.035 INFO:tasks.workunit.client.0.smithi050.stderr:136750K .......... .......... .......... .......... .......... 81% 23.8M 1s 2023-10-26T06:44:57.037 INFO:tasks.workunit.client.0.smithi050.stderr:136800K .......... .......... .......... .......... .......... 81% 22.7M 1s 2023-10-26T06:44:57.038 INFO:tasks.workunit.client.0.smithi050.stderr:136850K .......... .......... .......... .......... .......... 81% 46.1M 1s 2023-10-26T06:44:57.039 INFO:tasks.workunit.client.0.smithi050.stderr:136900K .......... .......... .......... .......... .......... 81% 25.6M 1s 2023-10-26T06:44:57.041 INFO:tasks.workunit.client.0.smithi050.stderr:136950K .......... .......... .......... .......... .......... 81% 33.8M 1s 2023-10-26T06:44:57.043 INFO:tasks.workunit.client.0.smithi050.stderr:137000K .......... .......... .......... .......... .......... 81% 21.1M 1s 2023-10-26T06:44:57.045 INFO:tasks.workunit.client.0.smithi050.stderr:137050K .......... .......... .......... .......... .......... 81% 27.6M 1s 2023-10-26T06:44:57.046 INFO:tasks.workunit.client.0.smithi050.stderr:137100K .......... .......... .......... .......... .......... 81% 42.1M 1s 2023-10-26T06:44:57.048 INFO:tasks.workunit.client.0.smithi050.stderr:137150K .......... .......... .......... .......... .......... 81% 25.4M 1s 2023-10-26T06:44:57.050 INFO:tasks.workunit.client.0.smithi050.stderr:137200K .......... .......... .......... .......... .......... 81% 36.9M 1s 2023-10-26T06:44:57.052 INFO:tasks.workunit.client.0.smithi050.stderr:137250K .......... .......... .......... .......... .......... 81% 22.7M 1s 2023-10-26T06:44:57.053 INFO:tasks.workunit.client.0.smithi050.stderr:137300K .......... .......... .......... .......... .......... 81% 35.7M 1s 2023-10-26T06:44:57.055 INFO:tasks.workunit.client.0.smithi050.stderr:137350K .......... .......... .......... .......... .......... 81% 27.1M 1s 2023-10-26T06:44:57.056 INFO:tasks.workunit.client.0.smithi050.stderr:137400K .......... .......... .......... .......... .......... 81% 37.7M 1s 2023-10-26T06:44:57.058 INFO:tasks.workunit.client.0.smithi050.stderr:137450K .......... .......... .......... .......... .......... 81% 23.8M 1s 2023-10-26T06:44:57.060 INFO:tasks.workunit.client.0.smithi050.stderr:137500K .......... .......... .......... .......... .......... 81% 23.4M 1s 2023-10-26T06:44:57.062 INFO:tasks.workunit.client.0.smithi050.stderr:137550K .......... .......... .......... .......... .......... 81% 25.0M 1s 2023-10-26T06:44:57.063 INFO:tasks.workunit.client.0.smithi050.stderr:137600K .......... .......... .......... .......... .......... 81% 36.4M 1s 2023-10-26T06:44:57.065 INFO:tasks.workunit.client.0.smithi050.stderr:137650K .......... .......... .......... .......... .......... 81% 28.7M 1s 2023-10-26T06:44:57.067 INFO:tasks.workunit.client.0.smithi050.stderr:137700K .......... .......... .......... .......... .......... 81% 35.1M 1s 2023-10-26T06:44:57.069 INFO:tasks.workunit.client.0.smithi050.stderr:137750K .......... .......... .......... .......... .......... 81% 23.6M 1s 2023-10-26T06:44:57.071 INFO:tasks.workunit.client.0.smithi050.stderr:137800K .......... .......... .......... .......... .......... 81% 25.0M 1s 2023-10-26T06:44:57.072 INFO:tasks.workunit.client.0.smithi050.stderr:137850K .......... .......... .......... .......... .......... 81% 46.4M 1s 2023-10-26T06:44:57.074 INFO:tasks.workunit.client.0.smithi050.stderr:137900K .......... .......... .......... .......... .......... 81% 22.0M 1s 2023-10-26T06:44:57.076 INFO:tasks.workunit.client.0.smithi050.stderr:137950K .......... .......... .......... .......... .......... 81% 37.3M 1s 2023-10-26T06:44:57.078 INFO:tasks.workunit.client.0.smithi050.stderr:138000K .......... .......... .......... .......... .......... 81% 24.1M 1s 2023-10-26T06:44:57.080 INFO:tasks.workunit.client.0.smithi050.stderr:138050K .......... .......... .......... .......... .......... 81% 22.6M 1s 2023-10-26T06:44:57.081 INFO:tasks.workunit.client.0.smithi050.stderr:138100K .......... .......... .......... .......... .......... 81% 53.0M 1s 2023-10-26T06:44:57.082 INFO:tasks.workunit.client.0.smithi050.stderr:138150K .......... .......... .......... .......... .......... 81% 30.2M 1s 2023-10-26T06:44:57.084 INFO:tasks.workunit.client.0.smithi050.stderr:138200K .......... .......... .......... .......... .......... 82% 28.4M 1s 2023-10-26T06:44:57.086 INFO:tasks.workunit.client.0.smithi050.stderr:138250K .......... .......... .......... .......... .......... 82% 17.3M 1s 2023-10-26T06:44:57.089 INFO:tasks.workunit.client.0.smithi050.stderr:138300K .......... .......... .......... .......... .......... 82% 38.8M 1s 2023-10-26T06:44:57.089 INFO:tasks.workunit.client.0.smithi050.stderr:138350K .......... .......... .......... .......... .......... 82% 41.3M 1s 2023-10-26T06:44:57.091 INFO:tasks.workunit.client.0.smithi050.stderr:138400K .......... .......... .......... .......... .......... 82% 23.0M 1s 2023-10-26T06:44:57.093 INFO:tasks.workunit.client.0.smithi050.stderr:138450K .......... .......... .......... .......... .......... 82% 39.7M 1s 2023-10-26T06:44:57.095 INFO:tasks.workunit.client.0.smithi050.stderr:138500K .......... .......... .......... .......... .......... 82% 23.5M 1s 2023-10-26T06:44:57.097 INFO:tasks.workunit.client.0.smithi050.stderr:138550K .......... .......... .......... .......... .......... 82% 26.3M 1s 2023-10-26T06:44:57.097 INFO:tasks.workunit.client.0.smithi050.stderr:138600K .......... .......... .......... .......... .......... 82% 52.4M 1s 2023-10-26T06:44:57.099 INFO:tasks.workunit.client.0.smithi050.stderr:138650K .......... .......... .......... .......... .......... 82% 20.6M 1s 2023-10-26T06:44:57.101 INFO:tasks.workunit.client.0.smithi050.stderr:138700K .......... .......... .......... .......... .......... 82% 40.7M 1s 2023-10-26T06:44:57.103 INFO:tasks.workunit.client.0.smithi050.stderr:138750K .......... .......... .......... .......... .......... 82% 25.5M 1s 2023-10-26T06:44:57.105 INFO:tasks.workunit.client.0.smithi050.stderr:138800K .......... .......... .......... .......... .......... 82% 25.7M 1s 2023-10-26T06:44:57.106 INFO:tasks.workunit.client.0.smithi050.stderr:138850K .......... .......... .......... .......... .......... 82% 43.4M 1s 2023-10-26T06:44:57.108 INFO:tasks.workunit.client.0.smithi050.stderr:138900K .......... .......... .......... .......... .......... 82% 25.9M 1s 2023-10-26T06:44:57.110 INFO:tasks.workunit.client.0.smithi050.stderr:138950K .......... .......... .......... .......... .......... 82% 29.8M 1s 2023-10-26T06:44:57.112 INFO:tasks.workunit.client.0.smithi050.stderr:139000K .......... .......... .......... .......... .......... 82% 22.2M 1s 2023-10-26T06:44:57.114 INFO:tasks.workunit.client.0.smithi050.stderr:139050K .......... .......... .......... .......... .......... 82% 29.6M 1s 2023-10-26T06:44:57.114 INFO:tasks.workunit.client.0.smithi050.stderr:139100K .......... .......... .......... .......... .......... 82% 47.1M 1s 2023-10-26T06:44:57.116 INFO:tasks.workunit.client.0.smithi050.stderr:139150K .......... .......... .......... .......... .......... 82% 22.4M 1s 2023-10-26T06:44:57.118 INFO:tasks.workunit.client.0.smithi050.stderr:139200K .......... .......... .......... .......... .......... 82% 33.0M 1s 2023-10-26T06:44:57.120 INFO:tasks.workunit.client.0.smithi050.stderr:139250K .......... .......... .......... .......... .......... 82% 27.1M 1s 2023-10-26T06:44:57.122 INFO:tasks.workunit.client.0.smithi050.stderr:139300K .......... .......... .......... .......... .......... 82% 24.5M 1s 2023-10-26T06:44:57.123 INFO:tasks.workunit.client.0.smithi050.stderr:139350K .......... .......... .......... .......... .......... 82% 44.9M 1s 2023-10-26T06:44:57.129 INFO:tasks.workunit.client.0.smithi050.stderr:139400K .......... .......... .......... .......... .......... 82% 24.6M 1s 2023-10-26T06:44:57.130 INFO:tasks.workunit.client.0.smithi050.stderr:139450K .......... .......... .......... .......... .......... 82% 30.5M 1s 2023-10-26T06:44:57.130 INFO:tasks.workunit.client.0.smithi050.stderr:139500K .......... .......... .......... .......... .......... 82% 25.0M 1s 2023-10-26T06:44:57.133 INFO:tasks.workunit.client.0.smithi050.stderr:139550K .......... .......... .......... .......... .......... 82% 23.9M 1s 2023-10-26T06:44:57.133 INFO:tasks.workunit.client.0.smithi050.stderr:139600K .......... .......... .......... .......... .......... 82% 76.0M 1s 2023-10-26T06:44:57.134 INFO:tasks.workunit.client.0.smithi050.stderr:139650K .......... .......... .......... .......... .......... 82% 24.4M 1s 2023-10-26T06:44:57.135 INFO:tasks.workunit.client.0.smithi050.stderr:139700K .......... .......... .......... .......... .......... 82% 25.5M 1s 2023-10-26T06:44:57.137 INFO:tasks.workunit.client.0.smithi050.stderr:139750K .......... .......... .......... .......... .......... 82% 26.2M 1s 2023-10-26T06:44:57.139 INFO:tasks.workunit.client.0.smithi050.stderr:139800K .......... .......... .......... .......... .......... 82% 26.5M 1s 2023-10-26T06:44:57.140 INFO:tasks.workunit.client.0.smithi050.stderr:139850K .......... .......... .......... .......... .......... 82% 38.3M 1s 2023-10-26T06:44:57.142 INFO:tasks.workunit.client.0.smithi050.stderr:139900K .......... .......... .......... .......... .......... 83% 19.6M 1s 2023-10-26T06:44:57.144 INFO:tasks.workunit.client.0.smithi050.stderr:139950K .......... .......... .......... .......... .......... 83% 33.5M 1s 2023-10-26T06:44:57.146 INFO:tasks.workunit.client.0.smithi050.stderr:140000K .......... .......... .......... .......... .......... 83% 28.8M 1s 2023-10-26T06:44:57.148 INFO:tasks.workunit.client.0.smithi050.stderr:140050K .......... .......... .......... .......... .......... 83% 21.8M 1s 2023-10-26T06:44:57.149 INFO:tasks.workunit.client.0.smithi050.stderr:140100K .......... .......... .......... .......... .......... 83% 57.8M 1s 2023-10-26T06:44:57.151 INFO:tasks.workunit.client.0.smithi050.stderr:140150K .......... .......... .......... .......... .......... 83% 26.9M 1s 2023-10-26T06:44:57.152 INFO:tasks.workunit.client.0.smithi050.stderr:140200K .......... .......... .......... .......... .......... 83% 25.7M 1s 2023-10-26T06:44:57.154 INFO:tasks.workunit.client.0.smithi050.stderr:140250K .......... .......... .......... .......... .......... 83% 26.0M 1s 2023-10-26T06:44:57.157 INFO:tasks.workunit.client.0.smithi050.stderr:140300K .......... .......... .......... .......... .......... 83% 21.8M 1s 2023-10-26T06:44:57.157 INFO:tasks.workunit.client.0.smithi050.stderr:140350K .......... .......... .......... .......... .......... 83% 77.3M 1s 2023-10-26T06:44:57.159 INFO:tasks.workunit.client.0.smithi050.stderr:140400K .......... .......... .......... .......... .......... 83% 28.3M 1s 2023-10-26T06:44:57.161 INFO:tasks.workunit.client.0.smithi050.stderr:140450K .......... .......... .......... .......... .......... 83% 19.2M 1s 2023-10-26T06:44:57.163 INFO:tasks.workunit.client.0.smithi050.stderr:140500K .......... .......... .......... .......... .......... 83% 28.7M 1s 2023-10-26T06:44:57.165 INFO:tasks.workunit.client.0.smithi050.stderr:140550K .......... .......... .......... .......... .......... 83% 22.9M 1s 2023-10-26T06:44:57.172 INFO:tasks.workunit.client.0.smithi050.stderr:140600K .......... .......... .......... .......... .......... 83% 24.9M 1s 2023-10-26T06:44:57.173 INFO:tasks.workunit.client.0.smithi050.stderr:140650K .......... .......... .......... .......... .......... 83% 40.1M 1s 2023-10-26T06:44:57.173 INFO:tasks.workunit.client.0.smithi050.stderr:140700K .......... .......... .......... .......... .......... 83% 37.3M 1s 2023-10-26T06:44:57.173 INFO:tasks.workunit.client.0.smithi050.stderr:140750K .......... .......... .......... .......... .......... 83% 26.1M 1s 2023-10-26T06:44:57.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:56 smithi125 ceph-mon[130643]: pgmap v357: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-10-26T06:44:57.180 INFO:tasks.workunit.client.0.smithi050.stderr:140800K .......... .......... .......... .......... .......... 83% 27.6M 1s 2023-10-26T06:44:57.180 INFO:tasks.workunit.client.0.smithi050.stderr:140850K .......... .......... .......... .......... .......... 83% 54.5M 1s 2023-10-26T06:44:57.181 INFO:tasks.workunit.client.0.smithi050.stderr:140900K .......... .......... .......... .......... .......... 83% 25.5M 1s 2023-10-26T06:44:57.181 INFO:tasks.workunit.client.0.smithi050.stderr:140950K .......... .......... .......... .......... .......... 83% 20.8M 1s 2023-10-26T06:44:57.181 INFO:tasks.workunit.client.0.smithi050.stderr:141000K .......... .......... .......... .......... .......... 83% 37.0M 1s 2023-10-26T06:44:57.183 INFO:tasks.workunit.client.0.smithi050.stderr:141050K .......... .......... .......... .......... .......... 83% 23.1M 1s 2023-10-26T06:44:57.185 INFO:tasks.workunit.client.0.smithi050.stderr:141100K .......... .......... .......... .......... .......... 83% 45.5M 1s 2023-10-26T06:44:57.185 INFO:tasks.workunit.client.0.smithi050.stderr:141150K .......... .......... .......... .......... .......... 83% 27.6M 1s 2023-10-26T06:44:57.187 INFO:tasks.workunit.client.0.smithi050.stderr:141200K .......... .......... .......... .......... .......... 83% 24.8M 1s 2023-10-26T06:44:57.189 INFO:tasks.workunit.client.0.smithi050.stderr:141250K .......... .......... .......... .......... .......... 83% 31.2M 1s 2023-10-26T06:44:57.190 INFO:tasks.workunit.client.0.smithi050.stderr:141300K .......... .......... .......... .......... .......... 83% 24.6M 1s 2023-10-26T06:44:57.192 INFO:tasks.workunit.client.0.smithi050.stderr:141350K .......... .......... .......... .......... .......... 83% 24.7M 1s 2023-10-26T06:44:57.193 INFO:tasks.workunit.client.0.smithi050.stderr:141400K .......... .......... .......... .......... .......... 83% 48.2M 1s 2023-10-26T06:44:57.195 INFO:tasks.workunit.client.0.smithi050.stderr:141450K .......... .......... .......... .......... .......... 83% 23.6M 1s 2023-10-26T06:44:57.197 INFO:tasks.workunit.client.0.smithi050.stderr:141500K .......... .......... .......... .......... .......... 83% 36.1M 1s 2023-10-26T06:44:57.199 INFO:tasks.workunit.client.0.smithi050.stderr:141550K .......... .......... .......... .......... .......... 84% 24.9M 1s 2023-10-26T06:44:57.201 INFO:tasks.workunit.client.0.smithi050.stderr:141600K .......... .......... .......... .......... .......... 84% 23.8M 1s 2023-10-26T06:44:57.202 INFO:tasks.workunit.client.0.smithi050.stderr:141650K .......... .......... .......... .......... .......... 84% 52.6M 1s 2023-10-26T06:44:57.204 INFO:tasks.workunit.client.0.smithi050.stderr:141700K .......... .......... .......... .......... .......... 84% 23.9M 1s 2023-10-26T06:44:57.206 INFO:tasks.workunit.client.0.smithi050.stderr:141750K .......... .......... .......... .......... .......... 84% 36.7M 1s 2023-10-26T06:44:57.208 INFO:tasks.workunit.client.0.smithi050.stderr:141800K .......... .......... .......... .......... .......... 84% 24.5M 1s 2023-10-26T06:44:57.209 INFO:tasks.workunit.client.0.smithi050.stderr:141850K .......... .......... .......... .......... .......... 84% 24.5M 1s 2023-10-26T06:44:57.211 INFO:tasks.workunit.client.0.smithi050.stderr:141900K .......... .......... .......... .......... .......... 84% 45.9M 1s 2023-10-26T06:44:57.212 INFO:tasks.workunit.client.0.smithi050.stderr:141950K .......... .......... .......... .......... .......... 84% 24.1M 1s 2023-10-26T06:44:57.214 INFO:tasks.workunit.client.0.smithi050.stderr:142000K .......... .......... .......... .......... .......... 84% 37.4M 1s 2023-10-26T06:44:57.216 INFO:tasks.workunit.client.0.smithi050.stderr:142050K .......... .......... .......... .......... .......... 84% 22.7M 1s 2023-10-26T06:44:57.217 INFO:tasks.workunit.client.0.smithi050.stderr:142100K .......... .......... .......... .......... .......... 84% 25.1M 1s 2023-10-26T06:44:57.219 INFO:tasks.workunit.client.0.smithi050.stderr:142150K .......... .......... .......... .......... .......... 84% 44.6M 1s 2023-10-26T06:44:57.221 INFO:tasks.workunit.client.0.smithi050.stderr:142200K .......... .......... .......... .......... .......... 84% 25.8M 1s 2023-10-26T06:44:57.222 INFO:tasks.workunit.client.0.smithi050.stderr:142250K .......... .......... .......... .......... .......... 84% 30.4M 1s 2023-10-26T06:44:57.224 INFO:tasks.workunit.client.0.smithi050.stderr:142300K .......... .......... .......... .......... .......... 84% 24.5M 1s 2023-10-26T06:44:57.226 INFO:tasks.workunit.client.0.smithi050.stderr:142350K .......... .......... .......... .......... .......... 84% 21.6M 1s 2023-10-26T06:44:57.227 INFO:tasks.workunit.client.0.smithi050.stderr:142400K .......... .......... .......... .......... .......... 84% 45.5M 1s 2023-10-26T06:44:57.229 INFO:tasks.workunit.client.0.smithi050.stderr:142450K .......... .......... .......... .......... .......... 84% 24.2M 1s 2023-10-26T06:44:57.231 INFO:tasks.workunit.client.0.smithi050.stderr:142500K .......... .......... .......... .......... .......... 84% 37.4M 1s 2023-10-26T06:44:57.233 INFO:tasks.workunit.client.0.smithi050.stderr:142550K .......... .......... .......... .......... .......... 84% 22.5M 1s 2023-10-26T06:44:57.236 INFO:tasks.workunit.client.0.smithi050.stderr:142600K .......... .......... .......... .......... .......... 84% 23.9M 1s 2023-10-26T06:44:57.236 INFO:tasks.workunit.client.0.smithi050.stderr:142650K .......... .......... .......... .......... .......... 84% 46.9M 1s 2023-10-26T06:44:57.238 INFO:tasks.workunit.client.0.smithi050.stderr:142700K .......... .......... .......... .......... .......... 84% 21.4M 1s 2023-10-26T06:44:57.240 INFO:tasks.workunit.client.0.smithi050.stderr:142750K .......... .......... .......... .......... .......... 84% 40.4M 1s 2023-10-26T06:44:57.243 INFO:tasks.workunit.client.0.smithi050.stderr:142800K .......... .......... .......... .......... .......... 84% 22.3M 1s 2023-10-26T06:44:57.245 INFO:tasks.workunit.client.0.smithi050.stderr:142850K .......... .......... .......... .......... .......... 84% 23.7M 1s 2023-10-26T06:44:57.245 INFO:tasks.workunit.client.0.smithi050.stderr:142900K .......... .......... .......... .......... .......... 84% 44.3M 1s 2023-10-26T06:44:57.247 INFO:tasks.workunit.client.0.smithi050.stderr:142950K .......... .......... .......... .......... .......... 84% 17.7M 1s 2023-10-26T06:44:57.251 INFO:tasks.workunit.client.0.smithi050.stderr:143000K .......... .......... .......... .......... .......... 84% 39.3M 1s 2023-10-26T06:44:57.251 INFO:tasks.workunit.client.0.smithi050.stderr:143050K .......... .......... .......... .......... .......... 84% 37.4M 1s 2023-10-26T06:44:57.253 INFO:tasks.workunit.client.0.smithi050.stderr:143100K .......... .......... .......... .......... .......... 84% 23.1M 1s 2023-10-26T06:44:57.253 INFO:tasks.workunit.client.0.smithi050.stderr:143150K .......... .......... .......... .......... .......... 84% 46.2M 1s 2023-10-26T06:44:57.255 INFO:tasks.workunit.client.0.smithi050.stderr:143200K .......... .......... .......... .......... .......... 84% 24.6M 1s 2023-10-26T06:44:57.256 INFO:tasks.workunit.client.0.smithi050.stderr:143250K .......... .......... .......... .......... .......... 85% 37.1M 1s 2023-10-26T06:44:57.259 INFO:tasks.workunit.client.0.smithi050.stderr:143300K .......... .......... .......... .......... .......... 85% 24.7M 1s 2023-10-26T06:44:57.262 INFO:tasks.workunit.client.0.smithi050.stderr:143350K .......... .......... .......... .......... .......... 85% 24.2M 1s 2023-10-26T06:44:57.262 INFO:tasks.workunit.client.0.smithi050.stderr:143400K .......... .......... .......... .......... .......... 85% 44.9M 1s 2023-10-26T06:44:57.264 INFO:tasks.workunit.client.0.smithi050.stderr:143450K .......... .......... .......... .......... .......... 85% 23.5M 1s 2023-10-26T06:44:57.266 INFO:tasks.workunit.client.0.smithi050.stderr:143500K .......... .......... .......... .......... .......... 85% 27.7M 1s 2023-10-26T06:44:57.269 INFO:tasks.workunit.client.0.smithi050.stderr:143550K .......... .......... .......... .......... .......... 85% 27.7M 1s 2023-10-26T06:44:57.269 INFO:tasks.workunit.client.0.smithi050.stderr:143600K .......... .......... .......... .......... .......... 85% 42.6M 1s 2023-10-26T06:44:57.272 INFO:tasks.workunit.client.0.smithi050.stderr:143650K .......... .......... .......... .......... .......... 85% 30.3M 1s 2023-10-26T06:44:57.272 INFO:tasks.workunit.client.0.smithi050.stderr:143700K .......... .......... .......... .......... .......... 85% 23.5M 1s 2023-10-26T06:44:57.277 INFO:tasks.workunit.client.0.smithi050.stderr:143750K .......... .......... .......... .......... .......... 85% 33.3M 1s 2023-10-26T06:44:57.277 INFO:tasks.workunit.client.0.smithi050.stderr:143800K .......... .......... .......... .......... .......... 85% 20.6M 1s 2023-10-26T06:44:57.277 INFO:tasks.workunit.client.0.smithi050.stderr:143850K .......... .......... .......... .......... .......... 85% 43.3M 1s 2023-10-26T06:44:57.279 INFO:tasks.workunit.client.0.smithi050.stderr:143900K .......... .......... .......... .......... .......... 85% 33.2M 1s 2023-10-26T06:44:57.281 INFO:tasks.workunit.client.0.smithi050.stderr:143950K .......... .......... .......... .......... .......... 85% 24.8M 1s 2023-10-26T06:44:57.283 INFO:tasks.workunit.client.0.smithi050.stderr:144000K .......... .......... .......... .......... .......... 85% 27.8M 1s 2023-10-26T06:44:57.285 INFO:tasks.workunit.client.0.smithi050.stderr:144050K .......... .......... .......... .......... .......... 85% 25.2M 1s 2023-10-26T06:44:57.285 INFO:tasks.workunit.client.0.smithi050.stderr:144100K .......... .......... .......... .......... .......... 85% 66.2M 1s 2023-10-26T06:44:57.287 INFO:tasks.workunit.client.0.smithi050.stderr:144150K .......... .......... .......... .......... .......... 85% 25.7M 1s 2023-10-26T06:44:57.289 INFO:tasks.workunit.client.0.smithi050.stderr:144200K .......... .......... .......... .......... .......... 85% 23.7M 1s 2023-10-26T06:44:57.292 INFO:tasks.workunit.client.0.smithi050.stderr:144250K .......... .......... .......... .......... .......... 85% 28.0M 1s 2023-10-26T06:44:57.293 INFO:tasks.workunit.client.0.smithi050.stderr:144300K .......... .......... .......... .......... .......... 85% 43.9M 1s 2023-10-26T06:44:57.294 INFO:tasks.workunit.client.0.smithi050.stderr:144350K .......... .......... .......... .......... .......... 85% 27.2M 1s 2023-10-26T06:44:57.296 INFO:tasks.workunit.client.0.smithi050.stderr:144400K .......... .......... .......... .......... .......... 85% 30.5M 1s 2023-10-26T06:44:57.298 INFO:tasks.workunit.client.0.smithi050.stderr:144450K .......... .......... .......... .......... .......... 85% 23.0M 1s 2023-10-26T06:44:57.300 INFO:tasks.workunit.client.0.smithi050.stderr:144500K .......... .......... .......... .......... .......... 85% 24.6M 1s 2023-10-26T06:44:57.302 INFO:tasks.workunit.client.0.smithi050.stderr:144550K .......... .......... .......... .......... .......... 85% 23.8M 1s 2023-10-26T06:44:57.303 INFO:tasks.workunit.client.0.smithi050.stderr:144600K .......... .......... .......... .......... .......... 85% 37.6M 1s 2023-10-26T06:44:57.304 INFO:tasks.workunit.client.0.smithi050.stderr:144650K .......... .......... .......... .......... .......... 85% 36.4M 1s 2023-10-26T06:44:57.306 INFO:tasks.workunit.client.0.smithi050.stderr:144700K .......... .......... .......... .......... .......... 85% 22.1M 1s 2023-10-26T06:44:57.308 INFO:tasks.workunit.client.0.smithi050.stderr:144750K .......... .......... .......... .......... .......... 85% 31.2M 1s 2023-10-26T06:44:57.310 INFO:tasks.workunit.client.0.smithi050.stderr:144800K .......... .......... .......... .......... .......... 85% 24.8M 1s 2023-10-26T06:44:57.311 INFO:tasks.workunit.client.0.smithi050.stderr:144850K .......... .......... .......... .......... .......... 85% 51.3M 1s 2023-10-26T06:44:57.313 INFO:tasks.workunit.client.0.smithi050.stderr:144900K .......... .......... .......... .......... .......... 85% 27.9M 1s 2023-10-26T06:44:57.315 INFO:tasks.workunit.client.0.smithi050.stderr:144950K .......... .......... .......... .......... .......... 86% 25.0M 1s 2023-10-26T06:44:57.317 INFO:tasks.workunit.client.0.smithi050.stderr:145000K .......... .......... .......... .......... .......... 86% 24.2M 1s 2023-10-26T06:44:57.319 INFO:tasks.workunit.client.0.smithi050.stderr:145050K .......... .......... .......... .......... .......... 86% 23.7M 1s 2023-10-26T06:44:57.320 INFO:tasks.workunit.client.0.smithi050.stderr:145100K .......... .......... .......... .......... .......... 86% 33.2M 1s 2023-10-26T06:44:57.321 INFO:tasks.workunit.client.0.smithi050.stderr:145150K .......... .......... .......... .......... .......... 86% 37.7M 1s 2023-10-26T06:44:57.323 INFO:tasks.workunit.client.0.smithi050.stderr:145200K .......... .......... .......... .......... .......... 86% 26.3M 1s 2023-10-26T06:44:57.326 INFO:tasks.workunit.client.0.smithi050.stderr:145250K .......... .......... .......... .......... .......... 86% 26.6M 1s 2023-10-26T06:44:57.328 INFO:tasks.workunit.client.0.smithi050.stderr:145300K .......... .......... .......... .......... .......... 86% 17.3M 1s 2023-10-26T06:44:57.329 INFO:tasks.workunit.client.0.smithi050.stderr:145350K .......... .......... .......... .......... .......... 86% 58.6M 1s 2023-10-26T06:44:57.332 INFO:tasks.workunit.client.0.smithi050.stderr:145400K .......... .......... .......... .......... .......... 86% 44.7M 1s 2023-10-26T06:44:57.332 INFO:tasks.workunit.client.0.smithi050.stderr:145450K .......... .......... .......... .......... .......... 86% 24.6M 1s 2023-10-26T06:44:57.334 INFO:tasks.workunit.client.0.smithi050.stderr:145500K .......... .......... .......... .......... .......... 86% 23.4M 1s 2023-10-26T06:44:57.336 INFO:tasks.workunit.client.0.smithi050.stderr:145550K .......... .......... .......... .......... .......... 86% 28.0M 1s 2023-10-26T06:44:57.337 INFO:tasks.workunit.client.0.smithi050.stderr:145600K .......... .......... .......... .......... .......... 86% 51.6M 1s 2023-10-26T06:44:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:145650K .......... .......... .......... .......... .......... 86% 30.9M 1s 2023-10-26T06:44:57.341 INFO:tasks.workunit.client.0.smithi050.stderr:145700K .......... .......... .......... .......... .......... 86% 24.7M 1s 2023-10-26T06:44:57.343 INFO:tasks.workunit.client.0.smithi050.stderr:145750K .......... .......... .......... .......... .......... 86% 21.6M 1s 2023-10-26T06:44:57.345 INFO:tasks.workunit.client.0.smithi050.stderr:145800K .......... .......... .......... .......... .......... 86% 28.4M 1s 2023-10-26T06:44:57.345 INFO:tasks.workunit.client.0.smithi050.stderr:145850K .......... .......... .......... .......... .......... 86% 50.6M 1s 2023-10-26T06:44:57.348 INFO:tasks.workunit.client.0.smithi050.stderr:145900K .......... .......... .......... .......... .......... 86% 31.2M 1s 2023-10-26T06:44:57.349 INFO:tasks.workunit.client.0.smithi050.stderr:145950K .......... .......... .......... .......... .......... 86% 23.6M 1s 2023-10-26T06:44:57.350 INFO:tasks.workunit.client.0.smithi050.stderr:146000K .......... .......... .......... .......... .......... 86% 23.9M 1s 2023-10-26T06:44:57.353 INFO:tasks.workunit.client.0.smithi050.stderr:146050K .......... .......... .......... .......... .......... 86% 24.9M 1s 2023-10-26T06:44:57.354 INFO:tasks.workunit.client.0.smithi050.stderr:146100K .......... .......... .......... .......... .......... 86% 35.2M 1s 2023-10-26T06:44:57.356 INFO:tasks.workunit.client.0.smithi050.stderr:146150K .......... .......... .......... .......... .......... 86% 40.9M 1s 2023-10-26T06:44:57.358 INFO:tasks.workunit.client.0.smithi050.stderr:146200K .......... .......... .......... .......... .......... 86% 25.3M 1s 2023-10-26T06:44:57.360 INFO:tasks.workunit.client.0.smithi050.stderr:146250K .......... .......... .......... .......... .......... 86% 25.5M 1s 2023-10-26T06:44:57.361 INFO:tasks.workunit.client.0.smithi050.stderr:146300K .......... .......... .......... .......... .......... 86% 32.6M 1s 2023-10-26T06:44:57.364 INFO:tasks.workunit.client.0.smithi050.stderr:146350K .......... .......... .......... .......... .......... 86% 24.6M 1s 2023-10-26T06:44:57.364 INFO:tasks.workunit.client.0.smithi050.stderr:146400K .......... .......... .......... .......... .......... 86% 49.8M 1s 2023-10-26T06:44:57.365 INFO:tasks.workunit.client.0.smithi050.stderr:146450K .......... .......... .......... .......... .......... 86% 24.4M 1s 2023-10-26T06:44:57.367 INFO:tasks.workunit.client.0.smithi050.stderr:146500K .......... .......... .......... .......... .......... 86% 22.9M 1s 2023-10-26T06:44:57.370 INFO:tasks.workunit.client.0.smithi050.stderr:146550K .......... .......... .......... .......... .......... 86% 32.3M 1s 2023-10-26T06:44:57.371 INFO:tasks.workunit.client.0.smithi050.stderr:146600K .......... .......... .......... .......... .......... 86% 25.3M 1s 2023-10-26T06:44:57.373 INFO:tasks.workunit.client.0.smithi050.stderr:146650K .......... .......... .......... .......... .......... 87% 24.4M 1s 2023-10-26T06:44:57.374 INFO:tasks.workunit.client.0.smithi050.stderr:146700K .......... .......... .......... .......... .......... 87% 41.2M 1s 2023-10-26T06:44:57.376 INFO:tasks.workunit.client.0.smithi050.stderr:146750K .......... .......... .......... .......... .......... 87% 24.6M 1s 2023-10-26T06:44:57.378 INFO:tasks.workunit.client.0.smithi050.stderr:146800K .......... .......... .......... .......... .......... 87% 37.2M 1s 2023-10-26T06:44:57.381 INFO:tasks.workunit.client.0.smithi050.stderr:146850K .......... .......... .......... .......... .......... 87% 24.2M 1s 2023-10-26T06:44:57.381 INFO:tasks.workunit.client.0.smithi050.stderr:146900K .......... .......... .......... .......... .......... 87% 32.6M 1s 2023-10-26T06:44:57.382 INFO:tasks.workunit.client.0.smithi050.stderr:146950K .......... .......... .......... .......... .......... 87% 32.2M 1s 2023-10-26T06:44:57.384 INFO:tasks.workunit.client.0.smithi050.stderr:147000K .......... .......... .......... .......... .......... 87% 23.5M 1s 2023-10-26T06:44:57.387 INFO:tasks.workunit.client.0.smithi050.stderr:147050K .......... .......... .......... .......... .......... 87% 35.8M 1s 2023-10-26T06:44:57.389 INFO:tasks.workunit.client.0.smithi050.stderr:147100K .......... .......... .......... .......... .......... 87% 24.4M 1s 2023-10-26T06:44:57.391 INFO:tasks.workunit.client.0.smithi050.stderr:147150K .......... .......... .......... .......... .......... 87% 26.7M 1s 2023-10-26T06:44:57.391 INFO:tasks.workunit.client.0.smithi050.stderr:147200K .......... .......... .......... .......... .......... 87% 45.4M 1s 2023-10-26T06:44:57.393 INFO:tasks.workunit.client.0.smithi050.stderr:147250K .......... .......... .......... .......... .......... 87% 22.8M 1s 2023-10-26T06:44:57.395 INFO:tasks.workunit.client.0.smithi050.stderr:147300K .......... .......... .......... .......... .......... 87% 41.2M 1s 2023-10-26T06:44:57.397 INFO:tasks.workunit.client.0.smithi050.stderr:147350K .......... .......... .......... .......... .......... 87% 22.4M 1s 2023-10-26T06:44:57.399 INFO:tasks.workunit.client.0.smithi050.stderr:147400K .......... .......... .......... .......... .......... 87% 31.8M 1s 2023-10-26T06:44:57.399 INFO:tasks.workunit.client.0.smithi050.stderr:147450K .......... .......... .......... .......... .......... 87% 35.0M 1s 2023-10-26T06:44:57.401 INFO:tasks.workunit.client.0.smithi050.stderr:147500K .......... .......... .......... .......... .......... 87% 35.3M 1s 2023-10-26T06:44:57.403 INFO:tasks.workunit.client.0.smithi050.stderr:147550K .......... .......... .......... .......... .......... 87% 24.3M 1s 2023-10-26T06:44:57.405 INFO:tasks.workunit.client.0.smithi050.stderr:147600K .......... .......... .......... .......... .......... 87% 24.5M 1s 2023-10-26T06:44:57.407 INFO:tasks.workunit.client.0.smithi050.stderr:147650K .......... .......... .......... .......... .......... 87% 23.5M 1s 2023-10-26T06:44:57.408 INFO:tasks.workunit.client.0.smithi050.stderr:147700K .......... .......... .......... .......... .......... 87% 52.4M 1s 2023-10-26T06:44:57.410 INFO:tasks.workunit.client.0.smithi050.stderr:147750K .......... .......... .......... .......... .......... 87% 24.2M 1s 2023-10-26T06:44:57.411 INFO:tasks.workunit.client.0.smithi050.stderr:147800K .......... .......... .......... .......... .......... 87% 38.6M 1s 2023-10-26T06:44:57.421 INFO:tasks.workunit.client.0.smithi050.stderr:147850K .......... .......... .......... .......... .......... 87% 21.6M 1s 2023-10-26T06:44:57.421 INFO:tasks.workunit.client.0.smithi050.stderr:147900K .......... .......... .......... .......... .......... 87% 27.1M 1s 2023-10-26T06:44:57.421 INFO:tasks.workunit.client.0.smithi050.stderr:147950K .......... .......... .......... .......... .......... 87% 45.4M 1s 2023-10-26T06:44:57.422 INFO:tasks.workunit.client.0.smithi050.stderr:148000K .......... .......... .......... .......... .......... 87% 20.7M 1s 2023-10-26T06:44:57.422 INFO:tasks.workunit.client.0.smithi050.stderr:148050K .......... .......... .......... .......... .......... 87% 38.2M 1s 2023-10-26T06:44:57.425 INFO:tasks.workunit.client.0.smithi050.stderr:148100K .......... .......... .......... .......... .......... 87% 21.2M 1s 2023-10-26T06:44:57.426 INFO:tasks.workunit.client.0.smithi050.stderr:148150K .......... .......... .......... .......... .......... 87% 28.1M 1s 2023-10-26T06:44:57.426 INFO:tasks.workunit.client.0.smithi050.stderr:148200K .......... .......... .......... .......... .......... 87% 34.8M 1s 2023-10-26T06:44:57.427 INFO:tasks.workunit.client.0.smithi050.stderr:148250K .......... .......... .......... .......... .......... 87% 21.5M 1s 2023-10-26T06:44:57.431 INFO:tasks.workunit.client.0.smithi050.stderr:148300K .......... .......... .......... .......... .......... 88% 39.1M 1s 2023-10-26T06:44:57.432 INFO:tasks.workunit.client.0.smithi050.stderr:148350K .......... .......... .......... .......... .......... 88% 23.4M 1s 2023-10-26T06:44:57.435 INFO:tasks.workunit.client.0.smithi050.stderr:148400K .......... .......... .......... .......... .......... 88% 28.7M 1s 2023-10-26T06:44:57.435 INFO:tasks.workunit.client.0.smithi050.stderr:148450K .......... .......... .......... .......... .......... 88% 42.3M 1s 2023-10-26T06:44:57.439 INFO:tasks.workunit.client.0.smithi050.stderr:148500K .......... .......... .......... .......... .......... 88% 22.3M 1s 2023-10-26T06:44:57.439 INFO:tasks.workunit.client.0.smithi050.stderr:148550K .......... .......... .......... .......... .......... 88% 38.7M 1s 2023-10-26T06:44:57.439 INFO:tasks.workunit.client.0.smithi050.stderr:148600K .......... .......... .......... .......... .......... 88% 27.3M 1s 2023-10-26T06:44:57.442 INFO:tasks.workunit.client.0.smithi050.stderr:148650K .......... .......... .......... .......... .......... 88% 21.6M 1s 2023-10-26T06:44:57.442 INFO:tasks.workunit.client.0.smithi050.stderr:148700K .......... .......... .......... .......... .......... 88% 36.5M 1s 2023-10-26T06:44:57.444 INFO:tasks.workunit.client.0.smithi050.stderr:148750K .......... .......... .......... .......... .......... 88% 27.7M 1s 2023-10-26T06:44:57.447 INFO:tasks.workunit.client.0.smithi050.stderr:148800K .......... .......... .......... .......... .......... 88% 28.9M 1s 2023-10-26T06:44:57.449 INFO:tasks.workunit.client.0.smithi050.stderr:148850K .......... .......... .......... .......... .......... 88% 25.3M 1s 2023-10-26T06:44:57.451 INFO:tasks.workunit.client.0.smithi050.stderr:148900K .......... .......... .......... .......... .......... 88% 23.1M 1s 2023-10-26T06:44:57.451 INFO:tasks.workunit.client.0.smithi050.stderr:148950K .......... .......... .......... .......... .......... 88% 53.4M 1s 2023-10-26T06:44:57.453 INFO:tasks.workunit.client.0.smithi050.stderr:149000K .......... .......... .......... .......... .......... 88% 21.3M 1s 2023-10-26T06:44:57.455 INFO:tasks.workunit.client.0.smithi050.stderr:149050K .......... .......... .......... .......... .......... 88% 37.5M 1s 2023-10-26T06:44:57.456 INFO:tasks.workunit.client.0.smithi050.stderr:149100K .......... .......... .......... .......... .......... 88% 25.5M 1s 2023-10-26T06:44:57.459 INFO:tasks.workunit.client.0.smithi050.stderr:149150K .......... .......... .......... .......... .......... 88% 24.0M 1s 2023-10-26T06:44:57.460 INFO:tasks.workunit.client.0.smithi050.stderr:149200K .......... .......... .......... .......... .......... 88% 45.1M 1s 2023-10-26T06:44:57.461 INFO:tasks.workunit.client.0.smithi050.stderr:149250K .......... .......... .......... .......... .......... 88% 24.3M 1s 2023-10-26T06:44:57.463 INFO:tasks.workunit.client.0.smithi050.stderr:149300K .......... .......... .......... .......... .......... 88% 23.9M 1s 2023-10-26T06:44:57.465 INFO:tasks.workunit.client.0.smithi050.stderr:149350K .......... .......... .......... .......... .......... 88% 38.7M 1s 2023-10-26T06:44:57.467 INFO:tasks.workunit.client.0.smithi050.stderr:149400K .......... .......... .......... .......... .......... 88% 24.8M 1s 2023-10-26T06:44:57.468 INFO:tasks.workunit.client.0.smithi050.stderr:149450K .......... .......... .......... .......... .......... 88% 42.2M 1s 2023-10-26T06:44:57.470 INFO:tasks.workunit.client.0.smithi050.stderr:149500K .......... .......... .......... .......... .......... 88% 24.3M 1s 2023-10-26T06:44:57.472 INFO:tasks.workunit.client.0.smithi050.stderr:149550K .......... .......... .......... .......... .......... 88% 40.3M 1s 2023-10-26T06:44:57.474 INFO:tasks.workunit.client.0.smithi050.stderr:149600K .......... .......... .......... .......... .......... 88% 23.6M 1s 2023-10-26T06:44:57.476 INFO:tasks.workunit.client.0.smithi050.stderr:149650K .......... .......... .......... .......... .......... 88% 24.8M 1s 2023-10-26T06:44:57.477 INFO:tasks.workunit.client.0.smithi050.stderr:149700K .......... .......... .......... .......... .......... 88% 36.7M 1s 2023-10-26T06:44:57.478 INFO:tasks.workunit.client.0.smithi050.stderr:149750K .......... .......... .......... .......... .......... 88% 24.9M 1s 2023-10-26T06:44:57.480 INFO:tasks.workunit.client.0.smithi050.stderr:149800K .......... .......... .......... .......... .......... 88% 36.9M 1s 2023-10-26T06:44:57.482 INFO:tasks.workunit.client.0.smithi050.stderr:149850K .......... .......... .......... .......... .......... 88% 23.6M 1s 2023-10-26T06:44:57.484 INFO:tasks.workunit.client.0.smithi050.stderr:149900K .......... .......... .......... .......... .......... 88% 23.3M 1s 2023-10-26T06:44:57.485 INFO:tasks.workunit.client.0.smithi050.stderr:149950K .......... .......... .......... .......... .......... 88% 41.9M 1s 2023-10-26T06:44:57.487 INFO:tasks.workunit.client.0.smithi050.stderr:150000K .......... .......... .......... .......... .......... 89% 22.1M 1s 2023-10-26T06:44:57.489 INFO:tasks.workunit.client.0.smithi050.stderr:150050K .......... .......... .......... .......... .......... 89% 35.7M 1s 2023-10-26T06:44:57.491 INFO:tasks.workunit.client.0.smithi050.stderr:150100K .......... .......... .......... .......... .......... 89% 25.7M 1s 2023-10-26T06:44:57.493 INFO:tasks.workunit.client.0.smithi050.stderr:150150K .......... .......... .......... .......... .......... 89% 20.8M 1s 2023-10-26T06:44:57.494 INFO:tasks.workunit.client.0.smithi050.stderr:150200K .......... .......... .......... .......... .......... 89% 40.1M 1s 2023-10-26T06:44:57.496 INFO:tasks.workunit.client.0.smithi050.stderr:150250K .......... .......... .......... .......... .......... 89% 28.0M 1s 2023-10-26T06:44:57.498 INFO:tasks.workunit.client.0.smithi050.stderr:150300K .......... .......... .......... .......... .......... 89% 22.9M 1s 2023-10-26T06:44:57.500 INFO:tasks.workunit.client.0.smithi050.stderr:150350K .......... .......... .......... .......... .......... 89% 30.0M 1s 2023-10-26T06:44:57.502 INFO:tasks.workunit.client.0.smithi050.stderr:150400K .......... .......... .......... .......... .......... 89% 28.4M 1s 2023-10-26T06:44:57.503 INFO:tasks.workunit.client.0.smithi050.stderr:150450K .......... .......... .......... .......... .......... 89% 50.6M 1s 2023-10-26T06:44:57.505 INFO:tasks.workunit.client.0.smithi050.stderr:150500K .......... .......... .......... .......... .......... 89% 20.8M 1s 2023-10-26T06:44:57.507 INFO:tasks.workunit.client.0.smithi050.stderr:150550K .......... .......... .......... .......... .......... 89% 35.6M 1s 2023-10-26T06:44:57.509 INFO:tasks.workunit.client.0.smithi050.stderr:150600K .......... .......... .......... .......... .......... 89% 21.9M 1s 2023-10-26T06:44:57.510 INFO:tasks.workunit.client.0.smithi050.stderr:150650K .......... .......... .......... .......... .......... 89% 26.3M 1s 2023-10-26T06:44:57.511 INFO:tasks.workunit.client.0.smithi050.stderr:150700K .......... .......... .......... .......... .......... 89% 43.4M 1s 2023-10-26T06:44:57.515 INFO:tasks.workunit.client.0.smithi050.stderr:150750K .......... .......... .......... .......... .......... 89% 28.4M 1s 2023-10-26T06:44:57.516 INFO:tasks.workunit.client.0.smithi050.stderr:150800K .......... .......... .......... .......... .......... 89% 28.6M 1s 2023-10-26T06:44:57.517 INFO:tasks.workunit.client.0.smithi050.stderr:150850K .......... .......... .......... .......... .......... 89% 26.0M 1s 2023-10-26T06:44:57.519 INFO:tasks.workunit.client.0.smithi050.stderr:150900K .......... .......... .......... .......... .......... 89% 24.9M 1s 2023-10-26T06:44:57.520 INFO:tasks.workunit.client.0.smithi050.stderr:150950K .......... .......... .......... .......... .......... 89% 45.1M 1s 2023-10-26T06:44:57.522 INFO:tasks.workunit.client.0.smithi050.stderr:151000K .......... .......... .......... .......... .......... 89% 25.1M 1s 2023-10-26T06:44:57.523 INFO:tasks.workunit.client.0.smithi050.stderr:151050K .......... .......... .......... .......... .......... 89% 32.8M 1s 2023-10-26T06:44:57.526 INFO:tasks.workunit.client.0.smithi050.stderr:151100K .......... .......... .......... .......... .......... 89% 25.8M 1s 2023-10-26T06:44:57.526 INFO:tasks.workunit.client.0.smithi050.stderr:151150K .......... .......... .......... .......... .......... 89% 34.6M 1s 2023-10-26T06:44:57.530 INFO:tasks.workunit.client.0.smithi050.stderr:151200K .......... .......... .......... .......... .......... 89% 29.5M 1s 2023-10-26T06:44:57.530 INFO:tasks.workunit.client.0.smithi050.stderr:151250K .......... .......... .......... .......... .......... 89% 24.4M 1s 2023-10-26T06:44:57.532 INFO:tasks.workunit.client.0.smithi050.stderr:151300K .......... .......... .......... .......... .......... 89% 35.2M 1s 2023-10-26T06:44:57.533 INFO:tasks.workunit.client.0.smithi050.stderr:151350K .......... .......... .......... .......... .......... 89% 25.9M 1s 2023-10-26T06:44:57.536 INFO:tasks.workunit.client.0.smithi050.stderr:151400K .......... .......... .......... .......... .......... 89% 21.7M 1s 2023-10-26T06:44:57.539 INFO:tasks.workunit.client.0.smithi050.stderr:151450K .......... .......... .......... .......... .......... 89% 58.5M 1s 2023-10-26T06:44:57.539 INFO:tasks.workunit.client.0.smithi050.stderr:151500K .......... .......... .......... .......... .......... 89% 24.6M 1s 2023-10-26T06:44:57.541 INFO:tasks.workunit.client.0.smithi050.stderr:151550K .......... .......... .......... .......... .......... 89% 30.7M 1s 2023-10-26T06:44:57.542 INFO:tasks.workunit.client.0.smithi050.stderr:151600K .......... .......... .......... .......... .......... 89% 27.5M 1s 2023-10-26T06:44:57.545 INFO:tasks.workunit.client.0.smithi050.stderr:151650K .......... .......... .......... .......... .......... 89% 24.5M 1s 2023-10-26T06:44:57.547 INFO:tasks.workunit.client.0.smithi050.stderr:151700K .......... .......... .......... .......... .......... 90% 24.6M 1s 2023-10-26T06:44:57.547 INFO:tasks.workunit.client.0.smithi050.stderr:151750K .......... .......... .......... .......... .......... 90% 47.8M 1s 2023-10-26T06:44:57.550 INFO:tasks.workunit.client.0.smithi050.stderr:151800K .......... .......... .......... .......... .......... 90% 23.9M 1s 2023-10-26T06:44:57.550 INFO:tasks.workunit.client.0.smithi050.stderr:151850K .......... .......... .......... .......... .......... 90% 43.8M 1s 2023-10-26T06:44:57.553 INFO:tasks.workunit.client.0.smithi050.stderr:151900K .......... .......... .......... .......... .......... 90% 22.0M 1s 2023-10-26T06:44:57.555 INFO:tasks.workunit.client.0.smithi050.stderr:151950K .......... .......... .......... .......... .......... 90% 24.2M 1s 2023-10-26T06:44:57.555 INFO:tasks.workunit.client.0.smithi050.stderr:152000K .......... .......... .......... .......... .......... 90% 48.2M 1s 2023-10-26T06:44:57.557 INFO:tasks.workunit.client.0.smithi050.stderr:152050K .......... .......... .......... .......... .......... 90% 23.6M 1s 2023-10-26T06:44:57.559 INFO:tasks.workunit.client.0.smithi050.stderr:152100K .......... .......... .......... .......... .......... 90% 31.6M 1s 2023-10-26T06:44:57.562 INFO:tasks.workunit.client.0.smithi050.stderr:152150K .......... .......... .......... .......... .......... 90% 28.1M 1s 2023-10-26T06:44:57.562 INFO:tasks.workunit.client.0.smithi050.stderr:152200K .......... .......... .......... .......... .......... 90% 34.2M 1s 2023-10-26T06:44:57.564 INFO:tasks.workunit.client.0.smithi050.stderr:152250K .......... .......... .......... .......... .......... 90% 32.3M 1s 2023-10-26T06:44:57.566 INFO:tasks.workunit.client.0.smithi050.stderr:152300K .......... .......... .......... .......... .......... 90% 31.4M 1s 2023-10-26T06:44:57.567 INFO:tasks.workunit.client.0.smithi050.stderr:152350K .......... .......... .......... .......... .......... 90% 26.2M 1s 2023-10-26T06:44:57.569 INFO:tasks.workunit.client.0.smithi050.stderr:152400K .......... .......... .......... .......... .......... 90% 22.1M 1s 2023-10-26T06:44:57.570 INFO:tasks.workunit.client.0.smithi050.stderr:152450K .......... .......... .......... .......... .......... 90% 31.9M 1s 2023-10-26T06:44:57.572 INFO:tasks.workunit.client.0.smithi050.stderr:152500K .......... .......... .......... .......... .......... 90% 38.6M 1s 2023-10-26T06:44:57.573 INFO:tasks.workunit.client.0.smithi050.stderr:152550K .......... .......... .......... .......... .......... 90% 28.4M 1s 2023-10-26T06:44:57.575 INFO:tasks.workunit.client.0.smithi050.stderr:152600K .......... .......... .......... .......... .......... 90% 26.3M 1s 2023-10-26T06:44:57.577 INFO:tasks.workunit.client.0.smithi050.stderr:152650K .......... .......... .......... .......... .......... 90% 24.4M 1s 2023-10-26T06:44:57.580 INFO:tasks.workunit.client.0.smithi050.stderr:152700K .......... .......... .......... .......... .......... 90% 21.6M 1s 2023-10-26T06:44:57.581 INFO:tasks.workunit.client.0.smithi050.stderr:152750K .......... .......... .......... .......... .......... 90% 53.7M 1s 2023-10-26T06:44:57.583 INFO:tasks.workunit.client.0.smithi050.stderr:152800K .......... .......... .......... .......... .......... 90% 26.0M 1s 2023-10-26T06:44:57.585 INFO:tasks.workunit.client.0.smithi050.stderr:152850K .......... .......... .......... .......... .......... 90% 29.1M 1s 2023-10-26T06:44:57.587 INFO:tasks.workunit.client.0.smithi050.stderr:152900K .......... .......... .......... .......... .......... 90% 21.9M 1s 2023-10-26T06:44:57.589 INFO:tasks.workunit.client.0.smithi050.stderr:152950K .......... .......... .......... .......... .......... 90% 29.3M 1s 2023-10-26T06:44:57.589 INFO:tasks.workunit.client.0.smithi050.stderr:153000K .......... .......... .......... .......... .......... 90% 49.1M 1s 2023-10-26T06:44:57.591 INFO:tasks.workunit.client.0.smithi050.stderr:153050K .......... .......... .......... .......... .......... 90% 27.3M 1s 2023-10-26T06:44:57.592 INFO:tasks.workunit.client.0.smithi050.stderr:153100K .......... .......... .......... .......... .......... 90% 26.4M 1s 2023-10-26T06:44:57.597 INFO:tasks.workunit.client.0.smithi050.stderr:153150K .......... .......... .......... .......... .......... 90% 25.8M 1s 2023-10-26T06:44:57.604 INFO:tasks.workunit.client.0.smithi050.stderr:153200K .......... .......... .......... .......... .......... 90% 25.0M 1s 2023-10-26T06:44:57.604 INFO:tasks.workunit.client.0.smithi050.stderr:153250K .......... .......... .......... .......... .......... 90% 49.8M 1s 2023-10-26T06:44:57.604 INFO:tasks.workunit.client.0.smithi050.stderr:153300K .......... .......... .......... .......... .......... 90% 22.9M 1s 2023-10-26T06:44:57.604 INFO:tasks.workunit.client.0.smithi050.stderr:153350K .......... .......... .......... .......... .......... 91% 32.7M 1s 2023-10-26T06:44:57.605 INFO:tasks.workunit.client.0.smithi050.stderr:153400K .......... .......... .......... .......... .......... 91% 24.8M 1s 2023-10-26T06:44:57.606 INFO:tasks.workunit.client.0.smithi050.stderr:153450K .......... .......... .......... .......... .......... 91% 24.4M 1s 2023-10-26T06:44:57.606 INFO:tasks.workunit.client.0.smithi050.stderr:153500K .......... .......... .......... .......... .......... 91% 42.9M 1s 2023-10-26T06:44:57.608 INFO:tasks.workunit.client.0.smithi050.stderr:153550K .......... .......... .......... .......... .......... 91% 22.4M 1s 2023-10-26T06:44:57.610 INFO:tasks.workunit.client.0.smithi050.stderr:153600K .......... .......... .......... .......... .......... 91% 29.8M 1s 2023-10-26T06:44:57.613 INFO:tasks.workunit.client.0.smithi050.stderr:153650K .......... .......... .......... .......... .......... 91% 28.2M 1s 2023-10-26T06:44:57.613 INFO:tasks.workunit.client.0.smithi050.stderr:153700K .......... .......... .......... .......... .......... 91% 44.0M 1s 2023-10-26T06:44:57.614 INFO:tasks.workunit.client.0.smithi050.stderr:153750K .......... .......... .......... .......... .......... 91% 26.4M 1s 2023-10-26T06:44:57.617 INFO:tasks.workunit.client.0.smithi050.stderr:153800K .......... .......... .......... .......... .......... 91% 22.5M 1s 2023-10-26T06:44:57.619 INFO:tasks.workunit.client.0.smithi050.stderr:153850K .......... .......... .......... .......... .......... 91% 36.0M 1s 2023-10-26T06:44:57.620 INFO:tasks.workunit.client.0.smithi050.stderr:153900K .......... .......... .......... .......... .......... 91% 31.4M 1s 2023-10-26T06:44:57.623 INFO:tasks.workunit.client.0.smithi050.stderr:153950K .......... .......... .......... .......... .......... 91% 20.3M 1s 2023-10-26T06:44:57.623 INFO:tasks.workunit.client.0.smithi050.stderr:154000K .......... .......... .......... .......... .......... 91% 58.3M 1s 2023-10-26T06:44:57.626 INFO:tasks.workunit.client.0.smithi050.stderr:154050K .......... .......... .......... .......... .......... 91% 22.0M 1s 2023-10-26T06:44:57.627 INFO:tasks.workunit.client.0.smithi050.stderr:154100K .......... .......... .......... .......... .......... 91% 28.1M 1s 2023-10-26T06:44:57.629 INFO:tasks.workunit.client.0.smithi050.stderr:154150K .......... .......... .......... .......... .......... 91% 33.1M 1s 2023-10-26T06:44:57.632 INFO:tasks.workunit.client.0.smithi050.stderr:154200K .......... .......... .......... .......... .......... 91% 23.5M 1s 2023-10-26T06:44:57.632 INFO:tasks.workunit.client.0.smithi050.stderr:154250K .......... .......... .......... .......... .......... 91% 56.7M 1s 2023-10-26T06:44:57.634 INFO:tasks.workunit.client.0.smithi050.stderr:154300K .......... .......... .......... .......... .......... 91% 23.5M 1s 2023-10-26T06:44:57.636 INFO:tasks.workunit.client.0.smithi050.stderr:154350K .......... .......... .......... .......... .......... 91% 31.6M 1s 2023-10-26T06:44:57.638 INFO:tasks.workunit.client.0.smithi050.stderr:154400K .......... .......... .......... .......... .......... 91% 24.4M 1s 2023-10-26T06:44:57.640 INFO:tasks.workunit.client.0.smithi050.stderr:154450K .......... .......... .......... .......... .......... 91% 24.2M 1s 2023-10-26T06:44:57.640 INFO:tasks.workunit.client.0.smithi050.stderr:154500K .......... .......... .......... .......... .......... 91% 51.2M 1s 2023-10-26T06:44:57.642 INFO:tasks.workunit.client.0.smithi050.stderr:154550K .......... .......... .......... .......... .......... 91% 24.3M 1s 2023-10-26T06:44:57.643 INFO:tasks.workunit.client.0.smithi050.stderr:154600K .......... .......... .......... .......... .......... 91% 30.4M 0s 2023-10-26T06:44:57.645 INFO:tasks.workunit.client.0.smithi050.stderr:154650K .......... .......... .......... .......... .......... 91% 29.3M 0s 2023-10-26T06:44:57.647 INFO:tasks.workunit.client.0.smithi050.stderr:154700K .......... .......... .......... .......... .......... 91% 22.6M 0s 2023-10-26T06:44:57.649 INFO:tasks.workunit.client.0.smithi050.stderr:154750K .......... .......... .......... .......... .......... 91% 38.9M 0s 2023-10-26T06:44:57.651 INFO:tasks.workunit.client.0.smithi050.stderr:154800K .......... .......... .......... .......... .......... 91% 24.5M 0s 2023-10-26T06:44:57.652 INFO:tasks.workunit.client.0.smithi050.stderr:154850K .......... .......... .......... .......... .......... 91% 36.3M 0s 2023-10-26T06:44:57.654 INFO:tasks.workunit.client.0.smithi050.stderr:154900K .......... .......... .......... .......... .......... 91% 24.7M 0s 2023-10-26T06:44:57.656 INFO:tasks.workunit.client.0.smithi050.stderr:154950K .......... .......... .......... .......... .......... 91% 23.0M 0s 2023-10-26T06:44:57.657 INFO:tasks.workunit.client.0.smithi050.stderr:155000K .......... .......... .......... .......... .......... 91% 33.7M 0s 2023-10-26T06:44:57.660 INFO:tasks.workunit.client.0.smithi050.stderr:155050K .......... .......... .......... .......... .......... 92% 25.5M 0s 2023-10-26T06:44:57.661 INFO:tasks.workunit.client.0.smithi050.stderr:155100K .......... .......... .......... .......... .......... 92% 39.4M 0s 2023-10-26T06:44:57.663 INFO:tasks.workunit.client.0.smithi050.stderr:155150K .......... .......... .......... .......... .......... 92% 24.7M 0s 2023-10-26T06:44:57.664 INFO:tasks.workunit.client.0.smithi050.stderr:155200K .......... .......... .......... .......... .......... 92% 36.9M 0s 2023-10-26T06:44:57.665 INFO:tasks.workunit.client.0.smithi050.stderr:155250K .......... .......... .......... .......... .......... 92% 28.4M 0s 2023-10-26T06:44:57.668 INFO:tasks.workunit.client.0.smithi050.stderr:155300K .......... .......... .......... .......... .......... 92% 26.8M 0s 2023-10-26T06:44:57.669 INFO:tasks.workunit.client.0.smithi050.stderr:155350K .......... .......... .......... .......... .......... 92% 30.2M 0s 2023-10-26T06:44:57.671 INFO:tasks.workunit.client.0.smithi050.stderr:155400K .......... .......... .......... .......... .......... 92% 24.8M 0s 2023-10-26T06:44:57.672 INFO:tasks.workunit.client.0.smithi050.stderr:155450K .......... .......... .......... .......... .......... 92% 35.9M 0s 2023-10-26T06:44:57.674 INFO:tasks.workunit.client.0.smithi050.stderr:155500K .......... .......... .......... .......... .......... 92% 28.6M 0s 2023-10-26T06:44:57.676 INFO:tasks.workunit.client.0.smithi050.stderr:155550K .......... .......... .......... .......... .......... 92% 27.5M 0s 2023-10-26T06:44:57.678 INFO:tasks.workunit.client.0.smithi050.stderr:155600K .......... .......... .......... .......... .......... 92% 36.0M 0s 2023-10-26T06:44:57.679 INFO:tasks.workunit.client.0.smithi050.stderr:155650K .......... .......... .......... .......... .......... 92% 24.7M 0s 2023-10-26T06:44:57.680 INFO:tasks.workunit.client.0.smithi050.stderr:155700K .......... .......... .......... .......... .......... 92% 35.5M 0s 2023-10-26T06:44:57.682 INFO:tasks.workunit.client.0.smithi050.stderr:155750K .......... .......... .......... .......... .......... 92% 27.6M 0s 2023-10-26T06:44:57.684 INFO:tasks.workunit.client.0.smithi050.stderr:155800K .......... .......... .......... .......... .......... 92% 23.6M 0s 2023-10-26T06:44:57.686 INFO:tasks.workunit.client.0.smithi050.stderr:155850K .......... .......... .......... .......... .......... 92% 37.6M 0s 2023-10-26T06:44:57.688 INFO:tasks.workunit.client.0.smithi050.stderr:155900K .......... .......... .......... .......... .......... 92% 25.5M 0s 2023-10-26T06:44:57.690 INFO:tasks.workunit.client.0.smithi050.stderr:155950K .......... .......... .......... .......... .......... 92% 23.6M 0s 2023-10-26T06:44:57.691 INFO:tasks.workunit.client.0.smithi050.stderr:156000K .......... .......... .......... .......... .......... 92% 44.3M 0s 2023-10-26T06:44:57.693 INFO:tasks.workunit.client.0.smithi050.stderr:156050K .......... .......... .......... .......... .......... 92% 23.8M 0s 2023-10-26T06:44:57.694 INFO:tasks.workunit.client.0.smithi050.stderr:156100K .......... .......... .......... .......... .......... 92% 34.7M 0s 2023-10-26T06:44:57.696 INFO:tasks.workunit.client.0.smithi050.stderr:156150K .......... .......... .......... .......... .......... 92% 22.7M 0s 2023-10-26T06:44:57.698 INFO:tasks.workunit.client.0.smithi050.stderr:156200K .......... .......... .......... .......... .......... 92% 23.0M 0s 2023-10-26T06:44:57.700 INFO:tasks.workunit.client.0.smithi050.stderr:156250K .......... .......... .......... .......... .......... 92% 30.0M 0s 2023-10-26T06:44:57.702 INFO:tasks.workunit.client.0.smithi050.stderr:156300K .......... .......... .......... .......... .......... 92% 25.9M 0s 2023-10-26T06:44:57.704 INFO:tasks.workunit.client.0.smithi050.stderr:156350K .......... .......... .......... .......... .......... 92% 21.1M 0s 2023-10-26T06:44:57.710 INFO:tasks.workunit.client.0.smithi050.stderr:156400K .......... .......... .......... .......... .......... 92% 19.1M 0s 2023-10-26T06:44:57.710 INFO:tasks.workunit.client.0.smithi050.stderr:156450K .......... .......... .......... .......... .......... 92% 28.5M 0s 2023-10-26T06:44:57.712 INFO:tasks.workunit.client.0.smithi050.stderr:156500K .......... .......... .......... .......... .......... 92% 19.9M 0s 2023-10-26T06:44:57.714 INFO:tasks.workunit.client.0.smithi050.stderr:156550K .......... .......... .......... .......... .......... 92% 16.7M 0s 2023-10-26T06:44:57.716 INFO:tasks.workunit.client.0.smithi050.stderr:156600K .......... .......... .......... .......... .......... 92% 29.0M 0s 2023-10-26T06:44:57.719 INFO:tasks.workunit.client.0.smithi050.stderr:156650K .......... .......... .......... .......... .......... 92% 29.7M 0s 2023-10-26T06:44:57.720 INFO:tasks.workunit.client.0.smithi050.stderr:156700K .......... .......... .......... .......... .......... 92% 149M 0s 2023-10-26T06:44:57.720 INFO:tasks.workunit.client.0.smithi050.stderr:156750K .......... .......... .......... .......... .......... 93% 188M 0s 2023-10-26T06:44:57.720 INFO:tasks.workunit.client.0.smithi050.stderr:156800K .......... .......... .......... .......... .......... 93% 63.2M 0s 2023-10-26T06:44:57.721 INFO:tasks.workunit.client.0.smithi050.stderr:156850K .......... .......... .......... .......... .......... 93% 24.8M 0s 2023-10-26T06:44:57.723 INFO:tasks.workunit.client.0.smithi050.stderr:156900K .......... .......... .......... .......... .......... 93% 19.5M 0s 2023-10-26T06:44:57.724 INFO:tasks.workunit.client.0.smithi050.stderr:156950K .......... .......... .......... .......... .......... 93% 58.9M 0s 2023-10-26T06:44:57.726 INFO:tasks.workunit.client.0.smithi050.stderr:157000K .......... .......... .......... .......... .......... 93% 25.7M 0s 2023-10-26T06:44:57.728 INFO:tasks.workunit.client.0.smithi050.stderr:157050K .......... .......... .......... .......... .......... 93% 25.2M 0s 2023-10-26T06:44:57.730 INFO:tasks.workunit.client.0.smithi050.stderr:157100K .......... .......... .......... .......... .......... 93% 29.8M 0s 2023-10-26T06:44:57.731 INFO:tasks.workunit.client.0.smithi050.stderr:157150K .......... .......... .......... .......... .......... 93% 24.4M 0s 2023-10-26T06:44:57.732 INFO:tasks.workunit.client.0.smithi050.stderr:157200K .......... .......... .......... .......... .......... 93% 46.0M 0s 2023-10-26T06:44:57.734 INFO:tasks.workunit.client.0.smithi050.stderr:157250K .......... .......... .......... .......... .......... 93% 25.2M 0s 2023-10-26T06:44:57.737 INFO:tasks.workunit.client.0.smithi050.stderr:157300K .......... .......... .......... .......... .......... 93% 19.7M 0s 2023-10-26T06:44:57.739 INFO:tasks.workunit.client.0.smithi050.stderr:157350K .......... .......... .......... .......... .......... 93% 24.2M 0s 2023-10-26T06:44:57.741 INFO:tasks.workunit.client.0.smithi050.stderr:157400K .......... .......... .......... .......... .......... 93% 30.2M 0s 2023-10-26T06:44:57.742 INFO:tasks.workunit.client.0.smithi050.stderr:157450K .......... .......... .......... .......... .......... 93% 49.0M 0s 2023-10-26T06:44:57.744 INFO:tasks.workunit.client.0.smithi050.stderr:157500K .......... .......... .......... .......... .......... 93% 24.0M 0s 2023-10-26T06:44:57.745 INFO:tasks.workunit.client.0.smithi050.stderr:157550K .......... .......... .......... .......... .......... 93% 23.1M 0s 2023-10-26T06:44:57.747 INFO:tasks.workunit.client.0.smithi050.stderr:157600K .......... .......... .......... .......... .......... 93% 37.9M 0s 2023-10-26T06:44:57.749 INFO:tasks.workunit.client.0.smithi050.stderr:157650K .......... .......... .......... .......... .......... 93% 25.7M 0s 2023-10-26T06:44:57.751 INFO:tasks.workunit.client.0.smithi050.stderr:157700K .......... .......... .......... .......... .......... 93% 19.9M 0s 2023-10-26T06:44:57.753 INFO:tasks.workunit.client.0.smithi050.stderr:157750K .......... .......... .......... .......... .......... 93% 67.2M 0s 2023-10-26T06:44:57.754 INFO:tasks.workunit.client.0.smithi050.stderr:157800K .......... .......... .......... .......... .......... 93% 28.6M 0s 2023-10-26T06:44:57.755 INFO:tasks.workunit.client.0.smithi050.stderr:157850K .......... .......... .......... .......... .......... 93% 29.5M 0s 2023-10-26T06:44:57.758 INFO:tasks.workunit.client.0.smithi050.stderr:157900K .......... .......... .......... .......... .......... 93% 25.0M 0s 2023-10-26T06:44:57.759 INFO:tasks.workunit.client.0.smithi050.stderr:157950K .......... .......... .......... .......... .......... 93% 27.6M 0s 2023-10-26T06:44:57.761 INFO:tasks.workunit.client.0.smithi050.stderr:158000K .......... .......... .......... .......... .......... 93% 57.0M 0s 2023-10-26T06:44:57.762 INFO:tasks.workunit.client.0.smithi050.stderr:158050K .......... .......... .......... .......... .......... 93% 23.3M 0s 2023-10-26T06:44:57.764 INFO:tasks.workunit.client.0.smithi050.stderr:158100K .......... .......... .......... .......... .......... 93% 27.4M 0s 2023-10-26T06:44:57.767 INFO:tasks.workunit.client.0.smithi050.stderr:158150K .......... .......... .......... .......... .......... 93% 19.5M 0s 2023-10-26T06:44:57.768 INFO:tasks.workunit.client.0.smithi050.stderr:158200K .......... .......... .......... .......... .......... 93% 36.5M 0s 2023-10-26T06:44:57.770 INFO:tasks.workunit.client.0.smithi050.stderr:158250K .......... .......... .......... .......... .......... 93% 23.8M 0s 2023-10-26T06:44:57.771 INFO:tasks.workunit.client.0.smithi050.stderr:158300K .......... .......... .......... .......... .......... 93% 29.6M 0s 2023-10-26T06:44:57.772 INFO:tasks.workunit.client.0.smithi050.stderr:158350K .......... .......... .......... .......... .......... 93% 56.7M 0s 2023-10-26T06:44:57.777 INFO:tasks.workunit.client.0.smithi050.stderr:158400K .......... .......... .......... .......... .......... 93% 12.8M 0s 2023-10-26T06:44:57.777 INFO:tasks.workunit.client.0.smithi050.stderr:158450K .......... .......... .......... .......... .......... 94% 80.6M 0s 2023-10-26T06:44:57.777 INFO:tasks.workunit.client.0.smithi050.stderr:158500K .......... .......... .......... .......... .......... 94% 87.0M 0s 2023-10-26T06:44:57.779 INFO:tasks.workunit.client.0.smithi050.stderr:158550K .......... .......... .......... .......... .......... 94% 31.2M 0s 2023-10-26T06:44:57.781 INFO:tasks.workunit.client.0.smithi050.stderr:158600K .......... .......... .......... .......... .......... 94% 21.0M 0s 2023-10-26T06:44:57.783 INFO:tasks.workunit.client.0.smithi050.stderr:158650K .......... .......... .......... .......... .......... 94% 25.2M 0s 2023-10-26T06:44:57.784 INFO:tasks.workunit.client.0.smithi050.stderr:158700K .......... .......... .......... .......... .......... 94% 45.0M 0s 2023-10-26T06:44:57.786 INFO:tasks.workunit.client.0.smithi050.stderr:158750K .......... .......... .......... .......... .......... 94% 26.4M 0s 2023-10-26T06:44:57.788 INFO:tasks.workunit.client.0.smithi050.stderr:158800K .......... .......... .......... .......... .......... 94% 33.4M 0s 2023-10-26T06:44:57.790 INFO:tasks.workunit.client.0.smithi050.stderr:158850K .......... .......... .......... .......... .......... 94% 22.5M 0s 2023-10-26T06:44:57.791 INFO:tasks.workunit.client.0.smithi050.stderr:158900K .......... .......... .......... .......... .......... 94% 35.0M 0s 2023-10-26T06:44:57.793 INFO:tasks.workunit.client.0.smithi050.stderr:158950K .......... .......... .......... .......... .......... 94% 22.2M 0s 2023-10-26T06:44:57.795 INFO:tasks.workunit.client.0.smithi050.stderr:159000K .......... .......... .......... .......... .......... 94% 28.3M 0s 2023-10-26T06:44:57.796 INFO:tasks.workunit.client.0.smithi050.stderr:159050K .......... .......... .......... .......... .......... 94% 43.6M 0s 2023-10-26T06:44:57.799 INFO:tasks.workunit.client.0.smithi050.stderr:159100K .......... .......... .......... .......... .......... 94% 21.2M 0s 2023-10-26T06:44:57.800 INFO:tasks.workunit.client.0.smithi050.stderr:159150K .......... .......... .......... .......... .......... 94% 27.5M 0s 2023-10-26T06:44:57.802 INFO:tasks.workunit.client.0.smithi050.stderr:159200K .......... .......... .......... .......... .......... 94% 34.8M 0s 2023-10-26T06:44:57.805 INFO:tasks.workunit.client.0.smithi050.stderr:159250K .......... .......... .......... .......... .......... 94% 24.8M 0s 2023-10-26T06:44:57.805 INFO:tasks.workunit.client.0.smithi050.stderr:159300K .......... .......... .......... .......... .......... 94% 41.0M 0s 2023-10-26T06:44:57.808 INFO:tasks.workunit.client.0.smithi050.stderr:159350K .......... .......... .......... .......... .......... 94% 24.8M 0s 2023-10-26T06:44:57.808 INFO:tasks.workunit.client.0.smithi050.stderr:159400K .......... .......... .......... .......... .......... 94% 49.3M 0s 2023-10-26T06:44:57.809 INFO:tasks.workunit.client.0.smithi050.stderr:159450K .......... .......... .......... .......... .......... 94% 31.0M 0s 2023-10-26T06:44:57.812 INFO:tasks.workunit.client.0.smithi050.stderr:159500K .......... .......... .......... .......... .......... 94% 26.5M 0s 2023-10-26T06:44:57.814 INFO:tasks.workunit.client.0.smithi050.stderr:159550K .......... .......... .......... .......... .......... 94% 24.5M 0s 2023-10-26T06:44:57.816 INFO:tasks.workunit.client.0.smithi050.stderr:159600K .......... .......... .......... .......... .......... 94% 25.7M 0s 2023-10-26T06:44:57.816 INFO:tasks.workunit.client.0.smithi050.stderr:159650K .......... .......... .......... .......... .......... 94% 46.8M 0s 2023-10-26T06:44:57.818 INFO:tasks.workunit.client.0.smithi050.stderr:159700K .......... .......... .......... .......... .......... 94% 31.3M 0s 2023-10-26T06:44:57.820 INFO:tasks.workunit.client.0.smithi050.stderr:159750K .......... .......... .......... .......... .......... 94% 24.8M 0s 2023-10-26T06:44:57.822 INFO:tasks.workunit.client.0.smithi050.stderr:159800K .......... .......... .......... .......... .......... 94% 26.2M 0s 2023-10-26T06:44:57.824 INFO:tasks.workunit.client.0.smithi050.stderr:159850K .......... .......... .......... .......... .......... 94% 24.5M 0s 2023-10-26T06:44:57.825 INFO:tasks.workunit.client.0.smithi050.stderr:159900K .......... .......... .......... .......... .......... 94% 32.3M 0s 2023-10-26T06:44:57.827 INFO:tasks.workunit.client.0.smithi050.stderr:159950K .......... .......... .......... .......... .......... 94% 40.1M 0s 2023-10-26T06:44:57.828 INFO:tasks.workunit.client.0.smithi050.stderr:160000K .......... .......... .......... .......... .......... 94% 27.7M 0s 2023-10-26T06:44:57.830 INFO:tasks.workunit.client.0.smithi050.stderr:160050K .......... .......... .......... .......... .......... 94% 24.8M 0s 2023-10-26T06:44:57.832 INFO:tasks.workunit.client.0.smithi050.stderr:160100K .......... .......... .......... .......... .......... 95% 32.3M 0s 2023-10-26T06:44:57.834 INFO:tasks.workunit.client.0.smithi050.stderr:160150K .......... .......... .......... .......... .......... 95% 24.0M 0s 2023-10-26T06:44:57.836 INFO:tasks.workunit.client.0.smithi050.stderr:160200K .......... .......... .......... .......... .......... 95% 53.0M 0s 2023-10-26T06:44:57.837 INFO:tasks.workunit.client.0.smithi050.stderr:160250K .......... .......... .......... .......... .......... 95% 22.4M 0s 2023-10-26T06:44:57.838 INFO:tasks.workunit.client.0.smithi050.stderr:160300K .......... .......... .......... .......... .......... 95% 24.5M 0s 2023-10-26T06:44:57.840 INFO:tasks.workunit.client.0.smithi050.stderr:160350K .......... .......... .......... .......... .......... 95% 31.6M 0s 2023-10-26T06:44:57.841 INFO:tasks.workunit.client.0.smithi050.stderr:160400K .......... .......... .......... .......... .......... 95% 42.5M 0s 2023-10-26T06:44:57.843 INFO:tasks.workunit.client.0.smithi050.stderr:160450K .......... .......... .......... .......... .......... 95% 24.5M 0s 2023-10-26T06:44:57.845 INFO:tasks.workunit.client.0.smithi050.stderr:160500K .......... .......... .......... .......... .......... 95% 28.9M 0s 2023-10-26T06:44:57.847 INFO:tasks.workunit.client.0.smithi050.stderr:160550K .......... .......... .......... .......... .......... 95% 29.7M 0s 2023-10-26T06:44:57.849 INFO:tasks.workunit.client.0.smithi050.stderr:160600K .......... .......... .......... .......... .......... 95% 27.4M 0s 2023-10-26T06:44:57.850 INFO:tasks.workunit.client.0.smithi050.stderr:160650K .......... .......... .......... .......... .......... 95% 36.8M 0s 2023-10-26T06:44:57.852 INFO:tasks.workunit.client.0.smithi050.stderr:160700K .......... .......... .......... .......... .......... 95% 21.5M 0s 2023-10-26T06:44:57.854 INFO:tasks.workunit.client.0.smithi050.stderr:160750K .......... .......... .......... .......... .......... 95% 39.1M 0s 2023-10-26T06:44:57.855 INFO:tasks.workunit.client.0.smithi050.stderr:160800K .......... .......... .......... .......... .......... 95% 23.9M 0s 2023-10-26T06:44:57.858 INFO:tasks.workunit.client.0.smithi050.stderr:160850K .......... .......... .......... .......... .......... 95% 20.9M 0s 2023-10-26T06:44:57.859 INFO:tasks.workunit.client.0.smithi050.stderr:160900K .......... .......... .......... .......... .......... 95% 37.5M 0s 2023-10-26T06:44:57.861 INFO:tasks.workunit.client.0.smithi050.stderr:160950K .......... .......... .......... .......... .......... 95% 26.5M 0s 2023-10-26T06:44:57.863 INFO:tasks.workunit.client.0.smithi050.stderr:161000K .......... .......... .......... .......... .......... 95% 22.6M 0s 2023-10-26T06:44:57.864 INFO:tasks.workunit.client.0.smithi050.stderr:161050K .......... .......... .......... .......... .......... 95% 41.8M 0s 2023-10-26T06:44:57.866 INFO:tasks.workunit.client.0.smithi050.stderr:161100K .......... .......... .......... .......... .......... 95% 28.1M 0s 2023-10-26T06:44:57.867 INFO:tasks.workunit.client.0.smithi050.stderr:161150K .......... .......... .......... .......... .......... 95% 36.5M 0s 2023-10-26T06:44:57.870 INFO:tasks.workunit.client.0.smithi050.stderr:161200K .......... .......... .......... .......... .......... 95% 21.6M 0s 2023-10-26T06:44:57.872 INFO:tasks.workunit.client.0.smithi050.stderr:161250K .......... .......... .......... .......... .......... 95% 23.5M 0s 2023-10-26T06:44:57.873 INFO:tasks.workunit.client.0.smithi050.stderr:161300K .......... .......... .......... .......... .......... 95% 65.3M 0s 2023-10-26T06:44:57.875 INFO:tasks.workunit.client.0.smithi050.stderr:161350K .......... .......... .......... .......... .......... 95% 22.0M 0s 2023-10-26T06:44:57.877 INFO:tasks.workunit.client.0.smithi050.stderr:161400K .......... .......... .......... .......... .......... 95% 28.4M 0s 2023-10-26T06:44:57.878 INFO:tasks.workunit.client.0.smithi050.stderr:161450K .......... .......... .......... .......... .......... 95% 50.2M 0s 2023-10-26T06:44:57.880 INFO:tasks.workunit.client.0.smithi050.stderr:161500K .......... .......... .......... .......... .......... 95% 19.0M 0s 2023-10-26T06:44:57.881 INFO:tasks.workunit.client.0.smithi050.stderr:161550K .......... .......... .......... .......... .......... 95% 42.3M 0s 2023-10-26T06:44:57.883 INFO:tasks.workunit.client.0.smithi050.stderr:161600K .......... .......... .......... .......... .......... 95% 24.5M 0s 2023-10-26T06:44:57.884 INFO:tasks.workunit.client.0.smithi050.stderr:161650K .......... .......... .......... .......... .......... 95% 43.6M 0s 2023-10-26T06:44:57.887 INFO:tasks.workunit.client.0.smithi050.stderr:161700K .......... .......... .......... .......... .......... 95% 22.4M 0s 2023-10-26T06:44:57.888 INFO:tasks.workunit.client.0.smithi050.stderr:161750K .......... .......... .......... .......... .......... 95% 22.3M 0s 2023-10-26T06:44:57.889 INFO:tasks.workunit.client.0.smithi050.stderr:161800K .......... .......... .......... .......... .......... 96% 43.0M 0s 2023-10-26T06:44:57.892 INFO:tasks.workunit.client.0.smithi050.stderr:161850K .......... .......... .......... .......... .......... 96% 22.1M 0s 2023-10-26T06:44:57.894 INFO:tasks.workunit.client.0.smithi050.stderr:161900K .......... .......... .......... .......... .......... 96% 39.1M 0s 2023-10-26T06:44:57.896 INFO:tasks.workunit.client.0.smithi050.stderr:161950K .......... .......... .......... .......... .......... 96% 23.1M 0s 2023-10-26T06:44:57.897 INFO:tasks.workunit.client.0.smithi050.stderr:162000K .......... .......... .......... .......... .......... 96% 25.3M 0s 2023-10-26T06:44:57.899 INFO:tasks.workunit.client.0.smithi050.stderr:162050K .......... .......... .......... .......... .......... 96% 28.0M 0s 2023-10-26T06:44:57.900 INFO:tasks.workunit.client.0.smithi050.stderr:162100K .......... .......... .......... .......... .......... 96% 47.9M 0s 2023-10-26T06:44:57.902 INFO:tasks.workunit.client.0.smithi050.stderr:162150K .......... .......... .......... .......... .......... 96% 26.0M 0s 2023-10-26T06:44:57.904 INFO:tasks.workunit.client.0.smithi050.stderr:162200K .......... .......... .......... .......... .......... 96% 35.7M 0s 2023-10-26T06:44:57.906 INFO:tasks.workunit.client.0.smithi050.stderr:162250K .......... .......... .......... .......... .......... 96% 19.6M 0s 2023-10-26T06:44:57.907 INFO:tasks.workunit.client.0.smithi050.stderr:162300K .......... .......... .......... .......... .......... 96% 92.9M 0s 2023-10-26T06:44:57.908 INFO:tasks.workunit.client.0.smithi050.stderr:162350K .......... .......... .......... .......... .......... 96% 21.8M 0s 2023-10-26T06:44:57.910 INFO:tasks.workunit.client.0.smithi050.stderr:162400K .......... .......... .......... .......... .......... 96% 27.5M 0s 2023-10-26T06:44:57.912 INFO:tasks.workunit.client.0.smithi050.stderr:162450K .......... .......... .......... .......... .......... 96% 36.4M 0s 2023-10-26T06:44:57.913 INFO:tasks.workunit.client.0.smithi050.stderr:162500K .......... .......... .......... .......... .......... 96% 28.3M 0s 2023-10-26T06:44:57.915 INFO:tasks.workunit.client.0.smithi050.stderr:162550K .......... .......... .......... .......... .......... 96% 34.9M 0s 2023-10-26T06:44:57.917 INFO:tasks.workunit.client.0.smithi050.stderr:162600K .......... .......... .......... .......... .......... 96% 25.6M 0s 2023-10-26T06:44:57.919 INFO:tasks.workunit.client.0.smithi050.stderr:162650K .......... .......... .......... .......... .......... 96% 25.5M 0s 2023-10-26T06:44:57.920 INFO:tasks.workunit.client.0.smithi050.stderr:162700K .......... .......... .......... .......... .......... 96% 30.5M 0s 2023-10-26T06:44:57.922 INFO:tasks.workunit.client.0.smithi050.stderr:162750K .......... .......... .......... .......... .......... 96% 24.0M 0s 2023-10-26T06:44:57.924 INFO:tasks.workunit.client.0.smithi050.stderr:162800K .......... .......... .......... .......... .......... 96% 25.0M 0s 2023-10-26T06:44:57.925 INFO:tasks.workunit.client.0.smithi050.stderr:162850K .......... .......... .......... .......... .......... 96% 45.5M 0s 2023-10-26T06:44:57.927 INFO:tasks.workunit.client.0.smithi050.stderr:162900K .......... .......... .......... .......... .......... 96% 29.8M 0s 2023-10-26T06:44:57.929 INFO:tasks.workunit.client.0.smithi050.stderr:162950K .......... .......... .......... .......... .......... 96% 28.5M 0s 2023-10-26T06:44:57.930 INFO:tasks.workunit.client.0.smithi050.stderr:163000K .......... .......... .......... .......... .......... 96% 32.4M 0s 2023-10-26T06:44:57.932 INFO:tasks.workunit.client.0.smithi050.stderr:163050K .......... .......... .......... .......... .......... 96% 21.2M 0s 2023-10-26T06:44:57.934 INFO:tasks.workunit.client.0.smithi050.stderr:163100K .......... .......... .......... .......... .......... 96% 35.5M 0s 2023-10-26T06:44:57.935 INFO:tasks.workunit.client.0.smithi050.stderr:163150K .......... .......... .......... .......... .......... 96% 31.4M 0s 2023-10-26T06:44:57.937 INFO:tasks.workunit.client.0.smithi050.stderr:163200K .......... .......... .......... .......... .......... 96% 25.9M 0s 2023-10-26T06:44:57.939 INFO:tasks.workunit.client.0.smithi050.stderr:163250K .......... .......... .......... .......... .......... 96% 28.5M 0s 2023-10-26T06:44:57.942 INFO:tasks.workunit.client.0.smithi050.stderr:163300K .......... .......... .......... .......... .......... 96% 21.4M 0s 2023-10-26T06:44:57.942 INFO:tasks.workunit.client.0.smithi050.stderr:163350K .......... .......... .......... .......... .......... 96% 54.4M 0s 2023-10-26T06:44:57.944 INFO:tasks.workunit.client.0.smithi050.stderr:163400K .......... .......... .......... .......... .......... 96% 29.6M 0s 2023-10-26T06:44:57.945 INFO:tasks.workunit.client.0.smithi050.stderr:163450K .......... .......... .......... .......... .......... 96% 28.7M 0s 2023-10-26T06:44:57.948 INFO:tasks.workunit.client.0.smithi050.stderr:163500K .......... .......... .......... .......... .......... 97% 21.9M 0s 2023-10-26T06:44:57.950 INFO:tasks.workunit.client.0.smithi050.stderr:163550K .......... .......... .......... .......... .......... 97% 24.2M 0s 2023-10-26T06:44:57.951 INFO:tasks.workunit.client.0.smithi050.stderr:163600K .......... .......... .......... .......... .......... 97% 50.5M 0s 2023-10-26T06:44:57.952 INFO:tasks.workunit.client.0.smithi050.stderr:163650K .......... .......... .......... .......... .......... 97% 24.8M 0s 2023-10-26T06:44:57.954 INFO:tasks.workunit.client.0.smithi050.stderr:163700K .......... .......... .......... .......... .......... 97% 33.5M 0s 2023-10-26T06:44:57.956 INFO:tasks.workunit.client.0.smithi050.stderr:163750K .......... .......... .......... .......... .......... 97% 25.5M 0s 2023-10-26T06:44:57.958 INFO:tasks.workunit.client.0.smithi050.stderr:163800K .......... .......... .......... .......... .......... 97% 22.0M 0s 2023-10-26T06:44:57.959 INFO:tasks.workunit.client.0.smithi050.stderr:163850K .......... .......... .......... .......... .......... 97% 42.8M 0s 2023-10-26T06:44:57.960 INFO:tasks.workunit.client.0.smithi050.stderr:163900K .......... .......... .......... .......... .......... 97% 35.1M 0s 2023-10-26T06:44:57.962 INFO:tasks.workunit.client.0.smithi050.stderr:163950K .......... .......... .......... .......... .......... 97% 28.3M 0s 2023-10-26T06:44:57.964 INFO:tasks.workunit.client.0.smithi050.stderr:164000K .......... .......... .......... .......... .......... 97% 22.1M 0s 2023-10-26T06:44:57.967 INFO:tasks.workunit.client.0.smithi050.stderr:164050K .......... .......... .......... .......... .......... 97% 28.7M 0s 2023-10-26T06:44:57.967 INFO:tasks.workunit.client.0.smithi050.stderr:164100K .......... .......... .......... .......... .......... 97% 51.0M 0s 2023-10-26T06:44:57.969 INFO:tasks.workunit.client.0.smithi050.stderr:164150K .......... .......... .......... .......... .......... 97% 23.0M 0s 2023-10-26T06:44:57.971 INFO:tasks.workunit.client.0.smithi050.stderr:164200K .......... .......... .......... .......... .......... 97% 43.5M 0s 2023-10-26T06:44:57.974 INFO:tasks.workunit.client.0.smithi050.stderr:164250K .......... .......... .......... .......... .......... 97% 22.6M 0s 2023-10-26T06:44:57.975 INFO:tasks.workunit.client.0.smithi050.stderr:164300K .......... .......... .......... .......... .......... 97% 24.8M 0s 2023-10-26T06:44:57.976 INFO:tasks.workunit.client.0.smithi050.stderr:164350K .......... .......... .......... .......... .......... 97% 45.0M 0s 2023-10-26T06:44:57.978 INFO:tasks.workunit.client.0.smithi050.stderr:164400K .......... .......... .......... .......... .......... 97% 22.2M 0s 2023-10-26T06:44:57.979 INFO:tasks.workunit.client.0.smithi050.stderr:164450K .......... .......... .......... .......... .......... 97% 36.7M 0s 2023-10-26T06:44:57.981 INFO:tasks.workunit.client.0.smithi050.stderr:164500K .......... .......... .......... .......... .......... 97% 22.3M 0s 2023-10-26T06:44:57.984 INFO:tasks.workunit.client.0.smithi050.stderr:164550K .......... .......... .......... .......... .......... 97% 22.3M 0s 2023-10-26T06:44:57.985 INFO:tasks.workunit.client.0.smithi050.stderr:164600K .......... .......... .......... .......... .......... 97% 46.0M 0s 2023-10-26T06:44:57.987 INFO:tasks.workunit.client.0.smithi050.stderr:164650K .......... .......... .......... .......... .......... 97% 22.3M 0s 2023-10-26T06:44:57.989 INFO:tasks.workunit.client.0.smithi050.stderr:164700K .......... .......... .......... .......... .......... 97% 36.9M 0s 2023-10-26T06:44:57.990 INFO:tasks.workunit.client.0.smithi050.stderr:164750K .......... .......... .......... .......... .......... 97% 23.7M 0s 2023-10-26T06:44:57.993 INFO:tasks.workunit.client.0.smithi050.stderr:164800K .......... .......... .......... .......... .......... 97% 37.7M 0s 2023-10-26T06:44:57.993 INFO:tasks.workunit.client.0.smithi050.stderr:164850K .......... .......... .......... .......... .......... 97% 29.1M 0s 2023-10-26T06:44:57.995 INFO:tasks.workunit.client.0.smithi050.stderr:164900K .......... .......... .......... .......... .......... 97% 31.2M 0s 2023-10-26T06:44:57.997 INFO:tasks.workunit.client.0.smithi050.stderr:164950K .......... .......... .......... .......... .......... 97% 27.2M 0s 2023-10-26T06:44:57.999 INFO:tasks.workunit.client.0.smithi050.stderr:165000K .......... .......... .......... .......... .......... 97% 22.3M 0s 2023-10-26T06:44:58.002 INFO:tasks.workunit.client.0.smithi050.stderr:165050K .......... .......... .......... .......... .......... 97% 24.8M 0s 2023-10-26T06:44:58.002 INFO:tasks.workunit.client.0.smithi050.stderr:165100K .......... .......... .......... .......... .......... 97% 49.1M 0s 2023-10-26T06:44:58.004 INFO:tasks.workunit.client.0.smithi050.stderr:165150K .......... .......... .......... .......... .......... 98% 26.9M 0s 2023-10-26T06:44:58.006 INFO:tasks.workunit.client.0.smithi050.stderr:165200K .......... .......... .......... .......... .......... 98% 23.9M 0s 2023-10-26T06:44:58.009 INFO:tasks.workunit.client.0.smithi050.stderr:165250K .......... .......... .......... .......... .......... 98% 24.8M 0s 2023-10-26T06:44:58.026 INFO:tasks.workunit.client.0.smithi050.stderr:165300K .......... .......... .......... .......... .......... 98% 24.1M 0s 2023-10-26T06:44:58.026 INFO:tasks.workunit.client.0.smithi050.stderr:165350K .......... .......... .......... .......... .......... 98% 45.0M 0s 2023-10-26T06:44:58.026 INFO:tasks.workunit.client.0.smithi050.stderr:165400K .......... .......... .......... .......... .......... 98% 23.9M 0s 2023-10-26T06:44:58.026 INFO:tasks.workunit.client.0.smithi050.stderr:165450K .......... .......... .......... .......... .......... 98% 35.9M 0s 2023-10-26T06:44:58.027 INFO:tasks.workunit.client.0.smithi050.stderr:165500K .......... .......... .......... .......... .......... 98% 24.4M 0s 2023-10-26T06:44:58.027 INFO:tasks.workunit.client.0.smithi050.stderr:165550K .......... .......... .......... .......... .......... 98% 24.7M 0s 2023-10-26T06:44:58.027 INFO:tasks.workunit.client.0.smithi050.stderr:165600K .......... .......... .......... .......... .......... 98% 46.1M 0s 2023-10-26T06:44:58.027 INFO:tasks.workunit.client.0.smithi050.stderr:165650K .......... .......... .......... .......... .......... 98% 24.8M 0s 2023-10-26T06:44:58.028 INFO:tasks.workunit.client.0.smithi050.stderr:165700K .......... .......... .......... .......... .......... 98% 35.6M 0s 2023-10-26T06:44:58.028 INFO:tasks.workunit.client.0.smithi050.stderr:165750K .......... .......... .......... .......... .......... 98% 24.9M 0s 2023-10-26T06:44:58.093 INFO:tasks.workunit.client.0.smithi050.stderr:165800K .......... .......... .......... .......... .......... 98% 24.2M 0s 2023-10-26T06:44:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:165850K .......... .......... .......... .......... .......... 98% 45.2M 0s 2023-10-26T06:44:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:165900K .......... .......... .......... .......... .......... 98% 24.7M 0s 2023-10-26T06:44:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:165950K .......... .......... .......... .......... .......... 98% 37.0M 0s 2023-10-26T06:44:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:166000K .......... .......... .......... .......... .......... 98% 24.9M 0s 2023-10-26T06:44:58.094 INFO:tasks.workunit.client.0.smithi050.stderr:166050K .......... .......... .......... .......... .......... 98% 40.1M 0s 2023-10-26T06:44:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:166100K .......... .......... .......... .......... .......... 98% 27.0M 0s 2023-10-26T06:44:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:166150K .......... .......... .......... .......... .......... 98% 32.9M 0s 2023-10-26T06:44:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:166200K .......... .......... .......... .......... .......... 98% 24.1M 0s 2023-10-26T06:44:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:166250K .......... .......... .......... .......... .......... 98% 24.6M 0s 2023-10-26T06:44:58.095 INFO:tasks.workunit.client.0.smithi050.stderr:166300K .......... .......... .......... .......... .......... 98% 44.8M 0s 2023-10-26T06:44:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:166350K .......... .......... .......... .......... .......... 98% 23.8M 0s 2023-10-26T06:44:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:166400K .......... .......... .......... .......... .......... 98% 23.8M 0s 2023-10-26T06:44:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:166450K .......... .......... .......... .......... .......... 98% 35.6M 0s 2023-10-26T06:44:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:166500K .......... .......... .......... .......... .......... 98% 24.3M 0s 2023-10-26T06:44:58.096 INFO:tasks.workunit.client.0.smithi050.stderr:166550K .......... .......... .......... .......... .......... 98% 43.7M 0s 2023-10-26T06:44:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:166600K .......... .......... .......... .......... .......... 98% 26.0M 0s 2023-10-26T06:44:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:166650K .......... .......... .......... .......... .......... 98% 29.5M 0s 2023-10-26T06:44:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:166700K .......... .......... .......... .......... .......... 98% 26.9M 0s 2023-10-26T06:44:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:166750K .......... .......... .......... .......... .......... 98% 24.6M 0s 2023-10-26T06:44:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:166800K .......... .......... .......... .......... .......... 98% 46.1M 0s 2023-10-26T06:44:58.097 INFO:tasks.workunit.client.0.smithi050.stderr:166850K .......... .......... .......... .......... .......... 99% 25.0M 0s 2023-10-26T06:44:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:166900K .......... .......... .......... .......... .......... 99% 35.6M 0s 2023-10-26T06:44:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:166950K .......... .......... .......... .......... .......... 99% 23.7M 0s 2023-10-26T06:44:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:167000K .......... .......... .......... .......... .......... 99% 24.6M 0s 2023-10-26T06:44:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:167050K .......... .......... .......... .......... .......... 99% 44.8M 0s 2023-10-26T06:44:58.098 INFO:tasks.workunit.client.0.smithi050.stderr:167100K .......... .......... .......... .......... .......... 99% 25.2M 0s 2023-10-26T06:44:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:167150K .......... .......... .......... .......... .......... 99% 34.0M 0s 2023-10-26T06:44:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:167200K .......... .......... .......... .......... .......... 99% 25.3M 0s 2023-10-26T06:44:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:167250K .......... .......... .......... .......... .......... 99% 21.7M 0s 2023-10-26T06:44:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:167300K .......... .......... .......... .......... .......... 99% 25.5M 0s 2023-10-26T06:44:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:167350K .......... .......... .......... .......... .......... 99% 54.3M 0s 2023-10-26T06:44:58.099 INFO:tasks.workunit.client.0.smithi050.stderr:167400K .......... .......... .......... .......... .......... 99% 28.8M 0s 2023-10-26T06:44:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:167450K .......... .......... .......... .......... .......... 99% 30.1M 0s 2023-10-26T06:44:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:167500K .......... .......... .......... .......... .......... 99% 23.8M 0s 2023-10-26T06:44:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:167550K .......... .......... .......... .......... .......... 99% 40.3M 0s 2023-10-26T06:44:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:167600K .......... .......... .......... .......... .......... 99% 25.6M 0s 2023-10-26T06:44:58.100 INFO:tasks.workunit.client.0.smithi050.stderr:167650K .......... .......... .......... .......... .......... 99% 35.0M 0s 2023-10-26T06:44:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:167700K .......... .......... .......... .......... .......... 99% 25.3M 0s 2023-10-26T06:44:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:167750K .......... .......... .......... .......... .......... 99% 27.3M 0s 2023-10-26T06:44:58.101 INFO:tasks.workunit.client.0.smithi050.stderr:167800K .......... .......... .......... .......... .......... 99% 40.5M 0s 2023-10-26T06:44:58.118 INFO:tasks.workunit.client.0.smithi050.stderr:167850K .......... .......... .......... .......... .......... 99% 24.8M 0s 2023-10-26T06:44:58.118 INFO:tasks.workunit.client.0.smithi050.stderr:167900K .......... .......... .......... .......... .......... 99% 33.8M 0s 2023-10-26T06:44:58.118 INFO:tasks.workunit.client.0.smithi050.stderr:167950K .......... .......... .......... .......... .......... 99% 24.7M 0s 2023-10-26T06:44:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:168000K .......... .......... .......... .......... .......... 99% 24.7M 0s 2023-10-26T06:44:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:168050K .......... .......... .......... .......... .......... 99% 50.7M 0s 2023-10-26T06:44:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:168100K .......... .......... .......... .......... .......... 99% 24.0M 0s 2023-10-26T06:44:58.119 INFO:tasks.workunit.client.0.smithi050.stderr:168150K .......... .......... .......... .......... .......... 99% 25.7M 0s 2023-10-26T06:44:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:168200K .......... .......... .......... .......... .......... 99% 33.2M 0s 2023-10-26T06:44:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:168250K .......... .......... .......... .......... .......... 99% 24.5M 0s 2023-10-26T06:44:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:168300K .......... .......... .......... .......... .......... 99% 52.5M 0s 2023-10-26T06:44:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:168350K .......... .......... .......... .......... .......... 99% 24.1M 0s 2023-10-26T06:44:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:168400K .......... .......... .......... .......... .......... 99% 31.1M 0s 2023-10-26T06:44:58.120 INFO:tasks.workunit.client.0.smithi050.stderr:168450K .......... .......... .......... .......... .......... 99% 26.7M 0s 2023-10-26T06:44:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:168500K .......... .......... .......... .......... .......... 99% 24.8M 0s 2023-10-26T06:44:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:168550K .......... .......... . 100% 110M=6.0s 2023-10-26T06:44:58.121 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:58.121 INFO:tasks.workunit.client.0.smithi050.stderr:2023-10-26 06:44:58 (27.3 MB/s) - ‘linux.tar.gz’ saved [172616875/172616875] 2023-10-26T06:44:58.121 INFO:tasks.workunit.client.0.smithi050.stderr: 2023-10-26T06:44:58.122 INFO:tasks.workunit.client.0.smithi050.stderr:+ mkdir t 2023-10-26T06:44:58.122 INFO:tasks.workunit.client.0.smithi050.stderr:+ cd t 2023-10-26T06:44:58.123 INFO:tasks.workunit.client.0.smithi050.stderr:+ tar xzf ../linux.tar.gz 2023-10-26T06:44:59.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:44:58 smithi050 ceph-mon[94997]: pgmap v358: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2023-10-26T06:44:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:44:58 smithi125 ceph-mon[130643]: pgmap v358: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2023-10-26T06:44:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:44:58 smithi153 ceph-mon[131657]: pgmap v358: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2023-10-26T06:45:01.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:00 smithi050 ceph-mon[94997]: pgmap v359: 97 pgs: 97 active+clean; 21 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2023-10-26T06:45:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:00 smithi125 ceph-mon[130643]: pgmap v359: 97 pgs: 97 active+clean; 21 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2023-10-26T06:45:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:00 smithi153 ceph-mon[131657]: pgmap v359: 97 pgs: 97 active+clean; 21 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2023-10-26T06:45:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:02 smithi050 ceph-mon[94997]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.4 MiB/s wr, 8 op/s 2023-10-26T06:45:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:02 smithi125 ceph-mon[130643]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.4 MiB/s wr, 8 op/s 2023-10-26T06:45:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:02 smithi153 ceph-mon[131657]: pgmap v360: 97 pgs: 97 active+clean; 42 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.4 MiB/s wr, 8 op/s 2023-10-26T06:45:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:03 smithi125 ceph-mon[130643]: pgmap v361: 97 pgs: 97 active+clean; 62 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 5.1 MiB/s wr, 12 op/s 2023-10-26T06:45:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:03 smithi153 ceph-mon[131657]: pgmap v361: 97 pgs: 97 active+clean; 62 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 5.1 MiB/s wr, 12 op/s 2023-10-26T06:45:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:03 smithi050 ceph-mon[94997]: pgmap v361: 97 pgs: 97 active+clean; 62 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 5.1 MiB/s wr, 12 op/s 2023-10-26T06:45:06.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:06 smithi153 ceph-mon[131657]: pgmap v362: 97 pgs: 97 active+clean; 91 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 7.5 MiB/s wr, 12 op/s 2023-10-26T06:45:07.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:06 smithi050 ceph-mon[94997]: pgmap v362: 97 pgs: 97 active+clean; 91 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 7.5 MiB/s wr, 12 op/s 2023-10-26T06:45:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:06 smithi125 ceph-mon[130643]: pgmap v362: 97 pgs: 97 active+clean; 91 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 7.5 MiB/s wr, 12 op/s 2023-10-26T06:45:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:08 smithi050 ceph-mon[94997]: pgmap v363: 97 pgs: 97 active+clean; 139 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 12 MiB/s wr, 31 op/s 2023-10-26T06:45:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:08 smithi125 ceph-mon[130643]: pgmap v363: 97 pgs: 97 active+clean; 139 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 12 MiB/s wr, 31 op/s 2023-10-26T06:45:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:08 smithi153 ceph-mon[131657]: pgmap v363: 97 pgs: 97 active+clean; 139 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 12 MiB/s wr, 31 op/s 2023-10-26T06:45:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:10 smithi050 ceph-mon[94997]: pgmap v364: 97 pgs: 97 active+clean; 187 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 36 op/s 2023-10-26T06:45:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:10 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:45:11.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:10 smithi125 ceph-mon[130643]: pgmap v364: 97 pgs: 97 active+clean; 187 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 36 op/s 2023-10-26T06:45:11.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:10 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:45:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:10 smithi153 ceph-mon[131657]: pgmap v364: 97 pgs: 97 active+clean; 187 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 36 op/s 2023-10-26T06:45:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:10 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:45:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:12 smithi050 ceph-mon[94997]: pgmap v365: 97 pgs: 97 active+clean; 187 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 37 op/s 2023-10-26T06:45:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:12 smithi125 ceph-mon[130643]: pgmap v365: 97 pgs: 97 active+clean; 187 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 37 op/s 2023-10-26T06:45:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:12 smithi153 ceph-mon[131657]: pgmap v365: 97 pgs: 97 active+clean; 187 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 37 op/s 2023-10-26T06:45:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:13 smithi153 ceph-mon[131657]: pgmap v366: 97 pgs: 97 active+clean; 198 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 46 op/s 2023-10-26T06:45:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:13 smithi050 ceph-mon[94997]: pgmap v366: 97 pgs: 97 active+clean; 198 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 46 op/s 2023-10-26T06:45:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:13 smithi125 ceph-mon[130643]: pgmap v366: 97 pgs: 97 active+clean; 198 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 46 op/s 2023-10-26T06:45:16.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:15 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:45:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:15 smithi153 ceph-mon[131657]: pgmap v367: 97 pgs: 97 active+clean; 202 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 48 op/s 2023-10-26T06:45:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:15 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:45:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:15 smithi050 ceph-mon[94997]: pgmap v367: 97 pgs: 97 active+clean; 202 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 48 op/s 2023-10-26T06:45:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:15 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:45:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:15 smithi125 ceph-mon[130643]: pgmap v367: 97 pgs: 97 active+clean; 202 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 48 op/s 2023-10-26T06:45:17.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:45:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 -- 172.21.15.50:0/3127675768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7770100720 msgr2=0x7f7770100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 --2- 172.21.15.50:0/3127675768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7770100720 0x7f7770100ba0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f77640098f0 tx=0x7f7764009c00 comp rx=0 tx=0).stop 2023-10-26T06:45:17.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 -- 172.21.15.50:0/3127675768 shutdown_connections 2023-10-26T06:45:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 --2- 172.21.15.50:0/3127675768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77701010e0 0x7f777010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 --2- 172.21.15.50:0/3127675768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770106730 0x7f7770106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 --2- 172.21.15.50:0/3127675768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7770100720 0x7f7770100ba0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 -- 172.21.15.50:0/3127675768 >> 172.21.15.50:0/3127675768 conn(0x7f77700fc1b0 msgr2=0x7f77700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:17.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 -- 172.21.15.50:0/3127675768 shutdown_connections 2023-10-26T06:45:17.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.904+0000 7f7774fff700 1 -- 172.21.15.50:0/3127675768 wait complete. 2023-10-26T06:45:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.905+0000 7f7774fff700 1 Processor -- start 2023-10-26T06:45:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.905+0000 7f7774fff700 1 -- start start 2023-10-26T06:45:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.905+0000 7f7774fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 0x7f7770198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.905+0000 7f7774fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701010e0 0x7f7770199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f7774fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770106730 0x7f777019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f7774fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019dd00 con 0x7f77701010e0 2023-10-26T06:45:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f7774fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019de70 con 0x7f7770106730 2023-10-26T06:45:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f7774fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777019e030 con 0x7f7770100720 2023-10-26T06:45:17.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 0x7f7770198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 0x7f7770198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47056/0 (socket says 172.21.15.50:47056) 2023-10-26T06:45:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776e59c700 1 -- 172.21.15.50:0/2339854067 learned_addr learned my addr 172.21.15.50:0/2339854067 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:17.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701010e0 0x7f7770199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776ed9d700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770106730 0x7f777019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 -- 172.21.15.50:0/2339854067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 msgr2=0x7f7770198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 0x7f7770198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 -- 172.21.15.50:0/2339854067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770106730 msgr2=0x7f777019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770106730 0x7f777019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 -- 172.21.15.50:0/2339854067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764009520 con 0x7f77701010e0 2023-10-26T06:45:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776e59c700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 0x7f7770198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.906+0000 7f776dd9b700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701010e0 0x7f7770199320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7764009fd0 tx=0x7f776400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.907+0000 7f775f7fe700 1 -- 172.21.15.50:0/2339854067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776401c070 con 0x7f77701010e0 2023-10-26T06:45:17.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.907+0000 7f775f7fe700 1 -- 172.21.15.50:0/2339854067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f776400baa0 con 0x7f77701010e0 2023-10-26T06:45:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.907+0000 7f775f7fe700 1 -- 172.21.15.50:0/2339854067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640038e0 con 0x7f77701010e0 2023-10-26T06:45:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.907+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777019e2b0 con 0x7f77701010e0 2023-10-26T06:45:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.907+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77701a5b50 con 0x7f77701010e0 2023-10-26T06:45:17.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.910+0000 7f775f7fe700 1 -- 172.21.15.50:0/2339854067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7764020030 con 0x7f77701010e0 2023-10-26T06:45:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.911+0000 7f7788934b80 1 Processor -- start 2023-10-26T06:45:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.911+0000 7f775f7fe700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f77580a1670 0x7f77580a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.911+0000 7f775f7fe700 1 -- 172.21.15.50:0/2339854067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f77640cdcd0 con 0x7f77701010e0 2023-10-26T06:45:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 -- start start 2023-10-26T06:45:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776ed9d700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f77580a1670 0x7f77580a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfb0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 0x5608acfab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfaba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acf1e6e0 con 0x5608acfb0be0 2023-10-26T06:45:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acf04c60 con 0x5608acfab5d0 2023-10-26T06:45:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f7788934b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acf02580 con 0x5608acfb1500 2023-10-26T06:45:17.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 0x5608acfab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 0x5608acfab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47072/0 (socket says 172.21.15.50:47072) 2023-10-26T06:45:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776dd9b700 1 -- 172.21.15.50:0/3537797679 learned_addr learned my addr 172.21.15.50:0/3537797679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776ed9d700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f77580a1670 0x7f77580a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f776800f540 tx=0x7f776800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776e59c700 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfb0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.912+0000 7f776ed9d700 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfaba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776dd9b700 1 -- 172.21.15.50:0/3537797679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 msgr2=0x5608acfaba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776dd9b700 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfaba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776dd9b700 1 -- 172.21.15.50:0/3537797679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 msgr2=0x5608acfb0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776dd9b700 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfb0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776dd9b700 1 -- 172.21.15.50:0/3537797679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608acebb3f0 con 0x5608acfb1500 2023-10-26T06:45:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776e59c700 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfb0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f776dd9b700 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 0x5608acfab090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7764097800 tx=0x7f7764097200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d8ee6ea2b7b2c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f775cff9700 1 -- 172.21.15.50:0/3537797679 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776409a6f0 con 0x5608acfb1500 2023-10-26T06:45:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f775cff9700 1 -- 172.21.15.50:0/3537797679 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77640052b0 con 0x5608acfb1500 2023-10-26T06:45:17.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.913+0000 7f775cff9700 1 -- 172.21.15.50:0/3537797679 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640a3090 con 0x5608acfb1500 2023-10-26T06:45:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 -- 172.21.15.50:0/3537797679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 msgr2=0x5608acfab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 0x5608acfab090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7764097800 tx=0x7f7764097200 comp rx=0 tx=0).stop 2023-10-26T06:45:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 -- 172.21.15.50:0/3537797679 shutdown_connections 2023-10-26T06:45:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfaba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfb0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 --2- 172.21.15.50:0/3537797679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb1500 0x5608acfab090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 -- 172.21.15.50:0/3537797679 >> 172.21.15.50:0/3537797679 conn(0x5608acf1f720 msgr2=0x5608acfa5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 -- 172.21.15.50:0/3537797679 shutdown_connections 2023-10-26T06:45:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.914+0000 7f7788934b80 1 -- 172.21.15.50:0/3537797679 wait complete. 2023-10-26T06:45:17.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.915+0000 7f7788934b80 1 -- start start 2023-10-26T06:45:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.915+0000 7f7788934b80 1 Processor -- start 2023-10-26T06:45:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfb74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 0x5608acfb4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acefde70 con 0x5608acfb1500 2023-10-26T06:45:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ace9a710 con 0x5608acfab5d0 2023-10-26T06:45:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ace9a3b0 con 0x5608acfb0be0 2023-10-26T06:45:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f7788934b80 10 client.0 _ll_register_callbacks cb 0x5608acde4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 0x5608acfb4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 0x5608acfb4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47080/0 (socket says 172.21.15.50:47080) 2023-10-26T06:45:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f776dd9b700 1 -- 172.21.15.50:0/170111737 learned_addr learned my addr 172.21.15.50:0/170111737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f776e59c700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfb74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.916+0000 7f776ed9d700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776dd9b700 1 -- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 msgr2=0x5608acfb74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776dd9b700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfb74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776dd9b700 1 -- 172.21.15.50:0/170111737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 msgr2=0x5608acfb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776dd9b700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfb4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776dd9b700 1 -- 172.21.15.50:0/170111737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77701a5b50 con 0x5608acfb0be0 2023-10-26T06:45:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776ed9d700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:45:17.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f776dd9b700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 0x5608acfb4850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77640a2b60 tx=0x7f776409ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc36f3fe86d3cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:17.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.917+0000 7f7755ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:17.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.918+0000 7f7755ffb700 1 -- 172.21.15.50:0/170111737 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776409ad90 con 0x5608acfb0be0 2023-10-26T06:45:17.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.918+0000 7f7755ffb700 1 -- 172.21.15.50:0/170111737 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7764021380 con 0x5608acfb0be0 2023-10-26T06:45:17.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.918+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608acf02ef0 con 0x5608acfb0be0 2023-10-26T06:45:17.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.918+0000 7f7755ffb700 1 -- 172.21.15.50:0/170111737 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f776409b490 con 0x5608acfb0be0 2023-10-26T06:45:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.918+0000 7f7788934b80 10 client.25786 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.918+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5608acd28de0 con 0x5608acfb0be0 2023-10-26T06:45:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7755ffb700 1 -- 172.21.15.50:0/170111737 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5608acf02ef0 con 0x5608acfb0be0 2023-10-26T06:45:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7755ffb700 1 -- 172.21.15.50:0/170111737 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f77640cb780 con 0x5608acfb0be0 2023-10-26T06:45:17.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7788934b80 10 client.25786 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7788934b80 10 client.25786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7788934b80 20 client.25786 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7788934b80 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608acfc46b0 0x5608acfc6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7788934b80 4 client.25786 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:17.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608acf7a8b0 con 0x5608acfc46b0 2023-10-26T06:45:17.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.919+0000 7f776e59c700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608acfc46b0 0x5608acfc6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.920+0000 7f776e59c700 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608acfc46b0 0x5608acfc6aa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43cb07cb7daeaf76 server_cookie=eb6cc879380ba199 in_seq=0 out_seq=0 2023-10-26T06:45:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.920+0000 7f7755ffb700 10 client.25786 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:17.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7755ffb700 1 -- 172.21.15.50:0/170111737 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5608acf7a8b0 con 0x5608acfc46b0 2023-10-26T06:45:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7755ffb700 10 client.25786 handle_command_reply: tid=0 2023-10-26T06:45:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 client.25786 shutdown 2023-10-26T06:45:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 msgr2=0x5608acfb4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 0x5608acfb4850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77640a2b60 tx=0x7f776409ac80 comp rx=0 tx=0).stop 2023-10-26T06:45:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 shutdown_connections 2023-10-26T06:45:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608acfc46b0 0x5608acfc6aa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfab5d0 0x5608acfb74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7755ffb700 0 client.25786 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 --2- 172.21.15.50:0/170111737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfb0be0 0x5608acfb4850 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 >> 172.21.15.50:0/170111737 conn(0x5608acf1f720 msgr2=0x5608acfaa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 shutdown_connections 2023-10-26T06:45:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 1 -- 172.21.15.50:0/170111737 wait complete. 2023-10-26T06:45:17.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.921+0000 7f7788934b80 20 client.25786 trim_cache size 0 max 16384 2023-10-26T06:45:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 Processor -- start 2023-10-26T06:45:17.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 -- start start 2023-10-26T06:45:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfc0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb0be0 0x5608acfbbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfaedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acd7e920 con 0x5608acfb1500 2023-10-26T06:45:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acf02ef0 con 0x5608acfb0be0 2023-10-26T06:45:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.942+0000 7f7788934b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acfa6a40 con 0x5608acfab5d0 2023-10-26T06:45:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfc0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfaedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfc0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47084/0 (socket says 172.21.15.50:47084) 2023-10-26T06:45:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 -- 172.21.15.50:0/211477543 learned_addr learned my addr 172.21.15.50:0/211477543 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776dd9b700 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb0be0 0x5608acfbbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 -- 172.21.15.50:0/211477543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb0be0 msgr2=0x5608acfbbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb0be0 0x5608acfbbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 -- 172.21.15.50:0/211477543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 msgr2=0x5608acfaedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfaedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.943+0000 7f776e59c700 1 -- 172.21.15.50:0/211477543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608acd11c60 con 0x5608acfab5d0 2023-10-26T06:45:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.944+0000 7f776e59c700 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfc0c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5608acfc7340 tx=0x7f7760009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58912f27651a395d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:17.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.944+0000 7f775d7fa700 1 -- 172.21.15.50:0/211477543 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760017040 con 0x5608acfab5d0 2023-10-26T06:45:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.944+0000 7f775d7fa700 1 -- 172.21.15.50:0/211477543 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7760023070 con 0x5608acfab5d0 2023-10-26T06:45:17.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.944+0000 7f775d7fa700 1 -- 172.21.15.50:0/211477543 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760012a30 con 0x5608acfab5d0 2023-10-26T06:45:17.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 -- 172.21.15.50:0/211477543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 msgr2=0x5608acfc0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfc0c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5608acfc7340 tx=0x7f7760009310 comp rx=0 tx=0).stop 2023-10-26T06:45:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 -- 172.21.15.50:0/211477543 shutdown_connections 2023-10-26T06:45:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb1500 0x5608acfaedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfc0c10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 --2- 172.21.15.50:0/211477543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb0be0 0x5608acfbbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 -- 172.21.15.50:0/211477543 >> 172.21.15.50:0/211477543 conn(0x5608acf1f720 msgr2=0x5608acfae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 -- 172.21.15.50:0/211477543 shutdown_connections 2023-10-26T06:45:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 -- 172.21.15.50:0/211477543 wait complete. 2023-10-26T06:45:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 -- start start 2023-10-26T06:45:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.945+0000 7f7788934b80 1 Processor -- start 2023-10-26T06:45:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfbbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb1500 0x5608acfba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acfbac60 con 0x5608acfb0be0 2023-10-26T06:45:17.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608acfbadd0 con 0x5608acfb1500 2023-10-26T06:45:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ad018480 con 0x5608acfab5d0 2023-10-26T06:45:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f7788934b80 10 client.0 _ll_register_callbacks cb 0x5608acde4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f776e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfbbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f776dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f776e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfbbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47092/0 (socket says 172.21.15.50:47092) 2023-10-26T06:45:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f776e59c700 1 -- 172.21.15.50:0/3182349715 learned_addr learned my addr 172.21.15.50:0/3182349715 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.946+0000 7f776ed9d700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb1500 0x5608acfba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776dd9b700 1 -- 172.21.15.50:0/3182349715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 msgr2=0x5608acfbbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776dd9b700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfbbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776dd9b700 1 -- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb1500 msgr2=0x5608acfba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776dd9b700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb1500 0x5608acfba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776dd9b700 1 -- 172.21.15.50:0/3182349715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7760012040 con 0x5608acfb0be0 2023-10-26T06:45:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776e59c700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfbbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f776dd9b700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfba040 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7764097800 tx=0x7f7764005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b07bfde27a9a72 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7755ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:45:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7755ffb700 1 -- 172.21.15.50:0/3182349715 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776409a8d0 con 0x5608acfb0be0 2023-10-26T06:45:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7755ffb700 1 -- 172.21.15.50:0/3182349715 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7764021380 con 0x5608acfb0be0 2023-10-26T06:45:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77640052b0 con 0x5608acfb0be0 2023-10-26T06:45:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7755ffb700 1 -- 172.21.15.50:0/3182349715 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f776409a6f0 con 0x5608acfb0be0 2023-10-26T06:45:17.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7788934b80 10 client.15768 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.947+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5608acd4f250 con 0x5608acfb0be0 2023-10-26T06:45:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7755ffb700 1 -- 172.21.15.50:0/3182349715 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77640052b0 con 0x5608acfb0be0 2023-10-26T06:45:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7755ffb700 1 -- 172.21.15.50:0/3182349715 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f77640ad050 con 0x5608acfb0be0 2023-10-26T06:45:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7788934b80 10 client.15768 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:17.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7788934b80 10 client.15768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7788934b80 20 client.15768 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7788934b80 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608ad0195d0 0x5608ad01b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7788934b80 4 client.15768 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:45:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5608acef6e50 con 0x5608ad0195d0 2023-10-26T06:45:17.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.948+0000 7f776e59c700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608ad0195d0 0x5608ad01b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f776e59c700 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608ad0195d0 0x5608ad01b9f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f4c6feae9970b8 server_cookie=da3bdb03b663cb80 in_seq=0 out_seq=0 2023-10-26T06:45:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7755ffb700 10 client.15768 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7755ffb700 1 -- 172.21.15.50:0/3182349715 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5608acef6e50 con 0x5608ad0195d0 2023-10-26T06:45:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7755ffb700 10 client.15768 handle_command_reply: tid=0 2023-10-26T06:45:17.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 client.15768 shutdown 2023-10-26T06:45:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 msgr2=0x5608acfba040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfba040 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7764097800 tx=0x7f7764005e30 comp rx=0 tx=0).stop 2023-10-26T06:45:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 shutdown_connections 2023-10-26T06:45:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5608ad0195d0 0x5608ad01b9f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5608acfb1500 0x5608acfba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5608acfab5d0 0x5608acfbbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7755ffb700 0 client.15768 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 --2- 172.21.15.50:0/3182349715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608acfb0be0 0x5608acfba040 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 >> 172.21.15.50:0/3182349715 conn(0x5608acf1f720 msgr2=0x5608acfc0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 shutdown_connections 2023-10-26T06:45:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.949+0000 7f7788934b80 1 -- 172.21.15.50:0/3182349715 wait complete. 2023-10-26T06:45:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7788934b80 20 client.15768 trim_cache size 0 max 16384 2023-10-26T06:45:17.965 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:45:17.965 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:45:17.965 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:45:17.966 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:45:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f77580a1670 msgr2=0x7f77580a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f77580a1670 0x7f77580a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f776800f540 tx=0x7f776800b040 comp rx=0 tx=0).stop 2023-10-26T06:45:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701010e0 msgr2=0x7f7770199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701010e0 0x7f7770199320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7764009fd0 tx=0x7f776400fa00 comp rx=0 tx=0).stop 2023-10-26T06:45:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 shutdown_connections 2023-10-26T06:45:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f77580a1670 0x7f77580a3b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7770106730 0x7f777019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7770100720 0x7f7770198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 --2- 172.21.15.50:0/2339854067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701010e0 0x7f7770199320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 >> 172.21.15.50:0/2339854067 conn(0x7f77700fc1b0 msgr2=0x7f77700fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.950+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 shutdown_connections 2023-10-26T06:45:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:17.951+0000 7f7774fff700 1 -- 172.21.15.50:0/2339854067 wait complete. 2023-10-26T06:45:17.971 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:45:17.971 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:45:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 -- 172.21.15.50:0/885786800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 msgr2=0x7f86d010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 --2- 172.21.15.50:0/885786800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 0x7f86d010d570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f86c800b0a0 tx=0x7f86c800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 -- 172.21.15.50:0/885786800 shutdown_connections 2023-10-26T06:45:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 --2- 172.21.15.50:0/885786800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 0x7f86d010d570 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 --2- 172.21.15.50:0/885786800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01066b0 0x7f86d0106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 --2- 172.21.15.50:0/885786800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86d01006a0 0x7f86d0100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 -- 172.21.15.50:0/885786800 >> 172.21.15.50:0/885786800 conn(0x7f86d00fc170 msgr2=0x7f86d00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 -- 172.21.15.50:0/885786800 shutdown_connections 2023-10-26T06:45:18.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.178+0000 7f86d51ff700 1 -- 172.21.15.50:0/885786800 wait complete. 2023-10-26T06:45:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.179+0000 7f86d51ff700 1 Processor -- start 2023-10-26T06:45:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.179+0000 7f86d51ff700 1 -- start start 2023-10-26T06:45:18.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86d51ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 0x7f86d0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86d51ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 0x7f86d0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86d51ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86d01066b0 0x7f86d0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86d51ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01a4e50 con 0x7f86d01066b0 2023-10-26T06:45:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86d51ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01a4fc0 con 0x7f86d01006a0 2023-10-26T06:45:18.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86d51ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01a5180 con 0x7f86d0101060 2023-10-26T06:45:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86ced9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 0x7f86d0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86ce59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 0x7f86d0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86ced9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 0x7f86d0072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:46852/0 (socket says 172.21.15.50:46852) 2023-10-26T06:45:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86ced9d700 1 -- 172.21.15.50:0/4077849866 learned_addr learned my addr 172.21.15.50:0/4077849866 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.180+0000 7f86cf59e700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86d01066b0 0x7f86d0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86ced9d700 1 -- 172.21.15.50:0/4077849866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 msgr2=0x7f86d0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86ced9d700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 0x7f86d0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86ced9d700 1 -- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86d01066b0 msgr2=0x7f86d0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86ced9d700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86d01066b0 0x7f86d0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86ced9d700 1 -- 172.21.15.50:0/4077849866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4009520 con 0x7f86d01006a0 2023-10-26T06:45:18.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86ced9d700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 0x7f86d0072af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86c000e9a0 tx=0x7f86c000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0009790 con 0x7f86d01006a0 2023-10-26T06:45:18.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c8009d00 con 0x7f86d01006a0 2023-10-26T06:45:18.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86c0010430 con 0x7f86d01006a0 2023-10-26T06:45:18.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0018680 con 0x7f86d01006a0 2023-10-26T06:45:18.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.181+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d01a5830 con 0x7f86d01006a0 2023-10-26T06:45:18.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.182+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d0108c30 con 0x7f86d01006a0 2023-10-26T06:45:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.184+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f86c00105a0 con 0x7f86d01006a0 2023-10-26T06:45:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.186+0000 7f86b7fff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86b80a15f0 0x7f86b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.186+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f86c0014070 con 0x7f86d01006a0 2023-10-26T06:45:18.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.186+0000 7f86ce59c700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86b80a15f0 0x7f86b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.186+0000 7f86ce59c700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86b80a15f0 0x7f86b80a3ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f86d0074220 tx=0x7f86c4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.188+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86c0096560 con 0x7f86d01006a0 2023-10-26T06:45:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.458+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d0101de0 con 0x7f86d01006a0 2023-10-26T06:45:18.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.459+0000 7f86b7fff700 1 -- 172.21.15.50:0/4077849866 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11324 (secure 0 0 0) 0x7f86c0099b80 con 0x7f86d01006a0 2023-10-26T06:45:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:45:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:45:14.436234+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:45:18.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86b80a15f0 msgr2=0x7f86b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86b80a15f0 0x7f86b80a3ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f86d0074220 tx=0x7f86c4009260 comp rx=0 tx=0).stop 2023-10-26T06:45:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 msgr2=0x7f86d0072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 0x7f86d0072af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86c000e9a0 tx=0x7f86c000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 shutdown_connections 2023-10-26T06:45:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f86b80a15f0 0x7f86b80a3ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86d01066b0 0x7f86d0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86d01006a0 0x7f86d0072af0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 --2- 172.21.15.50:0/4077849866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86d0101060 0x7f86d0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 >> 172.21.15.50:0/4077849866 conn(0x7f86d00fc170 msgr2=0x7f86d00fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 shutdown_connections 2023-10-26T06:45:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.462+0000 7f86d51ff700 1 -- 172.21.15.50:0/4077849866 wait complete. 2023-10-26T06:45:18.466 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-10-26T06:45:18.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:45:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/3120397069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d081010e0 msgr2=0x7f2d0810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/3120397069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d081010e0 0x7f2d0810d5f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009f90 tx=0x7f2d0000b330 comp rx=0 tx=0).stop 2023-10-26T06:45:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/3120397069 shutdown_connections 2023-10-26T06:45:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/3120397069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d081010e0 0x7f2d0810d5f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/3120397069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d08106730 0x7f2d08106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/3120397069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d08100720 0x7f2d08100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/3120397069 >> 172.21.15.50:0/3120397069 conn(0x7f2d080fc1b0 msgr2=0x7f2d080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/3120397069 shutdown_connections 2023-10-26T06:45:18.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.693+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/3120397069 wait complete. 2023-10-26T06:45:18.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 Processor -- start 2023-10-26T06:45:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 -- start start 2023-10-26T06:45:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 0x7f2d0819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081010e0 0x7f2d0819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d08106730 0x7f2d08198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08199180 con 0x7f2d08100720 2023-10-26T06:45:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d081992f0 con 0x7f2d081010e0 2023-10-26T06:45:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.695+0000 7f2d0d9ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d081994b0 con 0x7f2d08106730 2023-10-26T06:45:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 0x7f2d0819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 0x7f2d0819e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34684/0 (socket says 172.21.15.50:34684) 2023-10-26T06:45:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 -- 172.21.15.50:0/2452703594 learned_addr learned my addr 172.21.15.50:0/2452703594 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2cfffff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081010e0 0x7f2d0819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d077fe700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d08106730 0x7f2d08198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 -- 172.21.15.50:0/2452703594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d08106730 msgr2=0x7f2d08198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d08106730 0x7f2d08198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 -- 172.21.15.50:0/2452703594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081010e0 msgr2=0x7f2d0819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081010e0 0x7f2d0819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2d06ffd700 1 -- 172.21.15.50:0/2452703594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00009c40 con 0x7f2d08100720 2023-10-26T06:45:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.696+0000 7f2cfffff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081010e0 0x7f2d0819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.697+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 0x7f2d0819e9f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800e9a0 tx=0x7f2cf800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.697+0000 7f2d0c9fd700 1 -- 172.21.15.50:0/2452703594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8009790 con 0x7f2d08100720 2023-10-26T06:45:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.697+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08199790 con 0x7f2d08100720 2023-10-26T06:45:18.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.697+0000 7f2d0c9fd700 1 -- 172.21.15.50:0/2452703594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf800ce80 con 0x7f2d08100720 2023-10-26T06:45:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.697+0000 7f2d0c9fd700 1 -- 172.21.15.50:0/2452703594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8018680 con 0x7f2d08100720 2023-10-26T06:45:18.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.697+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d081a59e0 con 0x7f2d08100720 2023-10-26T06:45:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.700+0000 7f2d0c9fd700 1 -- 172.21.15.50:0/2452703594 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2cf8010430 con 0x7f2d08100720 2023-10-26T06:45:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.702+0000 7f2d0c9fd700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2cf40a1670 0x7f2cf40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.702+0000 7f2d0c9fd700 1 -- 172.21.15.50:0/2452703594 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2cf8014070 con 0x7f2d08100720 2023-10-26T06:45:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.702+0000 7f2d212b4b80 1 Processor -- start 2023-10-26T06:45:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.702+0000 7f2cfffff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2cf40a1670 0x7f2cf40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.702+0000 7f2d212b4b80 1 -- start start 2023-10-26T06:45:18.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2cfffff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2cf40a1670 0x7f2cf40a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2d08199ce0 tx=0x7f2cf0009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d892dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8928090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8928a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d889b6e0 con 0x5639d89285d0 2023-10-26T06:45:18.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d8881c60 con 0x5639d892e500 2023-10-26T06:45:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d887f580 con 0x5639d892dbe0 2023-10-26T06:45:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d892dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d892dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47124/0 (socket says 172.21.15.50:47124) 2023-10-26T06:45:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 -- 172.21.15.50:0/3796241095 learned_addr learned my addr 172.21.15.50:0/3796241095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d077fe700 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8928a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2cfffff700 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8928090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 -- 172.21.15.50:0/3796241095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 msgr2=0x5639d8928090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8928090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 -- 172.21.15.50:0/3796241095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 msgr2=0x5639d8928a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8928a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.703+0000 7f2d06ffd700 1 -- 172.21.15.50:0/3796241095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639d88383f0 con 0x5639d892dbe0 2023-10-26T06:45:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.704+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d892dfc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8096c10 tx=0x7f2cf809a8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f768073bc2628e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.704+0000 7f2cfdffb700 1 -- 172.21.15.50:0/3796241095 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf809e2f0 con 0x5639d892dbe0 2023-10-26T06:45:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.704+0000 7f2cfdffb700 1 -- 172.21.15.50:0/3796241095 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf80a2530 con 0x5639d892dbe0 2023-10-26T06:45:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.704+0000 7f2cfdffb700 1 -- 172.21.15.50:0/3796241095 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80998f0 con 0x5639d892dbe0 2023-10-26T06:45:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 -- 172.21.15.50:0/3796241095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 msgr2=0x5639d892dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d892dfc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8096c10 tx=0x7f2cf809a8a0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 -- 172.21.15.50:0/3796241095 shutdown_connections 2023-10-26T06:45:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8928a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d892dfc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/3796241095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8928090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 -- 172.21.15.50:0/3796241095 >> 172.21.15.50:0/3796241095 conn(0x5639d889c720 msgr2=0x5639d8922b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 -- 172.21.15.50:0/3796241095 shutdown_connections 2023-10-26T06:45:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 -- 172.21.15.50:0/3796241095 wait complete. 2023-10-26T06:45:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.705+0000 7f2d212b4b80 1 -- start start 2023-10-26T06:45:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 Processor -- start 2023-10-26T06:45:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d89285d0 0x5639d8934520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 0x5639d89317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8931e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d887ae70 con 0x5639d892dbe0 2023-10-26T06:45:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d8817710 con 0x5639d892e500 2023-10-26T06:45:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d88173b0 con 0x5639d89285d0 2023-10-26T06:45:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d212b4b80 10 client.0 _ll_register_callbacks cb 0x5639d8761a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2cfffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 0x5639d89317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2cfffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 0x5639d89317a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34708/0 (socket says 172.21.15.50:34708) 2023-10-26T06:45:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2cfffff700 1 -- 172.21.15.50:0/919688837 learned_addr learned my addr 172.21.15.50:0/919688837 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d89285d0 0x5639d8934520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.706+0000 7f2d077fe700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8931e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2cfffff700 1 -- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d89285d0 msgr2=0x5639d8934520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2cfffff700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d89285d0 0x5639d8934520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2cfffff700 1 -- 172.21.15.50:0/919688837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 msgr2=0x5639d8931e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2cfffff700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8931e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2cfffff700 1 -- 172.21.15.50:0/919688837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d081a59e0 con 0x5639d892dbe0 2023-10-26T06:45:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d89285d0 0x5639d8934520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2cfffff700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 0x5639d89317a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00039d0 tx=0x7f2cf00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f62350ed38c725e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2ce6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:45:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/919688837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf001fa50 con 0x5639d892dbe0 2023-10-26T06:45:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/919688837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2cf001fbb0 con 0x5639d892dbe0 2023-10-26T06:45:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.707+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639d887fef0 con 0x5639d892dbe0 2023-10-26T06:45:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/919688837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf001fd70 con 0x5639d892dbe0 2023-10-26T06:45:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 10 client.15786 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5639d86a5de0 con 0x5639d892dbe0 2023-10-26T06:45:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/919688837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5639d887fef0 con 0x5639d892dbe0 2023-10-26T06:45:18.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/919688837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2cf0028560 con 0x5639d892dbe0 2023-10-26T06:45:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 10 client.15786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:45:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 20 client.15786 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8941f60 0x5639d8944380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 4 client.15786 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.708+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639d88f78b0 con 0x5639d8941f60 2023-10-26T06:45:18.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.709+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8941f60 0x5639d8944380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.709+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8941f60 0x5639d8944380 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=815bdf7267e83d2f server_cookie=700bb521e1147d01 in_seq=0 out_seq=0 2023-10-26T06:45:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.709+0000 7f2ce6ffd700 10 client.15786 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/919688837 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5639d88f78b0 con 0x5639d8941f60 2023-10-26T06:45:18.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2ce6ffd700 10 client.15786 handle_command_reply: tid=0 2023-10-26T06:45:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 client.15786 shutdown 2023-10-26T06:45:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 msgr2=0x5639d89317a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 0x5639d89317a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00039d0 tx=0x7f2cf00047c0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 shutdown_connections 2023-10-26T06:45:18.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8941f60 0x5639d8944380 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892e500 0x5639d8931e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d89285d0 0x5639d8934520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/919688837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892dbe0 0x5639d89317a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 >> 172.21.15.50:0/919688837 conn(0x5639d889c720 msgr2=0x5639d8927080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2ce6ffd700 0 client.15786 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 shutdown_connections 2023-10-26T06:45:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 1 -- 172.21.15.50:0/919688837 wait complete. 2023-10-26T06:45:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.710+0000 7f2d212b4b80 20 client.15786 trim_cache size 0 max 16384 2023-10-26T06:45:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 Processor -- start 2023-10-26T06:45:18.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 -- start start 2023-10-26T06:45:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d89285d0 0x5639d8931e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d8938eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 0x5639d8927970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d86fb920 con 0x5639d892e500 2023-10-26T06:45:18.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d89393f0 con 0x5639d89285d0 2023-10-26T06:45:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d891f1a0 con 0x5639d892dbe0 2023-10-26T06:45:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 0x5639d8927970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d89285d0 0x5639d8931e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 0x5639d8927970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34722/0 (socket says 172.21.15.50:34722) 2023-10-26T06:45:18.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2d077fe700 1 -- 172.21.15.50:0/1575704177 learned_addr learned my addr 172.21.15.50:0/1575704177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.725+0000 7f2cfffff700 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d8938eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d06ffd700 1 -- 172.21.15.50:0/1575704177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 msgr2=0x5639d8938eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d8938eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d06ffd700 1 -- 172.21.15.50:0/1575704177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 msgr2=0x5639d8927970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 0x5639d8927970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d06ffd700 1 -- 172.21.15.50:0/1575704177 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639d868ec60 con 0x5639d89285d0 2023-10-26T06:45:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d077fe700 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 0x5639d8927970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d89285d0 0x5639d8931e50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8096c10 tx=0x7f2cf809aa10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf24a911831fa4d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2cfe7fc700 1 -- 172.21.15.50:0/1575704177 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf809e2f0 con 0x5639d89285d0 2023-10-26T06:45:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2cfe7fc700 1 -- 172.21.15.50:0/1575704177 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf8098540 con 0x5639d89285d0 2023-10-26T06:45:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.726+0000 7f2cfe7fc700 1 -- 172.21.15.50:0/1575704177 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80a2300 con 0x5639d89285d0 2023-10-26T06:45:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1575704177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d89285d0 msgr2=0x5639d8931e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d89285d0 0x5639d8931e50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8096c10 tx=0x7f2cf809aa10 comp rx=0 tx=0).stop 2023-10-26T06:45:18.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1575704177 shutdown_connections 2023-10-26T06:45:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d892e500 0x5639d8927970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d89285d0 0x5639d8931e50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1575704177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892dbe0 0x5639d8938eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1575704177 >> 172.21.15.50:0/1575704177 conn(0x5639d889c720 msgr2=0x5639d89289b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1575704177 shutdown_connections 2023-10-26T06:45:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1575704177 wait complete. 2023-10-26T06:45:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.727+0000 7f2d212b4b80 1 -- start start 2023-10-26T06:45:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 Processor -- start 2023-10-26T06:45:18.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8936e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892dbe0 0x5639d89373a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 0x5639d89378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d8939250 con 0x5639d89285d0 2023-10-26T06:45:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d89393c0 con 0x5639d892dbe0 2023-10-26T06:45:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.728+0000 7f2d212b4b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639d8994de0 con 0x5639d892e500 2023-10-26T06:45:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d212b4b80 10 client.0 _ll_register_callbacks cb 0x5639d8761a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:18.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 0x5639d89378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 0x5639d89378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47146/0 (socket says 172.21.15.50:47146) 2023-10-26T06:45:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 -- 172.21.15.50:0/1648559108 learned_addr learned my addr 172.21.15.50:0/1648559108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2cfffff700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892dbe0 0x5639d89373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8936e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 -- 172.21.15.50:0/1648559108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892dbe0 msgr2=0x5639d89373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892dbe0 0x5639d89373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 -- 172.21.15.50:0/1648559108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 msgr2=0x5639d8936e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8936e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 -- 172.21.15.50:0/1648559108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0810def0 con 0x5639d892e500 2023-10-26T06:45:18.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2cfffff700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892dbe0 0x5639d89373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2d077fe700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 0x5639d89378e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d00007f50 tx=0x7f2d00003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbced6db61bfdfe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.729+0000 7f2ce6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/1648559108 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000e040 con 0x5639d892e500 2023-10-26T06:45:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cf80a2530 con 0x5639d892e500 2023-10-26T06:45:18.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/1648559108 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2d00007420 con 0x5639d892e500 2023-10-26T06:45:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/1648559108 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d000075e0 con 0x5639d892e500 2023-10-26T06:45:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2d212b4b80 10 client.25816 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:18.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f2cf80b1040 con 0x5639d892e500 2023-10-26T06:45:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/1648559108 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf80a2530 con 0x5639d892e500 2023-10-26T06:45:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/1648559108 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d0002e020 con 0x5639d892e500 2023-10-26T06:45:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2d212b4b80 10 client.25816 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:18.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2d212b4b80 10 client.25816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:45:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.730+0000 7f2d212b4b80 20 client.25816 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8996580 0x5639d89989a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2d212b4b80 4 client.25816 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:45:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5639d8873e50 con 0x5639d8996580 2023-10-26T06:45:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8996580 0x5639d89989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2d06ffd700 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8996580 0x5639d89989a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e37f9ae80f2b3a8e server_cookie=996221d28daee739 in_seq=0 out_seq=0 2023-10-26T06:45:18.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2ce6ffd700 10 client.25816 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2ce6ffd700 1 -- 172.21.15.50:0/1648559108 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5639d8873e50 con 0x5639d8996580 2023-10-26T06:45:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2ce6ffd700 10 client.25816 handle_command_reply: tid=0 2023-10-26T06:45:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.731+0000 7f2d212b4b80 1 client.25816 shutdown 2023-10-26T06:45:18.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 msgr2=0x5639d89378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 0x5639d89378e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d00007f50 tx=0x7f2d00003f90 comp rx=0 tx=0).stop 2023-10-26T06:45:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 shutdown_connections 2023-10-26T06:45:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5639d8996580 0x5639d89989a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5639d892e500 0x5639d89378e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2ce6ffd700 0 client.25816 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5639d89285d0 0x5639d8936e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 --2- 172.21.15.50:0/1648559108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5639d892dbe0 0x5639d89373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 >> 172.21.15.50:0/1648559108 conn(0x5639d889c720 msgr2=0x5639d892b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 shutdown_connections 2023-10-26T06:45:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 1 -- 172.21.15.50:0/1648559108 wait complete. 2023-10-26T06:45:18.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.732+0000 7f2d212b4b80 20 client.25816 trim_cache size 0 max 16384 2023-10-26T06:45:18.761 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:45:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2cf40a1670 msgr2=0x7f2cf40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2cf40a1670 0x7f2cf40a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2d08199ce0 tx=0x7f2cf0009310 comp rx=0 tx=0).stop 2023-10-26T06:45:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 msgr2=0x7f2d0819e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 0x7f2d0819e9f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800e9a0 tx=0x7f2cf800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 shutdown_connections 2023-10-26T06:45:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2cf40a1670 0x7f2cf40a3b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d08106730 0x7f2d08198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d08100720 0x7f2d0819e9f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 --2- 172.21.15.50:0/2452703594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d081010e0 0x7f2d0819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 >> 172.21.15.50:0/2452703594 conn(0x7f2d080fc1b0 msgr2=0x7f2d08072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 shutdown_connections 2023-10-26T06:45:18.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.733+0000 7f2d0d9ff700 1 -- 172.21.15.50:0/2452703594 wait complete. 2023-10-26T06:45:18.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:45:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1265155738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc100720 msgr2=0x7fb6dc100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1265155738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc100720 0x7fb6dc100ba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009990 tx=0x7fb6d0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1265155738 shutdown_connections 2023-10-26T06:45:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1265155738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1265155738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6dc106730 0x7fb6dc106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1265155738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc100720 0x7fb6dc100ba0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1265155738 >> 172.21.15.50:0/1265155738 conn(0x7fb6dc0fc1b0 msgr2=0x7fb6dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1265155738 shutdown_connections 2023-10-26T06:45:18.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.973+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1265155738 wait complete. 2023-10-26T06:45:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.974+0000 7fb6e13ff700 1 Processor -- start 2023-10-26T06:45:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 -- start start 2023-10-26T06:45:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6dc100720 0x7fb6dc198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6dc106730 0x7fb6dc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc19dcc0 con 0x7fb6dc100720 2023-10-26T06:45:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc19de30 con 0x7fb6dc106730 2023-10-26T06:45:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6e13ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc19dff0 con 0x7fb6dc1010e0 2023-10-26T06:45:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6da7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6da7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47158/0 (socket says 172.21.15.50:47158) 2023-10-26T06:45:18.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6da7fc700 1 -- 172.21.15.50:0/1560633285 learned_addr learned my addr 172.21.15.50:0/1560633285 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.975+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6dc100720 0x7fb6dc198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6dc106730 0x7fb6dc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6da7fc700 1 -- 172.21.15.50:0/1560633285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6dc106730 msgr2=0x7fb6dc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6dc106730 0x7fb6dc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6da7fc700 1 -- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6dc100720 msgr2=0x7fb6dc198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6dc100720 0x7fb6dc198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6da7fc700 1 -- 172.21.15.50:0/1560633285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00095f0 con 0x7fb6dc1010e0 2023-10-26T06:45:18.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc1992e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0000c00 tx=0x7fb6d0005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.976+0000 7fb6c3fff700 1 -- 172.21.15.50:0/1560633285 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d001d070 con 0x7fb6dc1010e0 2023-10-26T06:45:18.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.977+0000 7fb6c3fff700 1 -- 172.21.15.50:0/1560633285 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6d0022470 con 0x7fb6dc1010e0 2023-10-26T06:45:18.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.977+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc19e270 con 0x7fb6dc1010e0 2023-10-26T06:45:18.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.977+0000 7fb6c3fff700 1 -- 172.21.15.50:0/1560633285 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0017650 con 0x7fb6dc1010e0 2023-10-26T06:45:18.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.977+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc1a5b10 con 0x7fb6dc1010e0 2023-10-26T06:45:18.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.980+0000 7fb6c3fff700 1 -- 172.21.15.50:0/1560633285 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb6d00225e0 con 0x7fb6dc1010e0 2023-10-26T06:45:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6f4d98b80 1 Processor -- start 2023-10-26T06:45:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6f4d98b80 1 -- start start 2023-10-26T06:45:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6c3fff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6c40a1670 0x7fb6c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c4184fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6c3fff700 1 -- 172.21.15.50:0/1560633285 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb6d00ce2b0 con 0x7fb6dc1010e0 2023-10-26T06:45:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4185500 0x5576c417f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.981+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c417f5d0 0x5576c417fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c40f26e0 con 0x5576c417f5d0 2023-10-26T06:45:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c40d8c60 con 0x5576c4185500 2023-10-26T06:45:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c40d6580 con 0x5576c4184be0 2023-10-26T06:45:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c4184fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c4184fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47174/0 (socket says 172.21.15.50:47174) 2023-10-26T06:45:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 -- 172.21.15.50:0/455768296 learned_addr learned my addr 172.21.15.50:0/455768296 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6c40a1670 0x7fb6c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4185500 0x5576c417f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c417f5d0 0x5576c417fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:18.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 -- 172.21.15.50:0/455768296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4185500 msgr2=0x5576c417f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4185500 0x5576c417f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 -- 172.21.15.50:0/455768296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c417f5d0 msgr2=0x5576c417fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:18.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c417f5d0 0x5576c417fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 -- 172.21.15.50:0/455768296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576c408f3f0 con 0x5576c4184be0 2023-10-26T06:45:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6daffd700 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c4184fc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009d00 tx=0x7fb6cc011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5afcda1530b16ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.982+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6c40a1670 0x7fb6c40a3b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009ec0 tx=0x7fb6d4009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.983+0000 7fb6c17fa700 1 -- 172.21.15.50:0/455768296 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc004230 con 0x5576c4184be0 2023-10-26T06:45:18.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.983+0000 7fb6c17fa700 1 -- 172.21.15.50:0/455768296 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6cc004390 con 0x5576c4184be0 2023-10-26T06:45:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.983+0000 7fb6c17fa700 1 -- 172.21.15.50:0/455768296 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc019880 con 0x5576c4184be0 2023-10-26T06:45:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.983+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/455768296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 msgr2=0x5576c4184fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:18.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.983+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c4184fc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc009d00 tx=0x7fb6cc011720 comp rx=0 tx=0).stop 2023-10-26T06:45:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/455768296 shutdown_connections 2023-10-26T06:45:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c417f5d0 0x5576c417fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c4184fc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/455768296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4185500 0x5576c417f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:18.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/455768296 >> 172.21.15.50:0/455768296 conn(0x5576c40f3720 msgr2=0x5576c4179b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:18.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/455768296 shutdown_connections 2023-10-26T06:45:18.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/455768296 wait complete. 2023-10-26T06:45:18.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 -- start start 2023-10-26T06:45:18.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.984+0000 7fb6f4d98b80 1 Processor -- start 2023-10-26T06:45:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c418b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4188720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4188d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:18.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c40d1e70 con 0x5576c4185500 2023-10-26T06:45:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c406e710 con 0x5576c4184be0 2023-10-26T06:45:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c406e3b0 con 0x5576c417f5d0 2023-10-26T06:45:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6f4d98b80 10 client.0 _ll_register_callbacks cb 0x5576c3fb8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:19.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c418b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6db7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4188d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c418b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47190/0 (socket says 172.21.15.50:47190) 2023-10-26T06:45:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6daffd700 1 -- 172.21.15.50:0/1838512332 learned_addr learned my addr 172.21.15.50:0/1838512332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.985+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4188720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6daffd700 1 -- 172.21.15.50:0/1838512332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 msgr2=0x5576c4188720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4188720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6daffd700 1 -- 172.21.15.50:0/1838512332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 msgr2=0x5576c4188d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4188d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6daffd700 1 -- 172.21.15.50:0/1838512332 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc009960 con 0x5576c417f5d0 2023-10-26T06:45:19.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c418b4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000c00 tx=0x7fb6cc0038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9bb946b0d2e6339 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6beff5700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6beff5700 1 -- 172.21.15.50:0/1838512332 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc005040 con 0x5576c417f5d0 2023-10-26T06:45:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6beff5700 1 -- 172.21.15.50:0/1838512332 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb6cc0051a0 con 0x5576c417f5d0 2023-10-26T06:45:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576c40d6ef0 con 0x5576c417f5d0 2023-10-26T06:45:19.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6beff5700 1 -- 172.21.15.50:0/1838512332 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6cc005360 con 0x5576c417f5d0 2023-10-26T06:45:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6f4d98b80 10 client.25828 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.986+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5576c3efcde0 con 0x5576c417f5d0 2023-10-26T06:45:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6beff5700 1 -- 172.21.15.50:0/1838512332 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5576c40d6ef0 con 0x5576c417f5d0 2023-10-26T06:45:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6beff5700 1 -- 172.21.15.50:0/1838512332 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb6cc032020 con 0x5576c417f5d0 2023-10-26T06:45:19.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6f4d98b80 10 client.25828 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6f4d98b80 10 client.25828 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:45:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6f4d98b80 20 client.25828 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c4198c20 0x5576c419b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6f4d98b80 4 client.25828 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576c414e8b0 con 0x5576c4198c20 2023-10-26T06:45:19.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.987+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c4198c20 0x5576c419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.988+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c4198c20 0x5576c419b040 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0ef5feb634aa361 server_cookie=cc6645d6eb50974d in_seq=0 out_seq=0 2023-10-26T06:45:19.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.988+0000 7fb6beff5700 10 client.25828 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6beff5700 1 -- 172.21.15.50:0/1838512332 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5576c414e8b0 con 0x5576c4198c20 2023-10-26T06:45:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6beff5700 10 client.25828 handle_command_reply: tid=0 2023-10-26T06:45:19.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 client.25828 shutdown 2023-10-26T06:45:19.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 msgr2=0x5576c418b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c418b4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000c00 tx=0x7fb6cc0038b0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 shutdown_connections 2023-10-26T06:45:19.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4188d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c418b4a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c4198c20 0x5576c419b040 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1838512332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4188720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 >> 172.21.15.50:0/1838512332 conn(0x5576c40f3720 msgr2=0x5576c4179ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6beff5700 0 client.25828 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:19.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.990+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 shutdown_connections 2023-10-26T06:45:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.991+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1838512332 wait complete. 2023-10-26T06:45:19.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:18.991+0000 7fb6f4d98b80 20 client.25828 trim_cache size 0 max 16384 2023-10-26T06:45:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.006+0000 7fb6f4d98b80 1 Processor -- start 2023-10-26T06:45:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 -- start start 2023-10-26T06:45:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c417f5d0 0x5576c418feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c418afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4187fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c4174af0 con 0x5576c4185500 2023-10-26T06:45:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c3f52920 con 0x5576c417f5d0 2023-10-26T06:45:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c41904a0 con 0x5576c4184be0 2023-10-26T06:45:19.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c418afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c418afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47198/0 (socket says 172.21.15.50:47198) 2023-10-26T06:45:19.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 -- 172.21.15.50:0/3679897772 learned_addr learned my addr 172.21.15.50:0/3679897772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4187fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6daffd700 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c417f5d0 0x5576c418feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 -- 172.21.15.50:0/3679897772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c417f5d0 msgr2=0x5576c418feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c417f5d0 0x5576c418feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 -- 172.21.15.50:0/3679897772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 msgr2=0x5576c4187fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4187fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.007+0000 7fb6da7fc700 1 -- 172.21.15.50:0/3679897772 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576c3ee5c60 con 0x5576c4184be0 2023-10-26T06:45:19.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.008+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4187fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.008+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c418afd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0022c40 tx=0x7fb6d0009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e184e33030d110a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.008+0000 7fb6c1ffb700 1 -- 172.21.15.50:0/3679897772 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d009ba70 con 0x5576c4184be0 2023-10-26T06:45:19.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.008+0000 7fb6c1ffb700 1 -- 172.21.15.50:0/3679897772 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6d009b370 con 0x5576c4184be0 2023-10-26T06:45:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.008+0000 7fb6c1ffb700 1 -- 172.21.15.50:0/3679897772 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d009f170 con 0x5576c4184be0 2023-10-26T06:45:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/3679897772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 msgr2=0x5576c418afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c418afd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0022c40 tx=0x7fb6d0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/3679897772 shutdown_connections 2023-10-26T06:45:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4187fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c417f5d0 0x5576c418feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/3679897772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c4184be0 0x5576c418afd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/3679897772 >> 172.21.15.50:0/3679897772 conn(0x5576c40f3720 msgr2=0x5576c417f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/3679897772 shutdown_connections 2023-10-26T06:45:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/3679897772 wait complete. 2023-10-26T06:45:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 -- start start 2023-10-26T06:45:19.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.009+0000 7fb6f4d98b80 1 Processor -- start 2023-10-26T06:45:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c4181940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4181e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4180630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c4180d40 con 0x5576c4185500 2023-10-26T06:45:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c4180eb0 con 0x5576c4184be0 2023-10-26T06:45:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c4181070 con 0x5576c417f5d0 2023-10-26T06:45:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6f4d98b80 10 client.0 _ll_register_callbacks cb 0x5576c3fb8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c4181940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c4181940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47206/0 (socket says 172.21.15.50:47206) 2023-10-26T06:45:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 -- 172.21.15.50:0/1314265032 learned_addr learned my addr 172.21.15.50:0/1314265032 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6db7fe700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4180630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4181e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 -- 172.21.15.50:0/1314265032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 msgr2=0x5576c4181e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4181e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 -- 172.21.15.50:0/1314265032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 msgr2=0x5576c4180630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4180630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.010+0000 7fb6daffd700 1 -- 172.21.15.50:0/1314265032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc1a5b10 con 0x5576c417f5d0 2023-10-26T06:45:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6daffd700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c4181940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc022810 tx=0x7fb6cc003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab69c172aa98259 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6beff5700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:19.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6beff5700 1 -- 172.21.15.50:0/1314265032 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc022e60 con 0x5576c417f5d0 2023-10-26T06:45:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6cc004390 con 0x5576c417f5d0 2023-10-26T06:45:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6beff5700 1 -- 172.21.15.50:0/1314265032 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb6cc000e40 con 0x5576c417f5d0 2023-10-26T06:45:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6beff5700 1 -- 172.21.15.50:0/1314265032 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6cc003920 con 0x5576c417f5d0 2023-10-26T06:45:19.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6f4d98b80 10 client.25834 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5576c3f23250 con 0x5576c417f5d0 2023-10-26T06:45:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.011+0000 7fb6beff5700 1 -- 172.21.15.50:0/1314265032 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6cc042020 con 0x5576c417f5d0 2023-10-26T06:45:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6beff5700 1 -- 172.21.15.50:0/1314265032 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb6cc03c020 con 0x5576c417f5d0 2023-10-26T06:45:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6f4d98b80 10 client.25834 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6f4d98b80 10 client.25834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:45:19.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6f4d98b80 20 client.25834 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c41ed770 0x5576c41efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6f4d98b80 4 client.25834 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:45:19.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5576c40cae50 con 0x5576c41ed770 2023-10-26T06:45:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c41ed770 0x5576c41efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6da7fc700 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c41ed770 0x5576c41efb60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b7a8b7906cd9697 server_cookie=44570a1bcb564b25 in_seq=0 out_seq=0 2023-10-26T06:45:19.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.012+0000 7fb6beff5700 10 client.25834 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.014+0000 7fb6beff5700 1 -- 172.21.15.50:0/1314265032 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5576c40cae50 con 0x5576c41ed770 2023-10-26T06:45:19.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.014+0000 7fb6beff5700 10 client.25834 handle_command_reply: tid=0 2023-10-26T06:45:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.014+0000 7fb6f4d98b80 1 client.25834 shutdown 2023-10-26T06:45:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 msgr2=0x5576c4181940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c4181940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc022810 tx=0x7fb6cc003f30 comp rx=0 tx=0).stop 2023-10-26T06:45:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 shutdown_connections 2023-10-26T06:45:19.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576c4185500 0x5576c4180630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5576c417f5d0 0x5576c4181940 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x5576c41ed770 0x5576c41efb60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 --2- 172.21.15.50:0/1314265032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5576c4184be0 0x5576c4181e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 >> 172.21.15.50:0/1314265032 conn(0x5576c40f3720 msgr2=0x5576c4187f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6beff5700 0 client.25834 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 shutdown_connections 2023-10-26T06:45:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 1 -- 172.21.15.50:0/1314265032 wait complete. 2023-10-26T06:45:19.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.015+0000 7fb6f4d98b80 20 client.25834 trim_cache size 0 max 16384 2023-10-26T06:45:19.035 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:45:19.035 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:18 smithi050 ceph-mon[94997]: pgmap v368: 97 pgs: 97 active+clean; 206 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 63 op/s 2023-10-26T06:45:19.036 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:18 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/4077849866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:45:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6c40a1670 msgr2=0x7fb6c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6c40a1670 0x7fb6c40a3b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009ec0 tx=0x7fb6d4009920 comp rx=0 tx=0).stop 2023-10-26T06:45:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 msgr2=0x7fb6dc1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc1992e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0000c00 tx=0x7fb6d0005740 comp rx=0 tx=0).stop 2023-10-26T06:45:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 shutdown_connections 2023-10-26T06:45:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb6c40a1670 0x7fb6c40a3b30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6dc106730 0x7fb6dc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6dc100720 0x7fb6dc198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 --2- 172.21.15.50:0/1560633285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc1010e0 0x7fb6dc1992e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 >> 172.21.15.50:0/1560633285 conn(0x7fb6dc0fc1b0 msgr2=0x7fb6dc10be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 shutdown_connections 2023-10-26T06:45:19.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.016+0000 7fb6e13ff700 1 -- 172.21.15.50:0/1560633285 wait complete. 2023-10-26T06:45:19.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:45:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:18 smithi125 ceph-mon[130643]: pgmap v368: 97 pgs: 97 active+clean; 206 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 63 op/s 2023-10-26T06:45:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:18 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/4077849866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:45:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:18 smithi153 ceph-mon[131657]: pgmap v368: 97 pgs: 97 active+clean; 206 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 63 op/s 2023-10-26T06:45:19.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:18 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/4077849866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:45:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 -- 172.21.15.50:0/2012466116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 msgr2=0x7f99dc10d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 --2- 172.21.15.50:0/2012466116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc10d540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b0d0 tx=0x7f99d400b3e0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 -- 172.21.15.50:0/2012466116 shutdown_connections 2023-10-26T06:45:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 --2- 172.21.15.50:0/2012466116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc10d540 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 --2- 172.21.15.50:0/2012466116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 --2- 172.21.15.50:0/2012466116 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 0x7f99dc1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.256+0000 7f99e13ff700 1 -- 172.21.15.50:0/2012466116 >> 172.21.15.50:0/2012466116 conn(0x7f99dc0767f0 msgr2=0x7f99dc076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.257+0000 7f99e13ff700 1 -- 172.21.15.50:0/2012466116 shutdown_connections 2023-10-26T06:45:19.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.257+0000 7f99e13ff700 1 -- 172.21.15.50:0/2012466116 wait complete. 2023-10-26T06:45:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 Processor -- start 2023-10-26T06:45:19.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 -- start start 2023-10-26T06:45:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 0x7f99dc1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19ddd0 con 0x7f99dc067d40 2023-10-26T06:45:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19df40 con 0x7f99dc105170 2023-10-26T06:45:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99e13ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19e100 con 0x7f99dc105b30 2023-10-26T06:45:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.258+0000 7f99db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34816/0 (socket says 172.21.15.50:34816) 2023-10-26T06:45:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99daffd700 1 -- 172.21.15.50:0/1497933966 learned_addr learned my addr 172.21.15.50:0/1497933966 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99da7fc700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 0x7f99dc1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99db7fe700 1 -- 172.21.15.50:0/1497933966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 msgr2=0x7f99dc1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99db7fe700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 0x7f99dc1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99db7fe700 1 -- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 msgr2=0x7f99dc198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99db7fe700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99db7fe700 1 -- 172.21.15.50:0/1497933966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009520 con 0x7f99dc105b30 2023-10-26T06:45:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99da7fc700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 0x7f99dc1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:19.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99daffd700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99db7fe700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc19d790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b770 tx=0x7f99d400bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99c3fff700 1 -- 172.21.15.50:0/1497933966 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400e040 con 0x7f99dc105b30 2023-10-26T06:45:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d4009d00 con 0x7f99dc105b30 2023-10-26T06:45:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99c3fff700 1 -- 172.21.15.50:0/1497933966 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99d401b460 con 0x7f99dc105b30 2023-10-26T06:45:19.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.259+0000 7f99c3fff700 1 -- 172.21.15.50:0/1497933966 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4005290 con 0x7f99dc105b30 2023-10-26T06:45:19.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.260+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc1a5a40 con 0x7f99dc105b30 2023-10-26T06:45:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.263+0000 7f99c3fff700 1 -- 172.21.15.50:0/1497933966 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f99d401b5d0 con 0x7f99dc105b30 2023-10-26T06:45:19.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.264+0000 7f99f4ddab80 1 Processor -- start 2023-10-26T06:45:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 -- start start 2023-10-26T06:45:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474be1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474bdc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474b4f6e0 con 0x562474bdc5d0 2023-10-26T06:45:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474b35c60 con 0x562474be1be0 2023-10-26T06:45:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474b33580 con 0x562474be2500 2023-10-26T06:45:19.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99c3fff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99c40a15f0 0x7f99c40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.265+0000 7f99c3fff700 1 -- 172.21.15.50:0/1497933966 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f99d40cde70 con 0x7f99dc105b30 2023-10-26T06:45:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474bdc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474be1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474bdc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47240/0 (socket says 172.21.15.50:47240) 2023-10-26T06:45:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 -- 172.21.15.50:0/1311390381 learned_addr learned my addr 172.21.15.50:0/1311390381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99db7fe700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99c40a15f0 0x7f99c40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99da7fc700 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 -- 172.21.15.50:0/1311390381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 msgr2=0x562474be1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474be1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 -- 172.21.15.50:0/1311390381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 msgr2=0x562474bdca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 -- 172.21.15.50:0/1311390381 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562474aec3f0 con 0x562474be2500 2023-10-26T06:45:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99db7fe700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99c40a15f0 0x7f99c40a3ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f99d4097430 tx=0x7f99d400b3e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.266+0000 7f99daffd700 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474bdc090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99cc011840 tx=0x7f99cc011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a822365c1bcd0ec server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99c17fa700 1 -- 172.21.15.50:0/1311390381 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc011030 con 0x562474be2500 2023-10-26T06:45:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99c17fa700 1 -- 172.21.15.50:0/1311390381 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99cc011190 con 0x562474be2500 2023-10-26T06:45:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99c17fa700 1 -- 172.21.15.50:0/1311390381 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0107d0 con 0x562474be2500 2023-10-26T06:45:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1311390381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 msgr2=0x562474bdc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474bdc090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99cc011840 tx=0x7f99cc011b50 comp rx=0 tx=0).stop 2023-10-26T06:45:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1311390381 shutdown_connections 2023-10-26T06:45:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474be1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1311390381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474bdc090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1311390381 >> 172.21.15.50:0/1311390381 conn(0x562474b50720 msgr2=0x562474bd6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.267+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1311390381 shutdown_connections 2023-10-26T06:45:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.268+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1311390381 wait complete. 2023-10-26T06:45:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.268+0000 7f99f4ddab80 1 -- start start 2023-10-26T06:45:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.268+0000 7f99f4ddab80 1 Processor -- start 2023-10-26T06:45:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474bdc5d0 0x562474be8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 0x562474be5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474b2ee70 con 0x562474be1be0 2023-10-26T06:45:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474acb710 con 0x562474bdc5d0 2023-10-26T06:45:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474acb3b0 con 0x562474be2500 2023-10-26T06:45:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99f4ddab80 10 client.0 _ll_register_callbacks cb 0x562474a15a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474bdc5d0 0x562474be8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 0x562474be5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 0x562474be5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34826/0 (socket says 172.21.15.50:34826) 2023-10-26T06:45:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474bdc5d0 0x562474be8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:46976/0 (socket says 172.21.15.50:46976) 2023-10-26T06:45:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 -- 172.21.15.50:0/3871739424 learned_addr learned my addr 172.21.15.50:0/3871739424 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 -- 172.21.15.50:0/3871739424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 msgr2=0x562474be5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 -- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474bdc5d0 msgr2=0x562474be8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474bdc5d0 0x562474be8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.269+0000 7f99daffd700 1 -- 172.21.15.50:0/3871739424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc0114a0 con 0x562474be1be0 2023-10-26T06:45:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99daffd700 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 0x562474be5820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c00 tx=0x7f99cc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501389c9252907d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99beff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:45:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99beff5700 1 -- 172.21.15.50:0/3871739424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00fd80 con 0x562474be1be0 2023-10-26T06:45:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562474b33ef0 con 0x562474be1be0 2023-10-26T06:45:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99beff5700 1 -- 172.21.15.50:0/3871739424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f99cc005d00 con 0x562474be1be0 2023-10-26T06:45:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99beff5700 1 -- 172.21.15.50:0/3871739424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99cc00fa60 con 0x562474be1be0 2023-10-26T06:45:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99f4ddab80 10 client.15822 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.270+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x562474959de0 con 0x562474be1be0 2023-10-26T06:45:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99beff5700 1 -- 172.21.15.50:0/3871739424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99cc030020 con 0x562474be1be0 2023-10-26T06:45:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99beff5700 1 -- 172.21.15.50:0/3871739424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99cc004a70 con 0x562474be1be0 2023-10-26T06:45:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99f4ddab80 10 client.15822 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99f4ddab80 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99f4ddab80 20 client.15822 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474bf5db0 0x562474bf81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99f4ddab80 4 client.15822 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562474bab8b0 con 0x562474bf5db0 2023-10-26T06:45:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.271+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474bf5db0 0x562474bf81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.272+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474bf5db0 0x562474bf81d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7cb985e8fd5d4a8 server_cookie=c3bc32e1e27437f in_seq=0 out_seq=0 2023-10-26T06:45:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.272+0000 7f99beff5700 10 client.15822 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99beff5700 1 -- 172.21.15.50:0/3871739424 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562474bab8b0 con 0x562474bf5db0 2023-10-26T06:45:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99beff5700 10 client.15822 handle_command_reply: tid=0 2023-10-26T06:45:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 client.15822 shutdown 2023-10-26T06:45:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 msgr2=0x562474be5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 0x562474be5820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c00 tx=0x7f99cc005270 comp rx=0 tx=0).stop 2023-10-26T06:45:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 shutdown_connections 2023-10-26T06:45:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474bf5db0 0x562474bf81d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474bdc5d0 0x562474be8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3871739424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474be1be0 0x562474be5820 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 >> 172.21.15.50:0/3871739424 conn(0x562474b50720 msgr2=0x562474bdb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99beff5700 0 client.15822 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 shutdown_connections 2023-10-26T06:45:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.273+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3871739424 wait complete. 2023-10-26T06:45:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.274+0000 7f99f4ddab80 20 client.15822 trim_cache size 0 max 16384 2023-10-26T06:45:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 Processor -- start 2023-10-26T06:45:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 -- start start 2023-10-26T06:45:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474bd1af0 con 0x562474bdc5d0 2023-10-26T06:45:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624749af920 con 0x562474be1be0 2023-10-26T06:45:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.287+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474be0300 con 0x562474be2500 2023-10-26T06:45:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34832/0 (socket says 172.21.15.50:34832) 2023-10-26T06:45:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 -- 172.21.15.50:0/3420195266 learned_addr learned my addr 172.21.15.50:0/3420195266 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99daffd700 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 -- 172.21.15.50:0/3420195266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 msgr2=0x562474be8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 -- 172.21.15.50:0/3420195266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 msgr2=0x562474beceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 -- 172.21.15.50:0/3420195266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562474942c60 con 0x562474bdc5d0 2023-10-26T06:45:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99daffd700 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.288+0000 7f99da7fc700 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdfdc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f99d0024600 tx=0x7f99d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2c97a922805278 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99c1ffb700 1 -- 172.21.15.50:0/3420195266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0004350 con 0x562474bdc5d0 2023-10-26T06:45:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99c1ffb700 1 -- 172.21.15.50:0/3420195266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99d002b070 con 0x562474bdc5d0 2023-10-26T06:45:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99c1ffb700 1 -- 172.21.15.50:0/3420195266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0003d50 con 0x562474bdc5d0 2023-10-26T06:45:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3420195266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 msgr2=0x562474bdfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdfdc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f99d0024600 tx=0x7f99d00047c0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3420195266 shutdown_connections 2023-10-26T06:45:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474be8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474bdfdc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/3420195266 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.289+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3420195266 >> 172.21.15.50:0/3420195266 conn(0x562474b50720 msgr2=0x562474bdf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.290+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3420195266 shutdown_connections 2023-10-26T06:45:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.290+0000 7f99f4ddab80 1 -- 172.21.15.50:0/3420195266 wait complete. 2023-10-26T06:45:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.290+0000 7f99f4ddab80 1 -- start start 2023-10-26T06:45:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.290+0000 7f99f4ddab80 1 Processor -- start 2023-10-26T06:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474beb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474c48bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474c49100 con 0x562474bdc5d0 2023-10-26T06:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474c49240 con 0x562474be1be0 2023-10-26T06:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562474c49380 con 0x562474be2500 2023-10-26T06:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99f4ddab80 10 client.0 _ll_register_callbacks cb 0x562474a15a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474beb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99daffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99da7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474beb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34846/0 (socket says 172.21.15.50:34846) 2023-10-26T06:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99da7fc700 1 -- 172.21.15.50:0/1436755492 learned_addr learned my addr 172.21.15.50:0/1436755492 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.291+0000 7f99da7fc700 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474c48bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99daffd700 1 -- 172.21.15.50:0/1436755492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 msgr2=0x562474c48bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99daffd700 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474c48bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99daffd700 1 -- 172.21.15.50:0/1436755492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 msgr2=0x562474beb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99daffd700 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474beb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99daffd700 1 -- 172.21.15.50:0/1436755492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d001a040 con 0x562474be1be0 2023-10-26T06:45:19.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99daffd700 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beb5c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99cc004e50 tx=0x7f99cc012fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2e442f46461ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99beff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99beff5700 1 -- 172.21.15.50:0/1436755492 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00f9f0 con 0x562474be1be0 2023-10-26T06:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99cc011190 con 0x562474be1be0 2023-10-26T06:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.292+0000 7f99beff5700 1 -- 172.21.15.50:0/1436755492 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f99cc016040 con 0x562474be1be0 2023-10-26T06:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99beff5700 1 -- 172.21.15.50:0/1436755492 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99cc00fb50 con 0x562474be1be0 2023-10-26T06:45:19.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 10 client.25847 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x562474980250 con 0x562474be1be0 2023-10-26T06:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99beff5700 1 -- 172.21.15.50:0/1436755492 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99cc042020 con 0x562474be1be0 2023-10-26T06:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99beff5700 1 -- 172.21.15.50:0/1436755492 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99cc03c020 con 0x562474be1be0 2023-10-26T06:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 10 client.25847 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 10 client.25847 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 20 client.25847 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474c4a960 0x562474c4cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 4 client.25847 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562474b27e50 con 0x562474c4a960 2023-10-26T06:45:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.293+0000 7f99da7fc700 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474c4a960 0x562474c4cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99da7fc700 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474c4a960 0x562474c4cd80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb98ce1e0bd1db1 server_cookie=854790bf25c3e877 in_seq=0 out_seq=0 2023-10-26T06:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99beff5700 10 client.25847 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99beff5700 1 -- 172.21.15.50:0/1436755492 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562474b27e50 con 0x562474c4a960 2023-10-26T06:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99beff5700 10 client.25847 handle_command_reply: tid=0 2023-10-26T06:45:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 client.25847 shutdown 2023-10-26T06:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 msgr2=0x562474beb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beb5c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99cc004e50 tx=0x7f99cc012fe0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 shutdown_connections 2023-10-26T06:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562474c4a960 0x562474c4cd80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562474be2500 0x562474c48bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562474bdc5d0 0x562474beb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 --2- 172.21.15.50:0/1436755492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562474be1be0 0x562474beb5c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99beff5700 0 client.25847 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:19.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.294+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 >> 172.21.15.50:0/1436755492 conn(0x562474b50720 msgr2=0x562474bf1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 shutdown_connections 2023-10-26T06:45:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99f4ddab80 1 -- 172.21.15.50:0/1436755492 wait complete. 2023-10-26T06:45:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99f4ddab80 20 client.25847 trim_cache size 0 max 16384 2023-10-26T06:45:19.315 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:45:19.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99c40a15f0 msgr2=0x7f99c40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99c40a15f0 0x7f99c40a3ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f99d4097430 tx=0x7f99d400b3e0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 msgr2=0x7f99dc19d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc19d790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b770 tx=0x7f99d400bcd0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 shutdown_connections 2023-10-26T06:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f99c40a15f0 0x7f99c40a3ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99dc105b30 0x7f99dc19d790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc067d40 0x7f99dc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.295+0000 7f99e13ff700 1 --2- 172.21.15.50:0/1497933966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99dc105170 0x7f99dc1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.296+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 >> 172.21.15.50:0/1497933966 conn(0x7f99dc0767f0 msgr2=0x7f99dc0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.296+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 shutdown_connections 2023-10-26T06:45:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:19.296+0000 7f99e13ff700 1 -- 172.21.15.50:0/1497933966 wait complete. 2023-10-26T06:45:20.320 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:45:20.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:45:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 -- 172.21.15.50:0/608985683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 msgr2=0x7fb95810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 --2- 172.21.15.50:0/608985683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95810d5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb95000b0a0 tx=0x7fb95000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 -- 172.21.15.50:0/608985683 shutdown_connections 2023-10-26T06:45:20.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 --2- 172.21.15.50:0/608985683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95810d5f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 --2- 172.21.15.50:0/608985683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb958106730 0x7fb958106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 --2- 172.21.15.50:0/608985683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958100720 0x7fb958100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 -- 172.21.15.50:0/608985683 >> 172.21.15.50:0/608985683 conn(0x7fb9580fc1b0 msgr2=0x7fb9580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 -- 172.21.15.50:0/608985683 shutdown_connections 2023-10-26T06:45:20.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.543+0000 7fb95edff700 1 -- 172.21.15.50:0/608985683 wait complete. 2023-10-26T06:45:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.544+0000 7fb95edff700 1 Processor -- start 2023-10-26T06:45:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 -- start start 2023-10-26T06:45:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb958100720 0x7fb95819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958106730 0x7fb9581969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb958197030 con 0x7fb958106730 2023-10-26T06:45:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9581971a0 con 0x7fb9581010e0 2023-10-26T06:45:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.545+0000 7fb95edff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb958197360 con 0x7fb958100720 2023-10-26T06:45:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb958100720 0x7fb95819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47008/0 (socket says 172.21.15.50:47008) 2023-10-26T06:45:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 -- 172.21.15.50:0/1512186528 learned_addr learned my addr 172.21.15.50:0/1512186528 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb95d39c700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958106730 0x7fb9581969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 -- 172.21.15.50:0/1512186528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb958100720 msgr2=0x7fb95819c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb958100720 0x7fb95819c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 -- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958106730 msgr2=0x7fb9581969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958106730 0x7fb9581969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 -- 172.21.15.50:0/1512186528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950009d00 con 0x7fb9581010e0 2023-10-26T06:45:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb95d39c700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958106730 0x7fb9581969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb957fff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95819cde0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e9a0 tx=0x7fb94400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb955ffb700 1 -- 172.21.15.50:0/1512186528 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944009790 con 0x7fb9581010e0 2023-10-26T06:45:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb958197640 con 0x7fb9581010e0 2023-10-26T06:45:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.546+0000 7fb955ffb700 1 -- 172.21.15.50:0/1512186528 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb944010430 con 0x7fb9581010e0 2023-10-26T06:45:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.547+0000 7fb955ffb700 1 -- 172.21.15.50:0/1512186528 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944018680 con 0x7fb9581010e0 2023-10-26T06:45:20.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.547+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9581a3890 con 0x7fb9581010e0 2023-10-26T06:45:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.550+0000 7fb955ffb700 1 -- 172.21.15.50:0/1512186528 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb9440105a0 con 0x7fb9581010e0 2023-10-26T06:45:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.551+0000 7fb955ffb700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb9480a15f0 0x7fb9480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.551+0000 7fb955ffb700 1 -- 172.21.15.50:0/1512186528 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb944014070 con 0x7fb9581010e0 2023-10-26T06:45:20.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.551+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb9480a15f0 0x7fb9480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 Processor -- start 2023-10-26T06:45:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 -- start start 2023-10-26T06:45:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb9480a15f0 0x7fb9480a3ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009be0 tx=0x7fb94c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b8911860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904110 0x55c8b8904590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b89192d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b8877760 con 0x55c8b8904110 2023-10-26T06:45:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b885dce0 con 0x55c8b8904ad0 2023-10-26T06:45:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb9726acb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b885b600 con 0x55c8b8911480 2023-10-26T06:45:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.552+0000 7fb957fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904110 0x55c8b8904590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb957fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904110 0x55c8b8904590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34874/0 (socket says 172.21.15.50:34874) 2023-10-26T06:45:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b89192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb957fff700 1 -- 172.21.15.50:0/2394318977 learned_addr learned my addr 172.21.15.50:0/2394318977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b8911860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 -- 172.21.15.50:0/2394318977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 msgr2=0x55c8b8911860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b8911860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 -- 172.21.15.50:0/2394318977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904110 msgr2=0x55c8b8904590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904110 0x55c8b8904590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 -- 172.21.15.50:0/2394318977 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b8814470 con 0x55c8b8904ad0 2023-10-26T06:45:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb95d39c700 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b89192d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb950009fd0 tx=0x7fb950008fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919f300c0d9c6862 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb942ffd700 1 -- 172.21.15.50:0/2394318977 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95000e040 con 0x55c8b8904ad0 2023-10-26T06:45:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb942ffd700 1 -- 172.21.15.50:0/2394318977 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb95000bcb0 con 0x55c8b8904ad0 2023-10-26T06:45:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.553+0000 7fb942ffd700 1 -- 172.21.15.50:0/2394318977 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500052a0 con 0x55c8b8904ad0 2023-10-26T06:45:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 -- 172.21.15.50:0/2394318977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 msgr2=0x55c8b89192d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b89192d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb950009fd0 tx=0x7fb950008fa0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 -- 172.21.15.50:0/2394318977 shutdown_connections 2023-10-26T06:45:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b89192d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b8911860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 --2- 172.21.15.50:0/2394318977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904110 0x55c8b8904590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 -- 172.21.15.50:0/2394318977 >> 172.21.15.50:0/2394318977 conn(0x55c8b88787a0 msgr2=0x55c8b88feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 -- 172.21.15.50:0/2394318977 shutdown_connections 2023-10-26T06:45:20.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.554+0000 7fb9726acb80 1 -- 172.21.15.50:0/2394318977 wait complete. 2023-10-26T06:45:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.555+0000 7fb9726acb80 1 -- start start 2023-10-26T06:45:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.555+0000 7fb9726acb80 1 Processor -- start 2023-10-26T06:45:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b891c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b891c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 0x55c8b8916590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b8856ef0 con 0x55c8b8904ad0 2023-10-26T06:45:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b87f3790 con 0x55c8b8911480 2023-10-26T06:45:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b87f3430 con 0x55c8b8904110 2023-10-26T06:45:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb9726acb80 10 client.0 _ll_register_callbacks cb 0x55c8b873db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb957fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b891c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b891c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb95d39c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 0x55c8b8916590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b891c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47306/0 (socket says 172.21.15.50:47306) 2023-10-26T06:45:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb95cb9b700 1 -- 172.21.15.50:0/1593666538 learned_addr learned my addr 172.21.15.50:0/1593666538 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb95d39c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 0x55c8b8916590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47038/0 (socket says 172.21.15.50:47038) 2023-10-26T06:45:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb957fff700 1 -- 172.21.15.50:0/1593666538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 msgr2=0x55c8b891c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb957fff700 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b891c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb957fff700 1 -- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 msgr2=0x55c8b8916590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb957fff700 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 0x55c8b8916590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb957fff700 1 -- 172.21.15.50:0/1593666538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95810def0 con 0x55c8b8904ad0 2023-10-26T06:45:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.556+0000 7fb95d39c700 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 0x55c8b8916590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:20.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb957fff700 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b891c6c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb944096d10 tx=0x7fb94409aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6498934f277db144 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb937fff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:45:20.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb937fff700 1 -- 172.21.15.50:0/1593666538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94409e3f0 con 0x55c8b8904ad0 2023-10-26T06:45:20.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb937fff700 1 -- 172.21.15.50:0/1593666538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb9440a2630 con 0x55c8b8904ad0 2023-10-26T06:45:20.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8b885bf70 con 0x55c8b8904ad0 2023-10-26T06:45:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb937fff700 1 -- 172.21.15.50:0/1593666538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb944064070 con 0x55c8b8904ad0 2023-10-26T06:45:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb9726acb80 10 client.15840 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c8b8681e60 con 0x55c8b8904ad0 2023-10-26T06:45:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.557+0000 7fb937fff700 1 -- 172.21.15.50:0/1593666538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8b885bf70 con 0x55c8b8904ad0 2023-10-26T06:45:20.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb937fff700 1 -- 172.21.15.50:0/1593666538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb944096090 con 0x55c8b8904ad0 2023-10-26T06:45:20.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb9726acb80 10 client.15840 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:20.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb9726acb80 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:20.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb9726acb80 20 client.15840 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:20.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb9726acb80 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b89266a0 0x55c8b8928ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb9726acb80 4 client.15840 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:20.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8b88d3930 con 0x55c8b89266a0 2023-10-26T06:45:20.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b89266a0 0x55c8b8928ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b89266a0 0x55c8b8928ac0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87679f9d2aa3d0d1 server_cookie=deaacfb545ad5fdb in_seq=0 out_seq=0 2023-10-26T06:45:20.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.558+0000 7fb937fff700 10 client.15840 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.560+0000 7fb937fff700 1 -- 172.21.15.50:0/1593666538 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8b88d3930 con 0x55c8b89266a0 2023-10-26T06:45:20.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.560+0000 7fb937fff700 10 client.15840 handle_command_reply: tid=0 2023-10-26T06:45:20.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.560+0000 7fb9726acb80 1 client.15840 shutdown 2023-10-26T06:45:20.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.560+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 msgr2=0x55c8b891c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.560+0000 7fb9726acb80 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b891c6c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb944096d10 tx=0x7fb94409aa90 comp rx=0 tx=0).stop 2023-10-26T06:45:20.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 shutdown_connections 2023-10-26T06:45:20.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b89266a0 0x55c8b8928ac0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8911480 0x55c8b8916590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b891c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb937fff700 0 client.15840 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 --2- 172.21.15.50:0/1593666538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b891c6c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 >> 172.21.15.50:0/1593666538 conn(0x55c8b88787a0 msgr2=0x55c8b8903100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 shutdown_connections 2023-10-26T06:45:20.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 1 -- 172.21.15.50:0/1593666538 wait complete. 2023-10-26T06:45:20.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.561+0000 7fb9726acb80 20 client.15840 trim_cache size 0 max 16384 2023-10-26T06:45:20.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.581+0000 7fb9726acb80 1 Processor -- start 2023-10-26T06:45:20.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.581+0000 7fb9726acb80 1 -- start start 2023-10-26T06:45:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.581+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 0x55c8b8916530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.581+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b88f8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b88f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb9726acb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b86d79a0 con 0x55c8b8904ad0 2023-10-26T06:45:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb9726acb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b885bfa0 con 0x55c8b8904110 2023-10-26T06:45:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb9726acb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b8923220 con 0x55c8b8911480 2023-10-26T06:45:20.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 0x55c8b8916530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb957fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b88f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 0x55c8b8916530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47046/0 (socket says 172.21.15.50:47046) 2023-10-26T06:45:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 -- 172.21.15.50:0/3447300998 learned_addr learned my addr 172.21.15.50:0/3447300998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95d39c700 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b88f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 -- 172.21.15.50:0/3447300998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 msgr2=0x55c8b88f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b88f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 -- 172.21.15.50:0/3447300998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 msgr2=0x55c8b88f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b88f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 -- 172.21.15.50:0/3447300998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b892d730 con 0x55c8b8904110 2023-10-26T06:45:20.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.582+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 0x55c8b8916530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0117d0 tx=0x7fb94c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eeb6ef049d5812a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9437fe700 1 -- 172.21.15.50:0/3447300998 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c024070 con 0x55c8b8904110 2023-10-26T06:45:20.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9437fe700 1 -- 172.21.15.50:0/3447300998 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94c025040 con 0x55c8b8904110 2023-10-26T06:45:20.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9437fe700 1 -- 172.21.15.50:0/3447300998 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c028730 con 0x55c8b8904110 2023-10-26T06:45:20.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 -- 172.21.15.50:0/3447300998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 msgr2=0x55c8b8916530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 0x55c8b8916530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0117d0 tx=0x7fb94c014000 comp rx=0 tx=0).stop 2023-10-26T06:45:20.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 -- 172.21.15.50:0/3447300998 shutdown_connections 2023-10-26T06:45:20.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8911480 0x55c8b88f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904110 0x55c8b8916530 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 --2- 172.21.15.50:0/3447300998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8904ad0 0x55c8b88f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.583+0000 7fb9726acb80 1 -- 172.21.15.50:0/3447300998 >> 172.21.15.50:0/3447300998 conn(0x55c8b88787a0 msgr2=0x55c8b8915e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.584+0000 7fb9726acb80 1 -- 172.21.15.50:0/3447300998 shutdown_connections 2023-10-26T06:45:20.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.584+0000 7fb9726acb80 1 -- 172.21.15.50:0/3447300998 wait complete. 2023-10-26T06:45:20.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.584+0000 7fb9726acb80 1 -- start start 2023-10-26T06:45:20.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.584+0000 7fb9726acb80 1 Processor -- start 2023-10-26T06:45:20.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b8921a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b8921fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8911480 0x55c8b8974560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b8974aa0 con 0x55c8b8911480 2023-10-26T06:45:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b8974c10 con 0x55c8b8904ad0 2023-10-26T06:45:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b8974dd0 con 0x55c8b8904110 2023-10-26T06:45:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb9726acb80 10 client.0 _ll_register_callbacks cb 0x55c8b873db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b8921fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b8921fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47060/0 (socket says 172.21.15.50:47060) 2023-10-26T06:45:20.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 -- 172.21.15.50:0/64926223 learned_addr learned my addr 172.21.15.50:0/64926223 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb95d39c700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8911480 0x55c8b8974560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b8921a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 -- 172.21.15.50:0/64926223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 msgr2=0x55c8b8921a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b8921a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 -- 172.21.15.50:0/64926223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8911480 msgr2=0x55c8b8974560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8911480 0x55c8b8974560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 -- 172.21.15.50:0/64926223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c017070 con 0x55c8b8904ad0 2023-10-26T06:45:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb957fff700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b8921fd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb9440985f0 tx=0x7fb944010c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b2506ee0b408ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.585+0000 7fb937fff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb937fff700 1 -- 172.21.15.50:0/64926223 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944064070 con 0x55c8b8904ad0 2023-10-26T06:45:20.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb95000bcb0 con 0x55c8b8904ad0 2023-10-26T06:45:20.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb937fff700 1 -- 172.21.15.50:0/64926223 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb9440a2630 con 0x55c8b8904ad0 2023-10-26T06:45:20.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb937fff700 1 -- 172.21.15.50:0/64926223 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb94409e3f0 con 0x55c8b8904ad0 2023-10-26T06:45:20.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 10 client.25865 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:20.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c8b866ace0 con 0x55c8b8904ad0 2023-10-26T06:45:20.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb937fff700 1 -- 172.21.15.50:0/64926223 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb95000bcb0 con 0x55c8b8904ad0 2023-10-26T06:45:20.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb937fff700 1 -- 172.21.15.50:0/64926223 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb9440998b0 con 0x55c8b8904ad0 2023-10-26T06:45:20.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 10 client.25865 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:20.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 10 client.25865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:20.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 20 client.25865 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:20.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b897c300 0x55c8b897e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 4 client.25865 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:45:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.586+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c8b884fed0 con 0x55c8b897c300 2023-10-26T06:45:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.587+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b897c300 0x55c8b897e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.587+0000 7fb95cb9b700 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b897c300 0x55c8b897e720 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ae33c17cd85af8 server_cookie=708f892b7cb0a4c7 in_seq=0 out_seq=0 2023-10-26T06:45:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.587+0000 7fb937fff700 10 client.25865 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb937fff700 1 -- 172.21.15.50:0/64926223 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c8b884fed0 con 0x55c8b897c300 2023-10-26T06:45:20.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb937fff700 10 client.25865 handle_command_reply: tid=0 2023-10-26T06:45:20.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 client.25865 shutdown 2023-10-26T06:45:20.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 msgr2=0x55c8b8921fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b8921fd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb9440985f0 tx=0x7fb944010c80 comp rx=0 tx=0).stop 2023-10-26T06:45:20.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 shutdown_connections 2023-10-26T06:45:20.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c8b897c300 0x55c8b897e720 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c8b8911480 0x55c8b8974560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c8b8904110 0x55c8b8921a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb937fff700 0 client.25865 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 --2- 172.21.15.50:0/64926223 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c8b8904ad0 0x55c8b8921fd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 >> 172.21.15.50:0/64926223 conn(0x55c8b88787a0 msgr2=0x55c8b891bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 shutdown_connections 2023-10-26T06:45:20.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 1 -- 172.21.15.50:0/64926223 wait complete. 2023-10-26T06:45:20.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.590+0000 7fb9726acb80 20 client.25865 trim_cache size 0 max 16384 2023-10-26T06:45:20.603 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:45:20.604 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:45:20.604 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "800932dc-6c82-418e-bbe2-8983969a6ce1", 2023-10-26T06:45:20.604 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:45:20.604 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:45:20.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb9480a15f0 msgr2=0x7fb9480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb9480a15f0 0x7fb9480a3ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009be0 tx=0x7fb94c009260 comp rx=0 tx=0).stop 2023-10-26T06:45:20.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 msgr2=0x7fb95819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95819cde0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e9a0 tx=0x7fb94400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 shutdown_connections 2023-10-26T06:45:20.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb9480a15f0 0x7fb9480a3ab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb958106730 0x7fb9581969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb958100720 0x7fb95819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 --2- 172.21.15.50:0/1512186528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9581010e0 0x7fb95819cde0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 >> 172.21.15.50:0/1512186528 conn(0x7fb9580fc1b0 msgr2=0x7fb9580fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 shutdown_connections 2023-10-26T06:45:20.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.591+0000 7fb95edff700 1 -- 172.21.15.50:0/1512186528 wait complete. 2023-10-26T06:45:20.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:45:20.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 -- 172.21.15.50:0/1066902883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105170 msgr2=0x7f002c1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 --2- 172.21.15.50:0/1066902883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105170 0x7f002c1055f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00200099c0 tx=0x7f0020009cd0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 -- 172.21.15.50:0/1066902883 shutdown_connections 2023-10-26T06:45:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 --2- 172.21.15.50:0/1066902883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c105b30 0x7f002c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 --2- 172.21.15.50:0/1066902883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c067d40 0x7f002c068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 --2- 172.21.15.50:0/1066902883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105170 0x7f002c1055f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 -- 172.21.15.50:0/1066902883 >> 172.21.15.50:0/1066902883 conn(0x7f002c0767f0 msgr2=0x7f002c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 -- 172.21.15.50:0/1066902883 shutdown_connections 2023-10-26T06:45:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.842+0000 7f00325ff700 1 -- 172.21.15.50:0/1066902883 wait complete. 2023-10-26T06:45:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 Processor -- start 2023-10-26T06:45:20.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 -- start start 2023-10-26T06:45:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 0x7f002c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c105170 0x7f002c1a2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105b30 0x7f002c10c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c10cd40 con 0x7f002c105170 2023-10-26T06:45:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c10ceb0 con 0x7f002c067d40 2023-10-26T06:45:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f00325ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c10d070 con 0x7f002c105b30 2023-10-26T06:45:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 0x7f002c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.844+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 0x7f002c1a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47080/0 (socket says 172.21.15.50:47080) 2023-10-26T06:45:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 -- 172.21.15.50:0/2991893279 learned_addr learned my addr 172.21.15.50:0/2991893279 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002b7fe700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c105170 0x7f002c1a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 -- 172.21.15.50:0/2991893279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105b30 msgr2=0x7f002c10c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105b30 0x7f002c10c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 -- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c105170 msgr2=0x7f002c1a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c105170 0x7f002c1a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 -- 172.21.15.50:0/2991893279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200095f0 con 0x7f002c067d40 2023-10-26T06:45:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002b7fe700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c105170 0x7f002c1a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:45:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f002bfff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 0x7f002c1a1e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e920 tx=0x7f001c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.845+0000 7f00297fa700 1 -- 172.21.15.50:0/2991893279 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c009790 con 0x7f002c067d40 2023-10-26T06:45:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.846+0000 7f00297fa700 1 -- 172.21.15.50:0/2991893279 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f001c00cbd0 con 0x7f002c067d40 2023-10-26T06:45:20.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.846+0000 7f00297fa700 1 -- 172.21.15.50:0/2991893279 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c018680 con 0x7f002c067d40 2023-10-26T06:45:20.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.846+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c10d350 con 0x7f002c067d40 2023-10-26T06:45:20.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.846+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c1a9f10 con 0x7f002c067d40 2023-10-26T06:45:20.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.850+0000 7f00297fa700 1 -- 172.21.15.50:0/2991893279 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f001c00cd40 con 0x7f002c067d40 2023-10-26T06:45:20.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 Processor -- start 2023-10-26T06:45:20.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 -- start start 2023-10-26T06:45:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ad9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ad4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ad4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05a476e0 con 0x55fe05ada500 2023-10-26T06:45:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f00297fa700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00140a15f0 0x7f00140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05a2dc60 con 0x55fe05ad45d0 2023-10-26T06:45:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.852+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05a2b580 con 0x55fe05ad9be0 2023-10-26T06:45:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f0030b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ad9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f0030b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ad9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47350/0 (socket says 172.21.15.50:47350) 2023-10-26T06:45:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f0030b9c700 1 -- 172.21.15.50:0/1401103386 learned_addr learned my addr 172.21.15.50:0/1401103386 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002b7fe700 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ad4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f00297fa700 1 -- 172.21.15.50:0/2991893279 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f001c014070 con 0x7f002c067d40 2023-10-26T06:45:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002b7fe700 1 -- 172.21.15.50:0/1401103386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 msgr2=0x55fe05ad9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002b7fe700 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ad9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002b7fe700 1 -- 172.21.15.50:0/1401103386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 msgr2=0x55fe05ad4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002bfff700 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ad4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002b7fe700 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ad4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f0030b9c700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00140a15f0 0x7f00140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.853+0000 7f002b7fe700 1 -- 172.21.15.50:0/1401103386 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe059e43f0 con 0x55fe05ad45d0 2023-10-26T06:45:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.854+0000 7f002b7fe700 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ad4a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f002000b580 tx=0x7f0020005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7588280da5dc3d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.854+0000 7f00127fc700 1 -- 172.21.15.50:0/1401103386 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002001d070 con 0x55fe05ad45d0 2023-10-26T06:45:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.854+0000 7f00127fc700 1 -- 172.21.15.50:0/1401103386 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0020005640 con 0x55fe05ad45d0 2023-10-26T06:45:20.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.854+0000 7f00127fc700 1 -- 172.21.15.50:0/1401103386 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200038e0 con 0x55fe05ad45d0 2023-10-26T06:45:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 -- 172.21.15.50:0/1401103386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 msgr2=0x55fe05ad4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ad4a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f002000b580 tx=0x7f0020005f00 comp rx=0 tx=0).stop 2023-10-26T06:45:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0030b9c700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00140a15f0 0x7f00140a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0024009fd0 tx=0x7f0024009920 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 -- 172.21.15.50:0/1401103386 shutdown_connections 2023-10-26T06:45:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ad4a50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ad9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/1401103386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ad4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 -- 172.21.15.50:0/1401103386 >> 172.21.15.50:0/1401103386 conn(0x55fe05a48720 msgr2=0x55fe05aceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 -- 172.21.15.50:0/1401103386 shutdown_connections 2023-10-26T06:45:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.855+0000 7f0045fa8b80 1 -- 172.21.15.50:0/1401103386 wait complete. 2023-10-26T06:45:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.856+0000 7f0045fa8b80 1 -- start start 2023-10-26T06:45:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.856+0000 7f0045fa8b80 1 Processor -- start 2023-10-26T06:45:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ad9be0 0x55fe05add810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ada500 0x55fe05addeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05a26e70 con 0x55fe05ad9be0 2023-10-26T06:45:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe059c3710 con 0x55fe05ad45d0 2023-10-26T06:45:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe059c33b0 con 0x55fe05ada500 2023-10-26T06:45:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0045fa8b80 10 client.0 _ll_register_callbacks cb 0x55fe0590da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47090/0 (socket says 172.21.15.50:47090) 2023-10-26T06:45:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f002bfff700 1 -- 172.21.15.50:0/3926904699 learned_addr learned my addr 172.21.15.50:0/3926904699 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f002b7fe700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ad9be0 0x55fe05add810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.857+0000 7f0030b9c700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ada500 0x55fe05addeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f002bfff700 1 -- 172.21.15.50:0/3926904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ada500 msgr2=0x55fe05addeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f002bfff700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ada500 0x55fe05addeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f002bfff700 1 -- 172.21.15.50:0/3926904699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ad9be0 msgr2=0x55fe05add810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f002bfff700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ad9be0 0x55fe05add810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f002bfff700 1 -- 172.21.15.50:0/3926904699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c10de70 con 0x55fe05ad45d0 2023-10-26T06:45:20.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f002bfff700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae0460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f001c0cab90 tx=0x7f001c09aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d80e57e04b20b681 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f000b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.858+0000 7f000b7fe700 1 -- 172.21.15.50:0/3926904699 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c09e350 con 0x55fe05ad45d0 2023-10-26T06:45:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f000b7fe700 1 -- 172.21.15.50:0/3926904699 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f001c09e510 con 0x55fe05ad45d0 2023-10-26T06:45:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe05a2bef0 con 0x55fe05ad45d0 2023-10-26T06:45:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f000b7fe700 1 -- 172.21.15.50:0/3926904699 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f001c0a2750 con 0x55fe05ad45d0 2023-10-26T06:45:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 10 client.25877 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55fe05851de0 con 0x55fe05ad45d0 2023-10-26T06:45:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f000b7fe700 1 -- 172.21.15.50:0/3926904699 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fe05a2bef0 con 0x55fe05ad45d0 2023-10-26T06:45:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f000b7fe700 1 -- 172.21.15.50:0/3926904699 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f001c0998b0 con 0x55fe05ad45d0 2023-10-26T06:45:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 10 client.25877 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 10 client.25877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 20 client.25877 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.859+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05aedea0 0x55fe05af02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.860+0000 7f0045fa8b80 4 client.25877 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.860+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe05aa38b0 con 0x55fe05aedea0 2023-10-26T06:45:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.860+0000 7f002b7fe700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05aedea0 0x55fe05af02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.860+0000 7f002b7fe700 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05aedea0 0x55fe05af02c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce990082838051a1 server_cookie=7ec55c13232c626b in_seq=0 out_seq=0 2023-10-26T06:45:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.861+0000 7f000b7fe700 10 client.25877 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f000b7fe700 1 -- 172.21.15.50:0/3926904699 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe05aa38b0 con 0x55fe05aedea0 2023-10-26T06:45:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f000b7fe700 10 client.25877 handle_command_reply: tid=0 2023-10-26T06:45:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 client.25877 shutdown 2023-10-26T06:45:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 msgr2=0x55fe05ae0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae0460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f001c0cab90 tx=0x7f001c09aac0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 shutdown_connections 2023-10-26T06:45:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05aedea0 0x55fe05af02c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ada500 0x55fe05addeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae0460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3926904699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ad9be0 0x55fe05add810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 >> 172.21.15.50:0/3926904699 conn(0x55fe05a48720 msgr2=0x55fe05ad3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f000b7fe700 0 client.25877 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 shutdown_connections 2023-10-26T06:45:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.863+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3926904699 wait complete. 2023-10-26T06:45:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.864+0000 7f0045fa8b80 20 client.25877 trim_cache size 0 max 16384 2023-10-26T06:45:20.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.883+0000 7f0045fa8b80 1 Processor -- start 2023-10-26T06:45:20.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.883+0000 7f0045fa8b80 1 -- start start 2023-10-26T06:45:20.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ace810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05adc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05ac9af0 con 0x55fe05ada500 2023-10-26T06:45:20.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe058a7920 con 0x55fe05ad45d0 2023-10-26T06:45:20.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05ad3700 con 0x55fe05ad9be0 2023-10-26T06:45:20.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47100/0 (socket says 172.21.15.50:47100) 2023-10-26T06:45:20.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 -- 172.21.15.50:0/2780269107 learned_addr learned my addr 172.21.15.50:0/2780269107 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002b7fe700 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ace810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f0030b9c700 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05adc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 -- 172.21.15.50:0/2780269107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 msgr2=0x55fe05ace810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ace810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 -- 172.21.15.50:0/2780269107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 msgr2=0x55fe05adc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05adc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.884+0000 7f002bfff700 1 -- 172.21.15.50:0/2780269107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe0583ac60 con 0x55fe05ad45d0 2023-10-26T06:45:20.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.885+0000 7f0030b9c700 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05adc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:45:20.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.885+0000 7f002bfff700 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f001c09a350 tx=0x7f001c09a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4a04c5e3d97020 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.885+0000 7f0012ffd700 1 -- 172.21.15.50:0/2780269107 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c09e510 con 0x55fe05ad45d0 2023-10-26T06:45:20.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.885+0000 7f0012ffd700 1 -- 172.21.15.50:0/2780269107 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f001c061050 con 0x55fe05ad45d0 2023-10-26T06:45:20.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.885+0000 7f0012ffd700 1 -- 172.21.15.50:0/2780269107 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c09a880 con 0x55fe05ad45d0 2023-10-26T06:45:20.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 -- 172.21.15.50:0/2780269107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 msgr2=0x55fe05ae4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f001c09a350 tx=0x7f001c09a500 comp rx=0 tx=0).stop 2023-10-26T06:45:20.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 -- 172.21.15.50:0/2780269107 shutdown_connections 2023-10-26T06:45:20.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05adc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad45d0 0x55fe05ae4e50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/2780269107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad9be0 0x55fe05ace810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 -- 172.21.15.50:0/2780269107 >> 172.21.15.50:0/2780269107 conn(0x55fe05a48720 msgr2=0x55fe05aefeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 -- 172.21.15.50:0/2780269107 shutdown_connections 2023-10-26T06:45:20.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 -- 172.21.15.50:0/2780269107 wait complete. 2023-10-26T06:45:20.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.886+0000 7f0045fa8b80 1 -- start start 2023-10-26T06:45:20.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 Processor -- start 2023-10-26T06:45:20.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad45d0 0x55fe05ae48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 0x55fe05ae4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ae9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05ae9e60 con 0x55fe05ada500 2023-10-26T06:45:20.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05ae9fd0 con 0x55fe05ad9be0 2023-10-26T06:45:20.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe05aea190 con 0x55fe05ad45d0 2023-10-26T06:45:20.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.887+0000 7f0045fa8b80 10 client.0 _ll_register_callbacks cb 0x55fe0590da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:20.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad45d0 0x55fe05ae48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 0x55fe05ae4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 0x55fe05ae4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47112/0 (socket says 172.21.15.50:47112) 2023-10-26T06:45:20.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 -- 172.21.15.50:0/3876546870 learned_addr learned my addr 172.21.15.50:0/3876546870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:20.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad45d0 0x55fe05ae48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47364/0 (socket says 172.21.15.50:47364) 2023-10-26T06:45:20.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f0030b9c700 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ae9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 -- 172.21.15.50:0/3876546870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad45d0 msgr2=0x55fe05ae48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad45d0 0x55fe05ae48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 -- 172.21.15.50:0/3876546870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 msgr2=0x55fe05ae9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:20.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ae9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.888+0000 7f002b7fe700 1 -- 172.21.15.50:0/3876546870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe05851de0 con 0x55fe05ad9be0 2023-10-26T06:45:20.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f002b7fe700 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 0x55fe05ae4e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f002000bd40 tx=0x7f0020000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74655541ffed2ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:20.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f000b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:20.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f000b7fe700 1 -- 172.21.15.50:0/3876546870 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002001d050 con 0x55fe05ad9be0 2023-10-26T06:45:20.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0020005640 con 0x55fe05ad9be0 2023-10-26T06:45:20.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f000b7fe700 1 -- 172.21.15.50:0/3876546870 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f002000b990 con 0x55fe05ad9be0 2023-10-26T06:45:20.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f000b7fe700 1 -- 172.21.15.50:0/3876546870 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f002000bb50 con 0x55fe05ad9be0 2023-10-26T06:45:20.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f0045fa8b80 10 client.25883 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:20.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.889+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55fe05878250 con 0x55fe05ad9be0 2023-10-26T06:45:20.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f000b7fe700 1 -- 172.21.15.50:0/3876546870 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0020005640 con 0x55fe05ad9be0 2023-10-26T06:45:20.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f000b7fe700 1 -- 172.21.15.50:0/3876546870 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0020003710 con 0x55fe05ad9be0 2023-10-26T06:45:20.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f0045fa8b80 10 client.25883 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:20.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f0045fa8b80 10 client.25883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:20.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f0045fa8b80 20 client.25883 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:20.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05b42ba0 0x55fe05b44fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:20.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f0045fa8b80 4 client.25883 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:45:20.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fe05a1fe50 con 0x55fe05b42ba0 2023-10-26T06:45:20.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.890+0000 7f002bfff700 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05b42ba0 0x55fe05b44fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:20.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.891+0000 7f002bfff700 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05b42ba0 0x55fe05b44fc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6961568f45aaa03 server_cookie=b0cc935eca8ef901 in_seq=0 out_seq=0 2023-10-26T06:45:20.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.891+0000 7f000b7fe700 10 client.25883 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f000b7fe700 1 -- 172.21.15.50:0/3876546870 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55fe05a1fe50 con 0x55fe05b42ba0 2023-10-26T06:45:20.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f000b7fe700 10 client.25883 handle_command_reply: tid=0 2023-10-26T06:45:20.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 client.25883 shutdown 2023-10-26T06:45:20.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 msgr2=0x55fe05ae4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 0x55fe05ae4e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f002000bd40 tx=0x7f0020000bc0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 shutdown_connections 2023-10-26T06:45:20.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55fe05b42ba0 0x55fe05b44fc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fe05ada500 0x55fe05ae9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f000b7fe700 0 client.25883 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:20.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe05ad45d0 0x55fe05ae48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 --2- 172.21.15.50:0/3876546870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fe05ad9be0 0x55fe05ae4e30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.893+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 >> 172.21.15.50:0/3876546870 conn(0x55fe05a48720 msgr2=0x55fe05ace810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 shutdown_connections 2023-10-26T06:45:20.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f0045fa8b80 1 -- 172.21.15.50:0/3876546870 wait complete. 2023-10-26T06:45:20.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f0045fa8b80 20 client.25883 trim_cache size 0 max 16384 2023-10-26T06:45:20.909 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:45:20.909 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (1540 inodes in the stack)", 2023-10-26T06:45:20.909 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:45:20.909 INFO:teuthology.orchestra.run.smithi050.stdout: "800932dc-6c82-418e-bbe2-8983969a6ce1": { 2023-10-26T06:45:20.910 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:45:20.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "800932dc-6c82-418e-bbe2-8983969a6ce1", 2023-10-26T06:45:20.910 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:45:20.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:45:20.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:45:20.910 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:45:20.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00140a15f0 msgr2=0x7f00140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00140a15f0 0x7f00140a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0024009fd0 tx=0x7f0024009920 comp rx=0 tx=0).stop 2023-10-26T06:45:20.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 msgr2=0x7f002c1a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:20.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 0x7f002c1a1e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e920 tx=0x7f001c00ece0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 shutdown_connections 2023-10-26T06:45:20.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f00140a15f0 0x7f00140a3ab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.894+0000 7f00325ff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f002c105b30 0x7f002c10c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.895+0000 7f00325ff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c067d40 0x7f002c1a1e10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.895+0000 7f00325ff700 1 --2- 172.21.15.50:0/2991893279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c105170 0x7f002c1a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.895+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 >> 172.21.15.50:0/2991893279 conn(0x7f002c0767f0 msgr2=0x7f002c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.895+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 shutdown_connections 2023-10-26T06:45:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:20.895+0000 7f00325ff700 1 -- 172.21.15.50:0/2991893279 wait complete. 2023-10-26T06:45:20.917 INFO:tasks.cephfs.filesystem:scrub status for tag:800932dc-6c82-418e-bbe2-8983969a6ce1 - {'path': '/', 'tag': '800932dc-6c82-418e-bbe2-8983969a6ce1', 'options': 'recursive,force'} 2023-10-26T06:45:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:20 smithi050 ceph-mon[94997]: pgmap v369: 97 pgs: 97 active+clean; 208 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2023-10-26T06:45:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:20 smithi125 ceph-mon[130643]: pgmap v369: 97 pgs: 97 active+clean; 208 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2023-10-26T06:45:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:20 smithi153 ceph-mon[131657]: pgmap v369: 97 pgs: 97 active+clean; 208 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 55 op/s 2023-10-26T06:45:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:45:22.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:22.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:21 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:22.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:45:22.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:22.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:22.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:22.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:22.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:22.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:21 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:22.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:45:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:22.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:22.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:22.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:22.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:21 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:22 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:22 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:22 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:22 smithi050 ceph-mon[94997]: pgmap v370: 97 pgs: 97 active+clean; 217 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 54 op/s 2023-10-26T06:45:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:22 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:22 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:22 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:22 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:22 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:22 smithi125 ceph-mon[130643]: pgmap v370: 97 pgs: 97 active+clean; 217 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 54 op/s 2023-10-26T06:45:23.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:22 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:22 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:22 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:22 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:22 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:22 smithi153 ceph-mon[131657]: pgmap v370: 97 pgs: 97 active+clean; 217 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 54 op/s 2023-10-26T06:45:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:22 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:22 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:24.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:23 smithi153 ceph-mon[131657]: pgmap v371: 97 pgs: 97 active+clean; 217 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 53 op/s 2023-10-26T06:45:24.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:23 smithi050 ceph-mon[94997]: pgmap v371: 97 pgs: 97 active+clean; 217 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 53 op/s 2023-10-26T06:45:24.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:23 smithi125 ceph-mon[130643]: pgmap v371: 97 pgs: 97 active+clean; 217 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 53 op/s 2023-10-26T06:45:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:26 smithi050 ceph-mon[94997]: pgmap v372: 97 pgs: 97 active+clean; 226 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 85 op/s 2023-10-26T06:45:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:26 smithi125 ceph-mon[130643]: pgmap v372: 97 pgs: 97 active+clean; 226 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 85 op/s 2023-10-26T06:45:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:26 smithi153 ceph-mon[131657]: pgmap v372: 97 pgs: 97 active+clean; 226 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 85 op/s 2023-10-26T06:45:29.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:28 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:29.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:28 smithi050 ceph-mon[94997]: pgmap v373: 97 pgs: 97 active+clean; 240 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 260 op/s 2023-10-26T06:45:29.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:28 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:29.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:28 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:28 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:28 smithi125 ceph-mon[130643]: pgmap v373: 97 pgs: 97 active+clean; 240 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 260 op/s 2023-10-26T06:45:29.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:28 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:29.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:28 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:28 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:28 smithi153 ceph-mon[131657]: pgmap v373: 97 pgs: 97 active+clean; 240 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 260 op/s 2023-10-26T06:45:29.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:28 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:29.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:28 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:31.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:30 smithi050 ceph-mon[94997]: pgmap v374: 97 pgs: 97 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 368 op/s 2023-10-26T06:45:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:30 smithi125 ceph-mon[130643]: pgmap v374: 97 pgs: 97 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 368 op/s 2023-10-26T06:45:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:30 smithi153 ceph-mon[131657]: pgmap v374: 97 pgs: 97 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 368 op/s 2023-10-26T06:45:33.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:32 smithi050 ceph-mon[94997]: pgmap v375: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 574 op/s 2023-10-26T06:45:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:32 smithi125 ceph-mon[130643]: pgmap v375: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 574 op/s 2023-10-26T06:45:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:32 smithi153 ceph-mon[131657]: pgmap v375: 97 pgs: 97 active+clean; 267 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 574 op/s 2023-10-26T06:45:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:33 smithi153 ceph-mon[131657]: pgmap v376: 97 pgs: 97 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 989 op/s 2023-10-26T06:45:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:33 smithi050 ceph-mon[94997]: pgmap v376: 97 pgs: 97 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 989 op/s 2023-10-26T06:45:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:33 smithi125 ceph-mon[130643]: pgmap v376: 97 pgs: 97 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 989 op/s 2023-10-26T06:45:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:34 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:45:35.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:34 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:45:35.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:34 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:45:35.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:34 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:45:35.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:34 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:45:35.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:34 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:45:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:35 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:45:36.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:35 smithi153 ceph-mon[131657]: pgmap v377: 97 pgs: 97 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.2 MiB/s wr, 1.21k op/s 2023-10-26T06:45:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:35 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:45:36.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:35 smithi050 ceph-mon[94997]: pgmap v377: 97 pgs: 97 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.2 MiB/s wr, 1.21k op/s 2023-10-26T06:45:36.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:35 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:45:36.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:35 smithi125 ceph-mon[130643]: pgmap v377: 97 pgs: 97 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.2 MiB/s wr, 1.21k op/s 2023-10-26T06:45:39.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:38 smithi050 ceph-mon[94997]: pgmap v378: 97 pgs: 97 active+clean; 336 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.9 MiB/s wr, 1.23k op/s 2023-10-26T06:45:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:38 smithi125 ceph-mon[130643]: pgmap v378: 97 pgs: 97 active+clean; 336 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.9 MiB/s wr, 1.23k op/s 2023-10-26T06:45:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:38 smithi153 ceph-mon[131657]: pgmap v378: 97 pgs: 97 active+clean; 336 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.9 MiB/s wr, 1.23k op/s 2023-10-26T06:45:41.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:40 smithi050 ceph-mon[94997]: pgmap v379: 97 pgs: 97 active+clean; 347 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 1.06k op/s 2023-10-26T06:45:41.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:40 smithi125 ceph-mon[130643]: pgmap v379: 97 pgs: 97 active+clean; 347 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 1.06k op/s 2023-10-26T06:45:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:40 smithi153 ceph-mon[131657]: pgmap v379: 97 pgs: 97 active+clean; 347 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 1.06k op/s 2023-10-26T06:45:43.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:42 smithi050 ceph-mon[94997]: pgmap v380: 97 pgs: 97 active+clean; 348 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 943 op/s 2023-10-26T06:45:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:42 smithi125 ceph-mon[130643]: pgmap v380: 97 pgs: 97 active+clean; 348 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 943 op/s 2023-10-26T06:45:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:42 smithi153 ceph-mon[131657]: pgmap v380: 97 pgs: 97 active+clean; 348 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 943 op/s 2023-10-26T06:45:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:43 smithi153 ceph-mon[131657]: pgmap v381: 97 pgs: 97 active+clean; 356 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.8 MiB/s wr, 731 op/s 2023-10-26T06:45:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:43 smithi050 ceph-mon[94997]: pgmap v381: 97 pgs: 97 active+clean; 356 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.8 MiB/s wr, 731 op/s 2023-10-26T06:45:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:43 smithi125 ceph-mon[130643]: pgmap v381: 97 pgs: 97 active+clean; 356 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.8 MiB/s wr, 731 op/s 2023-10-26T06:45:47.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:46 smithi050 ceph-mon[94997]: pgmap v382: 97 pgs: 97 active+clean; 359 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 320 op/s 2023-10-26T06:45:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:46 smithi125 ceph-mon[130643]: pgmap v382: 97 pgs: 97 active+clean; 359 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 320 op/s 2023-10-26T06:45:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:46 smithi153 ceph-mon[131657]: pgmap v382: 97 pgs: 97 active+clean; 359 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.4 MiB/s wr, 320 op/s 2023-10-26T06:45:48.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:47 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:45:48.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:47 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:45:48.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:47 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:45:49.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:48 smithi050 ceph-mon[94997]: pgmap v383: 97 pgs: 97 active+clean; 364 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 107 op/s 2023-10-26T06:45:49.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:45:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:45:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:48 smithi125 ceph-mon[130643]: pgmap v383: 97 pgs: 97 active+clean; 364 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 107 op/s 2023-10-26T06:45:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:45:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:45:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:48 smithi153 ceph-mon[131657]: pgmap v383: 97 pgs: 97 active+clean; 364 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 107 op/s 2023-10-26T06:45:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:49.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:45:49.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:45:49.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:45:50.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:45:51.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:50 smithi050 ceph-mon[94997]: pgmap v384: 97 pgs: 97 active+clean; 366 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 57 op/s 2023-10-26T06:45:51.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 -- 172.21.15.50:0/1724327304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105b30 msgr2=0x7fcabc10d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 --2- 172.21.15.50:0/1724327304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105b30 0x7fcabc10d540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcab400b0a0 tx=0x7fcab400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 -- 172.21.15.50:0/1724327304 shutdown_connections 2023-10-26T06:45:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 --2- 172.21.15.50:0/1724327304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105b30 0x7fcabc10d540 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 --2- 172.21.15.50:0/1724327304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcabc067d40 0x7fcabc068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 --2- 172.21.15.50:0/1724327304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcabc105170 0x7fcabc1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 -- 172.21.15.50:0/1724327304 >> 172.21.15.50:0/1724327304 conn(0x7fcabc0767f0 msgr2=0x7fcabc076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.134+0000 7fcac43ff700 1 -- 172.21.15.50:0/1724327304 shutdown_connections 2023-10-26T06:45:51.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.135+0000 7fcac43ff700 1 -- 172.21.15.50:0/1724327304 wait complete. 2023-10-26T06:45:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.135+0000 7fcac43ff700 1 Processor -- start 2023-10-26T06:45:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 -- start start 2023-10-26T06:45:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcabc067d40 0x7fcabc198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 0x7fcabc199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcabc105b30 0x7fcabc19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc19dde0 con 0x7fcabc105b30 2023-10-26T06:45:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc19df50 con 0x7fcabc105170 2023-10-26T06:45:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac43ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc19e110 con 0x7fcabc067d40 2023-10-26T06:45:51.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac199a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 0x7fcabc199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac299c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcabc105b30 0x7fcabc19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac199a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 0x7fcabc199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37546/0 (socket says 172.21.15.50:37546) 2023-10-26T06:45:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac199a700 1 -- 172.21.15.50:0/3430395454 learned_addr learned my addr 172.21.15.50:0/3430395454 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.136+0000 7fcac219b700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcabc067d40 0x7fcabc198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac199a700 1 -- 172.21.15.50:0/3430395454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcabc067d40 msgr2=0x7fcabc198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac199a700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcabc067d40 0x7fcabc198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac199a700 1 -- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcabc105b30 msgr2=0x7fcabc19d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac199a700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcabc105b30 0x7fcabc19d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac199a700 1 -- 172.21.15.50:0/3430395454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4009d00 con 0x7fcabc105170 2023-10-26T06:45:51.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac199a700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 0x7fcabc199400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00e9a0 tx=0x7fcaac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcab37fe700 1 -- 172.21.15.50:0/3430395454 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac009790 con 0x7fcabc105170 2023-10-26T06:45:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcab37fe700 1 -- 172.21.15.50:0/3430395454 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaac010430 con 0x7fcabc105170 2023-10-26T06:45:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcabc19e3f0 con 0x7fcabc105170 2023-10-26T06:45:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcab37fe700 1 -- 172.21.15.50:0/3430395454 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac018680 con 0x7fcabc105170 2023-10-26T06:45:51.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.137+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc1a5c30 con 0x7fcabc105170 2023-10-26T06:45:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.140+0000 7fcab37fe700 1 -- 172.21.15.50:0/3430395454 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcaac0105a0 con 0x7fcabc105170 2023-10-26T06:45:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.142+0000 7fcad7de3b80 1 Processor -- start 2023-10-26T06:45:51.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 -- start start 2023-10-26T06:45:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcab37fe700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcaa80a1670 0x7fcaa80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcab37fe700 1 -- 172.21.15.50:0/3430395454 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcaac014070 con 0x7fcabc105170 2023-10-26T06:45:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcac299c700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcaa80a1670 0x7fcaa80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e5811fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e580c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e577f6e0 con 0x55b7e5811be0 2023-10-26T06:45:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5765c60 con 0x55b7e580c5d0 2023-10-26T06:45:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5763580 con 0x55b7e5812500 2023-10-26T06:45:51.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.143+0000 7fcac219b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e5811fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e5811fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37514/0 (socket says 172.21.15.50:37514) 2023-10-26T06:45:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 -- 172.21.15.50:0/1091396419 learned_addr learned my addr 172.21.15.50:0/1091396419 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac199a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e580c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac299c700 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 -- 172.21.15.50:0/1091396419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 msgr2=0x55b7e580c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e580c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 -- 172.21.15.50:0/1091396419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 msgr2=0x55b7e580ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 -- 172.21.15.50:0/1091396419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7e571c3f0 con 0x55b7e5811be0 2023-10-26T06:45:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac299c700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcaa80a1670 0x7fcaa80a3b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009610 tx=0x7fcab4007e80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcac219b700 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e5811fc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009d80 tx=0x7fcab8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87759b18d65eb512 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.144+0000 7fcab0bfe700 1 -- 172.21.15.50:0/1091396419 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8004230 con 0x55b7e5811be0 2023-10-26T06:45:51.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcab0bfe700 1 -- 172.21.15.50:0/1091396419 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcab8004390 con 0x55b7e5811be0 2023-10-26T06:45:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcab0bfe700 1 -- 172.21.15.50:0/1091396419 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80198c0 con 0x55b7e5811be0 2023-10-26T06:45:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 -- 172.21.15.50:0/1091396419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 msgr2=0x55b7e5811fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e5811fc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009d80 tx=0x7fcab8011720 comp rx=0 tx=0).stop 2023-10-26T06:45:51.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 -- 172.21.15.50:0/1091396419 shutdown_connections 2023-10-26T06:45:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e5811fc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/1091396419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e580c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 -- 172.21.15.50:0/1091396419 >> 172.21.15.50:0/1091396419 conn(0x55b7e5780720 msgr2=0x55b7e5806b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 -- 172.21.15.50:0/1091396419 shutdown_connections 2023-10-26T06:45:51.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.145+0000 7fcad7de3b80 1 -- 172.21.15.50:0/1091396419 wait complete. 2023-10-26T06:45:51.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.146+0000 7fcad7de3b80 1 -- start start 2023-10-26T06:45:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.146+0000 7fcad7de3b80 1 Processor -- start 2023-10-26T06:45:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e58183d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58156c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e5815cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e575ee70 con 0x55b7e5811be0 2023-10-26T06:45:51.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e56fb710 con 0x55b7e580c5d0 2023-10-26T06:45:51.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e56fb3b0 con 0x55b7e5812500 2023-10-26T06:45:51.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcad7de3b80 10 client.0 _ll_register_callbacks cb 0x55b7e5645a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:51.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcac219b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e58183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcac219b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e58183d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37570/0 (socket says 172.21.15.50:37570) 2023-10-26T06:45:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcac219b700 1 -- 172.21.15.50:0/3165095844 learned_addr learned my addr 172.21.15.50:0/3165095844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.147+0000 7fcac199a700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac299c700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e5815cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac219b700 1 -- 172.21.15.50:0/3165095844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 msgr2=0x55b7e5815cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac219b700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e5815cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac219b700 1 -- 172.21.15.50:0/3165095844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 msgr2=0x55b7e58156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac219b700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac219b700 1 -- 172.21.15.50:0/3165095844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab80099e0 con 0x55b7e580c5d0 2023-10-26T06:45:51.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac299c700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e5815cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:51.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac199a700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:51.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcac219b700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e58183d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcab8000c00 tx=0x7fcab80038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4800d9513f95ec server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.148+0000 7fcaa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:51.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/3165095844 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8005240 con 0x55b7e580c5d0 2023-10-26T06:45:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/3165095844 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcab8005ce0 con 0x55b7e580c5d0 2023-10-26T06:45:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7e5763ef0 con 0x55b7e580c5d0 2023-10-26T06:45:51.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/3165095844 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab8004500 con 0x55b7e580c5d0 2023-10-26T06:45:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 10 client.25895 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b7e5589de0 con 0x55b7e580c5d0 2023-10-26T06:45:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/3165095844 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b7e5763ef0 con 0x55b7e580c5d0 2023-10-26T06:45:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/3165095844 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcab8021040 con 0x55b7e580c5d0 2023-10-26T06:45:51.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 10 client.25895 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 10 client.25895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 20 client.25895 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.149+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e5825d00 0x55b7e5828120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.150+0000 7fcad7de3b80 4 client.25895 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.150+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7e57db8b0 con 0x55b7e5825d00 2023-10-26T06:45:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.150+0000 7fcac199a700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e5825d00 0x55b7e5828120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.150+0000 7fcac199a700 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e5825d00 0x55b7e5828120 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9efbf55c6365b0dc server_cookie=11cb94aed1eedb7e in_seq=0 out_seq=0 2023-10-26T06:45:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.150+0000 7fcaa5ffb700 10 client.25895 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/3165095844 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7e57db8b0 con 0x55b7e5825d00 2023-10-26T06:45:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcaa5ffb700 10 client.25895 handle_command_reply: tid=0 2023-10-26T06:45:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 client.25895 shutdown 2023-10-26T06:45:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 msgr2=0x55b7e58183d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e58183d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcab8000c00 tx=0x7fcab80038b0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 shutdown_connections 2023-10-26T06:45:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e5825d00 0x55b7e5828120 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5812500 0x55b7e5815cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcaa5ffb700 0 client.25895 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e58183d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/3165095844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 >> 172.21.15.50:0/3165095844 conn(0x55b7e5780720 msgr2=0x55b7e5806ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 shutdown_connections 2023-10-26T06:45:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.153+0000 7fcad7de3b80 1 -- 172.21.15.50:0/3165095844 wait complete. 2023-10-26T06:45:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.154+0000 7fcad7de3b80 20 client.25895 trim_cache size 0 max 16384 2023-10-26T06:45:51.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:50 smithi125 ceph-mon[130643]: pgmap v384: 97 pgs: 97 active+clean; 366 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 57 op/s 2023-10-26T06:45:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 Processor -- start 2023-10-26T06:45:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 -- start start 2023-10-26T06:45:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5811be0 0x55b7e5813f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5812500 0x55b7e58144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e55df920 con 0x55b7e5812500 2023-10-26T06:45:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e58078a0 con 0x55b7e580c5d0 2023-10-26T06:45:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5814a10 con 0x55b7e5811be0 2023-10-26T06:45:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.173+0000 7fcac219b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac299c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5812500 0x55b7e58144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac219b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37576/0 (socket says 172.21.15.50:37576) 2023-10-26T06:45:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac219b700 1 -- 172.21.15.50:0/2016354108 learned_addr learned my addr 172.21.15.50:0/2016354108 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5811be0 0x55b7e5813f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 -- 172.21.15.50:0/2016354108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 msgr2=0x55b7e580c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 -- 172.21.15.50:0/2016354108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5812500 msgr2=0x55b7e58144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5812500 0x55b7e58144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 -- 172.21.15.50:0/2016354108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7e5572c60 con 0x55b7e5811be0 2023-10-26T06:45:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac219b700 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcac199a700 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5811be0 0x55b7e5813f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0ca910 tx=0x7fcaac010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c43f3265111199fc server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcab13ff700 1 -- 172.21.15.50:0/2016354108 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac0b6070 con 0x55b7e5811be0 2023-10-26T06:45:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcab13ff700 1 -- 172.21.15.50:0/2016354108 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaac0b1070 con 0x55b7e5811be0 2023-10-26T06:45:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.174+0000 7fcab13ff700 1 -- 172.21.15.50:0/2016354108 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac098660 con 0x55b7e5811be0 2023-10-26T06:45:51.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 -- 172.21.15.50:0/2016354108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5811be0 msgr2=0x55b7e5813f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5811be0 0x55b7e5813f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0ca910 tx=0x7fcaac010c80 comp rx=0 tx=0).stop 2023-10-26T06:45:51.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 -- 172.21.15.50:0/2016354108 shutdown_connections 2023-10-26T06:45:51.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5812500 0x55b7e58144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e580c5d0 0x55b7e580c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/2016354108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e5811be0 0x55b7e5813f90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 -- 172.21.15.50:0/2016354108 >> 172.21.15.50:0/2016354108 conn(0x55b7e5780720 msgr2=0x55b7e580f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 -- 172.21.15.50:0/2016354108 shutdown_connections 2023-10-26T06:45:51.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.175+0000 7fcad7de3b80 1 -- 172.21.15.50:0/2016354108 wait complete. 2023-10-26T06:45:51.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 -- start start 2023-10-26T06:45:51.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 Processor -- start 2023-10-26T06:45:51.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e580c5d0 0x55b7e5819480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e5812500 0x55b7e5819f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e581d450 con 0x55b7e5811be0 2023-10-26T06:45:51.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5879b50 con 0x55b7e5812500 2023-10-26T06:45:51.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e5879cc0 con 0x55b7e580c5d0 2023-10-26T06:45:51.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.176+0000 7fcad7de3b80 10 client.0 _ll_register_callbacks cb 0x55b7e5645a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:51.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac299c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e5812500 0x55b7e5819f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e580c5d0 0x55b7e5819480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac199a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac299c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e5812500 0x55b7e5819f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37584/0 (socket says 172.21.15.50:37584) 2023-10-26T06:45:51.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac299c700 1 -- 172.21.15.50:0/4039620350 learned_addr learned my addr 172.21.15.50:0/4039620350 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:51.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 -- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e5812500 msgr2=0x55b7e5819f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e5812500 0x55b7e5819f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 -- 172.21.15.50:0/4039620350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 msgr2=0x55b7e58199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 -- 172.21.15.50:0/4039620350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7e5589de0 con 0x55b7e580c5d0 2023-10-26T06:45:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcac219b700 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e580c5d0 0x55b7e5819480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcab80092a0 tx=0x7fcab8011a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f709079907947b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.177+0000 7fcaa5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/4039620350 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8023d70 con 0x55b7e580c5d0 2023-10-26T06:45:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7e580d040 con 0x55b7e580c5d0 2023-10-26T06:45:51.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/4039620350 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcab8005000 con 0x55b7e580c5d0 2023-10-26T06:45:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/4039620350 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab8003e20 con 0x55b7e580c5d0 2023-10-26T06:45:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcad7de3b80 10 client.25903 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fcabc1a5c30 con 0x55b7e580c5d0 2023-10-26T06:45:51.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.178+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/4039620350 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b7e580d040 con 0x55b7e580c5d0 2023-10-26T06:45:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/4039620350 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcab8011790 con 0x55b7e580c5d0 2023-10-26T06:45:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcad7de3b80 10 client.25903 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcad7de3b80 10 client.25903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:51.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcad7de3b80 20 client.25903 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:51.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e587afd0 0x55b7e587d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcad7de3b80 4 client.25903 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:45:51.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fcab8004390 con 0x55b7e587afd0 2023-10-26T06:45:51.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.179+0000 7fcac199a700 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e587afd0 0x55b7e587d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.180+0000 7fcac199a700 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e587afd0 0x55b7e587d3c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c1fc3b7a25b19e server_cookie=845dab5931c4660b in_seq=0 out_seq=0 2023-10-26T06:45:51.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.180+0000 7fcaa5ffb700 10 client.25903 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:51.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.184+0000 7fcaa5ffb700 1 -- 172.21.15.50:0/4039620350 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7fcab8004390 con 0x55b7e587afd0 2023-10-26T06:45:51.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.184+0000 7fcaa5ffb700 10 client.25903 handle_command_reply: tid=0 2023-10-26T06:45:51.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.184+0000 7fcad7de3b80 1 client.25903 shutdown 2023-10-26T06:45:51.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e580c5d0 msgr2=0x55b7e5819480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e580c5d0 0x55b7e5819480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcab80092a0 tx=0x7fcab8011a70 comp rx=0 tx=0).stop 2023-10-26T06:45:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 shutdown_connections 2023-10-26T06:45:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55b7e587afd0 0x55b7e587d3c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55b7e5812500 0x55b7e5819f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b7e580c5d0 0x55b7e5819480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcaa5ffb700 0 client.25903 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 --2- 172.21.15.50:0/4039620350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7e5811be0 0x55b7e58199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 >> 172.21.15.50:0/4039620350 conn(0x55b7e5780720 msgr2=0x55b7e58004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 shutdown_connections 2023-10-26T06:45:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 1 -- 172.21.15.50:0/4039620350 wait complete. 2023-10-26T06:45:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.185+0000 7fcad7de3b80 20 client.25903 trim_cache size 0 max 16384 2023-10-26T06:45:51.202 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:45:51.203 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:45:51.203 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:45:51.203 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:45:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcaa80a1670 msgr2=0x7fcaa80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcaa80a1670 0x7fcaa80a3b30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009610 tx=0x7fcab4007e80 comp rx=0 tx=0).stop 2023-10-26T06:45:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 msgr2=0x7fcabc199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 0x7fcabc199400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00e9a0 tx=0x7fcaac00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 shutdown_connections 2023-10-26T06:45:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcaa80a1670 0x7fcaa80a3b30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcabc105b30 0x7fcabc19d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcabc067d40 0x7fcabc198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 --2- 172.21.15.50:0/3430395454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcabc105170 0x7fcabc199400 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 >> 172.21.15.50:0/3430395454 conn(0x7fcabc0767f0 msgr2=0x7fcabc10bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 shutdown_connections 2023-10-26T06:45:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.186+0000 7fcac43ff700 1 -- 172.21.15.50:0/3430395454 wait complete. 2023-10-26T06:45:51.208 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:45:51.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:45:51.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:50 smithi153 ceph-mon[131657]: pgmap v384: 97 pgs: 97 active+clean; 366 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 57 op/s 2023-10-26T06:45:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.489+0000 7f67d15ff700 1 -- 172.21.15.50:0/1278651727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc072bc0 msgr2=0x7f67cc072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.489+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1278651727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc072bc0 0x7f67cc072fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009990 tx=0x7f67b4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.490+0000 7f67d15ff700 1 -- 172.21.15.50:0/1278651727 shutdown_connections 2023-10-26T06:45:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.490+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1278651727 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 0x7f67cc10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.490+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1278651727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc072bc0 0x7f67cc072fa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.490+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1278651727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67cc0734e0 0x7f67cc10ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.490+0000 7f67d15ff700 1 -- 172.21.15.50:0/1278651727 >> 172.21.15.50:0/1278651727 conn(0x7f67cc0fc1a0 msgr2=0x7f67cc0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.490+0000 7f67d15ff700 1 -- 172.21.15.50:0/1278651727 shutdown_connections 2023-10-26T06:45:51.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.492+0000 7f67d15ff700 1 -- 172.21.15.50:0/1278651727 wait complete. 2023-10-26T06:45:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.494+0000 7f67d15ff700 1 Processor -- start 2023-10-26T06:45:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.494+0000 7f67d15ff700 1 -- start start 2023-10-26T06:45:51.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.495+0000 7f67d15ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67cc072bc0 0x7f67cc198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.495+0000 7f67d15ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0734e0 0x7f67cc199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.495+0000 7f67d15ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 0x7f67cc19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.495+0000 7f67d15ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc19dd40 con 0x7f67cc0734e0 2023-10-26T06:45:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.495+0000 7f67d15ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc19deb0 con 0x7f67cc10cf90 2023-10-26T06:45:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.495+0000 7f67d15ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc19e070 con 0x7f67cc072bc0 2023-10-26T06:45:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.496+0000 7f67c27fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0734e0 0x7f67cc199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.496+0000 7f67cb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 0x7f67cc19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.497+0000 7f67cb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 0x7f67cc19d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37602/0 (socket says 172.21.15.50:37602) 2023-10-26T06:45:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.497+0000 7f67cb7fe700 1 -- 172.21.15.50:0/1286380177 learned_addr learned my addr 172.21.15.50:0/1286380177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:51.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.498+0000 7f67caffd700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67cc072bc0 0x7f67cc198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.500+0000 7f67c27fc700 1 -- 172.21.15.50:0/1286380177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67cc072bc0 msgr2=0x7f67cc198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.500+0000 7f67c27fc700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67cc072bc0 0x7f67cc198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.500+0000 7f67c27fc700 1 -- 172.21.15.50:0/1286380177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 msgr2=0x7f67cc19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.500+0000 7f67c27fc700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 0x7f67cc19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:51.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.500+0000 7f67c27fc700 1 -- 172.21.15.50:0/1286380177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40095f0 con 0x7f67cc0734e0 2023-10-26T06:45:51.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.502+0000 7f67c27fc700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0734e0 0x7f67cc199360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00d950 tx=0x7f67bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.503+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc009930 con 0x7f67cc0734e0 2023-10-26T06:45:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.503+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67bc010460 con 0x7f67cc0734e0 2023-10-26T06:45:51.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.503+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc00b5d0 con 0x7f67cc0734e0 2023-10-26T06:45:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.504+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67cc19e350 con 0x7f67cc0734e0 2023-10-26T06:45:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.504+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc1a5b90 con 0x7f67cc0734e0 2023-10-26T06:45:51.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.506+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67cc1081a0 con 0x7f67cc0734e0 2023-10-26T06:45:51.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.514+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f67bc010820 con 0x7f67cc0734e0 2023-10-26T06:45:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.517+0000 7f67c8ff9700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67b80a17c0 0x7f67b80a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.517+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f67bc0ccb40 con 0x7f67cc0734e0 2023-10-26T06:45:51.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.517+0000 7f67caffd700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67b80a17c0 0x7f67b80a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:51.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.518+0000 7f67caffd700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67b80a17c0 0x7f67b80a3c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b5c0 tx=0x7f67b401a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:51.529+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67bc095fb0 con 0x7f67cc0734e0 2023-10-26T06:45:52.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.050+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67cc19a120 con 0x7f67cc0734e0 2023-10-26T06:45:52.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.054+0000 7f67c8ff9700 1 -- 172.21.15.50:0/1286380177 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11324 (secure 0 0 0) 0x7f67bc021070 con 0x7f67cc0734e0 2023-10-26T06:45:52.056 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:45:52.056 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:45:14.436234+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:45:52.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67b80a17c0 msgr2=0x7f67b80a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67b80a17c0 0x7f67b80a3c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b5c0 tx=0x7f67b401a040 comp rx=0 tx=0).stop 2023-10-26T06:45:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0734e0 msgr2=0x7f67cc199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0734e0 0x7f67cc199360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00d950 tx=0x7f67bc00dc60 comp rx=0 tx=0).stop 2023-10-26T06:45:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 shutdown_connections 2023-10-26T06:45:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67b80a17c0 0x7f67b80a3c80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67cc10cf90 0x7f67cc19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67cc072bc0 0x7f67cc198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 --2- 172.21.15.50:0/1286380177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67cc0734e0 0x7f67cc199360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.061+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 >> 172.21.15.50:0/1286380177 conn(0x7f67cc0fc1a0 msgr2=0x7f67cc0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.062+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 shutdown_connections 2023-10-26T06:45:52.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.062+0000 7f67d15ff700 1 -- 172.21.15.50:0/1286380177 wait complete. 2023-10-26T06:45:52.066 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-10-26T06:45:52.099 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:45:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 -- 172.21.15.50:0/3531090651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb01010e0 msgr2=0x7f2cb010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/3531090651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb01010e0 0x7f2cb010d5f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b0a0 tx=0x7f2ca800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 -- 172.21.15.50:0/3531090651 shutdown_connections 2023-10-26T06:45:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/3531090651 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb01010e0 0x7f2cb010d5f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/3531090651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb0106730 0x7f2cb0106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/3531090651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0100720 0x7f2cb0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.490+0000 7f2cb51ff700 1 -- 172.21.15.50:0/3531090651 >> 172.21.15.50:0/3531090651 conn(0x7f2cb00fc1f0 msgr2=0x7f2cb00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.491+0000 7f2cb51ff700 1 -- 172.21.15.50:0/3531090651 shutdown_connections 2023-10-26T06:45:52.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.491+0000 7f2cb51ff700 1 -- 172.21.15.50:0/3531090651 wait complete. 2023-10-26T06:45:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.492+0000 7f2cb51ff700 1 Processor -- start 2023-10-26T06:45:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.493+0000 7f2cb51ff700 1 -- start start 2023-10-26T06:45:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.493+0000 7f2cb51ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 0x7f2cb0198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.493+0000 7f2cb51ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb01010e0 0x7f2cb01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.493+0000 7f2cb51ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0106730 0x7f2cb019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2cb51ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019dcb0 con 0x7f2cb01010e0 2023-10-26T06:45:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2cb51ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019de20 con 0x7f2cb0100720 2023-10-26T06:45:52.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2cb51ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019dfe0 con 0x7f2cb0106730 2023-10-26T06:45:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 0x7f2cb0198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 0x7f2cb0198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37610/0 (socket says 172.21.15.50:37610) 2023-10-26T06:45:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 -- 172.21.15.50:0/1534688015 learned_addr learned my addr 172.21.15.50:0/1534688015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caf59e700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0106730 0x7f2cb019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2cae59c700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb01010e0 0x7f2cb01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 -- 172.21.15.50:0/1534688015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0106730 msgr2=0x7f2cb019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0106730 0x7f2cb019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 -- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb01010e0 msgr2=0x7f2cb01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb01010e0 0x7f2cb01992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caed9d700 1 -- 172.21.15.50:0/1534688015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009d00 con 0x7f2cb0100720 2023-10-26T06:45:52.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.494+0000 7f2caf59e700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0106730 0x7f2cb019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:52.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.495+0000 7f2caed9d700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 0x7f2cb0198d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000b530 tx=0x7f2ca000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.495+0000 7f2ca7fff700 1 -- 172.21.15.50:0/1534688015 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0011830 con 0x7f2cb0100720 2023-10-26T06:45:52.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.495+0000 7f2ca7fff700 1 -- 172.21.15.50:0/1534688015 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca0011e50 con 0x7f2cb0100720 2023-10-26T06:45:52.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.495+0000 7f2ca7fff700 1 -- 172.21.15.50:0/1534688015 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000f2e0 con 0x7f2cb0100720 2023-10-26T06:45:52.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.495+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb019e2c0 con 0x7f2cb0100720 2023-10-26T06:45:52.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.495+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb01a5b00 con 0x7f2cb0100720 2023-10-26T06:45:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.499+0000 7f2ca7fff700 1 -- 172.21.15.50:0/1534688015 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2ca0010580 con 0x7f2cb0100720 2023-10-26T06:45:52.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.502+0000 7f2ca7fff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2c940a1670 0x7f2c940a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.502+0000 7f2ca7fff700 1 -- 172.21.15.50:0/1534688015 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2ca00cca60 con 0x7f2cb0100720 2023-10-26T06:45:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.502+0000 7f2cc8be2b80 1 Processor -- start 2023-10-26T06:45:52.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.503+0000 7f2cc8be2b80 1 -- start start 2023-10-26T06:45:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.503+0000 7f2cae59c700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2c940a1670 0x7f2c940a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a64dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64e500 0x55622a648090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a648a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a5bb6e0 con 0x55622a64e500 2023-10-26T06:45:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a5a1c60 con 0x55622a6485d0 2023-10-26T06:45:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a59f580 con 0x55622a64dbe0 2023-10-26T06:45:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a64dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a64dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:41502/0 (socket says 172.21.15.50:41502) 2023-10-26T06:45:52.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2caed9d700 1 -- 172.21.15.50:0/2751393271 learned_addr learned my addr 172.21.15.50:0/2751393271 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.504+0000 7f2caf59e700 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a648a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2cae59c700 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64e500 0x55622a648090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2caf59e700 1 -- 172.21.15.50:0/2751393271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 msgr2=0x55622a64dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2caf59e700 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a64dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2cae59c700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2c940a1670 0x7f2c940a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2cb019a2e0 tx=0x7f2c9c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2caf59e700 1 -- 172.21.15.50:0/2751393271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64e500 msgr2=0x55622a648090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2caf59e700 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64e500 0x55622a648090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.505+0000 7f2caf59e700 1 -- 172.21.15.50:0/2751393271 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55622a5583f0 con 0x55622a6485d0 2023-10-26T06:45:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.506+0000 7f2caf59e700 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a648a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b780 tx=0x7f2ca80095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15aa63957436a197 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.506+0000 7f2ca57fa700 1 -- 172.21.15.50:0/2751393271 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800e050 con 0x55622a6485d0 2023-10-26T06:45:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.506+0000 7f2ca57fa700 1 -- 172.21.15.50:0/2751393271 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca8004a50 con 0x55622a6485d0 2023-10-26T06:45:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.506+0000 7f2ca57fa700 1 -- 172.21.15.50:0/2751393271 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8005040 con 0x55622a6485d0 2023-10-26T06:45:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/2751393271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 msgr2=0x55622a648a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a648a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b780 tx=0x7f2ca80095b0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/2751393271 shutdown_connections 2023-10-26T06:45:52.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a648a50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a64dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/2751393271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64e500 0x55622a648090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.507+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/2751393271 >> 172.21.15.50:0/2751393271 conn(0x55622a5bc720 msgr2=0x55622a642b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.508+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/2751393271 shutdown_connections 2023-10-26T06:45:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.508+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/2751393271 wait complete. 2023-10-26T06:45:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.508+0000 7f2cc8be2b80 1 -- start start 2023-10-26T06:45:52.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 Processor -- start 2023-10-26T06:45:52.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a6485d0 0x55622a654450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a651e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a59ae70 con 0x55622a64dbe0 2023-10-26T06:45:52.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a537710 con 0x55622a64e500 2023-10-26T06:45:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a5373b0 con 0x55622a6485d0 2023-10-26T06:45:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.509+0000 7f2cc8be2b80 10 client.0 _ll_register_callbacks cb 0x55622a481a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37590/0 (socket says 172.21.15.50:37590) 2023-10-26T06:45:52.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 -- 172.21.15.50:0/4191753882 learned_addr learned my addr 172.21.15.50:0/4191753882 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2caed9d700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a6485d0 0x55622a654450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2caf59e700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a651e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 -- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a6485d0 msgr2=0x55622a654450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a6485d0 0x55622a654450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 -- 172.21.15.50:0/4191753882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 msgr2=0x55622a651e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a651e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2cae59c700 1 -- 172.21.15.50:0/4191753882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb010def0 con 0x55622a64dbe0 2023-10-26T06:45:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.510+0000 7f2caed9d700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a6485d0 0x55622a654450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.511+0000 7f2cae59c700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6517e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c011d50 tx=0x7f2c9c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f14d49744f5604 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.511+0000 7f2c927fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:45:52.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.511+0000 7f2c927fc700 1 -- 172.21.15.50:0/4191753882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c012c70 con 0x55622a64dbe0 2023-10-26T06:45:52.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.511+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55622a59fef0 con 0x55622a64dbe0 2023-10-26T06:45:52.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.511+0000 7f2c927fc700 1 -- 172.21.15.50:0/4191753882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2c9c01b070 con 0x55622a64dbe0 2023-10-26T06:45:52.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.512+0000 7f2c927fc700 1 -- 172.21.15.50:0/4191753882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c9c012dd0 con 0x55622a64dbe0 2023-10-26T06:45:52.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.512+0000 7f2cc8be2b80 10 client.15885 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:52.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.512+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55622a3c5de0 con 0x55622a64dbe0 2023-10-26T06:45:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.512+0000 7f2c927fc700 1 -- 172.21.15.50:0/4191753882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55622a59fef0 con 0x55622a64dbe0 2023-10-26T06:45:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2c927fc700 1 -- 172.21.15.50:0/4191753882 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2c9c020460 con 0x55622a64dbe0 2023-10-26T06:45:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2cc8be2b80 10 client.15885 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2cc8be2b80 10 client.15885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:45:52.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2cc8be2b80 20 client.15885 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a66a6e0 0x55622a66cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2cc8be2b80 4 client.15885 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55622a6178b0 con 0x55622a66a6e0 2023-10-26T06:45:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.513+0000 7f2caed9d700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a66a6e0 0x55622a66cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.514+0000 7f2caed9d700 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a66a6e0 0x55622a66cb00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a819e6f558aedb70 server_cookie=96ca292f09855acd in_seq=0 out_seq=0 2023-10-26T06:45:52.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.514+0000 7f2c927fc700 10 client.15885 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.515+0000 7f2c927fc700 1 -- 172.21.15.50:0/4191753882 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55622a6178b0 con 0x55622a66a6e0 2023-10-26T06:45:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.515+0000 7f2c927fc700 10 client.15885 handle_command_reply: tid=0 2023-10-26T06:45:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 client.15885 shutdown 2023-10-26T06:45:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 msgr2=0x55622a6517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6517e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c011d50 tx=0x7f2c9c0047c0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 shutdown_connections 2023-10-26T06:45:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a66a6e0 0x55622a66cb00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a651e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a6485d0 0x55622a654450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2c927fc700 0 client.15885 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/4191753882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6517e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 >> 172.21.15.50:0/4191753882 conn(0x55622a5bc720 msgr2=0x55622a647080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 shutdown_connections 2023-10-26T06:45:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.516+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/4191753882 wait complete. 2023-10-26T06:45:52.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.517+0000 7f2cc8be2b80 20 client.15885 trim_cache size 0 max 16384 2023-10-26T06:45:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 Processor -- start 2023-10-26T06:45:52.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 -- start start 2023-10-26T06:45:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a661740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64e500 0x55622a650610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a41b920 con 0x55622a64dbe0 2023-10-26T06:45:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a667160 con 0x55622a6485d0 2023-10-26T06:45:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a63f310 con 0x55622a64e500 2023-10-26T06:45:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a661740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2cae59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a661740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37638/0 (socket says 172.21.15.50:37638) 2023-10-26T06:45:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.539+0000 7f2caed9d700 1 -- 172.21.15.50:0/556698088 learned_addr learned my addr 172.21.15.50:0/556698088 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caf59e700 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64e500 0x55622a650610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caed9d700 1 -- 172.21.15.50:0/556698088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64e500 msgr2=0x55622a650610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caed9d700 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64e500 0x55622a650610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caed9d700 1 -- 172.21.15.50:0/556698088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 msgr2=0x55622a6500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caed9d700 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caed9d700 1 -- 172.21.15.50:0/556698088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55622a3aec60 con 0x55622a6485d0 2023-10-26T06:45:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2cae59c700 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:52.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2caed9d700 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a661740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00998a0 tx=0x7f2ca00cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d912794f33868b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2ca5ffb700 1 -- 172.21.15.50:0/556698088 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0099ba0 con 0x55622a6485d0 2023-10-26T06:45:52.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2ca5ffb700 1 -- 172.21.15.50:0/556698088 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ca009dcf0 con 0x55622a6485d0 2023-10-26T06:45:52.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.540+0000 7f2ca5ffb700 1 -- 172.21.15.50:0/556698088 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00b2210 con 0x55622a6485d0 2023-10-26T06:45:52.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/556698088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 msgr2=0x55622a661740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a661740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00998a0 tx=0x7f2ca00cc040 comp rx=0 tx=0).stop 2023-10-26T06:45:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/556698088 shutdown_connections 2023-10-26T06:45:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64e500 0x55622a650610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a6485d0 0x55622a661740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/556698088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a64dbe0 0x55622a6500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/556698088 >> 172.21.15.50:0/556698088 conn(0x55622a5bc720 msgr2=0x55622a642810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/556698088 shutdown_connections 2023-10-26T06:45:52.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.541+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/556698088 wait complete. 2023-10-26T06:45:52.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.542+0000 7f2cc8be2b80 1 -- start start 2023-10-26T06:45:52.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.542+0000 7f2cc8be2b80 1 Processor -- start 2023-10-26T06:45:52.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 0x55622a65fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a660420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a660960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a6be520 con 0x55622a6485d0 2023-10-26T06:45:52.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a6be660 con 0x55622a64e500 2023-10-26T06:45:52.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55622a6be7a0 con 0x55622a64dbe0 2023-10-26T06:45:52.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cc8be2b80 10 client.0 _ll_register_callbacks cb 0x55622a481a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:52.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 0x55622a65fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 0x55622a65fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37614/0 (socket says 172.21.15.50:37614) 2023-10-26T06:45:52.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 -- 172.21.15.50:0/1893614563 learned_addr learned my addr 172.21.15.50:0/1893614563 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2cae59c700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a660420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caf59e700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a660960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 -- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 msgr2=0x55622a660420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a660420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 -- 172.21.15.50:0/1893614563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 msgr2=0x55622a660960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a660960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.543+0000 7f2caed9d700 1 -- 172.21.15.50:0/1893614563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55622a3c5de0 con 0x55622a6485d0 2023-10-26T06:45:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2caed9d700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 0x55622a65fee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00a1a00 tx=0x7f2ca0099a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a50b0a685b9f8ed server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2c927fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:45:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2c927fc700 1 -- 172.21.15.50:0/1893614563 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00174c0 con 0x55622a6485d0 2023-10-26T06:45:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2c927fc700 1 -- 172.21.15.50:0/1893614563 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2ca0099ba0 con 0x55622a6485d0 2023-10-26T06:45:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55622a649040 con 0x55622a6485d0 2023-10-26T06:45:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2c927fc700 1 -- 172.21.15.50:0/1893614563 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca00b2210 con 0x55622a6485d0 2023-10-26T06:45:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2cc8be2b80 10 client.15891 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f2cb01a5b00 con 0x55622a6485d0 2023-10-26T06:45:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2c927fc700 1 -- 172.21.15.50:0/1893614563 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55622a649040 con 0x55622a6485d0 2023-10-26T06:45:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2c927fc700 1 -- 172.21.15.50:0/1893614563 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ca0099170 con 0x55622a6485d0 2023-10-26T06:45:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2cc8be2b80 10 client.15891 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2cc8be2b80 10 client.15891 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:45:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.544+0000 7f2cc8be2b80 20 client.15891 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.545+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a6bfbe0 0x55622a6c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.545+0000 7f2cc8be2b80 4 client.15891 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:45:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.545+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f2ca8004a50 con 0x55622a6bfbe0 2023-10-26T06:45:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.545+0000 7f2cae59c700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a6bfbe0 0x55622a6c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.545+0000 7f2cae59c700 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a6bfbe0 0x55622a6c2000 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e440aa6a91e97e8d server_cookie=fa145953b39ba0f0 in_seq=0 out_seq=0 2023-10-26T06:45:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.545+0000 7f2c927fc700 10 client.15891 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:52.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2c927fc700 1 -- 172.21.15.50:0/1893614563 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f2ca8004a50 con 0x55622a6bfbe0 2023-10-26T06:45:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2c927fc700 10 client.15891 handle_command_reply: tid=0 2023-10-26T06:45:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 client.15891 shutdown 2023-10-26T06:45:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 msgr2=0x55622a65fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 0x55622a65fee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00a1a00 tx=0x7f2ca0099a10 comp rx=0 tx=0).stop 2023-10-26T06:45:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 shutdown_connections 2023-10-26T06:45:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55622a6bfbe0 0x55622a6c2000 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55622a64e500 0x55622a660960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55622a6485d0 0x55622a65fee0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2c927fc700 0 client.15891 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:45:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 --2- 172.21.15.50:0/1893614563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55622a64dbe0 0x55622a660420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 >> 172.21.15.50:0/1893614563 conn(0x55622a5bc720 msgr2=0x55622a64b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 shutdown_connections 2023-10-26T06:45:52.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.547+0000 7f2cc8be2b80 1 -- 172.21.15.50:0/1893614563 wait complete. 2023-10-26T06:45:52.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cc8be2b80 20 client.15891 trim_cache size 0 max 16384 2023-10-26T06:45:52.563 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:45:52.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2c940a1670 msgr2=0x7f2c940a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2c940a1670 0x7f2c940a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2cb019a2e0 tx=0x7f2c9c009260 comp rx=0 tx=0).stop 2023-10-26T06:45:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 msgr2=0x7f2cb0198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 0x7f2cb0198d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000b530 tx=0x7f2ca000b8f0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 shutdown_connections 2023-10-26T06:45:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f2c940a1670 0x7f2c940a3b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cb0106730 0x7f2cb019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2cb0100720 0x7f2cb0198d90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 --2- 172.21.15.50:0/1534688015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2cb01010e0 0x7f2cb01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.548+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 >> 172.21.15.50:0/1534688015 conn(0x7f2cb00fc1f0 msgr2=0x7f2cb00fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.549+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 shutdown_connections 2023-10-26T06:45:52.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.549+0000 7f2cb51ff700 1 -- 172.21.15.50:0/1534688015 wait complete. 2023-10-26T06:45:52.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:45:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 -- 172.21.15.50:0/3163900816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841087f0 msgr2=0x7fe884108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 --2- 172.21.15.50:0/3163900816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841087f0 0x7fe884108bd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe874009990 tx=0x7fe874009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 -- 172.21.15.50:0/3163900816 shutdown_connections 2023-10-26T06:45:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 --2- 172.21.15.50:0/3163900816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8841031a0 0x7fe88410f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 --2- 172.21.15.50:0/3163900816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841087f0 0x7fe884108bd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 --2- 172.21.15.50:0/3163900816 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841027e0 0x7fe884102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 -- 172.21.15.50:0/3163900816 >> 172.21.15.50:0/3163900816 conn(0x7fe8840fe290 msgr2=0x7fe8841006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 -- 172.21.15.50:0/3163900816 shutdown_connections 2023-10-26T06:45:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.782+0000 7fe88359e700 1 -- 172.21.15.50:0/3163900816 wait complete. 2023-10-26T06:45:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.783+0000 7fe88359e700 1 Processor -- start 2023-10-26T06:45:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.783+0000 7fe88359e700 1 -- start start 2023-10-26T06:45:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.783+0000 7fe88359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 0x7fe884074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8841031a0 0x7fe884075240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841087f0 0x7fe884075780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841a9270 con 0x7fe8841031a0 2023-10-26T06:45:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841a93b0 con 0x7fe8841087f0 2023-10-26T06:45:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841a9540 con 0x7fe8841027e0 2023-10-26T06:45:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 0x7fe884074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe881d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8841031a0 0x7fe884075240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe882d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841087f0 0x7fe884075780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 0x7fe884074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:41556/0 (socket says 172.21.15.50:41556) 2023-10-26T06:45:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88259c700 1 -- 172.21.15.50:0/2480665734 learned_addr learned my addr 172.21.15.50:0/2480665734 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe882d9d700 1 -- 172.21.15.50:0/2480665734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 msgr2=0x7fe884074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe882d9d700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 0x7fe884074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe882d9d700 1 -- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8841031a0 msgr2=0x7fe884075240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe882d9d700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8841031a0 0x7fe884075240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe882d9d700 1 -- 172.21.15.50:0/2480665734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740095f0 con 0x7fe8841087f0 2023-10-26T06:45:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.784+0000 7fe88259c700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 0x7fe884074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.785+0000 7fe882d9d700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841087f0 0x7fe884075780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00efc0 tx=0x7fe87c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.785+0000 7fe8737fe700 1 -- 172.21.15.50:0/2480665734 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c018070 con 0x7fe8841087f0 2023-10-26T06:45:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.785+0000 7fe8737fe700 1 -- 172.21.15.50:0/2480665734 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe87c00f040 con 0x7fe8841087f0 2023-10-26T06:45:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.785+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8841a97c0 con 0x7fe8841087f0 2023-10-26T06:45:52.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.785+0000 7fe8737fe700 1 -- 172.21.15.50:0/2480665734 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00cd60 con 0x7fe8841087f0 2023-10-26T06:45:52.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.785+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8841a9cd0 con 0x7fe8841087f0 2023-10-26T06:45:52.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.789+0000 7fe8737fe700 1 -- 172.21.15.50:0/2480665734 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe87c003a00 con 0x7fe8841087f0 2023-10-26T06:45:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.790+0000 7fe89c8cfb80 1 Processor -- start 2023-10-26T06:45:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 -- start start 2023-10-26T06:45:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe8737fe700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe86c0a1670 0x7fe86c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 0x55ff50daf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50da92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe8737fe700 1 -- 172.21.15.50:0/2480665734 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe87c0cca40 con 0x7fe8841087f0 2023-10-26T06:45:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50da9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50d1c6e0 con 0x55ff50daf680 2023-10-26T06:45:52.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50d02c60 con 0x55ff50daed60 2023-10-26T06:45:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50d00580 con 0x55ff50da9820 2023-10-26T06:45:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe88259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 0x55ff50daf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe88259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 0x55ff50daf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37686/0 (socket says 172.21.15.50:37686) 2023-10-26T06:45:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe88259c700 1 -- 172.21.15.50:0/127283224 learned_addr learned my addr 172.21.15.50:0/127283224 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe882d9d700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50da9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe881d9b700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50da92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.791+0000 7fe881d9b700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe86c0a1670 0x7fe86c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe88259c700 1 -- 172.21.15.50:0/127283224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 msgr2=0x55ff50da9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe88259c700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50da9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe88259c700 1 -- 172.21.15.50:0/127283224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 msgr2=0x55ff50da92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe88259c700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50da92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe88259c700 1 -- 172.21.15.50:0/127283224 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff50cb93f0 con 0x55ff50daed60 2023-10-26T06:45:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe881d9b700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50da92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:45:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe882d9d700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50da9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:52.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe88259c700 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 0x55ff50daf140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe87400b660 tx=0x7fe87400b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59d26d7324d7209f server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe881d9b700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe86c0a1670 0x7fe86c0a3b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55ff50dafae0 tx=0x7fe878009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe870ff9700 1 -- 172.21.15.50:0/127283224 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401d070 con 0x55ff50daed60 2023-10-26T06:45:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe870ff9700 1 -- 172.21.15.50:0/127283224 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe87401e040 con 0x55ff50daed60 2023-10-26T06:45:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.792+0000 7fe870ff9700 1 -- 172.21.15.50:0/127283224 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874004d50 con 0x55ff50daed60 2023-10-26T06:45:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/127283224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 msgr2=0x55ff50daf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 0x55ff50daf140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe87400b660 tx=0x7fe87400b690 comp rx=0 tx=0).stop 2023-10-26T06:45:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/127283224 shutdown_connections 2023-10-26T06:45:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50da9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daed60 0x55ff50daf140 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/127283224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50da92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/127283224 >> 172.21.15.50:0/127283224 conn(0x55ff50d1d720 msgr2=0x55ff50da3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/127283224 shutdown_connections 2023-10-26T06:45:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.793+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/127283224 wait complete. 2023-10-26T06:45:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 -- start start 2023-10-26T06:45:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 Processor -- start 2023-10-26T06:45:52.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daf680 0x55ff50db3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50cfbe70 con 0x55ff50daed60 2023-10-26T06:45:52.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50c98710 con 0x55ff50da9820 2023-10-26T06:45:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50c983b0 con 0x55ff50daf680 2023-10-26T06:45:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.794+0000 7fe89c8cfb80 10 client.0 _ll_register_callbacks cb 0x55ff50be2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe881d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37694/0 (socket says 172.21.15.50:37694) 2023-10-26T06:45:52.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 -- 172.21.15.50:0/4132809442 learned_addr learned my addr 172.21.15.50:0/4132809442 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe882d9d700 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daf680 0x55ff50db3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 -- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daf680 msgr2=0x55ff50db3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daf680 0x55ff50db3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 -- 172.21.15.50:0/4132809442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 msgr2=0x55ff50db2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 -- 172.21.15.50:0/4132809442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88410ffb0 con 0x55ff50da9820 2023-10-26T06:45:52.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe88259c700 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db5670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe874009ce0 tx=0x7fe874022630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c076a1ce573eef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.795+0000 7fe869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:52.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe869ffb700 1 -- 172.21.15.50:0/4132809442 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401d070 con 0x55ff50da9820 2023-10-26T06:45:52.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff50d00ef0 con 0x55ff50da9820 2023-10-26T06:45:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe869ffb700 1 -- 172.21.15.50:0/4132809442 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe874022c30 con 0x55ff50da9820 2023-10-26T06:45:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe869ffb700 1 -- 172.21.15.50:0/4132809442 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe874022df0 con 0x55ff50da9820 2023-10-26T06:45:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 10 client.25934 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ff50b26de0 con 0x55ff50da9820 2023-10-26T06:45:52.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe869ffb700 1 -- 172.21.15.50:0/4132809442 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff50d00ef0 con 0x55ff50da9820 2023-10-26T06:45:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe869ffb700 1 -- 172.21.15.50:0/4132809442 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe874037520 con 0x55ff50da9820 2023-10-26T06:45:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 10 client.25934 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 10 client.25934 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:45:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 20 client.25934 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:52.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50dc2b10 0x55ff50dc4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 4 client.25934 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.796+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff50d788b0 con 0x55ff50dc2b10 2023-10-26T06:45:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.797+0000 7fe881d9b700 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50dc2b10 0x55ff50dc4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.797+0000 7fe881d9b700 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50dc2b10 0x55ff50dc4f00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf91d1cf1e86f83d server_cookie=8204e250153aac09 in_seq=0 out_seq=0 2023-10-26T06:45:52.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.797+0000 7fe869ffb700 10 client.25934 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:52.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe869ffb700 1 -- 172.21.15.50:0/4132809442 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ff50d788b0 con 0x55ff50dc2b10 2023-10-26T06:45:52.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe869ffb700 10 client.25934 handle_command_reply: tid=0 2023-10-26T06:45:52.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 client.25934 shutdown 2023-10-26T06:45:52.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 msgr2=0x55ff50db5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db5670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe874009ce0 tx=0x7fe874022630 comp rx=0 tx=0).stop 2023-10-26T06:45:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 shutdown_connections 2023-10-26T06:45:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daf680 0x55ff50db3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50dc2b10 0x55ff50dc4f00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db5670 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4132809442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 >> 172.21.15.50:0/4132809442 conn(0x55ff50d1d720 msgr2=0x55ff50da82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe869ffb700 0 client.25934 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:52.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 shutdown_connections 2023-10-26T06:45:52.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4132809442 wait complete. 2023-10-26T06:45:52.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.798+0000 7fe89c8cfb80 20 client.25934 trim_cache size 0 max 16384 2023-10-26T06:45:52.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 Processor -- start 2023-10-26T06:45:52.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 -- start start 2023-10-26T06:45:52.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 0x55ff50dba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50db51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50d9ed40 con 0x55ff50daf680 2023-10-26T06:45:52.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50b7c920 con 0x55ff50da9820 2023-10-26T06:45:52.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50da04a0 con 0x55ff50daed60 2023-10-26T06:45:52.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe881d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 0x55ff50dba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe88259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe882d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50db51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe88259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37696/0 (socket says 172.21.15.50:37696) 2023-10-26T06:45:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe881d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 0x55ff50dba060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:41578/0 (socket says 172.21.15.50:41578) 2023-10-26T06:45:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.812+0000 7fe88259c700 1 -- 172.21.15.50:0/4231969146 learned_addr learned my addr 172.21.15.50:0/4231969146 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe88259c700 1 -- 172.21.15.50:0/4231969146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 msgr2=0x55ff50dba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe88259c700 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 0x55ff50dba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe88259c700 1 -- 172.21.15.50:0/4231969146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 msgr2=0x55ff50db51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe88259c700 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50db51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe88259c700 1 -- 172.21.15.50:0/4231969146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff50b0fc60 con 0x55ff50da9820 2023-10-26T06:45:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe881d9b700 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 0x55ff50dba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe88259c700 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db29a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe87400be60 tx=0x7fe874009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631790a1b3d42112 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe8717fa700 1 -- 172.21.15.50:0/4231969146 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401d040 con 0x55ff50da9820 2023-10-26T06:45:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe8717fa700 1 -- 172.21.15.50:0/4231969146 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe874037eb0 con 0x55ff50da9820 2023-10-26T06:45:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.813+0000 7fe8717fa700 1 -- 172.21.15.50:0/4231969146 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87400f6c0 con 0x55ff50da9820 2023-10-26T06:45:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4231969146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 msgr2=0x55ff50db29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db29a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe87400be60 tx=0x7fe874009310 comp rx=0 tx=0).stop 2023-10-26T06:45:52.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4231969146 shutdown_connections 2023-10-26T06:45:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daf680 0x55ff50db51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50da9820 0x55ff50db29a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/4231969146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50daed60 0x55ff50dba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4231969146 >> 172.21.15.50:0/4231969146 conn(0x55ff50d1d720 msgr2=0x55ff50db2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4231969146 shutdown_connections 2023-10-26T06:45:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/4231969146 wait complete. 2023-10-26T06:45:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.814+0000 7fe89c8cfb80 1 -- start start 2023-10-26T06:45:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 Processor -- start 2023-10-26T06:45:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50db8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daf680 0x55ff50db8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50e158a0 con 0x55ff50daed60 2023-10-26T06:45:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50e159e0 con 0x55ff50daf680 2023-10-26T06:45:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.815+0000 7fe89c8cfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff50e15b70 con 0x55ff50da9820 2023-10-26T06:45:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe89c8cfb80 10 client.0 _ll_register_callbacks cb 0x55ff50be2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50db8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe882d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daf680 0x55ff50db8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50db8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:41594/0 (socket says 172.21.15.50:41594) 2023-10-26T06:45:52.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 -- 172.21.15.50:0/3851581409 learned_addr learned my addr 172.21.15.50:0/3851581409 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:52.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe881d9b700 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 -- 172.21.15.50:0/3851581409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daf680 msgr2=0x55ff50db8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daf680 0x55ff50db8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 -- 172.21.15.50:0/3851581409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 msgr2=0x55ff50db8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 -- 172.21.15.50:0/3851581409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe878010c20 con 0x55ff50da9820 2023-10-26T06:45:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe88259c700 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50db8040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe874000c00 tx=0x7fe874004810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a51f1e38a7785c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:52.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.816+0000 7fe869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:52.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe869ffb700 1 -- 172.21.15.50:0/3851581409 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401d040 con 0x55ff50da9820 2023-10-26T06:45:52.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe87401e040 con 0x55ff50da9820 2023-10-26T06:45:52.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe869ffb700 1 -- 172.21.15.50:0/3851581409 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe874000e40 con 0x55ff50da9820 2023-10-26T06:45:52.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe869ffb700 1 -- 172.21.15.50:0/3851581409 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe87400f460 con 0x55ff50da9820 2023-10-26T06:45:52.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 10 client.25945 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ff50b26de0 con 0x55ff50da9820 2023-10-26T06:45:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe869ffb700 1 -- 172.21.15.50:0/3851581409 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe87401e040 con 0x55ff50da9820 2023-10-26T06:45:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe869ffb700 1 -- 172.21.15.50:0/3851581409 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe874048020 con 0x55ff50da9820 2023-10-26T06:45:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 10 client.25945 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 10 client.25945 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:45:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 20 client.25945 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50e16f50 0x55ff50e19370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 4 client.25945 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:45:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.817+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ff50cf4e50 con 0x55ff50e16f50 2023-10-26T06:45:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe881d9b700 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50e16f50 0x55ff50e19370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe881d9b700 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50e16f50 0x55ff50e19370 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fefcecafa23e5291 server_cookie=1068a758cbe33d36 in_seq=0 out_seq=0 2023-10-26T06:45:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe869ffb700 10 client.25945 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe869ffb700 1 -- 172.21.15.50:0/3851581409 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ff50cf4e50 con 0x55ff50e16f50 2023-10-26T06:45:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe869ffb700 10 client.25945 handle_command_reply: tid=0 2023-10-26T06:45:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe89c8cfb80 1 client.25945 shutdown 2023-10-26T06:45:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 msgr2=0x55ff50db8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.818+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50db8040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe874000c00 tx=0x7fe874004810 comp rx=0 tx=0).stop 2023-10-26T06:45:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 shutdown_connections 2023-10-26T06:45:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ff50e16f50 0x55ff50e19370 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ff50daf680 0x55ff50db8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ff50da9820 0x55ff50db8040 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 --2- 172.21.15.50:0/3851581409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff50daed60 0x55ff50db8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 >> 172.21.15.50:0/3851581409 conn(0x55ff50d1d720 msgr2=0x55ff50dac790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe869ffb700 0 client.25945 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:45:52.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 shutdown_connections 2023-10-26T06:45:52.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 1 -- 172.21.15.50:0/3851581409 wait complete. 2023-10-26T06:45:52.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe89c8cfb80 20 client.25945 trim_cache size 0 max 16384 2023-10-26T06:45:52.839 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:45:52.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe86c0a1670 msgr2=0x7fe86c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe88359e700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe86c0a1670 0x7fe86c0a3b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55ff50dafae0 tx=0x7fe878009260 comp rx=0 tx=0).stop 2023-10-26T06:45:52.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841087f0 msgr2=0x7fe884075780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:52.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.819+0000 7fe88359e700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841087f0 0x7fe884075780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00efc0 tx=0x7fe87c00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 shutdown_connections 2023-10-26T06:45:52.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe86c0a1670 0x7fe86c0a3b30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8841087f0 0x7fe884075780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8841027e0 0x7fe884074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 --2- 172.21.15.50:0/2480665734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8841031a0 0x7fe884075240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:52.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 >> 172.21.15.50:0/2480665734 conn(0x7fe8840fe290 msgr2=0x7fe8840febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:52.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 shutdown_connections 2023-10-26T06:45:52.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:52.820+0000 7fe88359e700 1 -- 172.21.15.50:0/2480665734 wait complete. 2023-10-26T06:45:52.842 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:52 smithi050 ceph-mon[94997]: pgmap v385: 97 pgs: 97 active+clean; 375 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 56 op/s 2023-10-26T06:45:52.843 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:52 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1286380177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:45:52.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:45:53.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.057+0000 7fbee7dff700 1 -- 172.21.15.50:0/1273569170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0067d40 msgr2=0x7fbee0068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.057+0000 7fbee7dff700 1 --2- 172.21.15.50:0/1273569170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0067d40 0x7fbee0068120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009990 tx=0x7fbedc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 -- 172.21.15.50:0/1273569170 shutdown_connections 2023-10-26T06:45:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 --2- 172.21.15.50:0/1273569170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee0105b30 0x7fbee010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 --2- 172.21.15.50:0/1273569170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0067d40 0x7fbee0068120 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 --2- 172.21.15.50:0/1273569170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee01055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 -- 172.21.15.50:0/1273569170 >> 172.21.15.50:0/1273569170 conn(0x7fbee00767f0 msgr2=0x7fbee0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 -- 172.21.15.50:0/1273569170 shutdown_connections 2023-10-26T06:45:53.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.058+0000 7fbee7dff700 1 -- 172.21.15.50:0/1273569170 wait complete. 2023-10-26T06:45:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 Processor -- start 2023-10-26T06:45:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 -- start start 2023-10-26T06:45:53.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee0067d40 0x7fbee0198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0105b30 0x7fbee019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee019dd20 con 0x7fbee0067d40 2023-10-26T06:45:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee019de90 con 0x7fbee0105b30 2023-10-26T06:45:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.059+0000 7fbee7dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee019e050 con 0x7fbee0105170 2023-10-26T06:45:53.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee0199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:41604/0 (socket says 172.21.15.50:41604) 2023-10-26T06:45:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 -- 172.21.15.50:0/3653795716 learned_addr learned my addr 172.21.15.50:0/3653795716 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee0067d40 0x7fbee0198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee639c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0105b30 0x7fbee019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 -- 172.21.15.50:0/3653795716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0105b30 msgr2=0x7fbee019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0105b30 0x7fbee019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 -- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee0067d40 msgr2=0x7fbee0198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee0067d40 0x7fbee0198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 -- 172.21.15.50:0/3653795716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0095f0 con 0x7fbee0105170 2023-10-26T06:45:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.060+0000 7fbee539a700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee0199340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbed000e9a0 tx=0x7fbed000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.061+0000 7fbed6ffd700 1 -- 172.21.15.50:0/3653795716 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0009790 con 0x7fbee0105170 2023-10-26T06:45:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.061+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee019e330 con 0x7fbee0105170 2023-10-26T06:45:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.061+0000 7fbed6ffd700 1 -- 172.21.15.50:0/3653795716 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbed0010430 con 0x7fbee0105170 2023-10-26T06:45:53.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.061+0000 7fbed6ffd700 1 -- 172.21.15.50:0/3653795716 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0018680 con 0x7fbee0105170 2023-10-26T06:45:53.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.061+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee01a5b70 con 0x7fbee0105170 2023-10-26T06:45:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.064+0000 7fbed6ffd700 1 -- 172.21.15.50:0/3653795716 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbed00105a0 con 0x7fbee0105170 2023-10-26T06:45:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.065+0000 7fbefb790b80 1 Processor -- start 2023-10-26T06:45:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.065+0000 7fbefb790b80 1 -- start start 2023-10-26T06:45:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.065+0000 7fbed6ffd700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbecc0a15f0 0x7fbecc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.065+0000 7fbed6ffd700 1 -- 172.21.15.50:0/3653795716 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbed0014070 con 0x7fbee0105170 2023-10-26T06:45:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d31fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d32500 0x55cee2d2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbefb790b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2c9f6e0 con 0x55cee2d31be0 2023-10-26T06:45:53.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbefb790b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2c85c60 con 0x55cee2d2c5d0 2023-10-26T06:45:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbefb790b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2c83580 con 0x55cee2d32500 2023-10-26T06:45:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee639c700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbecc0a15f0 0x7fbecc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d31fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d31fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37694/0 (socket says 172.21.15.50:37694) 2023-10-26T06:45:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 -- 172.21.15.50:0/603109341 learned_addr learned my addr 172.21.15.50:0/603109341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:53.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee539a700 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d32500 0x55cee2d2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee639c700 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 -- 172.21.15.50:0/603109341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d32500 msgr2=0x55cee2d2c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d32500 0x55cee2d2c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 -- 172.21.15.50:0/603109341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d2c5d0 msgr2=0x55cee2d2ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.066+0000 7fbee5b9b700 1 -- 172.21.15.50:0/603109341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee2c3c3f0 con 0x55cee2d31be0 2023-10-26T06:45:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.067+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d31fc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbedc005ec0 tx=0x7fbedc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d0f778fd0e4242 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.067+0000 7fbee639c700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbecc0a15f0 0x7fbecc0a3ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009fd0 tx=0x7fbed800fc20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.067+0000 7fbecbfff700 1 -- 172.21.15.50:0/603109341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc01d070 con 0x55cee2d31be0 2023-10-26T06:45:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.067+0000 7fbecbfff700 1 -- 172.21.15.50:0/603109341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbedc01e040 con 0x55cee2d31be0 2023-10-26T06:45:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.067+0000 7fbecbfff700 1 -- 172.21.15.50:0/603109341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0047f0 con 0x55cee2d31be0 2023-10-26T06:45:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 -- 172.21.15.50:0/603109341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 msgr2=0x55cee2d31fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d31fc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbedc005ec0 tx=0x7fbedc005ef0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 -- 172.21.15.50:0/603109341 shutdown_connections 2023-10-26T06:45:53.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d31fc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 --2- 172.21.15.50:0/603109341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d32500 0x55cee2d2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 -- 172.21.15.50:0/603109341 >> 172.21.15.50:0/603109341 conn(0x55cee2ca0720 msgr2=0x55cee2d26b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 -- 172.21.15.50:0/603109341 shutdown_connections 2023-10-26T06:45:53.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 -- 172.21.15.50:0/603109341 wait complete. 2023-10-26T06:45:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.068+0000 7fbefb790b80 1 -- start start 2023-10-26T06:45:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 Processor -- start 2023-10-26T06:45:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d38430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d35720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d35ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2c7ee70 con 0x55cee2d32500 2023-10-26T06:45:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2c1b710 con 0x55cee2d31be0 2023-10-26T06:45:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2c1b3b0 con 0x55cee2d2c5d0 2023-10-26T06:45:53.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbefb790b80 10 client.0 _ll_register_callbacks cb 0x55cee2b65a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbee539a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d35720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbee539a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d35720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37734/0 (socket says 172.21.15.50:37734) 2023-10-26T06:45:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbee539a700 1 -- 172.21.15.50:0/3561221957 learned_addr learned my addr 172.21.15.50:0/3561221957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbee5b9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d38430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.069+0000 7fbee639c700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d35ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee539a700 1 -- 172.21.15.50:0/3561221957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 msgr2=0x55cee2d38430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee539a700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d38430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee539a700 1 -- 172.21.15.50:0/3561221957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 msgr2=0x55cee2d35ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee539a700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d35ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee539a700 1 -- 172.21.15.50:0/3561221957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee010de70 con 0x55cee2d31be0 2023-10-26T06:45:53.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee639c700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d35ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d38430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbee539a700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d35720 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbed0096790 tx=0x7fbed009aaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aa97cbfafd50ef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbec97fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbec97fa700 1 -- 172.21.15.50:0/3561221957 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0094ea0 con 0x55cee2d31be0 2023-10-26T06:45:53.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cee2c83ef0 con 0x55cee2d31be0 2023-10-26T06:45:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbec97fa700 1 -- 172.21.15.50:0/3561221957 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbed009e3e0 con 0x55cee2d31be0 2023-10-26T06:45:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbec97fa700 1 -- 172.21.15.50:0/3561221957 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbed00a2620 con 0x55cee2d31be0 2023-10-26T06:45:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbefb790b80 10 client.25952 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.070+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55cee2aa9de0 con 0x55cee2d31be0 2023-10-26T06:45:53.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbec97fa700 1 -- 172.21.15.50:0/3561221957 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cee2c83ef0 con 0x55cee2d31be0 2023-10-26T06:45:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbec97fa700 1 -- 172.21.15.50:0/3561221957 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbed00991f0 con 0x55cee2d31be0 2023-10-26T06:45:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbefb790b80 10 client.25952 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbefb790b80 10 client.25952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbefb790b80 20 client.25952 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbefb790b80 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d45e10 0x55cee2d48230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbefb790b80 4 client.25952 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cee2cfb8b0 con 0x55cee2d45e10 2023-10-26T06:45:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.071+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d45e10 0x55cee2d48230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.072+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d45e10 0x55cee2d48230 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6ccf3e4f8101c04 server_cookie=f5ac18909454d967 in_seq=0 out_seq=0 2023-10-26T06:45:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.072+0000 7fbec97fa700 10 client.25952 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.072+0000 7fbec97fa700 1 -- 172.21.15.50:0/3561221957 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cee2cfb8b0 con 0x55cee2d45e10 2023-10-26T06:45:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.072+0000 7fbec97fa700 10 client.25952 handle_command_reply: tid=0 2023-10-26T06:45:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.072+0000 7fbefb790b80 1 client.25952 shutdown 2023-10-26T06:45:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 msgr2=0x55cee2d35720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d35720 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbed0096790 tx=0x7fbed009aaa0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 shutdown_connections 2023-10-26T06:45:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d45e10 0x55cee2d48230 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d35ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d38430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbec97fa700 0 client.25952 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 --2- 172.21.15.50:0/3561221957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d35720 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 >> 172.21.15.50:0/3561221957 conn(0x55cee2ca0720 msgr2=0x55cee2d26ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 shutdown_connections 2023-10-26T06:45:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 1 -- 172.21.15.50:0/3561221957 wait complete. 2023-10-26T06:45:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.073+0000 7fbefb790b80 20 client.25952 trim_cache size 0 max 16384 2023-10-26T06:45:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.086+0000 7fbefb790b80 1 Processor -- start 2023-10-26T06:45:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 -- start start 2023-10-26T06:45:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d35c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 0x55cee2d415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2d21af0 con 0x55cee2d31be0 2023-10-26T06:45:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2aff920 con 0x55cee2d32500 2023-10-26T06:45:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbefb790b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2d1f060 con 0x55cee2d2c5d0 2023-10-26T06:45:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbee539a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d35c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbee639c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 0x55cee2d415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbee5b9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbee639c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 0x55cee2d415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:37740/0 (socket says 172.21.15.50:37740) 2023-10-26T06:45:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.087+0000 7fbee639c700 1 -- 172.21.15.50:0/4113189735 learned_addr learned my addr 172.21.15.50:0/4113189735 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbee639c700 1 -- 172.21.15.50:0/4113189735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 msgr2=0x55cee2d2c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbee639c700 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbee639c700 1 -- 172.21.15.50:0/4113189735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 msgr2=0x55cee2d35c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbee639c700 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d35c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbee639c700 1 -- 172.21.15.50:0/4113189735 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee2d4ce60 con 0x55cee2d32500 2023-10-26T06:45:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbee639c700 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 0x55cee2d415a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009c10 tx=0x7fbed801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d07223aa2941b371 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbed4bff700 1 -- 172.21.15.50:0/4113189735 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8029070 con 0x55cee2d32500 2023-10-26T06:45:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbed4bff700 1 -- 172.21.15.50:0/4113189735 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbed800f040 con 0x55cee2d32500 2023-10-26T06:45:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.088+0000 7fbed4bff700 1 -- 172.21.15.50:0/4113189735 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed800e040 con 0x55cee2d32500 2023-10-26T06:45:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 -- 172.21.15.50:0/4113189735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 msgr2=0x55cee2d415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 0x55cee2d415a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009c10 tx=0x7fbed801f000 comp rx=0 tx=0).stop 2023-10-26T06:45:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 -- 172.21.15.50:0/4113189735 shutdown_connections 2023-10-26T06:45:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d32500 0x55cee2d415a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 --2- 172.21.15.50:0/4113189735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d31be0 0x55cee2d35c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 -- 172.21.15.50:0/4113189735 >> 172.21.15.50:0/4113189735 conn(0x55cee2ca0720 msgr2=0x55cee2d33ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 -- 172.21.15.50:0/4113189735 shutdown_connections 2023-10-26T06:45:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 -- 172.21.15.50:0/4113189735 wait complete. 2023-10-26T06:45:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.089+0000 7fbefb790b80 1 -- start start 2023-10-26T06:45:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 Processor -- start 2023-10-26T06:45:53.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d2e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d2e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2d99c90 con 0x55cee2d32500 2023-10-26T06:45:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2d99e00 con 0x55cee2d31be0 2023-10-26T06:45:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee2d99fc0 con 0x55cee2d2c5d0 2023-10-26T06:45:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbefb790b80 10 client.0 _ll_register_callbacks cb 0x55cee2b65a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbee5b9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbee539a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d2e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbee5b9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:41642/0 (socket says 172.21.15.50:41642) 2023-10-26T06:45:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbee5b9b700 1 -- 172.21.15.50:0/164355182 learned_addr learned my addr 172.21.15.50:0/164355182 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.090+0000 7fbee639c700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d2e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee5b9b700 1 -- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 msgr2=0x55cee2d2e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d2e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee5b9b700 1 -- 172.21.15.50:0/164355182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 msgr2=0x55cee2d2e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:53.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d2e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee5b9b700 1 -- 172.21.15.50:0/164355182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed800fda0 con 0x55cee2d2c5d0 2023-10-26T06:45:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee539a700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d2e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbee5b9b700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2def0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009ce0 tx=0x7fbedc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7398808a7739e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbec97fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbec97fa700 1 -- 172.21.15.50:0/164355182 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc034070 con 0x55cee2d2c5d0 2023-10-26T06:45:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbedc01e040 con 0x55cee2d2c5d0 2023-10-26T06:45:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.091+0000 7fbec97fa700 1 -- 172.21.15.50:0/164355182 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbedc034810 con 0x55cee2d2c5d0 2023-10-26T06:45:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbec97fa700 1 -- 172.21.15.50:0/164355182 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbedc01d040 con 0x55cee2d2c5d0 2023-10-26T06:45:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 10 client.25963 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55cee2a92c60 con 0x55cee2d2c5d0 2023-10-26T06:45:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbec97fa700 1 -- 172.21.15.50:0/164355182 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbedc01e040 con 0x55cee2d2c5d0 2023-10-26T06:45:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbec97fa700 1 -- 172.21.15.50:0/164355182 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbedc00bd50 con 0x55cee2d2c5d0 2023-10-26T06:45:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 10 client.25963 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 10 client.25963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 20 client.25963 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d9b3d0 0x55cee2d9d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 4 client.25963 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:45:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cee2c77e50 con 0x55cee2d9b3d0 2023-10-26T06:45:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.092+0000 7fbee539a700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d9b3d0 0x55cee2d9d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.093+0000 7fbee539a700 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d9b3d0 0x55cee2d9d7f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c51ce7fac51a01d server_cookie=6c41395fab382b64 in_seq=0 out_seq=0 2023-10-26T06:45:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.093+0000 7fbec97fa700 10 client.25963 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbec97fa700 1 -- 172.21.15.50:0/164355182 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cee2c77e50 con 0x55cee2d9b3d0 2023-10-26T06:45:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbec97fa700 10 client.25963 handle_command_reply: tid=0 2023-10-26T06:45:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbefb790b80 1 client.25963 shutdown 2023-10-26T06:45:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 msgr2=0x55cee2d2def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbefb790b80 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2def0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009ce0 tx=0x7fbedc005800 comp rx=0 tx=0).stop 2023-10-26T06:45:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 shutdown_connections 2023-10-26T06:45:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.094+0000 7fbefb790b80 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55cee2d9b3d0 0x55cee2d9d7f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cee2d32500 0x55cee2d2e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cee2d2c5d0 0x55cee2d2def0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 1 --2- 172.21.15.50:0/164355182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55cee2d31be0 0x55cee2d2e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbec97fa700 0 client.25963 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 >> 172.21.15.50:0/164355182 conn(0x55cee2ca0720 msgr2=0x55cee2d204b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 shutdown_connections 2023-10-26T06:45:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 1 -- 172.21.15.50:0/164355182 wait complete. 2023-10-26T06:45:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbefb790b80 20 client.25963 trim_cache size 0 max 16384 2023-10-26T06:45:53.113 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:45:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbecc0a15f0 msgr2=0x7fbecc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbecc0a15f0 0x7fbecc0a3ab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009fd0 tx=0x7fbed800fc20 comp rx=0 tx=0).stop 2023-10-26T06:45:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 msgr2=0x7fbee0199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee0199340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbed000e9a0 tx=0x7fbed000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 shutdown_connections 2023-10-26T06:45:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbecc0a15f0 0x7fbecc0a3ab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbee0105b30 0x7fbee019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbee0067d40 0x7fbee0198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 --2- 172.21.15.50:0/3653795716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbee0105170 0x7fbee0199340 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.095+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 >> 172.21.15.50:0/3653795716 conn(0x7fbee00767f0 msgr2=0x7fbee0100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.096+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 shutdown_connections 2023-10-26T06:45:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:53.096+0000 7fbee7dff700 1 -- 172.21.15.50:0/3653795716 wait complete. 2023-10-26T06:45:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:52 smithi125 ceph-mon[130643]: pgmap v385: 97 pgs: 97 active+clean; 375 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 56 op/s 2023-10-26T06:45:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:52 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1286380177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:45:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:52 smithi153 ceph-mon[131657]: pgmap v385: 97 pgs: 97 active+clean; 375 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 56 op/s 2023-10-26T06:45:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:52 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1286380177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:45:54.117 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:45:54.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:45:54.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:53 smithi050 ceph-mon[94997]: pgmap v386: 97 pgs: 97 active+clean; 400 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.6 MiB/s wr, 266 op/s 2023-10-26T06:45:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:53 smithi153 ceph-mon[131657]: pgmap v386: 97 pgs: 97 active+clean; 400 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.6 MiB/s wr, 266 op/s 2023-10-26T06:45:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 -- 172.21.15.50:0/402078683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 msgr2=0x7f34d01055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 --2- 172.21.15.50:0/402078683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 0x7f34d01055f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34c40099c0 tx=0x7f34c4009cd0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 -- 172.21.15.50:0/402078683 shutdown_connections 2023-10-26T06:45:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 --2- 172.21.15.50:0/402078683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 0x7f34d010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 --2- 172.21.15.50:0/402078683 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d0068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 --2- 172.21.15.50:0/402078683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 0x7f34d01055f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 -- 172.21.15.50:0/402078683 >> 172.21.15.50:0/402078683 conn(0x7f34d00767f0 msgr2=0x7f34d0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 -- 172.21.15.50:0/402078683 shutdown_connections 2023-10-26T06:45:54.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.364+0000 7f34d49ff700 1 -- 172.21.15.50:0/402078683 wait complete. 2023-10-26T06:45:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.366+0000 7f34d49ff700 1 Processor -- start 2023-10-26T06:45:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.366+0000 7f34d49ff700 1 -- start start 2023-10-26T06:45:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.366+0000 7f34d49ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.366+0000 7f34d49ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 0x7f34d00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.366+0000 7f34d49ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 0x7f34d0100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34d49ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d01a4fb0 con 0x7f34d0105b30 2023-10-26T06:45:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34d49ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d01a5120 con 0x7f34d0067d40 2023-10-26T06:45:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34d49ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d01a52e0 con 0x7f34d0105170 2023-10-26T06:45:54.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d00ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:40468/0 (socket says 172.21.15.50:40468) 2023-10-26T06:45:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 -- 172.21.15.50:0/606315586 learned_addr learned my addr 172.21.15.50:0/606315586 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 0x7f34d00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ced9d700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 0x7f34d0100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 -- 172.21.15.50:0/606315586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 msgr2=0x7f34d00ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 0x7f34d00ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 -- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 msgr2=0x7f34d0100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 0x7f34d0100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 -- 172.21.15.50:0/606315586 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0009520 con 0x7f34d0067d40 2023-10-26T06:45:54.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ced9d700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 0x7f34d0100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.367+0000 7f34ce59c700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d00ff6b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34c000eb30 tx=0x7f34c000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.368+0000 7f34bf7fe700 1 -- 172.21.15.50:0/606315586 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0009880 con 0x7f34d0067d40 2023-10-26T06:45:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.368+0000 7f34bf7fe700 1 -- 172.21.15.50:0/606315586 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34c00044e0 con 0x7f34d0067d40 2023-10-26T06:45:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.368+0000 7f34bf7fe700 1 -- 172.21.15.50:0/606315586 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0003e90 con 0x7f34d0067d40 2023-10-26T06:45:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.368+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c40095f0 con 0x7f34d0067d40 2023-10-26T06:45:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.368+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d01a58c0 con 0x7f34d0067d40 2023-10-26T06:45:54.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.371+0000 7f34bf7fe700 1 -- 172.21.15.50:0/606315586 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f34c0004000 con 0x7f34d0067d40 2023-10-26T06:45:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.372+0000 7f34bf7fe700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34b80a1670 0x7f34b80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.372+0000 7f34e83ebb80 1 Processor -- start 2023-10-26T06:45:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34bf7fe700 1 -- 172.21.15.50:0/606315586 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f34c0014070 con 0x7f34d0067d40 2023-10-26T06:45:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 -- start start 2023-10-26T06:45:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34b80a1670 0x7f34b80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81423040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d8141d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d8141dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d81390760 con 0x555d8141d650 2023-10-26T06:45:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d81376ce0 con 0x555d81423580 2023-10-26T06:45:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.373+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d81374600 con 0x555d81422c60 2023-10-26T06:45:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81423040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81423040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47094/0 (socket says 172.21.15.50:47094) 2023-10-26T06:45:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 -- 172.21.15.50:0/2212573852 learned_addr learned my addr 172.21.15.50:0/2212573852 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34b80a1670 0x7f34b80a3b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009990 tx=0x7f34c4005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ced9d700 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d8141dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d8141d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 -- 172.21.15.50:0/2212573852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 msgr2=0x555d8141d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d8141d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 -- 172.21.15.50:0/2212573852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 msgr2=0x555d8141dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d8141dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 -- 172.21.15.50:0/2212573852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d8132d470 con 0x555d81422c60 2023-10-26T06:45:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d8141d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:45:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81423040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34c0096f50 tx=0x7f34c009a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=730982241e59c8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.374+0000 7f34bcff9700 1 -- 172.21.15.50:0/2212573852 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000cc90 con 0x555d81422c60 2023-10-26T06:45:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.375+0000 7f34bcff9700 1 -- 172.21.15.50:0/2212573852 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34c009a4e0 con 0x555d81422c60 2023-10-26T06:45:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.375+0000 7f34bcff9700 1 -- 172.21.15.50:0/2212573852 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c009a740 con 0x555d81422c60 2023-10-26T06:45:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.375+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2212573852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 msgr2=0x555d81423040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.375+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81423040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34c0096f50 tx=0x7f34c009a0a0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2212573852 shutdown_connections 2023-10-26T06:45:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d8141dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81423040 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2212573852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d8141d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2212573852 >> 172.21.15.50:0/2212573852 conn(0x555d813917a0 msgr2=0x555d81417be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2212573852 shutdown_connections 2023-10-26T06:45:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2212573852 wait complete. 2023-10-26T06:45:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.376+0000 7f34e83ebb80 1 -- start start 2023-10-26T06:45:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 Processor -- start 2023-10-26T06:45:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d814295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81426860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d81426fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8136fef0 con 0x555d8141d650 2023-10-26T06:45:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8130c790 con 0x555d81423580 2023-10-26T06:45:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8130c430 con 0x555d81422c60 2023-10-26T06:45:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34e83ebb80 10 client.0 _ll_register_callbacks cb 0x555d81256b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81426860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81426860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47098/0 (socket says 172.21.15.50:47098) 2023-10-26T06:45:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34cdd9b700 1 -- 172.21.15.50:0/2215190612 learned_addr learned my addr 172.21.15.50:0/2215190612 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.377+0000 7f34ced9d700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d81426fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d814295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34cdd9b700 1 -- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 msgr2=0x555d81426fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d81426fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34cdd9b700 1 -- 172.21.15.50:0/2215190612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 msgr2=0x555d814295e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d814295e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34cdd9b700 1 -- 172.21.15.50:0/2215190612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d01a58c0 con 0x555d81422c60 2023-10-26T06:45:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34ced9d700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d81426fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d814295e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81426860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f34c40058e0 tx=0x7f34c401a070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ce2149929e94ca server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.378+0000 7f34b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34b5ffb700 1 -- 172.21.15.50:0/2215190612 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400be90 con 0x555d81422c60 2023-10-26T06:45:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d81374f70 con 0x555d81422c60 2023-10-26T06:45:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34b5ffb700 1 -- 172.21.15.50:0/2215190612 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f34c4023460 con 0x555d81422c60 2023-10-26T06:45:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34b5ffb700 1 -- 172.21.15.50:0/2215190612 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34c4023620 con 0x555d81422c60 2023-10-26T06:45:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34e83ebb80 10 client.25975 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x555d8119ae60 con 0x555d81422c60 2023-10-26T06:45:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.379+0000 7f34b5ffb700 1 -- 172.21.15.50:0/2215190612 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34c403d080 con 0x555d81422c60 2023-10-26T06:45:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34b5ffb700 1 -- 172.21.15.50:0/2215190612 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f34c4037030 con 0x555d81422c60 2023-10-26T06:45:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34e83ebb80 10 client.25975 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34e83ebb80 10 client.25975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34e83ebb80 20 client.25975 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d81436ca0 0x555d814390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34e83ebb80 4 client.25975 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d813ec930 con 0x555d81436ca0 2023-10-26T06:45:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d81436ca0 0x555d814390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34ce59c700 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d81436ca0 0x555d814390c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=628b382039f84693 server_cookie=6cb1be87dfe2630d in_seq=0 out_seq=0 2023-10-26T06:45:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.380+0000 7f34b5ffb700 10 client.25975 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.381+0000 7f34b5ffb700 1 -- 172.21.15.50:0/2215190612 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d813ec930 con 0x555d81436ca0 2023-10-26T06:45:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.381+0000 7f34b5ffb700 10 client.25975 handle_command_reply: tid=0 2023-10-26T06:45:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.381+0000 7f34e83ebb80 1 client.25975 shutdown 2023-10-26T06:45:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.381+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 msgr2=0x555d81426860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.381+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81426860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f34c40058e0 tx=0x7f34c401a070 comp rx=0 tx=0).stop 2023-10-26T06:45:54.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.381+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 shutdown_connections 2023-10-26T06:45:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d81436ca0 0x555d814390c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81423580 0x555d81426fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d814295e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34b5ffb700 0 client.25975 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/2215190612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81422c60 0x555d81426860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 >> 172.21.15.50:0/2215190612 conn(0x555d813917a0 msgr2=0x555d8141c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 shutdown_connections 2023-10-26T06:45:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 1 -- 172.21.15.50:0/2215190612 wait complete. 2023-10-26T06:45:54.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.382+0000 7f34e83ebb80 20 client.25975 trim_cache size 0 max 16384 2023-10-26T06:45:54.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 Processor -- start 2023-10-26T06:45:54.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 -- start start 2023-10-26T06:45:54.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81426800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d8142de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d81420730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d811f09a0 con 0x555d8141d650 2023-10-26T06:45:54.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d81427ed0 con 0x555d81422c60 2023-10-26T06:45:54.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.400+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8141d070 con 0x555d81423580 2023-10-26T06:45:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d8142de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34ced9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d81420730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d8142de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:40498/0 (socket says 172.21.15.50:40498) 2023-10-26T06:45:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1700837758 learned_addr learned my addr 172.21.15.50:0/1700837758 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81426800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1700837758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 msgr2=0x555d81420730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d81420730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1700837758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 msgr2=0x555d81426800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81426800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1700837758 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d81417df0 con 0x555d81422c60 2023-10-26T06:45:54.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d8142de70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34c402fa40 tx=0x7f34c4003a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1d55baf75a3c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.401+0000 7f34bd7fa700 1 -- 172.21.15.50:0/1700837758 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c402fbb0 con 0x555d81422c60 2023-10-26T06:45:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.402+0000 7f34bd7fa700 1 -- 172.21.15.50:0/1700837758 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555d81374f70 con 0x555d81422c60 2023-10-26T06:45:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.402+0000 7f34bd7fa700 1 -- 172.21.15.50:0/1700837758 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4023be0 con 0x555d81422c60 2023-10-26T06:45:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.402+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1700837758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 msgr2=0x555d8142de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d8142de70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34c402fa40 tx=0x7f34c4003a60 comp rx=0 tx=0).stop 2023-10-26T06:45:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1700837758 shutdown_connections 2023-10-26T06:45:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d81420730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81426800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1700837758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d8142de70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1700837758 >> 172.21.15.50:0/1700837758 conn(0x555d813917a0 msgr2=0x555d814260f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1700837758 shutdown_connections 2023-10-26T06:45:54.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1700837758 wait complete. 2023-10-26T06:45:54.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.403+0000 7f34e83ebb80 1 -- start start 2023-10-26T06:45:54.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 Processor -- start 2023-10-26T06:45:54.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81485490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d814859d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d8142d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8142d9f0 con 0x555d8141d650 2023-10-26T06:45:54.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8142db60 con 0x555d81422c60 2023-10-26T06:45:54.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8142dd20 con 0x555d81423580 2023-10-26T06:45:54.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.404+0000 7f34e83ebb80 10 client.0 _ll_register_callbacks cb 0x555d81256b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:54.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d814859d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d814859d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:40514/0 (socket says 172.21.15.50:40514) 2023-10-26T06:45:54.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1195275329 learned_addr learned my addr 172.21.15.50:0/1195275329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34ce59c700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81485490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34ced9d700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d8142d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1195275329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 msgr2=0x555d8142d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d8142d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1195275329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 msgr2=0x555d81485490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81485490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 -- 172.21.15.50:0/1195275329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d8119ae60 con 0x555d81422c60 2023-10-26T06:45:54.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34ced9d700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d8142d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:54.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34ce59c700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81485490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:45:54.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34cdd9b700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d814859d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009fd0 tx=0x7f34c4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c758775fe4b3b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.405+0000 7f34b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34b5ffb700 1 -- 172.21.15.50:0/1195275329 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c402f610 con 0x555d81422c60 2023-10-26T06:45:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34b5ffb700 1 -- 172.21.15.50:0/1195275329 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f34c4023880 con 0x555d81422c60 2023-10-26T06:45:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34c009a4e0 con 0x555d81422c60 2023-10-26T06:45:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34b5ffb700 1 -- 172.21.15.50:0/1195275329 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34c402f770 con 0x555d81422c60 2023-10-26T06:45:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 10 client.25973 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x555d81183ce0 con 0x555d81422c60 2023-10-26T06:45:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34b5ffb700 1 -- 172.21.15.50:0/1195275329 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34c009a4e0 con 0x555d81422c60 2023-10-26T06:45:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34b5ffb700 1 -- 172.21.15.50:0/1195275329 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f34c4037050 con 0x555d81422c60 2023-10-26T06:45:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 10 client.25973 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 10 client.25973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 20 client.25973 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d8148cef0 0x555d8148f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 4 client.25973 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:45:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.406+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555d81368ed0 con 0x555d8148cef0 2023-10-26T06:45:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.407+0000 7f34ce59c700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d8148cef0 0x555d8148f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.407+0000 7f34ce59c700 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d8148cef0 0x555d8148f310 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6f3f729ba03bf97 server_cookie=45d259325273acab in_seq=0 out_seq=0 2023-10-26T06:45:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.407+0000 7f34b5ffb700 10 client.25973 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34b5ffb700 1 -- 172.21.15.50:0/1195275329 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555d81368ed0 con 0x555d8148cef0 2023-10-26T06:45:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34b5ffb700 10 client.25973 handle_command_reply: tid=0 2023-10-26T06:45:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 client.25973 shutdown 2023-10-26T06:45:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 msgr2=0x555d814859d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d814859d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009fd0 tx=0x7f34c4009310 comp rx=0 tx=0).stop 2023-10-26T06:45:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 shutdown_connections 2023-10-26T06:45:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555d8148cef0 0x555d8148f310 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555d81423580 0x555d8142d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d8141d650 0x555d81485490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 --2- 172.21.15.50:0/1195275329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555d81422c60 0x555d814859d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34b5ffb700 0 client.25973 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 >> 172.21.15.50:0/1195275329 conn(0x555d813917a0 msgr2=0x555d81420730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.408+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 shutdown_connections 2023-10-26T06:45:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.409+0000 7f34e83ebb80 1 -- 172.21.15.50:0/1195275329 wait complete. 2023-10-26T06:45:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.409+0000 7f34e83ebb80 20 client.25973 trim_cache size 0 max 16384 2023-10-26T06:45:54.423 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:45:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:45:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "d7e6d8dd-a46e-4979-bcbd-894bc85c04c3", 2023-10-26T06:45:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:45:54.424 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:45:54.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.409+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34b80a1670 msgr2=0x7f34b80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.409+0000 7f34d49ff700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34b80a1670 0x7f34b80a3b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009990 tx=0x7f34c4005fd0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.409+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 msgr2=0x7f34d00ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.409+0000 7f34d49ff700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d00ff6b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34c000eb30 tx=0x7f34c000ee40 comp rx=0 tx=0).stop 2023-10-26T06:45:54.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 shutdown_connections 2023-10-26T06:45:54.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f34b80a1670 0x7f34b80a3b30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34d0105b30 0x7f34d0100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d0067d40 0x7f34d00ff6b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 --2- 172.21.15.50:0/606315586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34d0105170 0x7f34d00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 >> 172.21.15.50:0/606315586 conn(0x7f34d00767f0 msgr2=0x7f34d00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 shutdown_connections 2023-10-26T06:45:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.410+0000 7f34d49ff700 1 -- 172.21.15.50:0/606315586 wait complete. 2023-10-26T06:45:54.427 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:53 smithi125 ceph-mon[130643]: pgmap v386: 97 pgs: 97 active+clean; 400 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.6 MiB/s wr, 266 op/s 2023-10-26T06:45:54.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:45:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 -- 172.21.15.50:0/3549838060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff574106730 msgr2=0x7ff574106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 --2- 172.21.15.50:0/3549838060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff574106730 0x7ff574106b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff564009990 tx=0x7ff564009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 -- 172.21.15.50:0/3549838060 shutdown_connections 2023-10-26T06:45:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 --2- 172.21.15.50:0/3549838060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5741010e0 0x7ff57410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 --2- 172.21.15.50:0/3549838060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff574106730 0x7ff574106b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 --2- 172.21.15.50:0/3549838060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 -- 172.21.15.50:0/3549838060 >> 172.21.15.50:0/3549838060 conn(0x7ff5740fc1b0 msgr2=0x7ff5740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 -- 172.21.15.50:0/3549838060 shutdown_connections 2023-10-26T06:45:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.660+0000 7ff578bff700 1 -- 172.21.15.50:0/3549838060 wait complete. 2023-10-26T06:45:54.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 Processor -- start 2023-10-26T06:45:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 -- start start 2023-10-26T06:45:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 0x7ff574073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff574106730 0x7ff574073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5741a4f30 con 0x7ff574100720 2023-10-26T06:45:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5741a50a0 con 0x7ff5741010e0 2023-10-26T06:45:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff578bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5741a5260 con 0x7ff574106730 2023-10-26T06:45:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff57259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 0x7ff574073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 0x7ff574073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:40524/0 (socket says 172.21.15.50:40524) 2023-10-26T06:45:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff57259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39836/0 (socket says 172.21.15.50:39836) 2023-10-26T06:45:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.662+0000 7ff56bfff700 1 -- 172.21.15.50:0/1907980159 learned_addr learned my addr 172.21.15.50:0/1907980159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff572d9d700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff574106730 0x7ff574073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff57259c700 1 -- 172.21.15.50:0/1907980159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff574106730 msgr2=0x7ff574073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff57259c700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff574106730 0x7ff574073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff57259c700 1 -- 172.21.15.50:0/1907980159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 msgr2=0x7ff574073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff57259c700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 0x7ff574073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff57259c700 1 -- 172.21.15.50:0/1907980159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640095f0 con 0x7ff574100720 2023-10-26T06:45:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff56bfff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 0x7ff574073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff57259c700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574072af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff564000c00 tx=0x7ff564004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1907980159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56401d070 con 0x7ff574100720 2023-10-26T06:45:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5741a54e0 con 0x7ff574100720 2023-10-26T06:45:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.663+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1907980159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff564021410 con 0x7ff574100720 2023-10-26T06:45:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.664+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5741a59c0 con 0x7ff574100720 2023-10-26T06:45:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.664+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1907980159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640175f0 con 0x7ff574100720 2023-10-26T06:45:54.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.667+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1907980159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff564021580 con 0x7ff574100720 2023-10-26T06:45:54.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.668+0000 7ff58c5efb80 1 Processor -- start 2023-10-26T06:45:54.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.668+0000 7ff58c5efb80 1 -- start start 2023-10-26T06:45:54.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.668+0000 7ff56b7fe700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff5600a15f0 0x7ff5600a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1907980159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff5640cdfe0 con 0x7ff574100720 2023-10-26T06:45:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 0x55f1650e97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e3de0 0x55f1650e4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16504e6e0 con 0x55f1650e3de0 2023-10-26T06:45:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f165034c60 con 0x55f1650e9d10 2023-10-26T06:45:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f165032580 con 0x55f1650e93f0 2023-10-26T06:45:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 0x55f1650e97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650e38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:40536/0 (socket says 172.21.15.50:40536) 2023-10-26T06:45:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 0x55f1650e97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47134/0 (socket says 172.21.15.50:47134) 2023-10-26T06:45:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56bfff700 1 -- 172.21.15.50:0/3472930818 learned_addr learned my addr 172.21.15.50:0/3472930818 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56bfff700 1 -- 172.21.15.50:0/3472930818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 msgr2=0x55f1650e97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56bfff700 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 0x55f1650e97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff572d9d700 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e3de0 0x55f1650e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.669+0000 7ff56bfff700 1 -- 172.21.15.50:0/3472930818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e3de0 msgr2=0x55f1650e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff56bfff700 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e3de0 0x55f1650e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff56bfff700 1 -- 172.21.15.50:0/3472930818 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f164feb3f0 con 0x55f1650e9d10 2023-10-26T06:45:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff57259c700 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 0x55f1650e97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff572d9d700 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e3de0 0x55f1650e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:45:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff572d9d700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff5600a15f0 0x7ff5600a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff56bfff700 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650e38a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff55c011680 tx=0x7ff55c011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7fca985f9ffeea server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff568ff9700 1 -- 172.21.15.50:0/3472930818 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c004030 con 0x55f1650e9d10 2023-10-26T06:45:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff568ff9700 1 -- 172.21.15.50:0/3472930818 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff55c003680 con 0x55f1650e9d10 2023-10-26T06:45:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff568ff9700 1 -- 172.21.15.50:0/3472930818 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0196b0 con 0x55f1650e9d10 2023-10-26T06:45:54.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.670+0000 7ff572d9d700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff5600a15f0 0x7ff5600a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009550 tx=0x7ff56c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 -- 172.21.15.50:0/3472930818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 msgr2=0x55f1650e38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650e38a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff55c011680 tx=0x7ff55c011990 comp rx=0 tx=0).stop 2023-10-26T06:45:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 -- 172.21.15.50:0/3472930818 shutdown_connections 2023-10-26T06:45:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e3de0 0x55f1650e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e93f0 0x55f1650e97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/3472930818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650e38a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 -- 172.21.15.50:0/3472930818 >> 172.21.15.50:0/3472930818 conn(0x55f16504f720 msgr2=0x55f1650d5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 -- 172.21.15.50:0/3472930818 shutdown_connections 2023-10-26T06:45:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.671+0000 7ff58c5efb80 1 -- 172.21.15.50:0/3472930818 wait complete. 2023-10-26T06:45:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 -- start start 2023-10-26T06:45:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 Processor -- start 2023-10-26T06:45:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650efd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e93f0 0x55f1650ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e9d10 0x55f1650ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16502de70 con 0x55f1650e9d10 2023-10-26T06:45:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f164fca710 con 0x55f1650e93f0 2023-10-26T06:45:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f164fca3b0 con 0x55f1650e3de0 2023-10-26T06:45:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.672+0000 7ff58c5efb80 10 client.0 _ll_register_callbacks cb 0x55f164f14a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650efd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47142/0 (socket says 172.21.15.50:47142) 2023-10-26T06:45:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 -- 172.21.15.50:0/2858596054 learned_addr learned my addr 172.21.15.50:0/2858596054 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff572d9d700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e9d10 0x55f1650ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff56bfff700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e93f0 0x55f1650ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 -- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e93f0 msgr2=0x55f1650ecf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e93f0 0x55f1650ecf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 -- 172.21.15.50:0/2858596054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e9d10 msgr2=0x55f1650ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e9d10 0x55f1650ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 -- 172.21.15.50:0/2858596054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5741a59c0 con 0x55f1650e3de0 2023-10-26T06:45:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff57259c700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650efd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff56409b030 tx=0x7ff56409ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf850c1411a71f22 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.673+0000 7ff559ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:45:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff559ffb700 1 -- 172.21.15.50:0/2858596054 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640a12c0 con 0x55f1650e3de0 2023-10-26T06:45:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff559ffb700 1 -- 172.21.15.50:0/2858596054 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff56409b7a0 con 0x55f1650e3de0 2023-10-26T06:45:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f165032ef0 con 0x55f1650e3de0 2023-10-26T06:45:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff559ffb700 1 -- 172.21.15.50:0/2858596054 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff56409b0a0 con 0x55f1650e3de0 2023-10-26T06:45:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 10 client.25993 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:54.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7ff55c009e10 con 0x55f1650e3de0 2023-10-26T06:45:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff559ffb700 1 -- 172.21.15.50:0/2858596054 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f165032ef0 con 0x55f1650e3de0 2023-10-26T06:45:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff559ffb700 1 -- 172.21.15.50:0/2858596054 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff56409b450 con 0x55f1650e3de0 2023-10-26T06:45:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 10 client.25993 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 10 client.25993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:54.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 20 client.25993 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f1650fd320 0x55f1650ff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 4 client.25993 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:45:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.674+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1650aa8b0 con 0x55f1650fd320 2023-10-26T06:45:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.675+0000 7ff56bfff700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f1650fd320 0x55f1650ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.675+0000 7ff56bfff700 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f1650fd320 0x55f1650ff710 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15807b057617b7cc server_cookie=1abc566a9aaa1902 in_seq=0 out_seq=0 2023-10-26T06:45:54.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.675+0000 7ff559ffb700 10 client.25993 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.677+0000 7ff559ffb700 1 -- 172.21.15.50:0/2858596054 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f1650aa8b0 con 0x55f1650fd320 2023-10-26T06:45:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.677+0000 7ff559ffb700 10 client.25993 handle_command_reply: tid=0 2023-10-26T06:45:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.677+0000 7ff58c5efb80 1 client.25993 shutdown 2023-10-26T06:45:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 msgr2=0x55f1650efd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650efd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff56409b030 tx=0x7ff56409ac60 comp rx=0 tx=0).stop 2023-10-26T06:45:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 shutdown_connections 2023-10-26T06:45:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f1650fd320 0x55f1650ff710 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e9d10 0x55f1650ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650efd10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff559ffb700 0 client.25993 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/2858596054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e93f0 0x55f1650ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 >> 172.21.15.50:0/2858596054 conn(0x55f16504f720 msgr2=0x55f1650d5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 shutdown_connections 2023-10-26T06:45:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 1 -- 172.21.15.50:0/2858596054 wait complete. 2023-10-26T06:45:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.678+0000 7ff58c5efb80 20 client.25993 trim_cache size 0 max 16384 2023-10-26T06:45:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.696+0000 7ff58c5efb80 1 Processor -- start 2023-10-26T06:45:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 -- start start 2023-10-26T06:45:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1650d6130 con 0x55f1650e93f0 2023-10-26T06:45:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1650d0af0 con 0x55f1650e9d10 2023-10-26T06:45:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f164eae920 con 0x55f1650e3de0 2023-10-26T06:45:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff572d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff57259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47152/0 (socket says 172.21.15.50:47152) 2023-10-26T06:45:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.697+0000 7ff57259c700 1 -- 172.21.15.50:0/1877950121 learned_addr learned my addr 172.21.15.50:0/1877950121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff57259c700 1 -- 172.21.15.50:0/1877950121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 msgr2=0x55f1650ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff57259c700 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff57259c700 1 -- 172.21.15.50:0/1877950121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 msgr2=0x55f1650f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff57259c700 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff57259c700 1 -- 172.21.15.50:0/1877950121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f164e58de0 con 0x55f1650e3de0 2023-10-26T06:45:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff56bfff700 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff57259c700 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650ecf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5640a2e70 tx=0x7ff564009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e44f518095cd079 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff5697fa700 1 -- 172.21.15.50:0/1877950121 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56409b0a0 con 0x55f1650e3de0 2023-10-26T06:45:54.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff5697fa700 1 -- 172.21.15.50:0/1877950121 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff56409a720 con 0x55f1650e3de0 2023-10-26T06:45:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.698+0000 7ff5697fa700 1 -- 172.21.15.50:0/1877950121 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640a1310 con 0x55f1650e3de0 2023-10-26T06:45:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1877950121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 msgr2=0x55f1650ecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650ecf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5640a2e70 tx=0x7ff564009ca0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1877950121 shutdown_connections 2023-10-26T06:45:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e9d10 0x55f1650ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e3de0 0x55f1650ecf30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1877950121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1877950121 >> 172.21.15.50:0/1877950121 conn(0x55f16504f720 msgr2=0x55f1650ec820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1877950121 shutdown_connections 2023-10-26T06:45:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.699+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1877950121 wait complete. 2023-10-26T06:45:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 -- start start 2023-10-26T06:45:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 Processor -- start 2023-10-26T06:45:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 0x55f1650e6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e9d10 0x55f1650e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1650e5380 con 0x55f1650e93f0 2023-10-26T06:45:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1650e54f0 con 0x55f1650e3de0 2023-10-26T06:45:54.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1650e56b0 con 0x55f1650e9d10 2023-10-26T06:45:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.700+0000 7ff58c5efb80 10 client.0 _ll_register_callbacks cb 0x55f164f14a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:45:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 0x55f1650e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 0x55f1650e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:40566/0 (socket says 172.21.15.50:40566) 2023-10-26T06:45:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff56bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 -- 172.21.15.50:0/1526377058 learned_addr learned my addr 172.21.15.50:0/1526377058 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:45:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff572d9d700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e9d10 0x55f1650e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 -- 172.21.15.50:0/1526377058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e9d10 msgr2=0x55f1650e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e9d10 0x55f1650e4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 -- 172.21.15.50:0/1526377058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 msgr2=0x55f1650e67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:45:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650e67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 -- 172.21.15.50:0/1526377058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f164feb3f0 con 0x55f1650e3de0 2023-10-26T06:45:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff56bfff700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:45:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff57259c700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 0x55f1650e6260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5640975a0 tx=0x7ff56409af20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe8e53bc6a14fe9 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:45:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff559ffb700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:45:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff559ffb700 1 -- 172.21.15.50:0/1526377058 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56409a720 con 0x55f1650e3de0 2023-10-26T06:45:54.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.701+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f165026e50 con 0x55f1650e3de0 2023-10-26T06:45:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff559ffb700 1 -- 172.21.15.50:0/1526377058 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff5640a9020 con 0x55f1650e3de0 2023-10-26T06:45:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff559ffb700 1 -- 172.21.15.50:0/1526377058 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5640a33a0 con 0x55f1650e3de0 2023-10-26T06:45:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 10 client.25991 fetch_fsmap learned FSMap version 25 2023-10-26T06:45:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7ff55c009e10 con 0x55f1650e3de0 2023-10-26T06:45:54.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff559ffb700 1 -- 172.21.15.50:0/1526377058 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f165026e50 con 0x55f1650e3de0 2023-10-26T06:45:54.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff559ffb700 1 -- 172.21.15.50:0/1526377058 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff564096f90 con 0x55f1650e3de0 2023-10-26T06:45:54.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 10 client.25991 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:45:54.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 10 client.25991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:45:54.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 20 client.25991 populate_metadata read hostname 'smithi050' 2023-10-26T06:45:54.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f165151d70 0x55f165154190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:45:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 4 client.25991 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:45:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.702+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f165026b70 con 0x55f165151d70 2023-10-26T06:45:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.703+0000 7ff56bfff700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f165151d70 0x55f165154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:45:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.703+0000 7ff56bfff700 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f165151d70 0x55f165154190 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce17965924c4649d server_cookie=5ec1994b75695a1e in_seq=0 out_seq=0 2023-10-26T06:45:54.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.703+0000 7ff559ffb700 10 client.25991 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff559ffb700 1 -- 172.21.15.50:0/1526377058 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55f165026b70 con 0x55f165151d70 2023-10-26T06:45:54.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff559ffb700 10 client.25991 handle_command_reply: tid=0 2023-10-26T06:45:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 client.25991 shutdown 2023-10-26T06:45:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 msgr2=0x55f1650e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 0x55f1650e6260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5640975a0 tx=0x7ff56409af20 comp rx=0 tx=0).stop 2023-10-26T06:45:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 shutdown_connections 2023-10-26T06:45:54.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f165151d70 0x55f165154190 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f1650e9d10 0x55f1650e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f1650e3de0 0x55f1650e6260 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 --2- 172.21.15.50:0/1526377058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1650e93f0 0x55f1650e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff559ffb700 0 client.25991 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:45:54.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 >> 172.21.15.50:0/1526377058 conn(0x55f16504f720 msgr2=0x55f1650e8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 shutdown_connections 2023-10-26T06:45:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 1 -- 172.21.15.50:0/1526377058 wait complete. 2023-10-26T06:45:54.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.707+0000 7ff58c5efb80 20 client.25991 trim_cache size 0 max 16384 2023-10-26T06:45:54.719 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:45:54.720 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (2987 inodes in the stack)", 2023-10-26T06:45:54.720 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:45:54.720 INFO:teuthology.orchestra.run.smithi050.stdout: "d7e6d8dd-a46e-4979-bcbd-894bc85c04c3": { 2023-10-26T06:45:54.720 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:45:54.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "d7e6d8dd-a46e-4979-bcbd-894bc85c04c3", 2023-10-26T06:45:54.720 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:45:54.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:45:54.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:45:54.721 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:45:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff5600a15f0 msgr2=0x7ff5600a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff5600a15f0 0x7ff5600a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009550 tx=0x7ff56c00b040 comp rx=0 tx=0).stop 2023-10-26T06:45:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 msgr2=0x7ff574072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:45:54.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574072af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff564000c00 tx=0x7ff564004730 comp rx=0 tx=0).stop 2023-10-26T06:45:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 shutdown_connections 2023-10-26T06:45:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff5600a15f0 0x7ff5600a3ab0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff574106730 0x7ff574073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff574100720 0x7ff574072af0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 --2- 172.21.15.50:0/1907980159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5741010e0 0x7ff574073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:45:54.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 >> 172.21.15.50:0/1907980159 conn(0x7ff5740fc1b0 msgr2=0x7ff5740fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:45:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 shutdown_connections 2023-10-26T06:45:54.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:45:54.708+0000 7ff578bff700 1 -- 172.21.15.50:0/1907980159 wait complete. 2023-10-26T06:45:54.728 INFO:tasks.cephfs.filesystem:scrub status for tag:d7e6d8dd-a46e-4979-bcbd-894bc85c04c3 - {'path': '/', 'tag': 'd7e6d8dd-a46e-4979-bcbd-894bc85c04c3', 'options': 'recursive,force'} 2023-10-26T06:45:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:54 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:45:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:54 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:55.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:54 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:55.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:54 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:45:55.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:54 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:55.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:54 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:54 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:45:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:54 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:54 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:56.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:55 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:55 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:45:56.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:55 smithi153 ceph-mon[131657]: pgmap v387: 97 pgs: 97 active+clean; 409 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 386 op/s 2023-10-26T06:45:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:55 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:55 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:45:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:55 smithi050 ceph-mon[94997]: pgmap v387: 97 pgs: 97 active+clean; 409 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 386 op/s 2023-10-26T06:45:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:55 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:55 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:45:56.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:55 smithi125 ceph-mon[130643]: pgmap v387: 97 pgs: 97 active+clean; 409 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 386 op/s 2023-10-26T06:45:57.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:56 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:57.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:56 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:57.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:56 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:58.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:57 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:58.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:45:57 smithi153 ceph-mon[131657]: pgmap v388: 97 pgs: 97 active+clean; 427 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 564 op/s 2023-10-26T06:45:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:57 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:45:57 smithi050 ceph-mon[94997]: pgmap v388: 97 pgs: 97 active+clean; 427 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 564 op/s 2023-10-26T06:45:58.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:57 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:45:58.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:45:57 smithi125 ceph-mon[130643]: pgmap v388: 97 pgs: 97 active+clean; 427 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 564 op/s 2023-10-26T06:46:01.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:00 smithi050 ceph-mon[94997]: pgmap v389: 97 pgs: 97 active+clean; 470 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.4 MiB/s wr, 824 op/s 2023-10-26T06:46:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:00 smithi125 ceph-mon[130643]: pgmap v389: 97 pgs: 97 active+clean; 470 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.4 MiB/s wr, 824 op/s 2023-10-26T06:46:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:00 smithi153 ceph-mon[131657]: pgmap v389: 97 pgs: 97 active+clean; 470 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.4 MiB/s wr, 824 op/s 2023-10-26T06:46:02.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:02.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:02.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:02.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:02.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:01 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:02.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:01 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:02.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:02.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:02.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:02.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:01 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:03.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:02 smithi050 ceph-mon[94997]: pgmap v390: 97 pgs: 97 active+clean; 487 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 939 op/s 2023-10-26T06:46:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:02 smithi125 ceph-mon[130643]: pgmap v390: 97 pgs: 97 active+clean; 487 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 939 op/s 2023-10-26T06:46:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:02 smithi153 ceph-mon[131657]: pgmap v390: 97 pgs: 97 active+clean; 487 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 939 op/s 2023-10-26T06:46:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:03 smithi153 ceph-mon[131657]: pgmap v391: 97 pgs: 97 active+clean; 509 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 993 op/s 2023-10-26T06:46:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:03 smithi050 ceph-mon[94997]: pgmap v391: 97 pgs: 97 active+clean; 509 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 993 op/s 2023-10-26T06:46:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:03 smithi125 ceph-mon[130643]: pgmap v391: 97 pgs: 97 active+clean; 509 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 993 op/s 2023-10-26T06:46:05.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:05 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:05.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:05 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:05.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:05 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:06.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:06 smithi050 ceph-mon[94997]: pgmap v392: 97 pgs: 97 active+clean; 509 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.6 MiB/s wr, 773 op/s 2023-10-26T06:46:06.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:06 smithi125 ceph-mon[130643]: pgmap v392: 97 pgs: 97 active+clean; 509 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.6 MiB/s wr, 773 op/s 2023-10-26T06:46:06.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:06 smithi153 ceph-mon[131657]: pgmap v392: 97 pgs: 97 active+clean; 509 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.6 MiB/s wr, 773 op/s 2023-10-26T06:46:09.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:08 smithi050 ceph-mon[94997]: pgmap v393: 97 pgs: 97 active+clean; 513 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.1 MiB/s wr, 661 op/s 2023-10-26T06:46:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:08 smithi125 ceph-mon[130643]: pgmap v393: 97 pgs: 97 active+clean; 513 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.1 MiB/s wr, 661 op/s 2023-10-26T06:46:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:08 smithi153 ceph-mon[131657]: pgmap v393: 97 pgs: 97 active+clean; 513 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.1 MiB/s wr, 661 op/s 2023-10-26T06:46:10.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:09 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:46:10.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:09 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:46:10.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:09 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:46:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:10 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:46:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:10 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:46:11.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:10 smithi050 ceph-mon[94997]: pgmap v394: 97 pgs: 97 active+clean; 522 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.2 MiB/s wr, 492 op/s 2023-10-26T06:46:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:10 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:46:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:10 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:46:11.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:10 smithi125 ceph-mon[130643]: pgmap v394: 97 pgs: 97 active+clean; 522 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.2 MiB/s wr, 492 op/s 2023-10-26T06:46:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:10 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:46:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:10 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:46:11.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:10 smithi153 ceph-mon[131657]: pgmap v394: 97 pgs: 97 active+clean; 522 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.2 MiB/s wr, 492 op/s 2023-10-26T06:46:13.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:12 smithi050 ceph-mon[94997]: pgmap v395: 97 pgs: 97 active+clean; 522 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 221 op/s 2023-10-26T06:46:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:12 smithi125 ceph-mon[130643]: pgmap v395: 97 pgs: 97 active+clean; 522 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 221 op/s 2023-10-26T06:46:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:12 smithi153 ceph-mon[131657]: pgmap v395: 97 pgs: 97 active+clean; 522 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 221 op/s 2023-10-26T06:46:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:13 smithi153 ceph-mon[131657]: pgmap v396: 97 pgs: 97 active+clean; 537 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.4 MiB/s wr, 110 op/s 2023-10-26T06:46:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:13 smithi050 ceph-mon[94997]: pgmap v396: 97 pgs: 97 active+clean; 537 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.4 MiB/s wr, 110 op/s 2023-10-26T06:46:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:13 smithi125 ceph-mon[130643]: pgmap v396: 97 pgs: 97 active+clean; 537 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.4 MiB/s wr, 110 op/s 2023-10-26T06:46:17.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:16 smithi050 ceph-mon[94997]: pgmap v397: 97 pgs: 97 active+clean; 537 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 53 op/s 2023-10-26T06:46:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:16 smithi125 ceph-mon[130643]: pgmap v397: 97 pgs: 97 active+clean; 537 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 53 op/s 2023-10-26T06:46:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:16 smithi153 ceph-mon[131657]: pgmap v397: 97 pgs: 97 active+clean; 537 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 53 op/s 2023-10-26T06:46:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:18 smithi050 ceph-mon[94997]: pgmap v398: 97 pgs: 97 active+clean; 545 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 60 op/s 2023-10-26T06:46:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:18 smithi125 ceph-mon[130643]: pgmap v398: 97 pgs: 97 active+clean; 545 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 60 op/s 2023-10-26T06:46:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:18 smithi153 ceph-mon[131657]: pgmap v398: 97 pgs: 97 active+clean; 545 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 60 op/s 2023-10-26T06:46:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:20 smithi050 ceph-mon[94997]: pgmap v399: 97 pgs: 97 active+clean; 555 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 57 op/s 2023-10-26T06:46:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:20 smithi125 ceph-mon[130643]: pgmap v399: 97 pgs: 97 active+clean; 555 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 57 op/s 2023-10-26T06:46:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:20 smithi153 ceph-mon[131657]: pgmap v399: 97 pgs: 97 active+clean; 555 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 57 op/s 2023-10-26T06:46:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:22 smithi050 ceph-mon[94997]: pgmap v400: 97 pgs: 97 active+clean; 555 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 43 op/s 2023-10-26T06:46:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:22 smithi125 ceph-mon[130643]: pgmap v400: 97 pgs: 97 active+clean; 555 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 43 op/s 2023-10-26T06:46:23.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:22 smithi153 ceph-mon[131657]: pgmap v400: 97 pgs: 97 active+clean; 555 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 43 op/s 2023-10-26T06:46:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:23 smithi153 ceph-mon[131657]: pgmap v401: 97 pgs: 97 active+clean; 562 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 59 op/s 2023-10-26T06:46:24.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:23 smithi050 ceph-mon[94997]: pgmap v401: 97 pgs: 97 active+clean; 562 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 59 op/s 2023-10-26T06:46:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:23 smithi125 ceph-mon[130643]: pgmap v401: 97 pgs: 97 active+clean; 562 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 59 op/s 2023-10-26T06:46:24.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:46:24.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 -- 172.21.15.50:0/1985207215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f0100000 msgr2=0x7fd7f010c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:24.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/1985207215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f0100000 0x7fd7f010c4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800b0a0 tx=0x7fd7e800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 -- 172.21.15.50:0/1985207215 shutdown_connections 2023-10-26T06:46:24.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/1985207215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f0100000 0x7fd7f010c4a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/1985207215 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f01056e0 0x7fd7f0105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/1985207215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f00ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.951+0000 7fd7f5fff700 1 -- 172.21.15.50:0/1985207215 >> 172.21.15.50:0/1985207215 conn(0x7fd7f00767f0 msgr2=0x7fd7f0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:24.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.952+0000 7fd7f5fff700 1 -- 172.21.15.50:0/1985207215 shutdown_connections 2023-10-26T06:46:24.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.952+0000 7fd7f5fff700 1 -- 172.21.15.50:0/1985207215 wait complete. 2023-10-26T06:46:24.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 Processor -- start 2023-10-26T06:46:24.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 -- start start 2023-10-26T06:46:24.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f0198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f0100000 0x7fd7f0199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f01056e0 0x7fd7f019d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f019de40 con 0x7fd7f00ff640 2023-10-26T06:46:24.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f019dfb0 con 0x7fd7f0100000 2023-10-26T06:46:24.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7f5fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f019e170 con 0x7fd7f01056e0 2023-10-26T06:46:24.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f0198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f0198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57260/0 (socket says 172.21.15.50:57260) 2023-10-26T06:46:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.953+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/4984434 learned_addr learned my addr 172.21.15.50:0/4984434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7effff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f01056e0 0x7fd7f019d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f0100000 0x7fd7f0199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/4984434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f01056e0 msgr2=0x7fd7f019d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f01056e0 0x7fd7f019d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/4984434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f0100000 msgr2=0x7fd7f0199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f0100000 0x7fd7f0199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/4984434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009520 con 0x7fd7f00ff640 2023-10-26T06:46:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7effff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f01056e0 0x7fd7f019d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f0100000 0x7fd7f0199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f0198f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000e9a0 tx=0x7fd7e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ecff9700 1 -- 172.21.15.50:0/4984434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0009790 con 0x7fd7f00ff640 2023-10-26T06:46:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.954+0000 7fd7ecff9700 1 -- 172.21.15.50:0/4984434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7e0010430 con 0x7fd7f00ff640 2023-10-26T06:46:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.955+0000 7fd7ecff9700 1 -- 172.21.15.50:0/4984434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0018680 con 0x7fd7f00ff640 2023-10-26T06:46:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.955+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e8009d00 con 0x7fd7f00ff640 2023-10-26T06:46:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.955+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f01a5ab0 con 0x7fd7f00ff640 2023-10-26T06:46:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.958+0000 7fd7ecff9700 1 -- 172.21.15.50:0/4984434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd7e00105a0 con 0x7fd7f00ff640 2023-10-26T06:46:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.959+0000 7fd7ecff9700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7d80a1670 0x7fd7d80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd7ecff9700 1 -- 172.21.15.50:0/4984434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd7e0014070 con 0x7fd7f00ff640 2023-10-26T06:46:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 Processor -- start 2023-10-26T06:46:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7d80a1670 0x7fd7d80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 -- start start 2023-10-26T06:46:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed8798ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8798a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed878fd6e0 con 0x55ed8798a5d0 2023-10-26T06:46:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed878e3c60 con 0x55ed87990500 2023-10-26T06:46:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.960+0000 7fd809a12b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed878e1580 con 0x55ed8798fbe0 2023-10-26T06:46:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8798a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed8798ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed8798ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34380/0 (socket says 172.21.15.50:34380) 2023-10-26T06:46:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/2515694039 learned_addr learned my addr 172.21.15.50:0/2515694039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8798a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56776/0 (socket says 172.21.15.50:56776) 2023-10-26T06:46:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7effff700 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7d80a1670 0x7fd7d80a3b30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009fd0 tx=0x7fd7e4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/2515694039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 msgr2=0x55ed8798a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8798a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/2515694039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 msgr2=0x55ed8798aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/2515694039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8789a3f0 con 0x55ed8798fbe0 2023-10-26T06:46:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7effff700 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed8798ffc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00a2040 tx=0x7fd7e009a960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23437ba7b9c91c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7d5ffb700 1 -- 172.21.15.50:0/2515694039 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00b1070 con 0x55ed8798fbe0 2023-10-26T06:46:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7d5ffb700 1 -- 172.21.15.50:0/2515694039 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7e00a2570 con 0x55ed8798fbe0 2023-10-26T06:46:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.961+0000 7fd7d5ffb700 1 -- 172.21.15.50:0/2515694039 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e009a6a0 con 0x55ed8798fbe0 2023-10-26T06:46:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 -- 172.21.15.50:0/2515694039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 msgr2=0x55ed8798ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed8798ffc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00a2040 tx=0x7fd7e009a960 comp rx=0 tx=0).stop 2023-10-26T06:46:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 -- 172.21.15.50:0/2515694039 shutdown_connections 2023-10-26T06:46:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed8798ffc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 --2- 172.21.15.50:0/2515694039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8798a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 -- 172.21.15.50:0/2515694039 >> 172.21.15.50:0/2515694039 conn(0x55ed878fe720 msgr2=0x55ed87984b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.962+0000 7fd809a12b80 1 -- 172.21.15.50:0/2515694039 shutdown_connections 2023-10-26T06:46:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.963+0000 7fd809a12b80 1 -- 172.21.15.50:0/2515694039 wait complete. 2023-10-26T06:46:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.963+0000 7fd809a12b80 1 -- start start 2023-10-26T06:46:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.963+0000 7fd809a12b80 1 Processor -- start 2023-10-26T06:46:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed879938a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed87993de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed87994320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed878dce70 con 0x55ed8798a5d0 2023-10-26T06:46:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed87879710 con 0x55ed87990500 2023-10-26T06:46:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed878793b0 con 0x55ed8798fbe0 2023-10-26T06:46:24.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd809a12b80 10 client.0 _ll_register_callbacks cb 0x55ed877c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd7effff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed87994320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd7effff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed87994320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56778/0 (socket says 172.21.15.50:56778) 2023-10-26T06:46:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd7effff700 1 -- 172.21.15.50:0/653361112 learned_addr learned my addr 172.21.15.50:0/653361112 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed879938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.964+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed87993de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7effff700 1 -- 172.21.15.50:0/653361112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 msgr2=0x55ed87993de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7effff700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed87993de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7effff700 1 -- 172.21.15.50:0/653361112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 msgr2=0x55ed879938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7effff700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed879938a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7effff700 1 -- 172.21.15.50:0/653361112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f01a5ab0 con 0x55ed87990500 2023-10-26T06:46:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7effff700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed87994320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8015000 tx=0x7fd7e8009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567f0e6c051cce8a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7ceffd700 1 -- 172.21.15.50:0/653361112 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800e040 con 0x55ed87990500 2023-10-26T06:46:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed878e1ef0 con 0x55ed87990500 2023-10-26T06:46:24.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.965+0000 7fd7ceffd700 1 -- 172.21.15.50:0/653361112 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd7e8022070 con 0x55ed87990500 2023-10-26T06:46:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd7ceffd700 1 -- 172.21.15.50:0/653361112 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e8008ef0 con 0x55ed87990500 2023-10-26T06:46:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 10 client.26003 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ed87707de0 con 0x55ed87990500 2023-10-26T06:46:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd7ceffd700 1 -- 172.21.15.50:0/653361112 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ed878e1ef0 con 0x55ed87990500 2023-10-26T06:46:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd7ceffd700 1 -- 172.21.15.50:0/653361112 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd7e802e020 con 0x55ed87990500 2023-10-26T06:46:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 10 client.26003 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 10 client.26003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 20 client.26003 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879a3f60 0x55ed879a6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 4 client.26003 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:24.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed879598b0 con 0x55ed879a3f60 2023-10-26T06:46:24.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.966+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879a3f60 0x55ed879a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.967+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879a3f60 0x55ed879a6380 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fb1bf1b9e2f0172 server_cookie=931ab065adfd5046 in_seq=0 out_seq=0 2023-10-26T06:46:24.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.967+0000 7fd7ceffd700 10 client.26003 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:24.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd7ceffd700 1 -- 172.21.15.50:0/653361112 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed879598b0 con 0x55ed879a3f60 2023-10-26T06:46:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd7ceffd700 10 client.26003 handle_command_reply: tid=0 2023-10-26T06:46:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 client.26003 shutdown 2023-10-26T06:46:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 msgr2=0x55ed87994320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed87994320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8015000 tx=0x7fd7e8009570 comp rx=0 tx=0).stop 2023-10-26T06:46:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 shutdown_connections 2023-10-26T06:46:24.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879a3f60 0x55ed879a6380 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed87994320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed879938a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 --2- 172.21.15.50:0/653361112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798fbe0 0x55ed87993de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd7ceffd700 0 client.26003 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:24.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 >> 172.21.15.50:0/653361112 conn(0x55ed878fe720 msgr2=0x55ed87989080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 shutdown_connections 2023-10-26T06:46:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 1 -- 172.21.15.50:0/653361112 wait complete. 2023-10-26T06:46:24.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.969+0000 7fd809a12b80 20 client.26003 trim_cache size 0 max 16384 2023-10-26T06:46:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.991+0000 7fd809a12b80 1 Processor -- start 2023-10-26T06:46:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.991+0000 7fd809a12b80 1 -- start start 2023-10-26T06:46:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.991+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.991+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 0x55ed8799aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed87990500 0x55ed8798f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd809a12b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8775d920 con 0x55ed8798a5d0 2023-10-26T06:46:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd809a12b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed87994ea0 con 0x55ed8798fbe0 2023-10-26T06:46:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd809a12b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8798b010 con 0x55ed87990500 2023-10-26T06:46:24.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd7eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 0x55ed8799aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd7eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 0x55ed8799aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56786/0 (socket says 172.21.15.50:56786) 2023-10-26T06:46:24.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd7effff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed87990500 0x55ed8798f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:24.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.992+0000 7fd7eeffd700 1 -- 172.21.15.50:0/1641619351 learned_addr learned my addr 172.21.15.50:0/1641619351 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:24.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7effff700 1 -- 172.21.15.50:0/1641619351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 msgr2=0x55ed8799aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:24.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7effff700 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 0x55ed8799aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7effff700 1 -- 172.21.15.50:0/1641619351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 msgr2=0x55ed8798a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7effff700 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7effff700 1 -- 172.21.15.50:0/1641619351 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed876f0c60 con 0x55ed87990500 2023-10-26T06:46:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 0x55ed8799aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:24.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.993+0000 7fd7effff700 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed87990500 0x55ed8798f100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005730 tx=0x7fd7e8006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7115edcce945273 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.994+0000 7fd7d67fc700 1 -- 172.21.15.50:0/1641619351 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800e030 con 0x55ed87990500 2023-10-26T06:46:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.994+0000 7fd7d67fc700 1 -- 172.21.15.50:0/1641619351 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7e8020070 con 0x55ed87990500 2023-10-26T06:46:24.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.994+0000 7fd7d67fc700 1 -- 172.21.15.50:0/1641619351 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005030 con 0x55ed87990500 2023-10-26T06:46:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 -- 172.21.15.50:0/1641619351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed87990500 msgr2=0x55ed8798f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed87990500 0x55ed8798f100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005730 tx=0x7fd7e8006000 comp rx=0 tx=0).stop 2023-10-26T06:46:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 -- 172.21.15.50:0/1641619351 shutdown_connections 2023-10-26T06:46:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed87990500 0x55ed8798f100 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798a5d0 0x55ed8798a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 --2- 172.21.15.50:0/1641619351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed8798fbe0 0x55ed8799aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 -- 172.21.15.50:0/1641619351 >> 172.21.15.50:0/1641619351 conn(0x55ed878fe720 msgr2=0x55ed8798e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 -- 172.21.15.50:0/1641619351 shutdown_connections 2023-10-26T06:46:25.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 -- 172.21.15.50:0/1641619351 wait complete. 2023-10-26T06:46:25.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.995+0000 7fd809a12b80 1 -- start start 2023-10-26T06:46:25.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 Processor -- start 2023-10-26T06:46:25.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 0x55ed87999750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798fbe0 0x55ed87999c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8799a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed879f7da0 con 0x55ed8798fbe0 2023-10-26T06:46:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed879f7f10 con 0x55ed87990500 2023-10-26T06:46:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed879f80d0 con 0x55ed8798a5d0 2023-10-26T06:46:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd809a12b80 10 client.0 _ll_register_callbacks cb 0x55ed877c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 0x55ed87999750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.996+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 0x55ed87999750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34410/0 (socket says 172.21.15.50:34410) 2023-10-26T06:46:25.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/788427958 learned_addr learned my addr 172.21.15.50:0/788427958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798fbe0 0x55ed87999c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7effff700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8799a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 msgr2=0x55ed8799a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8799a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/788427958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798fbe0 msgr2=0x55ed87999c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798fbe0 0x55ed87999c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7ef7fe700 1 -- 172.21.15.50:0/788427958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e4017050 con 0x55ed8798a5d0 2023-10-26T06:46:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7effff700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8799a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.997+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798fbe0 0x55ed87999c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd7ef7fe700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 0x55ed87999750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0096c50 tx=0x7fd7e00a26e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5292aceef0b4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd7ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:46:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd7ceffd700 1 -- 172.21.15.50:0/788427958 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00b8040 con 0x55ed8798a5d0 2023-10-26T06:46:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd7ceffd700 1 -- 172.21.15.50:0/788427958 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd7e00b7040 con 0x55ed8798a5d0 2023-10-26T06:46:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7e00a2570 con 0x55ed8798a5d0 2023-10-26T06:46:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd7ceffd700 1 -- 172.21.15.50:0/788427958 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e00b1040 con 0x55ed8798a5d0 2023-10-26T06:46:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd809a12b80 10 client.26017 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.998+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ed87707de0 con 0x55ed8798a5d0 2023-10-26T06:46:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd7ceffd700 1 -- 172.21.15.50:0/788427958 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7e00a2570 con 0x55ed8798a5d0 2023-10-26T06:46:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd7ceffd700 1 -- 172.21.15.50:0/788427958 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd7e00a20e0 con 0x55ed8798a5d0 2023-10-26T06:46:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd809a12b80 10 client.26017 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd809a12b80 10 client.26017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd809a12b80 20 client.26017 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd809a12b80 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879f94d0 0x55ed879fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd809a12b80 4 client.26017 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:46:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ed878d5e50 con 0x55ed879f94d0 2023-10-26T06:46:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:24.999+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879f94d0 0x55ed879fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.000+0000 7fd7eeffd700 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879f94d0 0x55ed879fb8f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1107e3ecf5ea7ca1 server_cookie=8a5c3019ab454d56 in_seq=0 out_seq=0 2023-10-26T06:46:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.000+0000 7fd7ceffd700 10 client.26017 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd7ceffd700 1 -- 172.21.15.50:0/788427958 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ed878d5e50 con 0x55ed879f94d0 2023-10-26T06:46:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd7ceffd700 10 client.26017 handle_command_reply: tid=0 2023-10-26T06:46:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 client.26017 shutdown 2023-10-26T06:46:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 msgr2=0x55ed87999750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 0x55ed87999750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0096c50 tx=0x7fd7e00a26e0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 shutdown_connections 2023-10-26T06:46:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ed879f94d0 0x55ed879fb8f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed87990500 0x55ed8799a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed8798a5d0 0x55ed87999750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd7ceffd700 0 client.26017 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 --2- 172.21.15.50:0/788427958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed8798fbe0 0x55ed87999c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.003+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 >> 172.21.15.50:0/788427958 conn(0x55ed878fe720 msgr2=0x55ed8797e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.004+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 shutdown_connections 2023-10-26T06:46:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.004+0000 7fd809a12b80 1 -- 172.21.15.50:0/788427958 wait complete. 2023-10-26T06:46:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.004+0000 7fd809a12b80 20 client.26017 trim_cache size 0 max 16384 2023-10-26T06:46:25.014 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:46:25.014 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:46:25.015 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:46:25.015 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:46:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7d80a1670 msgr2=0x7fd7d80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7d80a1670 0x7fd7d80a3b30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009fd0 tx=0x7fd7e4009260 comp rx=0 tx=0).stop 2023-10-26T06:46:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 msgr2=0x7fd7f0198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f0198f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000e9a0 tx=0x7fd7e000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 shutdown_connections 2023-10-26T06:46:25.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd7d80a1670 0x7fd7d80a3b30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7f01056e0 0x7fd7f019d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7f00ff640 0x7fd7f0198f20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 --2- 172.21.15.50:0/4984434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7f0100000 0x7fd7f0199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 >> 172.21.15.50:0/4984434 conn(0x7fd7f00767f0 msgr2=0x7fd7f0067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 shutdown_connections 2023-10-26T06:46:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.005+0000 7fd7f5fff700 1 -- 172.21.15.50:0/4984434 wait complete. 2023-10-26T06:46:25.028 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:46:25.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:46:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 -- 172.21.15.50:0/2042342243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41006a0 msgr2=0x7feef4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 --2- 172.21.15.50:0/2042342243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41006a0 0x7feef4100b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feee0009990 tx=0x7feee0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 -- 172.21.15.50:0/2042342243 shutdown_connections 2023-10-26T06:46:25.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 --2- 172.21.15.50:0/2042342243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 --2- 172.21.15.50:0/2042342243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41066b0 0x7feef4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 --2- 172.21.15.50:0/2042342243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41006a0 0x7feef4100b20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 -- 172.21.15.50:0/2042342243 >> 172.21.15.50:0/2042342243 conn(0x7feef40fc170 msgr2=0x7feef40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 -- 172.21.15.50:0/2042342243 shutdown_connections 2023-10-26T06:46:25.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.245+0000 7feefabff700 1 -- 172.21.15.50:0/2042342243 wait complete. 2023-10-26T06:46:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.246+0000 7feefabff700 1 Processor -- start 2023-10-26T06:46:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.246+0000 7feefabff700 1 -- start start 2023-10-26T06:46:25.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.246+0000 7feefabff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 0x7feef419e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feefabff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feefabff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41066b0 0x7feef4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feefabff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef4199170 con 0x7feef4101060 2023-10-26T06:46:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feefabff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef41992e0 con 0x7feef41066b0 2023-10-26T06:46:25.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feefabff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef41994a0 con 0x7feef41006a0 2023-10-26T06:46:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 0x7feef419e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 0x7feef419e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34428/0 (socket says 172.21.15.50:34428) 2023-10-26T06:46:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 -- 172.21.15.50:0/1262180784 learned_addr learned my addr 172.21.15.50:0/1262180784 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57330/0 (socket says 172.21.15.50:57330) 2023-10-26T06:46:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef919c700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41066b0 0x7feef4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 -- 172.21.15.50:0/1262180784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41066b0 msgr2=0x7feef4198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41066b0 0x7feef4198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 -- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 msgr2=0x7feef419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 -- 172.21.15.50:0/1262180784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009c40 con 0x7feef41006a0 2023-10-26T06:46:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef3fff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.247+0000 7feef899b700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 0x7feef419e9e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feee800eb30 tx=0x7feee800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.248+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8009880 con 0x7feef41006a0 2023-10-26T06:46:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.248+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8009520 con 0x7feef41006a0 2023-10-26T06:46:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.248+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feee80044e0 con 0x7feef41006a0 2023-10-26T06:46:25.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.248+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8003d80 con 0x7feef41006a0 2023-10-26T06:46:25.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.248+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee00095f0 con 0x7feef41006a0 2023-10-26T06:46:25.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.249+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef4101de0 con 0x7feef41006a0 2023-10-26T06:46:25.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.251+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7feee8003ee0 con 0x7feef41006a0 2023-10-26T06:46:25.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.253+0000 7feef1ffb700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7feee40a15f0 0x7feee40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.253+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7feee8014070 con 0x7feef41006a0 2023-10-26T06:46:25.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.253+0000 7feef3fff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7feee40a15f0 0x7feee40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.253+0000 7feef3fff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7feee40a15f0 0x7feee40a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feee00098e0 tx=0x7feee0005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.255+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feee8096960 con 0x7feef41006a0 2023-10-26T06:46:25.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.549+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feef4067530 con 0x7feef41006a0 2023-10-26T06:46:25.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.550+0000 7feef1ffb700 1 -- 172.21.15.50:0/1262180784 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11324 (secure 0 0 0) 0x7feee8004190 con 0x7feef41006a0 2023-10-26T06:46:25.552 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:46:25.552 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:45:14.436234+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:46:25.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7feee40a15f0 msgr2=0x7feee40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7feee40a15f0 0x7feee40a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feee00098e0 tx=0x7feee0005960 comp rx=0 tx=0).stop 2023-10-26T06:46:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 msgr2=0x7feef419e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 0x7feef419e9e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feee800eb30 tx=0x7feee800ee40 comp rx=0 tx=0).stop 2023-10-26T06:46:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 shutdown_connections 2023-10-26T06:46:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7feee40a15f0 0x7feee40a3ab0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feef41066b0 0x7feef4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feef41006a0 0x7feef419e9e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 --2- 172.21.15.50:0/1262180784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feef4101060 0x7feef419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 >> 172.21.15.50:0/1262180784 conn(0x7feef40fc170 msgr2=0x7feef410bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 shutdown_connections 2023-10-26T06:46:25.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.553+0000 7feefabff700 1 -- 172.21.15.50:0/1262180784 wait complete. 2023-10-26T06:46:25.557 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-10-26T06:46:25.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:46:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 -- 172.21.15.50:0/130174376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3894106730 msgr2=0x7f3894106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 --2- 172.21.15.50:0/130174376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3894106730 0x7f3894106b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3884009990 tx=0x7f3884009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 -- 172.21.15.50:0/130174376 shutdown_connections 2023-10-26T06:46:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 --2- 172.21.15.50:0/130174376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38941010e0 0x7f389410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 --2- 172.21.15.50:0/130174376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3894106730 0x7f3894106b10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 --2- 172.21.15.50:0/130174376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894100720 0x7f3894100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.789+0000 7f3899fff700 1 -- 172.21.15.50:0/130174376 >> 172.21.15.50:0/130174376 conn(0x7f38940fc1b0 msgr2=0x7f38940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.790+0000 7f3899fff700 1 -- 172.21.15.50:0/130174376 shutdown_connections 2023-10-26T06:46:25.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.790+0000 7f3899fff700 1 -- 172.21.15.50:0/130174376 wait complete. 2023-10-26T06:46:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 Processor -- start 2023-10-26T06:46:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 -- start start 2023-10-26T06:46:25.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 0x7f3894198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38941010e0 0x7f38941992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894106730 0x7f389419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389419dcc0 con 0x7f3894100720 2023-10-26T06:46:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389419de30 con 0x7f38941010e0 2023-10-26T06:46:25.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3899fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389419dff0 con 0x7f3894106730 2023-10-26T06:46:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f38937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 0x7f3894198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f38937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 0x7f3894198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57348/0 (socket says 172.21.15.50:57348) 2023-10-26T06:46:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f38937fe700 1 -- 172.21.15.50:0/3737787405 learned_addr learned my addr 172.21.15.50:0/3737787405 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.791+0000 7f3892ffd700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38941010e0 0x7f38941992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f3893fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894106730 0x7f389419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f38937fe700 1 -- 172.21.15.50:0/3737787405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894106730 msgr2=0x7f389419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f38937fe700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894106730 0x7f389419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f38937fe700 1 -- 172.21.15.50:0/3737787405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38941010e0 msgr2=0x7f38941992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f38937fe700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38941010e0 0x7f38941992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f38937fe700 1 -- 172.21.15.50:0/3737787405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009c40 con 0x7f3894100720 2023-10-26T06:46:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f3892ffd700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38941010e0 0x7f38941992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:25.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f38937fe700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 0x7f3894198da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3884000c00 tx=0x7f3884005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.792+0000 7f3890ff9700 1 -- 172.21.15.50:0/3737787405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388401d070 con 0x7f3894100720 2023-10-26T06:46:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.793+0000 7f3890ff9700 1 -- 172.21.15.50:0/3737787405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3884022470 con 0x7f3894100720 2023-10-26T06:46:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.793+0000 7f3890ff9700 1 -- 172.21.15.50:0/3737787405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884017650 con 0x7f3894100720 2023-10-26T06:46:25.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.793+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38840095f0 con 0x7f3894100720 2023-10-26T06:46:25.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.793+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941a5930 con 0x7f3894100720 2023-10-26T06:46:25.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.796+0000 7f3890ff9700 1 -- 172.21.15.50:0/3737787405 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f38840225e0 con 0x7f3894100720 2023-10-26T06:46:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.797+0000 7f3890ff9700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f387c0a15f0 0x7f387c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.797+0000 7f3890ff9700 1 -- 172.21.15.50:0/3737787405 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f38840ce310 con 0x7f3894100720 2023-10-26T06:46:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.797+0000 7f38ad942b80 1 Processor -- start 2023-10-26T06:46:25.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.797+0000 7f3892ffd700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f387c0a15f0 0x7f387c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 -- start start 2023-10-26T06:46:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f3892ffd700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f387c0a15f0 0x7f387c0a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f389419a2f0 tx=0x7f3888009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 0x5651c4346fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c4341090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c43415d0 0x5651c4341a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c42b46e0 con 0x5651c4347500 2023-10-26T06:46:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c429ac60 con 0x5651c4346be0 2023-10-26T06:46:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38ad942b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c4298580 con 0x5651c43415d0 2023-10-26T06:46:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 0x5651c4346fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f3892ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c4341090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 0x5651c4346fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56836/0 (socket says 172.21.15.50:56836) 2023-10-26T06:46:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.798+0000 7f38937fe700 1 -- 172.21.15.50:0/735811790 learned_addr learned my addr 172.21.15.50:0/735811790 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f3893fff700 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c43415d0 0x5651c4341a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f38937fe700 1 -- 172.21.15.50:0/735811790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c43415d0 msgr2=0x5651c4341a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f38937fe700 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c43415d0 0x5651c4341a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f38937fe700 1 -- 172.21.15.50:0/735811790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 msgr2=0x5651c4341090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f38937fe700 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c4341090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f38937fe700 1 -- 172.21.15.50:0/735811790 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c42513f0 con 0x5651c4346be0 2023-10-26T06:46:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f38937fe700 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 0x5651c4346fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3884097e40 tx=0x7f3884097710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5318d00bb7d0c57 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f3879ffb700 1 -- 172.21.15.50:0/735811790 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388409ad30 con 0x5651c4346be0 2023-10-26T06:46:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f3879ffb700 1 -- 172.21.15.50:0/735811790 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f388409bad0 con 0x5651c4346be0 2023-10-26T06:46:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.799+0000 7f3879ffb700 1 -- 172.21.15.50:0/735811790 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884022990 con 0x5651c4346be0 2023-10-26T06:46:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 -- 172.21.15.50:0/735811790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 msgr2=0x5651c4346fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 0x5651c4346fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3884097e40 tx=0x7f3884097710 comp rx=0 tx=0).stop 2023-10-26T06:46:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 -- 172.21.15.50:0/735811790 shutdown_connections 2023-10-26T06:46:25.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c43415d0 0x5651c4341a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4346be0 0x5651c4346fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 --2- 172.21.15.50:0/735811790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c4341090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 -- 172.21.15.50:0/735811790 >> 172.21.15.50:0/735811790 conn(0x5651c42b5720 msgr2=0x5651c433bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 -- 172.21.15.50:0/735811790 shutdown_connections 2023-10-26T06:46:25.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.800+0000 7f38ad942b80 1 -- 172.21.15.50:0/735811790 wait complete. 2023-10-26T06:46:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.801+0000 7f38ad942b80 1 -- start start 2023-10-26T06:46:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.801+0000 7f38ad942b80 1 Processor -- start 2023-10-26T06:46:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 0x5651c434d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c434a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4347500 0x5651c434af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c4293e70 con 0x5651c43415d0 2023-10-26T06:46:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c4230710 con 0x5651c4347500 2023-10-26T06:46:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c42303b0 con 0x5651c4346be0 2023-10-26T06:46:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38ad942b80 10 client.0 _ll_register_callbacks cb 0x5651c417aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 0x5651c434d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f3893fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4347500 0x5651c434af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 0x5651c434d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57366/0 (socket says 172.21.15.50:57366) 2023-10-26T06:46:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 -- 172.21.15.50:0/1841265864 learned_addr learned my addr 172.21.15.50:0/1841265864 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f3892ffd700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c434a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 -- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 msgr2=0x5651c434a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c434a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 -- 172.21.15.50:0/1841265864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4347500 msgr2=0x5651c434af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4347500 0x5651c434af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f38937fe700 1 -- 172.21.15.50:0/1841265864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941a5930 con 0x5651c43415d0 2023-10-26T06:46:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.802+0000 7f3893fff700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4347500 0x5651c434af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f38937fe700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 0x5651c434d520 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3884022cd0 tx=0x7f388409afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8296f8c300f202dd server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f3872ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:46:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f3872ffd700 1 -- 172.21.15.50:0/1841265864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388409f520 con 0x5651c43415d0 2023-10-26T06:46:25.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f3872ffd700 1 -- 172.21.15.50:0/1841265864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f38840a36d0 con 0x5651c43415d0 2023-10-26T06:46:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651c4298ef0 con 0x5651c43415d0 2023-10-26T06:46:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f3872ffd700 1 -- 172.21.15.50:0/1841265864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3884099770 con 0x5651c43415d0 2023-10-26T06:46:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f38ad942b80 10 client.15990 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.803+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5651c40bede0 con 0x5651c43415d0 2023-10-26T06:46:25.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f3872ffd700 1 -- 172.21.15.50:0/1841265864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5651c4298ef0 con 0x5651c43415d0 2023-10-26T06:46:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f3872ffd700 1 -- 172.21.15.50:0/1841265864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f38840a3350 con 0x5651c43415d0 2023-10-26T06:46:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f38ad942b80 10 client.15990 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f38ad942b80 10 client.15990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:46:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f38ad942b80 20 client.15990 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:25.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f38ad942b80 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c435a700 0x5651c435cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f38ad942b80 4 client.15990 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651c43108b0 con 0x5651c435a700 2023-10-26T06:46:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.804+0000 7f3892ffd700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c435a700 0x5651c435cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.805+0000 7f3892ffd700 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c435a700 0x5651c435cb20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea2e69ff71ac24b4 server_cookie=d3387ca67620a4c7 in_seq=0 out_seq=0 2023-10-26T06:46:25.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.805+0000 7f3872ffd700 10 client.15990 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.805+0000 7f3872ffd700 1 -- 172.21.15.50:0/1841265864 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651c43108b0 con 0x5651c435a700 2023-10-26T06:46:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.805+0000 7f3872ffd700 10 client.15990 handle_command_reply: tid=0 2023-10-26T06:46:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.805+0000 7f38ad942b80 1 client.15990 shutdown 2023-10-26T06:46:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 msgr2=0x5651c434d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 0x5651c434d520 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3884022cd0 tx=0x7f388409afd0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 shutdown_connections 2023-10-26T06:46:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c435a700 0x5651c435cb20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c4347500 0x5651c434af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c43415d0 0x5651c434d520 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 --2- 172.21.15.50:0/1841265864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c434a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 >> 172.21.15.50:0/1841265864 conn(0x5651c42b5720 msgr2=0x5651c4340080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f3872ffd700 0 client.15990 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 shutdown_connections 2023-10-26T06:46:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 1 -- 172.21.15.50:0/1841265864 wait complete. 2023-10-26T06:46:25.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.806+0000 7f38ad942b80 20 client.15990 trim_cache size 0 max 16384 2023-10-26T06:46:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.823+0000 7f38ad942b80 1 Processor -- start 2023-10-26T06:46:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.823+0000 7f38ad942b80 1 -- start start 2023-10-26T06:46:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c434af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c4350070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c434a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38ad942b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c4114920 con 0x5651c4347500 2023-10-26T06:46:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38ad942b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c434b810 con 0x5651c43415d0 2023-10-26T06:46:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38ad942b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c43505b0 con 0x5651c4346be0 2023-10-26T06:46:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c434af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c434af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56852/0 (socket says 172.21.15.50:56852) 2023-10-26T06:46:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 -- 172.21.15.50:0/3990847135 learned_addr learned my addr 172.21.15.50:0/3990847135 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f3892ffd700 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c4350070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f3893fff700 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c434a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 -- 172.21.15.50:0/3990847135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 msgr2=0x5651c4350070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c4350070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 -- 172.21.15.50:0/3990847135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 msgr2=0x5651c434a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c434a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.824+0000 7f38937fe700 1 -- 172.21.15.50:0/3990847135 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c40a7c60 con 0x5651c43415d0 2023-10-26T06:46:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38937fe700 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c434af00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38840978d0 tx=0x7f38840cc070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0a68c2f8a0e077 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f387a7fc700 1 -- 172.21.15.50:0/3990847135 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388409ad30 con 0x5651c43415d0 2023-10-26T06:46:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f387a7fc700 1 -- 172.21.15.50:0/3990847135 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3884097710 con 0x5651c43415d0 2023-10-26T06:46:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f387a7fc700 1 -- 172.21.15.50:0/3990847135 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884099800 con 0x5651c43415d0 2023-10-26T06:46:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 -- 172.21.15.50:0/3990847135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 msgr2=0x5651c434af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c434af00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38840978d0 tx=0x7f38840cc070 comp rx=0 tx=0).stop 2023-10-26T06:46:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 -- 172.21.15.50:0/3990847135 shutdown_connections 2023-10-26T06:46:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4347500 0x5651c434a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c434af00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 --2- 172.21.15.50:0/3990847135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4346be0 0x5651c4350070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.825+0000 7f38ad942b80 1 -- 172.21.15.50:0/3990847135 >> 172.21.15.50:0/3990847135 conn(0x5651c42b5720 msgr2=0x5651c433b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.826+0000 7f38ad942b80 1 -- 172.21.15.50:0/3990847135 shutdown_connections 2023-10-26T06:46:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.826+0000 7f38ad942b80 1 -- 172.21.15.50:0/3990847135 wait complete. 2023-10-26T06:46:25.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.826+0000 7f38ad942b80 1 -- start start 2023-10-26T06:46:25.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.826+0000 7f38ad942b80 1 Processor -- start 2023-10-26T06:46:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c43a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4346be0 0x5651c43a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4347500 0x5651c43a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c43a7ac0 con 0x5651c4346be0 2023-10-26T06:46:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c43a7c30 con 0x5651c43415d0 2023-10-26T06:46:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c43a7df0 con 0x5651c4347500 2023-10-26T06:46:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38ad942b80 10 client.0 _ll_register_callbacks cb 0x5651c417aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c43a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c43a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56860/0 (socket says 172.21.15.50:56860) 2023-10-26T06:46:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 -- 172.21.15.50:0/2588869715 learned_addr learned my addr 172.21.15.50:0/2588869715 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f3892ffd700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4346be0 0x5651c43a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f3893fff700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4347500 0x5651c43a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 -- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4347500 msgr2=0x5651c43a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4347500 0x5651c43a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 -- 172.21.15.50:0/2588869715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4346be0 msgr2=0x5651c43a2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4346be0 0x5651c43a2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.827+0000 7f38937fe700 1 -- 172.21.15.50:0/2588869715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651c40bede0 con 0x5651c43415d0 2023-10-26T06:46:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38937fe700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c43a26b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38840a12d0 tx=0x7f3884009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25b3639db1d5d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f3872ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f3872ffd700 1 -- 172.21.15.50:0/2588869715 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388409ad30 con 0x5651c43415d0 2023-10-26T06:46:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f3872ffd700 1 -- 172.21.15.50:0/2588869715 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f38840a36d0 con 0x5651c43415d0 2023-10-26T06:46:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f388409bad0 con 0x5651c43415d0 2023-10-26T06:46:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f3872ffd700 1 -- 172.21.15.50:0/2588869715 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3884099770 con 0x5651c43415d0 2023-10-26T06:46:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 10 client.26033 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5651c40e5250 con 0x5651c43415d0 2023-10-26T06:46:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f3872ffd700 1 -- 172.21.15.50:0/2588869715 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f388409bad0 con 0x5651c43415d0 2023-10-26T06:46:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f3872ffd700 1 -- 172.21.15.50:0/2588869715 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f388409a330 con 0x5651c43415d0 2023-10-26T06:46:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 10 client.26033 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 10 client.26033 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:46:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 20 client.26033 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c43af030 0x5651c43b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 4 client.26033 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:46:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.828+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5651c428ce50 con 0x5651c43af030 2023-10-26T06:46:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.829+0000 7f3892ffd700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c43af030 0x5651c43b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.829+0000 7f3892ffd700 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c43af030 0x5651c43b1420 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bf06b569a71883 server_cookie=ccd6dcd729213dc0 in_seq=0 out_seq=0 2023-10-26T06:46:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.829+0000 7f3872ffd700 10 client.26033 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.829+0000 7f3872ffd700 1 -- 172.21.15.50:0/2588869715 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5651c428ce50 con 0x5651c43af030 2023-10-26T06:46:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.829+0000 7f3872ffd700 10 client.26033 handle_command_reply: tid=0 2023-10-26T06:46:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 client.26033 shutdown 2023-10-26T06:46:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 msgr2=0x5651c43a26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c43a26b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38840a12d0 tx=0x7f3884009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 shutdown_connections 2023-10-26T06:46:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5651c43af030 0x5651c43b1420 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5651c4347500 0x5651c43a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5651c43415d0 0x5651c43a26b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 --2- 172.21.15.50:0/2588869715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5651c4346be0 0x5651c43a2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 >> 172.21.15.50:0/2588869715 conn(0x5651c42b5720 msgr2=0x5651c434a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f3872ffd700 0 client.26033 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 shutdown_connections 2023-10-26T06:46:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 1 -- 172.21.15.50:0/2588869715 wait complete. 2023-10-26T06:46:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f38ad942b80 20 client.26033 trim_cache size 0 max 16384 2023-10-26T06:46:25.861 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:46:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f387c0a15f0 msgr2=0x7f387c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.830+0000 7f3899fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f387c0a15f0 0x7f387c0a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f389419a2f0 tx=0x7f3888009260 comp rx=0 tx=0).stop 2023-10-26T06:46:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 msgr2=0x7f3894198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 0x7f3894198da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3884000c00 tx=0x7f3884005740 comp rx=0 tx=0).stop 2023-10-26T06:46:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 shutdown_connections 2023-10-26T06:46:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f387c0a15f0 0x7f387c0a3ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894106730 0x7f389419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3894100720 0x7f3894198da0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 --2- 172.21.15.50:0/3737787405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38941010e0 0x7f38941992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 >> 172.21.15.50:0/3737787405 conn(0x7f38940fc1b0 msgr2=0x7f389410bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 shutdown_connections 2023-10-26T06:46:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:25.831+0000 7f3899fff700 1 -- 172.21.15.50:0/3737787405 wait complete. 2023-10-26T06:46:25.865 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:25 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1262180784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:46:25.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:46:25.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:25 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1262180784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:46:25.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:25 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1262180784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:46:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 -- 172.21.15.50:0/772027045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87701010e0 msgr2=0x7f877010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 --2- 172.21.15.50:0/772027045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87701010e0 0x7f877010d5f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8768009f90 tx=0x7f876800b330 comp rx=0 tx=0).stop 2023-10-26T06:46:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 -- 172.21.15.50:0/772027045 shutdown_connections 2023-10-26T06:46:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 --2- 172.21.15.50:0/772027045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87701010e0 0x7f877010d5f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 --2- 172.21.15.50:0/772027045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 0x7f8770106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 --2- 172.21.15.50:0/772027045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8770100720 0x7f8770100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 -- 172.21.15.50:0/772027045 >> 172.21.15.50:0/772027045 conn(0x7f87700fc1b0 msgr2=0x7f87700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 -- 172.21.15.50:0/772027045 shutdown_connections 2023-10-26T06:46:26.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.077+0000 7f87773ff700 1 -- 172.21.15.50:0/772027045 wait complete. 2023-10-26T06:46:26.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.078+0000 7f87773ff700 1 Processor -- start 2023-10-26T06:46:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.078+0000 7f87773ff700 1 -- start start 2023-10-26T06:46:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f87773ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 0x7f8770198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f87773ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87701010e0 0x7f8770199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f87773ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 0x7f877019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f87773ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877019cb40 con 0x7f8770106730 2023-10-26T06:46:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f87773ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877019ccb0 con 0x7f8770100720 2023-10-26T06:46:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f87773ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877019ce70 con 0x7f87701010e0 2023-10-26T06:46:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 0x7f8770198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877599c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 0x7f877019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 0x7f8770198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56882/0 (socket says 172.21.15.50:56882) 2023-10-26T06:46:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877519b700 1 -- 172.21.15.50:0/553267440 learned_addr learned my addr 172.21.15.50:0/553267440 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877499a700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87701010e0 0x7f8770199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877599c700 1 -- 172.21.15.50:0/553267440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87701010e0 msgr2=0x7f8770199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877599c700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87701010e0 0x7f8770199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877599c700 1 -- 172.21.15.50:0/553267440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 msgr2=0x7f8770198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877599c700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 0x7f8770198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877599c700 1 -- 172.21.15.50:0/553267440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768009c40 con 0x7f8770106730 2023-10-26T06:46:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.079+0000 7f877519b700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 0x7f8770198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.080+0000 7f877599c700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 0x7f877019c540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f876800b6c0 tx=0x7f8768008fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.080+0000 7f87667fc700 1 -- 172.21.15.50:0/553267440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800e040 con 0x7f8770106730 2023-10-26T06:46:26.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.080+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877019d0f0 con 0x7f8770106730 2023-10-26T06:46:26.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.080+0000 7f87667fc700 1 -- 172.21.15.50:0/553267440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f876801d470 con 0x7f8770106730 2023-10-26T06:46:26.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.080+0000 7f87667fc700 1 -- 172.21.15.50:0/553267440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768005240 con 0x7f8770106730 2023-10-26T06:46:26.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.080+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87701a5ab0 con 0x7f8770106730 2023-10-26T06:46:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.083+0000 7f87667fc700 1 -- 172.21.15.50:0/553267440 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f876801d5e0 con 0x7f8770106730 2023-10-26T06:46:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.084+0000 7f878ac47b80 1 Processor -- start 2023-10-26T06:46:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 -- start start 2023-10-26T06:46:26.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f87667fc700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f875c0a15f0 0x7f875c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 0x55fa461aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461ab500 0x55fa461a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461a55d0 0x55fa461a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa461186e0 con 0x55fa461ab500 2023-10-26T06:46:26.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa460fec60 con 0x55fa461aabe0 2023-10-26T06:46:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f878ac47b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa460fc580 con 0x55fa461a55d0 2023-10-26T06:46:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f87667fc700 1 -- 172.21.15.50:0/553267440 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f87680ce110 con 0x7f8770106730 2023-10-26T06:46:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 0x55fa461aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f877499a700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f875c0a15f0 0x7f875c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 0x55fa461aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56896/0 (socket says 172.21.15.50:56896) 2023-10-26T06:46:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f877519b700 1 -- 172.21.15.50:0/3799855481 learned_addr learned my addr 172.21.15.50:0/3799855481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f877599c700 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461a55d0 0x55fa461a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.085+0000 7f877499a700 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461ab500 0x55fa461a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877519b700 1 -- 172.21.15.50:0/3799855481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461a55d0 msgr2=0x55fa461a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877519b700 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461a55d0 0x55fa461a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877519b700 1 -- 172.21.15.50:0/3799855481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461ab500 msgr2=0x55fa461a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877519b700 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461ab500 0x55fa461a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877519b700 1 -- 172.21.15.50:0/3799855481 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa460b53f0 con 0x55fa461aabe0 2023-10-26T06:46:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877499a700 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461ab500 0x55fa461a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877519b700 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 0x55fa461aafc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f876c0115f0 tx=0x7f876c011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e2f6fd2e0288a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f877499a700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f875c0a15f0 0x7f875c0a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55fa461a0a70 tx=0x7f87600099b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f875b7fe700 1 -- 172.21.15.50:0/3799855481 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c019630 con 0x55fa461aabe0 2023-10-26T06:46:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f875b7fe700 1 -- 172.21.15.50:0/3799855481 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f876c019c50 con 0x55fa461aabe0 2023-10-26T06:46:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.086+0000 7f875b7fe700 1 -- 172.21.15.50:0/3799855481 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00ecd0 con 0x55fa461aabe0 2023-10-26T06:46:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 -- 172.21.15.50:0/3799855481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 msgr2=0x55fa461aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 0x55fa461aafc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f876c0115f0 tx=0x7f876c011900 comp rx=0 tx=0).stop 2023-10-26T06:46:26.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 -- 172.21.15.50:0/3799855481 shutdown_connections 2023-10-26T06:46:26.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461a55d0 0x55fa461a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461aabe0 0x55fa461aafc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3799855481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461ab500 0x55fa461a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 -- 172.21.15.50:0/3799855481 >> 172.21.15.50:0/3799855481 conn(0x55fa46119720 msgr2=0x55fa4619fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 -- 172.21.15.50:0/3799855481 shutdown_connections 2023-10-26T06:46:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.087+0000 7f878ac47b80 1 -- 172.21.15.50:0/3799855481 wait complete. 2023-10-26T06:46:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.088+0000 7f878ac47b80 1 -- start start 2023-10-26T06:46:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.088+0000 7f878ac47b80 1 Processor -- start 2023-10-26T06:46:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa460f7e70 con 0x55fa461aabe0 2023-10-26T06:46:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa46094710 con 0x55fa461a55d0 2023-10-26T06:46:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa460943b0 con 0x55fa461ab500 2023-10-26T06:46:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f878ac47b80 10 client.0 _ll_register_callbacks cb 0x55fa45fdea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:26.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56898/0 (socket says 172.21.15.50:56898) 2023-10-26T06:46:26.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f877519b700 1 -- 172.21.15.50:0/2036467546 learned_addr learned my addr 172.21.15.50:0/2036467546 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f877499a700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.089+0000 7f877599c700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f877519b700 1 -- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 msgr2=0x55fa461aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f877519b700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f877519b700 1 -- 172.21.15.50:0/2036467546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 msgr2=0x55fa461ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f877519b700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f877519b700 1 -- 172.21.15.50:0/2036467546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c009dd0 con 0x55fa461a55d0 2023-10-26T06:46:26.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f877519b700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b13e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f876c00eec0 tx=0x7f876c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a2179740f0beca server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f8758ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:26.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f8758ff9700 1 -- 172.21.15.50:0/2036467546 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c004220 con 0x55fa461a55d0 2023-10-26T06:46:26.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa460fcef0 con 0x55fa461a55d0 2023-10-26T06:46:26.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f8758ff9700 1 -- 172.21.15.50:0/2036467546 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f876c004380 con 0x55fa461a55d0 2023-10-26T06:46:26.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f8758ff9700 1 -- 172.21.15.50:0/2036467546 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f876c004540 con 0x55fa461a55d0 2023-10-26T06:46:26.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f878ac47b80 10 client.26045 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:26.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.090+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55fa45f22de0 con 0x55fa461a55d0 2023-10-26T06:46:26.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f8758ff9700 1 -- 172.21.15.50:0/2036467546 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa460fcef0 con 0x55fa461a55d0 2023-10-26T06:46:26.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f8758ff9700 1 -- 172.21.15.50:0/2036467546 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f876c029030 con 0x55fa461a55d0 2023-10-26T06:46:26.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f878ac47b80 10 client.26045 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:26.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f878ac47b80 10 client.26045 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:46:26.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f878ac47b80 20 client.26045 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:26.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f878ac47b80 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa461bede0 0x55fa461c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f878ac47b80 4 client.26045 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:26.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa461748b0 con 0x55fa461bede0 2023-10-26T06:46:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.091+0000 7f877499a700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa461bede0 0x55fa461c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.092+0000 7f877499a700 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa461bede0 0x55fa461c1200 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3b6c79f9affabd9 server_cookie=f68686211989778c in_seq=0 out_seq=0 2023-10-26T06:46:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.092+0000 7f8758ff9700 10 client.26045 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.092+0000 7f8758ff9700 1 -- 172.21.15.50:0/2036467546 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa461748b0 con 0x55fa461bede0 2023-10-26T06:46:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.092+0000 7f8758ff9700 10 client.26045 handle_command_reply: tid=0 2023-10-26T06:46:26.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.092+0000 7f878ac47b80 1 client.26045 shutdown 2023-10-26T06:46:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 msgr2=0x55fa461b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b13e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f876c00eec0 tx=0x7f876c00eef0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 shutdown_connections 2023-10-26T06:46:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa461bede0 0x55fa461c1200 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b13e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 --2- 172.21.15.50:0/2036467546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 >> 172.21.15.50:0/2036467546 conn(0x55fa46119720 msgr2=0x55fa461a4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f8758ff9700 0 client.26045 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:26.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 shutdown_connections 2023-10-26T06:46:26.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 1 -- 172.21.15.50:0/2036467546 wait complete. 2023-10-26T06:46:26.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.093+0000 7f878ac47b80 20 client.26045 trim_cache size 0 max 16384 2023-10-26T06:46:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 Processor -- start 2023-10-26T06:46:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 -- start start 2023-10-26T06:46:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa4619a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa45f78920 con 0x55fa461aabe0 2023-10-26T06:46:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa460fcef0 con 0x55fa461a55d0 2023-10-26T06:46:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.107+0000 7f878ac47b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa461a13b0 con 0x55fa461ab500 2023-10-26T06:46:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877499a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa4619a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa4619a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56900/0 (socket says 172.21.15.50:56900) 2023-10-26T06:46:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877499a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461a8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57418/0 (socket says 172.21.15.50:57418) 2023-10-26T06:46:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 -- 172.21.15.50:0/221659662 learned_addr learned my addr 172.21.15.50:0/221659662 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877599c700 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 -- 172.21.15.50:0/221659662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 msgr2=0x55fa461b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 -- 172.21.15.50:0/221659662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 msgr2=0x55fa461a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 -- 172.21.15.50:0/221659662 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa45f0bc60 con 0x55fa461a55d0 2023-10-26T06:46:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877499a700 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f877519b700 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa4619a5d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f876c005950 tx=0x7f876c011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6017589eb91a6420 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f875bfff700 1 -- 172.21.15.50:0/221659662 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c019630 con 0x55fa461a55d0 2023-10-26T06:46:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.108+0000 7f875bfff700 1 -- 172.21.15.50:0/221659662 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f876c005700 con 0x55fa461a55d0 2023-10-26T06:46:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f875bfff700 1 -- 172.21.15.50:0/221659662 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c004e80 con 0x55fa461a55d0 2023-10-26T06:46:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 -- 172.21.15.50:0/221659662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 msgr2=0x55fa4619a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa4619a5d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f876c005950 tx=0x7f876c011900 comp rx=0 tx=0).stop 2023-10-26T06:46:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 -- 172.21.15.50:0/221659662 shutdown_connections 2023-10-26T06:46:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa4619a5d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 --2- 172.21.15.50:0/221659662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 -- 172.21.15.50:0/221659662 >> 172.21.15.50:0/221659662 conn(0x55fa46119720 msgr2=0x55fa461a85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 -- 172.21.15.50:0/221659662 shutdown_connections 2023-10-26T06:46:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.109+0000 7f878ac47b80 1 -- 172.21.15.50:0/221659662 wait complete. 2023-10-26T06:46:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.110+0000 7f878ac47b80 1 -- start start 2023-10-26T06:46:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.110+0000 7f878ac47b80 1 Processor -- start 2023-10-26T06:46:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa461a4760 con 0x55fa461aabe0 2023-10-26T06:46:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa461a48d0 con 0x55fa461a55d0 2023-10-26T06:46:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa461a4a90 con 0x55fa461ab500 2023-10-26T06:46:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f878ac47b80 10 client.0 _ll_register_callbacks cb 0x55fa45fdea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56908/0 (socket says 172.21.15.50:56908) 2023-10-26T06:46:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 -- 172.21.15.50:0/3269982511 learned_addr learned my addr 172.21.15.50:0/3269982511 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877499a700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877599c700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 -- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 msgr2=0x55fa461a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 -- 172.21.15.50:0/3269982511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 msgr2=0x55fa461b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877519b700 1 -- 172.21.15.50:0/3269982511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8760019040 con 0x55fa461a55d0 2023-10-26T06:46:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.111+0000 7f877599c700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f877519b700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b58a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f876c030040 tx=0x7f876c00e830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=888398f2cd51abd server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f8758ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f8758ff9700 1 -- 172.21.15.50:0/3269982511 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c004c60 con 0x55fa461a55d0 2023-10-26T06:46:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa460f0e50 con 0x55fa461a55d0 2023-10-26T06:46:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f8758ff9700 1 -- 172.21.15.50:0/3269982511 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f876c000e40 con 0x55fa461a55d0 2023-10-26T06:46:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f8758ff9700 1 -- 172.21.15.50:0/3269982511 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f876c005700 con 0x55fa461a55d0 2023-10-26T06:46:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f878ac47b80 10 client.26051 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:26.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55fa45f22de0 con 0x55fa461a55d0 2023-10-26T06:46:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.112+0000 7f8758ff9700 1 -- 172.21.15.50:0/3269982511 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa460f0e50 con 0x55fa461a55d0 2023-10-26T06:46:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f8758ff9700 1 -- 172.21.15.50:0/3269982511 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f876c011a20 con 0x55fa461a55d0 2023-10-26T06:46:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f878ac47b80 10 client.26051 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f878ac47b80 10 client.26051 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:46:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f878ac47b80 20 client.26051 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa46213990 0x55fa46215db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f878ac47b80 4 client.26051 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:46:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fa460f0b70 con 0x55fa46213990 2023-10-26T06:46:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f877499a700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa46213990 0x55fa46215db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f877499a700 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa46213990 0x55fa46215db0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ac1bad1fe9b2c74 server_cookie=4eb5d405cc0fb32 in_seq=0 out_seq=0 2023-10-26T06:46:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.113+0000 7f8758ff9700 10 client.26051 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f8758ff9700 1 -- 172.21.15.50:0/3269982511 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa460f0b70 con 0x55fa46213990 2023-10-26T06:46:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f8758ff9700 10 client.26051 handle_command_reply: tid=0 2023-10-26T06:46:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 client.26051 shutdown 2023-10-26T06:46:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 msgr2=0x55fa461b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b58a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f876c030040 tx=0x7f876c00e830 comp rx=0 tx=0).stop 2023-10-26T06:46:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 shutdown_connections 2023-10-26T06:46:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fa461ab500 0x55fa461a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55fa46213990 0x55fa46215db0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55fa461a55d0 0x55fa461b58a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 --2- 172.21.15.50:0/3269982511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa461aabe0 0x55fa461b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f8758ff9700 0 client.26051 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 >> 172.21.15.50:0/3269982511 conn(0x55fa46119720 msgr2=0x55fa461a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 shutdown_connections 2023-10-26T06:46:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 1 -- 172.21.15.50:0/3269982511 wait complete. 2023-10-26T06:46:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.114+0000 7f878ac47b80 20 client.26051 trim_cache size 0 max 16384 2023-10-26T06:46:26.132 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:46:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f875c0a15f0 msgr2=0x7f875c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f875c0a15f0 0x7f875c0a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55fa461a0a70 tx=0x7f87600099b0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 msgr2=0x7f877019c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 0x7f877019c540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f876800b6c0 tx=0x7f8768008fb0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 shutdown_connections 2023-10-26T06:46:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f875c0a15f0 0x7f875c0a3ab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8770106730 0x7f877019c540 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8770100720 0x7f8770198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 --2- 172.21.15.50:0/553267440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87701010e0 0x7f8770199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 >> 172.21.15.50:0/553267440 conn(0x7f87700fc1b0 msgr2=0x7f877010c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 shutdown_connections 2023-10-26T06:46:26.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.115+0000 7f87773ff700 1 -- 172.21.15.50:0/553267440 wait complete. 2023-10-26T06:46:26.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:46:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 -- 172.21.15.50:0/3738484045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0105170 msgr2=0x7fcbf01055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/3738484045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0105170 0x7fcbf01055f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009990 tx=0x7fcbe4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 -- 172.21.15.50:0/3738484045 shutdown_connections 2023-10-26T06:46:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/3738484045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105b30 0x7fcbf010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/3738484045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0067d40 0x7fcbf0068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/3738484045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0105170 0x7fcbf01055f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 -- 172.21.15.50:0/3738484045 >> 172.21.15.50:0/3738484045 conn(0x7fcbf00767f0 msgr2=0x7fcbf0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 -- 172.21.15.50:0/3738484045 shutdown_connections 2023-10-26T06:46:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.364+0000 7fcbf55ff700 1 -- 172.21.15.50:0/3738484045 wait complete. 2023-10-26T06:46:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.365+0000 7fcbf55ff700 1 Processor -- start 2023-10-26T06:46:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.365+0000 7fcbf55ff700 1 -- start start 2023-10-26T06:46:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbf55ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0067d40 0x7fcbf019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbf55ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105170 0x7fcbf019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbf55ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0105b30 0x7fcbf0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbf55ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf01970b0 con 0x7fcbf0105170 2023-10-26T06:46:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbf55ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0197220 con 0x7fcbf0067d40 2023-10-26T06:46:26.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbf55ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf01973e0 con 0x7fcbf0105b30 2023-10-26T06:46:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbee7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105170 0x7fcbf019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0067d40 0x7fcbf019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0067d40 0x7fcbf019c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56926/0 (socket says 172.21.15.50:56926) 2023-10-26T06:46:26.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbeeffd700 1 -- 172.21.15.50:0/592602918 learned_addr learned my addr 172.21.15.50:0/592602918 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0105b30 0x7fcbf0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbee7fc700 1 -- 172.21.15.50:0/592602918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0105b30 msgr2=0x7fcbf0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0105b30 0x7fcbf0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbee7fc700 1 -- 172.21.15.50:0/592602918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0067d40 msgr2=0x7fcbf019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0067d40 0x7fcbf019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbee7fc700 1 -- 172.21.15.50:0/592602918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40095f0 con 0x7fcbf0105170 2023-10-26T06:46:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.366+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0105b30 0x7fcbf0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.367+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105170 0x7fcbf019ce60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4000c00 tx=0x7fcbe4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.367+0000 7fcbd7fff700 1 -- 172.21.15.50:0/592602918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe401d070 con 0x7fcbf0105170 2023-10-26T06:46:26.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.367+0000 7fcbd7fff700 1 -- 172.21.15.50:0/592602918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbe4021410 con 0x7fcbf0105170 2023-10-26T06:46:26.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.367+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf0197660 con 0x7fcbf0105170 2023-10-26T06:46:26.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.367+0000 7fcbd7fff700 1 -- 172.21.15.50:0/592602918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4021ea0 con 0x7fcbf0105170 2023-10-26T06:46:26.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.367+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf01a3910 con 0x7fcbf0105170 2023-10-26T06:46:26.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.370+0000 7fcbd7fff700 1 -- 172.21.15.50:0/592602918 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcbe4021580 con 0x7fcbf0105170 2023-10-26T06:46:26.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 Processor -- start 2023-10-26T06:46:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcbd7fff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcbd80a15f0 0x7fcbd80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcbd7fff700 1 -- 172.21.15.50:0/592602918 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcbe40ce100 con 0x7fcbf0105170 2023-10-26T06:46:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 -- start start 2023-10-26T06:46:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcbd80a15f0 0x7fcbd80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 0x55bb27368090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb273685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb2737cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb272db6e0 con 0x55bb2736bc30 2023-10-26T06:46:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb272c1c60 con 0x55bb27368b10 2023-10-26T06:46:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.372+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb272bf580 con 0x55bb2736c010 2023-10-26T06:46:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 0x55bb27368090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcbd80a15f0 0x7fcbd80a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009440 tx=0x7fcbe800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb2737cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbee7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb273685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb2737cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56942/0 (socket says 172.21.15.50:56942) 2023-10-26T06:46:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 0x55bb27368090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57454/0 (socket says 172.21.15.50:57454) 2023-10-26T06:46:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 -- 172.21.15.50:0/782610643 learned_addr learned my addr 172.21.15.50:0/782610643 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 -- 172.21.15.50:0/782610643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 msgr2=0x55bb273685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb273685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 -- 172.21.15.50:0/782610643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 msgr2=0x55bb27368090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 0x55bb27368090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 -- 172.21.15.50:0/782610643 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb272783f0 con 0x55bb27368b10 2023-10-26T06:46:26.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 0x55bb27368090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:26.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb273685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:26.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.373+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb2737cd00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8015820 tx=0x7fcbe8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bbe2b5e352bfe0e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.374+0000 7fcbd57fa700 1 -- 172.21.15.50:0/782610643 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800e050 con 0x55bb27368b10 2023-10-26T06:46:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.374+0000 7fcbd57fa700 1 -- 172.21.15.50:0/782610643 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbe800f040 con 0x55bb27368b10 2023-10-26T06:46:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.374+0000 7fcbd57fa700 1 -- 172.21.15.50:0/782610643 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8021be0 con 0x55bb27368b10 2023-10-26T06:46:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.374+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/782610643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 msgr2=0x55bb2737cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.374+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb2737cd00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8015820 tx=0x7fcbe8013000 comp rx=0 tx=0).stop 2023-10-26T06:46:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/782610643 shutdown_connections 2023-10-26T06:46:26.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb2737cd00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736bc30 0x55bb27368090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/782610643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb273685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/782610643 >> 172.21.15.50:0/782610643 conn(0x55bb272dc720 msgr2=0x55bb27362b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/782610643 shutdown_connections 2023-10-26T06:46:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/782610643 wait complete. 2023-10-26T06:46:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 -- start start 2023-10-26T06:46:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.375+0000 7fcc08eaeb80 1 Processor -- start 2023-10-26T06:46:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2737cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 0x55bb27379f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb2737a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb272bae70 con 0x55bb27368b10 2023-10-26T06:46:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb27257710 con 0x55bb2736bc30 2023-10-26T06:46:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb272573b0 con 0x55bb2736c010 2023-10-26T06:46:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcc08eaeb80 10 client.0 _ll_register_callbacks cb 0x55bb271a1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2737cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcbee7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 0x55bb27379f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcbee7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 0x55bb27379f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56958/0 (socket says 172.21.15.50:56958) 2023-10-26T06:46:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcbee7fc700 1 -- 172.21.15.50:0/1172668848 learned_addr learned my addr 172.21.15.50:0/1172668848 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.376+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb2737a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1172668848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 msgr2=0x55bb2737a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb2737a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 msgr2=0x55bb27379f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 0x55bb27379f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1172668848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf01a3910 con 0x55bb27368b10 2023-10-26T06:46:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 0x55bb27379f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2737cca0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00127f0 tx=0x7fcbe0012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c881529822a90618 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbd2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:46:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1172668848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0017070 con 0x55bb27368b10 2023-10-26T06:46:26.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb272bfef0 con 0x55bb27368b10 2023-10-26T06:46:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1172668848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcbe0004830 con 0x55bb27368b10 2023-10-26T06:46:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1172668848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbe00049f0 con 0x55bb27368b10 2023-10-26T06:46:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.377+0000 7fcc08eaeb80 10 client.16026 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:26.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fcbe80154a0 con 0x55bb27368b10 2023-10-26T06:46:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1172668848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bb272bfef0 con 0x55bb27368b10 2023-10-26T06:46:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1172668848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcbe0024050 con 0x55bb27368b10 2023-10-26T06:46:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 10 client.16026 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:26.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 20 client.16026 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:26.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb2738a750 0x55bb2738cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 4 client.16026 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:26.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb273378b0 con 0x55bb2738a750 2023-10-26T06:46:26.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.378+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb2738a750 0x55bb2738cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.379+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb2738a750 0x55bb2738cb70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b45f1028c8e4ca0 server_cookie=9c78e0eb960c3444 in_seq=0 out_seq=0 2023-10-26T06:46:26.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.379+0000 7fcbd2ff5700 10 client.16026 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1172668848 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bb273378b0 con 0x55bb2738a750 2023-10-26T06:46:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcbd2ff5700 10 client.16026 handle_command_reply: tid=0 2023-10-26T06:46:26.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 client.16026 shutdown 2023-10-26T06:46:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 msgr2=0x55bb2737cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2737cca0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00127f0 tx=0x7fcbe0012b00 comp rx=0 tx=0).stop 2023-10-26T06:46:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 shutdown_connections 2023-10-26T06:46:26.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb2738a750 0x55bb2738cb70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736c010 0x55bb2737a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2737cca0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcbd2ff5700 0 client.16026 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1172668848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736bc30 0x55bb27379f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 >> 172.21.15.50:0/1172668848 conn(0x55bb272dc720 msgr2=0x55bb27365070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 shutdown_connections 2023-10-26T06:46:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.381+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1172668848 wait complete. 2023-10-26T06:46:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.382+0000 7fcc08eaeb80 20 client.16026 trim_cache size 0 max 16384 2023-10-26T06:46:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 Processor -- start 2023-10-26T06:46:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 -- start start 2023-10-26T06:46:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2735d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb273816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736c010 0x55bb273752b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb2713b920 con 0x55bb27368b10 2023-10-26T06:46:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb27364810 con 0x55bb2736c010 2023-10-26T06:46:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.397+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb2737af10 con 0x55bb2736bc30 2023-10-26T06:46:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2735d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736c010 0x55bb273752b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2735d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57478/0 (socket says 172.21.15.50:57478) 2023-10-26T06:46:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbeeffd700 1 -- 172.21.15.50:0/354474880 learned_addr learned my addr 172.21.15.50:0/354474880 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb273816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 -- 172.21.15.50:0/354474880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 msgr2=0x55bb273816b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb273816b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 -- 172.21.15.50:0/354474880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 msgr2=0x55bb2735d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2735d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 -- 172.21.15.50:0/354474880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb270e5de0 con 0x55bb2736c010 2023-10-26T06:46:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.398+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736c010 0x55bb273752b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b010 tx=0x7fcbe80217e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3604c99810cadf server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcbd5ffb700 1 -- 172.21.15.50:0/354474880 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800e040 con 0x55bb2736c010 2023-10-26T06:46:26.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcbd5ffb700 1 -- 172.21.15.50:0/354474880 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbe80098a0 con 0x55bb2736c010 2023-10-26T06:46:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcbd5ffb700 1 -- 172.21.15.50:0/354474880 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8016860 con 0x55bb2736c010 2023-10-26T06:46:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/354474880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736c010 msgr2=0x55bb273752b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736c010 0x55bb273752b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b010 tx=0x7fcbe80217e0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/354474880 shutdown_connections 2023-10-26T06:46:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb2736c010 0x55bb273752b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb27368b10 0x55bb2735d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/354474880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb273816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/354474880 >> 172.21.15.50:0/354474880 conn(0x55bb272dc720 msgr2=0x55bb27362810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.399+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/354474880 shutdown_connections 2023-10-26T06:46:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.400+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/354474880 wait complete. 2023-10-26T06:46:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.400+0000 7fcc08eaeb80 1 -- start start 2023-10-26T06:46:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.400+0000 7fcc08eaeb80 1 Processor -- start 2023-10-26T06:46:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.400+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb273812c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.400+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb27381800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcc08eaeb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736c010 0x55bb2737f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb2737ff30 con 0x55bb2736c010 2023-10-26T06:46:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb273800a0 con 0x55bb27368b10 2023-10-26T06:46:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcc08eaeb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb27380260 con 0x55bb2736bc30 2023-10-26T06:46:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcc08eaeb80 10 client.0 _ll_register_callbacks cb 0x55bb271a1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb273812c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736c010 0x55bb2737f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb273812c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56988/0 (socket says 172.21.15.50:56988) 2023-10-26T06:46:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1290180688 learned_addr learned my addr 172.21.15.50:0/1290180688 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb27381800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1290180688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 msgr2=0x55bb27381800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb27381800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1290180688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736c010 msgr2=0x55bb2737f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736c010 0x55bb2737f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbeeffd700 1 -- 172.21.15.50:0/1290180688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb272783f0 con 0x55bb27368b10 2023-10-26T06:46:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbef7fe700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736c010 0x55bb2737f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.401+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb27381800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcbeeffd700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb273812c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0012540 tx=0x7fcbe0009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e93e451dc961d469 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcbd2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1290180688 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0017040 con 0x55bb27368b10 2023-10-26T06:46:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1290180688 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcbe002a050 con 0x55bb27368b10 2023-10-26T06:46:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbe800f040 con 0x55bb27368b10 2023-10-26T06:46:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1290180688 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbe000f8f0 con 0x55bb27368b10 2023-10-26T06:46:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcc08eaeb80 10 client.26069 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55bb270cec60 con 0x55bb27368b10 2023-10-26T06:46:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.402+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1290180688 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbe003c020 con 0x55bb27368b10 2023-10-26T06:46:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1290180688 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcbe0036020 con 0x55bb27368b10 2023-10-26T06:46:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcc08eaeb80 10 client.26069 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcc08eaeb80 10 client.26069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcc08eaeb80 20 client.26069 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb273df900 0x55bb273e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcc08eaeb80 4 client.26069 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:46:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bb272b3e50 con 0x55bb273df900 2023-10-26T06:46:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb273df900 0x55bb273e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcbd2ff5700 10 client.26069 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.403+0000 7fcbee7fc700 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb273df900 0x55bb273e1cf0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c88dde649555e7 server_cookie=2b0745d428d65ab7 in_seq=0 out_seq=0 2023-10-26T06:46:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcbd2ff5700 1 -- 172.21.15.50:0/1290180688 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bb272b3e50 con 0x55bb273df900 2023-10-26T06:46:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcbd2ff5700 10 client.26069 handle_command_reply: tid=0 2023-10-26T06:46:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 client.26069 shutdown 2023-10-26T06:46:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 msgr2=0x55bb273812c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb273812c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0012540 tx=0x7fcbe0009790 comp rx=0 tx=0).stop 2023-10-26T06:46:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 shutdown_connections 2023-10-26T06:46:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55bb273df900 0x55bb273e1cf0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bb2736c010 0x55bb2737f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55bb27368b10 0x55bb273812c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 --2- 172.21.15.50:0/1290180688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bb2736bc30 0x55bb27381800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcbd2ff5700 0 client.26069 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 >> 172.21.15.50:0/1290180688 conn(0x55bb272dc720 msgr2=0x55bb273752b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 shutdown_connections 2023-10-26T06:46:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 1 -- 172.21.15.50:0/1290180688 wait complete. 2023-10-26T06:46:26.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.407+0000 7fcc08eaeb80 20 client.26069 trim_cache size 0 max 16384 2023-10-26T06:46:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:46:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcbd80a15f0 msgr2=0x7fcbd80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcbd80a15f0 0x7fcbd80a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009440 tx=0x7fcbe800b040 comp rx=0 tx=0).stop 2023-10-26T06:46:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105170 msgr2=0x7fcbf019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:26.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105170 0x7fcbf019ce60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4000c00 tx=0x7fcbe4004730 comp rx=0 tx=0).stop 2023-10-26T06:46:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 shutdown_connections 2023-10-26T06:46:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcbd80a15f0 0x7fcbd80a3ab0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbf0105b30 0x7fcbf0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcbf0067d40 0x7fcbf019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 --2- 172.21.15.50:0/592602918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf0105170 0x7fcbf019ce60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 >> 172.21.15.50:0/592602918 conn(0x7fcbf00767f0 msgr2=0x7fcbf00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 shutdown_connections 2023-10-26T06:46:26.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:26.408+0000 7fcbf55ff700 1 -- 172.21.15.50:0/592602918 wait complete. 2023-10-26T06:46:26.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:26 smithi050 ceph-mon[94997]: pgmap v402: 97 pgs: 97 active+clean; 586 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 77 op/s 2023-10-26T06:46:26.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:26 smithi125 ceph-mon[130643]: pgmap v402: 97 pgs: 97 active+clean; 586 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 77 op/s 2023-10-26T06:46:26.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:26 smithi153 ceph-mon[131657]: pgmap v402: 97 pgs: 97 active+clean; 586 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 77 op/s 2023-10-26T06:46:27.429 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:46:27.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:46:27.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 -- 172.21.15.50:0/1961927301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac106730 msgr2=0x7f7dac106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 --2- 172.21.15.50:0/1961927301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac106730 0x7f7dac106b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009990 tx=0x7f7d9c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 -- 172.21.15.50:0/1961927301 shutdown_connections 2023-10-26T06:46:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 --2- 172.21.15.50:0/1961927301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dac1010e0 0x7f7dac10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 --2- 172.21.15.50:0/1961927301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac106730 0x7f7dac106b10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 --2- 172.21.15.50:0/1961927301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac100720 0x7f7dac100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 -- 172.21.15.50:0/1961927301 >> 172.21.15.50:0/1961927301 conn(0x7f7dac0fc1b0 msgr2=0x7f7dac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 -- 172.21.15.50:0/1961927301 shutdown_connections 2023-10-26T06:46:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.648+0000 7f7db13ff700 1 -- 172.21.15.50:0/1961927301 wait complete. 2023-10-26T06:46:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 Processor -- start 2023-10-26T06:46:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 -- start start 2023-10-26T06:46:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 0x7f7dac19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dac1010e0 0x7f7dac19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac106730 0x7f7dac198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac1991f0 con 0x7f7dac106730 2023-10-26T06:46:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac199360 con 0x7f7dac100720 2023-10-26T06:46:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.649+0000 7f7db13ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac199520 con 0x7f7dac1010e0 2023-10-26T06:46:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 0x7f7dac19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 0x7f7dac19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:57010/0 (socket says 172.21.15.50:57010) 2023-10-26T06:46:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 -- 172.21.15.50:0/3949831712 learned_addr learned my addr 172.21.15.50:0/3949831712 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:27.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac106730 0x7f7dac198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dac1010e0 0x7f7dac19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 -- 172.21.15.50:0/3949831712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dac1010e0 msgr2=0x7f7dac19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dac1010e0 0x7f7dac19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 -- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac106730 msgr2=0x7f7dac198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac106730 0x7f7dac198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 -- 172.21.15.50:0/3949831712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009520 con 0x7f7dac100720 2023-10-26T06:46:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 0x7f7dac19ea60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c000c00 tx=0x7f7d9c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.650+0000 7f7d93fff700 1 -- 172.21.15.50:0/3949831712 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c01d070 con 0x7f7dac100720 2023-10-26T06:46:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.651+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c0095f0 con 0x7f7dac100720 2023-10-26T06:46:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.651+0000 7f7d93fff700 1 -- 172.21.15.50:0/3949831712 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d9c022470 con 0x7f7dac100720 2023-10-26T06:46:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.651+0000 7f7d93fff700 1 -- 172.21.15.50:0/3949831712 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c017650 con 0x7f7dac100720 2023-10-26T06:46:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.651+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac1a5870 con 0x7f7dac100720 2023-10-26T06:46:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.654+0000 7f7d93fff700 1 -- 172.21.15.50:0/3949831712 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7d9c0225e0 con 0x7f7dac100720 2023-10-26T06:46:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.655+0000 7f7dc4c54b80 1 Processor -- start 2023-10-26T06:46:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 -- start start 2023-10-26T06:46:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e97040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e91ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31e04760 con 0x55ab31e91650 2023-10-26T06:46:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31deace0 con 0x55ab31e97580 2023-10-26T06:46:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31de8600 con 0x55ab31e96c60 2023-10-26T06:46:27.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7d93fff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7d940a15f0 0x7f7d940a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.656+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7d93fff700 1 -- 172.21.15.50:0/3949831712 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7d9c0ce200 con 0x7f7dac100720 2023-10-26T06:46:27.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e91110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:57020/0 (socket says 172.21.15.50:57020) 2023-10-26T06:46:27.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 -- 172.21.15.50:0/1522735406 learned_addr learned my addr 172.21.15.50:0/1522735406 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:27.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e97040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e91ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7d940a15f0 0x7f7d940a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 -- 172.21.15.50:0/1522735406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 msgr2=0x55ab31e97040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e97040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 -- 172.21.15.50:0/1522735406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 msgr2=0x55ab31e91ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e91ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 -- 172.21.15.50:0/1522735406 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab31da1470 con 0x55ab31e97580 2023-10-26T06:46:27.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7daaffd700 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e91110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c022890 tx=0x7f7d9c090a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8aa31bc78a85f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:27.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7d917fa700 1 -- 172.21.15.50:0/1522735406 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c09b9c0 con 0x55ab31e97580 2023-10-26T06:46:27.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.657+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7d940a15f0 0x7f7d940a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009ec0 tx=0x7f7da400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7d917fa700 1 -- 172.21.15.50:0/1522735406 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d9c09f410 con 0x55ab31e97580 2023-10-26T06:46:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7d917fa700 1 -- 172.21.15.50:0/1522735406 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c015300 con 0x55ab31e97580 2023-10-26T06:46:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/1522735406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 msgr2=0x55ab31e91110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e91110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c022890 tx=0x7f7d9c090a30 comp rx=0 tx=0).stop 2023-10-26T06:46:27.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/1522735406 shutdown_connections 2023-10-26T06:46:27.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e91ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e97040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/1522735406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e91110 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/1522735406 >> 172.21.15.50:0/1522735406 conn(0x55ab31e057a0 msgr2=0x55ab31e8bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:27.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/1522735406 shutdown_connections 2023-10-26T06:46:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.658+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/1522735406 wait complete. 2023-10-26T06:46:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.659+0000 7f7dc4c54b80 1 -- start start 2023-10-26T06:46:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.659+0000 7f7dc4c54b80 1 Processor -- start 2023-10-26T06:46:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e9d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e9a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e9ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31de3ef0 con 0x55ab31e91650 2023-10-26T06:46:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31d80790 con 0x55ab31e97580 2023-10-26T06:46:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31d80430 con 0x55ab31e96c60 2023-10-26T06:46:27.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dc4c54b80 10 client.0 _ll_register_callbacks cb 0x55ab31ccab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:27.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e9a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dab7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e9ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e9a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34636/0 (socket says 172.21.15.50:34636) 2023-10-26T06:46:27.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 -- 172.21.15.50:0/3199622271 learned_addr learned my addr 172.21.15.50:0/3199622271 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:27.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e9d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 -- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 msgr2=0x55ab31e9ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e9ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 -- 172.21.15.50:0/3199622271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 msgr2=0x55ab31e9d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e9d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7daa7fc700 1 -- 172.21.15.50:0/3199622271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac1a5870 con 0x55ab31e96c60 2023-10-26T06:46:27.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.660+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e9ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e9a740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009f50 tx=0x7f7da000e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ada34a3e4033ef38 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7d8eff5700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:46:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3199622271 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0004250 con 0x55ab31e96c60 2023-10-26T06:46:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab31de8f70 con 0x55ab31e96c60 2023-10-26T06:46:27.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3199622271 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7da00043b0 con 0x55ab31e96c60 2023-10-26T06:46:27.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3199622271 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7da0004570 con 0x55ab31e96c60 2023-10-26T06:46:27.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7dc4c54b80 10 client.26089 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:27.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.661+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ab31c0ee60 con 0x55ab31e96c60 2023-10-26T06:46:27.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3199622271 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab31de8f70 con 0x55ab31e96c60 2023-10-26T06:46:27.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3199622271 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7da002a020 con 0x55ab31e96c60 2023-10-26T06:46:27.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7dc4c54b80 10 client.26089 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:27.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7dc4c54b80 10 client.26089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:27.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7dc4c54b80 20 client.26089 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:27.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31eaabb0 0x55ab31eacfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7dc4c54b80 4 client.26089 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:27.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab31e60930 con 0x55ab31eaabb0 2023-10-26T06:46:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.662+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31eaabb0 0x55ab31eacfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.663+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31eaabb0 0x55ab31eacfd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b86437c29583700d server_cookie=87db8069182b3040 in_seq=0 out_seq=0 2023-10-26T06:46:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.663+0000 7f7d8eff5700 10 client.26089 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.665+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3199622271 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ab31e60930 con 0x55ab31eaabb0 2023-10-26T06:46:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.665+0000 7f7d8eff5700 10 client.26089 handle_command_reply: tid=0 2023-10-26T06:46:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.665+0000 7f7dc4c54b80 1 client.26089 shutdown 2023-10-26T06:46:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 msgr2=0x55ab31e9a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e9a740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009f50 tx=0x7f7da000e690 comp rx=0 tx=0).stop 2023-10-26T06:46:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 shutdown_connections 2023-10-26T06:46:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31eaabb0 0x55ab31eacfd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e97580 0x55ab31e9ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e91650 0x55ab31e9d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3199622271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e96c60 0x55ab31e9a740 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 >> 172.21.15.50:0/3199622271 conn(0x55ab31e057a0 msgr2=0x55ab31e8bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7d8eff5700 0 client.26089 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 shutdown_connections 2023-10-26T06:46:27.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3199622271 wait complete. 2023-10-26T06:46:27.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.666+0000 7f7dc4c54b80 20 client.26089 trim_cache size 0 max 16384 2023-10-26T06:46:27.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.683+0000 7f7dc4c54b80 1 Processor -- start 2023-10-26T06:46:27.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.683+0000 7f7dc4c54b80 1 -- start start 2023-10-26T06:46:27.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31ea6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31e93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31e8c1b0 con 0x55ab31e96c60 2023-10-26T06:46:27.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31c649a0 con 0x55ab31e91650 2023-10-26T06:46:27.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31e97040 con 0x55ab31e97580 2023-10-26T06:46:27.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7daa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31ea6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31e93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e91110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:57028/0 (socket says 172.21.15.50:57028) 2023-10-26T06:46:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7daaffd700 1 -- 172.21.15.50:0/913337036 learned_addr learned my addr 172.21.15.50:0/913337036 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:27.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.684+0000 7f7dab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31e93730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34642/0 (socket says 172.21.15.50:34642) 2023-10-26T06:46:27.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7dab7fe700 1 -- 172.21.15.50:0/913337036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 msgr2=0x55ab31e91110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e91110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7dab7fe700 1 -- 172.21.15.50:0/913337036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 msgr2=0x55ab31ea6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31ea6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7dab7fe700 1 -- 172.21.15.50:0/913337036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab31bf7ce0 con 0x55ab31e97580 2023-10-26T06:46:27.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7daaffd700 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e91110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:27.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31ea6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:27.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31e93730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7da40184f0 tx=0x7f7da4009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c82c4a1286bda15 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:27.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7d91ffb700 1 -- 172.21.15.50:0/913337036 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4028070 con 0x55ab31e97580 2023-10-26T06:46:27.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7d91ffb700 1 -- 172.21.15.50:0/913337036 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7da400f040 con 0x55ab31e97580 2023-10-26T06:46:27.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.685+0000 7f7d91ffb700 1 -- 172.21.15.50:0/913337036 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400e070 con 0x55ab31e97580 2023-10-26T06:46:27.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/913337036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 msgr2=0x55ab31e93730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:27.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31e93730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7da40184f0 tx=0x7f7da4009920 comp rx=0 tx=0).stop 2023-10-26T06:46:27.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/913337036 shutdown_connections 2023-10-26T06:46:27.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31e93730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e91110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/913337036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31ea6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/913337036 >> 172.21.15.50:0/913337036 conn(0x55ab31e057a0 msgr2=0x55ab31ea6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/913337036 shutdown_connections 2023-10-26T06:46:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/913337036 wait complete. 2023-10-26T06:46:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.686+0000 7f7dc4c54b80 1 -- start start 2023-10-26T06:46:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 Processor -- start 2023-10-26T06:46:27.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e93540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31e93a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31ef89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31ef8f20 con 0x55ab31e96c60 2023-10-26T06:46:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31ef9090 con 0x55ab31e91650 2023-10-26T06:46:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab31ef9250 con 0x55ab31e97580 2023-10-26T06:46:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7dc4c54b80 10 client.0 _ll_register_callbacks cb 0x55ab31ccab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e93540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e93540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:57036/0 (socket says 172.21.15.50:57036) 2023-10-26T06:46:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7daaffd700 1 -- 172.21.15.50:0/3920885808 learned_addr learned my addr 172.21.15.50:0/3920885808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.687+0000 7f7daa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31e93a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7dab7fe700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31ef89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daaffd700 1 -- 172.21.15.50:0/3920885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 msgr2=0x55ab31ef89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31ef89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daaffd700 1 -- 172.21.15.50:0/3920885808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 msgr2=0x55ab31e93a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31e93a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:27.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daaffd700 1 -- 172.21.15.50:0/3920885808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab31da1470 con 0x55ab31e91650 2023-10-26T06:46:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31e93a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7daaffd700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e93540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c09afc0 tx=0x7f7d9c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6253244cf79dd41 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.688+0000 7f7d8eff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3920885808 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c09b2c0 con 0x55ab31e91650 2023-10-26T06:46:27.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3920885808 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7d9c0228e0 con 0x55ab31e91650 2023-10-26T06:46:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d9c09f410 con 0x55ab31e91650 2023-10-26T06:46:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3920885808 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d9c022aa0 con 0x55ab31e91650 2023-10-26T06:46:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 10 client.26087 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ab31c0ee60 con 0x55ab31e91650 2023-10-26T06:46:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3920885808 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d9c09f410 con 0x55ab31e91650 2023-10-26T06:46:27.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3920885808 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d9c09a8d0 con 0x55ab31e91650 2023-10-26T06:46:27.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 10 client.26087 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:27.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 10 client.26087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:27.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 20 client.26087 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:27.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31f007f0 0x55ab31f02c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:27.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 4 client.26087 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:46:27.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.689+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ab31ddced0 con 0x55ab31f007f0 2023-10-26T06:46:27.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.690+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31f007f0 0x55ab31f02c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:27.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.690+0000 7f7daa7fc700 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31f007f0 0x55ab31f02c10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d34e70a7b855f1cd server_cookie=478fd58f49dd3856 in_seq=0 out_seq=0 2023-10-26T06:46:27.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:27.690+0000 7f7d8eff5700 10 client.26087 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7d8eff5700 1 -- 172.21.15.50:0/3920885808 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ab31ddced0 con 0x55ab31f007f0 2023-10-26T06:46:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7d8eff5700 10 client.26087 handle_command_reply: tid=0 2023-10-26T06:46:28.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 client.26087 shutdown 2023-10-26T06:46:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 msgr2=0x55ab31e93540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e93540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c09afc0 tx=0x7f7d9c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 shutdown_connections 2023-10-26T06:46:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55ab31f007f0 0x55ab31f02c10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab31e97580 0x55ab31ef89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ab31e91650 0x55ab31e93540 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7d8eff5700 0 client.26087 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 --2- 172.21.15.50:0/3920885808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab31e96c60 0x55ab31e93a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.144+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 >> 172.21.15.50:0/3920885808 conn(0x55ab31e057a0 msgr2=0x55ab31e85530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.145+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 shutdown_connections 2023-10-26T06:46:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.145+0000 7f7dc4c54b80 1 -- 172.21.15.50:0/3920885808 wait complete. 2023-10-26T06:46:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.145+0000 7f7dc4c54b80 20 client.26087 trim_cache size 0 max 16384 2023-10-26T06:46:28.150 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:46:28.150 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:46:28.150 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "a01b9d73-a791-40f3-9a70-9e0919a2099d", 2023-10-26T06:46:28.150 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:46:28.150 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:46:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7d940a15f0 msgr2=0x7f7d940a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7d940a15f0 0x7f7d940a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009ec0 tx=0x7f7da400b040 comp rx=0 tx=0).stop 2023-10-26T06:46:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 msgr2=0x7f7dac19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 0x7f7dac19ea60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c000c00 tx=0x7f7d9c004730 comp rx=0 tx=0).stop 2023-10-26T06:46:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 shutdown_connections 2023-10-26T06:46:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7d940a15f0 0x7f7d940a3ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dac106730 0x7f7dac198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7dac100720 0x7f7dac19ea60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 --2- 172.21.15.50:0/3949831712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7dac1010e0 0x7f7dac19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.146+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 >> 172.21.15.50:0/3949831712 conn(0x7f7dac0fc1b0 msgr2=0x7f7dac10be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.147+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 shutdown_connections 2023-10-26T06:46:28.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.147+0000 7f7db13ff700 1 -- 172.21.15.50:0/3949831712 wait complete. 2023-10-26T06:46:28.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:46:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 -- 172.21.15.50:0/304583408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 msgr2=0x7f7b8c072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 --2- 172.21.15.50:0/304583408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c072f80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009990 tx=0x7f7b7c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 -- 172.21.15.50:0/304583408 shutdown_connections 2023-10-26T06:46:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 --2- 172.21.15.50:0/304583408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 0x7f7b8c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 --2- 172.21.15.50:0/304583408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c072f80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 --2- 172.21.15.50:0/304583408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b8c0734c0 0x7f7b8c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 -- 172.21.15.50:0/304583408 >> 172.21.15.50:0/304583408 conn(0x7f7b8c0fc200 msgr2=0x7f7b8c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 -- 172.21.15.50:0/304583408 shutdown_connections 2023-10-26T06:46:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.402+0000 7f7b925ff700 1 -- 172.21.15.50:0/304583408 wait complete. 2023-10-26T06:46:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.403+0000 7f7b925ff700 1 Processor -- start 2023-10-26T06:46:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.403+0000 7f7b925ff700 1 -- start start 2023-10-26T06:46:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b925ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b925ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b8c0734c0 0x7f7b8c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b925ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 0x7f7b8c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b925ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c19dcc0 con 0x7f7b8c10cff0 2023-10-26T06:46:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b925ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c19de30 con 0x7f7b8c0734c0 2023-10-26T06:46:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b925ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c19dff0 con 0x7f7b8c072ba0 2023-10-26T06:46:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b8c0734c0 0x7f7b8c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34676/0 (socket says 172.21.15.50:34676) 2023-10-26T06:46:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b8bfff700 1 -- 172.21.15.50:0/3347125473 learned_addr learned my addr 172.21.15.50:0/3347125473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.404+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 0x7f7b8c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b8bfff700 1 -- 172.21.15.50:0/3347125473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b8c0734c0 msgr2=0x7f7b8c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b8c0734c0 0x7f7b8c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b8bfff700 1 -- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 msgr2=0x7f7b8c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 0x7f7b8c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b8bfff700 1 -- 172.21.15.50:0/3347125473 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0095f0 con 0x7f7b8c072ba0 2023-10-26T06:46:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 0x7f7b8c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.405+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c198df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0095c0 tx=0x7f7b7c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.406+0000 7f7b897fa700 1 -- 172.21.15.50:0/3347125473 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c01d070 con 0x7f7b8c072ba0 2023-10-26T06:46:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.406+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c19e270 con 0x7f7b8c072ba0 2023-10-26T06:46:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.406+0000 7f7b897fa700 1 -- 172.21.15.50:0/3347125473 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b7c005030 con 0x7f7b8c072ba0 2023-10-26T06:46:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.406+0000 7f7b897fa700 1 -- 172.21.15.50:0/3347125473 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004a90 con 0x7f7b8c072ba0 2023-10-26T06:46:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.406+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c1a5b10 con 0x7f7b8c072ba0 2023-10-26T06:46:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.410+0000 7f7b897fa700 1 -- 172.21.15.50:0/3347125473 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7b7c005410 con 0x7f7b8c072ba0 2023-10-26T06:46:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.411+0000 7f7ba5f94b80 1 Processor -- start 2023-10-26T06:46:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.411+0000 7f7b897fa700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b740a15f0 0x7f7b740a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 -- start start 2023-10-26T06:46:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b897fa700 1 -- 172.21.15.50:0/3347125473 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7b7c0cde40 con 0x7f7b8c072ba0 2023-10-26T06:46:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b740a15f0 0x7f7b740a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f6ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 0x560547f6a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f6a5d0 0x560547f6aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547edd6e0 con 0x560547f6fbe0 2023-10-26T06:46:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547ec3c60 con 0x560547f6a5d0 2023-10-26T06:46:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547ec1580 con 0x560547f70500 2023-10-26T06:46:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 0x560547f6a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f6ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b90b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f6a5d0 0x560547f6aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 0x560547f6a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34680/0 (socket says 172.21.15.50:34680) 2023-10-26T06:46:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b8b7fe700 1 -- 172.21.15.50:0/2408746687 learned_addr learned my addr 172.21.15.50:0/2408746687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.412+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f6ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57592/0 (socket says 172.21.15.50:57592) 2023-10-26T06:46:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b740a15f0 0x7f7b740a3ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007610 tx=0x7f7b84009100 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2408746687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 msgr2=0x560547f6a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 0x560547f6a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2408746687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f6a5d0 msgr2=0x560547f6aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f6a5d0 0x560547f6aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2408746687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560547e7a3f0 con 0x560547f6fbe0 2023-10-26T06:46:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 0x560547f6a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f6a5d0 0x560547f6aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f6ffc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0cb5e0 tx=0x7f7b7c09ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4947c96dead4d590 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b727fc700 1 -- 172.21.15.50:0/2408746687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c09f050 con 0x560547f6fbe0 2023-10-26T06:46:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b727fc700 1 -- 172.21.15.50:0/2408746687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b7c0a3200 con 0x560547f6fbe0 2023-10-26T06:46:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.413+0000 7f7b727fc700 1 -- 172.21.15.50:0/2408746687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c09b3a0 con 0x560547f6fbe0 2023-10-26T06:46:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2408746687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 msgr2=0x560547f6ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f6ffc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0cb5e0 tx=0x7f7b7c09ab50 comp rx=0 tx=0).stop 2023-10-26T06:46:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2408746687 shutdown_connections 2023-10-26T06:46:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f6a5d0 0x560547f6aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f6ffc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2408746687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f70500 0x560547f6a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.414+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2408746687 >> 172.21.15.50:0/2408746687 conn(0x560547ede720 msgr2=0x560547f64b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.415+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2408746687 shutdown_connections 2023-10-26T06:46:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.415+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2408746687 wait complete. 2023-10-26T06:46:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.415+0000 7f7ba5f94b80 1 -- start start 2023-10-26T06:46:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.415+0000 7f7ba5f94b80 1 Processor -- start 2023-10-26T06:46:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f764e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f73760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f73ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547ebce70 con 0x560547f6fbe0 2023-10-26T06:46:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547e59710 con 0x560547f70500 2023-10-26T06:46:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547e593b0 con 0x560547f6a5d0 2023-10-26T06:46:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7ba5f94b80 10 client.0 _ll_register_callbacks cb 0x560547da3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:28.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7b90b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f73ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7b90b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f73ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:57070/0 (socket says 172.21.15.50:57070) 2023-10-26T06:46:28.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7b8b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f73760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.416+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2111452999 learned_addr learned my addr 172.21.15.50:0/2111452999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:28.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2111452999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 msgr2=0x560547f764e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f764e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2111452999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 msgr2=0x560547f73760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f73760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2111452999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8000b960 con 0x560547f70500 2023-10-26T06:46:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f73ea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b84017bf0 tx=0x7f7b84004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d56e9d6f4e573e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.417+0000 7f7b6b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:28.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2111452999 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84015c40 con 0x560547f70500 2023-10-26T06:46:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560547ec1ef0 con 0x560547f70500 2023-10-26T06:46:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2111452999 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7b84015da0 con 0x560547f70500 2023-10-26T06:46:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2111452999 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b84003a00 con 0x560547f70500 2023-10-26T06:46:28.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7ba5f94b80 10 client.26099 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f7b8c1a5b10 con 0x560547f70500 2023-10-26T06:46:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2111452999 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560547ec1ef0 con 0x560547f70500 2023-10-26T06:46:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.418+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2111452999 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7b84022460 con 0x560547f70500 2023-10-26T06:46:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7ba5f94b80 10 client.26099 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:28.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7ba5f94b80 10 client.26099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7ba5f94b80 20 client.26099 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547f83ca0 0x560547f860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7ba5f94b80 4 client.26099 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560547f398b0 con 0x560547f83ca0 2023-10-26T06:46:28.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.419+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547f83ca0 0x560547f860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.420+0000 7f7b6b7fe700 10 client.26099 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:28.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.420+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547f83ca0 0x560547f860c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89fbfa62d3f9210d server_cookie=4d230459b75a6417 in_seq=0 out_seq=0 2023-10-26T06:46:28.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2111452999 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560547f398b0 con 0x560547f83ca0 2023-10-26T06:46:28.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7b6b7fe700 10 client.26099 handle_command_reply: tid=0 2023-10-26T06:46:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 client.26099 shutdown 2023-10-26T06:46:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 msgr2=0x560547f73ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f73ea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b84017bf0 tx=0x7f7b84004b40 comp rx=0 tx=0).stop 2023-10-26T06:46:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 shutdown_connections 2023-10-26T06:46:28.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547f83ca0 0x560547f860c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f73ea0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f764e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2111452999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7b6b7fe700 0 client.26099 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:28.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.427+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 >> 172.21.15.50:0/2111452999 conn(0x560547ede720 msgr2=0x560547f69080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.428+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 shutdown_connections 2023-10-26T06:46:28.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.428+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2111452999 wait complete. 2023-10-26T06:46:28.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.428+0000 7f7ba5f94b80 20 client.26099 trim_cache size 0 max 16384 2023-10-26T06:46:28.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.450+0000 7f7ba5f94b80 1 Processor -- start 2023-10-26T06:46:28.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.450+0000 7f7ba5f94b80 1 -- start start 2023-10-26T06:46:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f76010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f72ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547d3d920 con 0x560547f6fbe0 2023-10-26T06:46:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547ec1ef0 con 0x560547f70500 2023-10-26T06:46:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547f5d060 con 0x560547f6a5d0 2023-10-26T06:46:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7b90b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f72ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7b90b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f72ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:57074/0 (socket says 172.21.15.50:57074) 2023-10-26T06:46:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.451+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2882456082 learned_addr learned my addr 172.21.15.50:0/2882456082 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f76010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2882456082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 msgr2=0x560547f7ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2882456082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 msgr2=0x560547f76010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f76010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b90b9c700 1 -- 172.21.15.50:0/2882456082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560547ce7de0 con 0x560547f70500 2023-10-26T06:46:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.452+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f72ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009550 tx=0x7f7b840095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a15fe36d371b373a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:28.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.453+0000 7f7b72ffd700 1 -- 172.21.15.50:0/2882456082 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840229e0 con 0x560547f70500 2023-10-26T06:46:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.453+0000 7f7b72ffd700 1 -- 172.21.15.50:0/2882456082 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b8400f040 con 0x560547f70500 2023-10-26T06:46:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.453+0000 7f7b72ffd700 1 -- 172.21.15.50:0/2882456082 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840042a0 con 0x560547f70500 2023-10-26T06:46:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.453+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2882456082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 msgr2=0x560547f72ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.453+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f72ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009550 tx=0x7f7b840095e0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2882456082 shutdown_connections 2023-10-26T06:46:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f72ff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2882456082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f76010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2882456082 >> 172.21.15.50:0/2882456082 conn(0x560547ede720 msgr2=0x560547f72030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2882456082 shutdown_connections 2023-10-26T06:46:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2882456082 wait complete. 2023-10-26T06:46:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 -- start start 2023-10-26T06:46:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.454+0000 7f7ba5f94b80 1 Processor -- start 2023-10-26T06:46:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f799e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547f7a0f0 con 0x560547f6fbe0 2023-10-26T06:46:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547fd7aa0 con 0x560547f70500 2023-10-26T06:46:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560547fd7be0 con 0x560547f6a5d0 2023-10-26T06:46:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7ba5f94b80 10 client.0 _ll_register_callbacks cb 0x560547da3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7b8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:34718/0 (socket says 172.21.15.50:34718) 2023-10-26T06:46:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.455+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2092011152 learned_addr learned my addr 172.21.15.50:0/2092011152 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b90b9c700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f799e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 msgr2=0x560547f799e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f799e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2092011152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 msgr2=0x560547f792f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f792f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8bfff700 1 -- 172.21.15.50:0/2092011152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560547e7a3f0 con 0x560547f6a5d0 2023-10-26T06:46:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:28.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b8bfff700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ae00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c028000 tx=0x7f7b7c09b080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b078b639c8271cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:28.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.456+0000 7f7b6b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:46:28.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.457+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2092011152 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c09b600 con 0x560547f6a5d0 2023-10-26T06:46:28.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.457+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2092011152 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7b7c09f050 con 0x560547f6a5d0 2023-10-26T06:46:28.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.457+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b7c0a3200 con 0x560547f6a5d0 2023-10-26T06:46:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.457+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2092011152 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b7c00fad0 con 0x560547f6a5d0 2023-10-26T06:46:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.457+0000 7f7ba5f94b80 10 client.26113 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.457+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f7b8c1a5b10 con 0x560547f6a5d0 2023-10-26T06:46:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2092011152 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b7c0a3200 con 0x560547f6a5d0 2023-10-26T06:46:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2092011152 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7b7c09b160 con 0x560547f6a5d0 2023-10-26T06:46:28.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7ba5f94b80 10 client.26113 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7ba5f94b80 10 client.26113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7ba5f94b80 20 client.26113 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547fd8ff0 0x560547fdb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7ba5f94b80 4 client.26113 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:46:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560547eb5e50 con 0x560547fd8ff0 2023-10-26T06:46:28.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.458+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547fd8ff0 0x560547fdb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:28.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.459+0000 7f7b8b7fe700 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547fd8ff0 0x560547fdb410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eee184aa7417600 server_cookie=60ebdb34b58058 in_seq=0 out_seq=0 2023-10-26T06:46:28.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.459+0000 7f7b6b7fe700 10 client.26113 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:28.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7b6b7fe700 1 -- 172.21.15.50:0/2092011152 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x560547eb5e50 con 0x560547fd8ff0 2023-10-26T06:46:28.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7b6b7fe700 10 client.26113 handle_command_reply: tid=0 2023-10-26T06:46:28.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 client.26113 shutdown 2023-10-26T06:46:28.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 msgr2=0x560547f7ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ae00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c028000 tx=0x7f7b7c09b080 comp rx=0 tx=0).stop 2023-10-26T06:46:28.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 shutdown_connections 2023-10-26T06:46:28.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x560547fd8ff0 0x560547fdb410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560547f70500 0x560547f799e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560547f6a5d0 0x560547f7ae00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 --2- 172.21.15.50:0/2092011152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560547f6fbe0 0x560547f792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7b6b7fe700 0 client.26113 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 >> 172.21.15.50:0/2092011152 conn(0x560547ede720 msgr2=0x560547f6d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 shutdown_connections 2023-10-26T06:46:28.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 1 -- 172.21.15.50:0/2092011152 wait complete. 2023-10-26T06:46:28.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.462+0000 7f7ba5f94b80 20 client.26113 trim_cache size 0 max 16384 2023-10-26T06:46:28.473 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:46:28.473 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (3316 inodes in the stack)", 2023-10-26T06:46:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:46:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "a01b9d73-a791-40f3-9a70-9e0919a2099d": { 2023-10-26T06:46:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:46:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "a01b9d73-a791-40f3-9a70-9e0919a2099d", 2023-10-26T06:46:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:46:28.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:46:28.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:46:28.475 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:46:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b740a15f0 msgr2=0x7f7b740a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b740a15f0 0x7f7b740a3ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007610 tx=0x7f7b84009100 comp rx=0 tx=0).stop 2023-10-26T06:46:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 msgr2=0x7f7b8c198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c198df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0095c0 tx=0x7f7b7c00f690 comp rx=0 tx=0).stop 2023-10-26T06:46:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 shutdown_connections 2023-10-26T06:46:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f7b740a15f0 0x7f7b740a3ab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b8c10cff0 0x7f7b8c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b8c072ba0 0x7f7b8c198df0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 --2- 172.21.15.50:0/3347125473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7b8c0734c0 0x7f7b8c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 >> 172.21.15.50:0/3347125473 conn(0x7f7b8c0fc200 msgr2=0x7f7b8c0fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 shutdown_connections 2023-10-26T06:46:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:28.463+0000 7f7b925ff700 1 -- 172.21.15.50:0/3347125473 wait complete. 2023-10-26T06:46:28.489 INFO:tasks.cephfs.filesystem:scrub status for tag:a01b9d73-a791-40f3-9a70-9e0919a2099d - {'path': '/', 'tag': 'a01b9d73-a791-40f3-9a70-9e0919a2099d', 'options': 'recursive,force'} 2023-10-26T06:46:28.765 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:28 smithi050 ceph-mon[94997]: pgmap v403: 97 pgs: 97 active+clean; 631 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 122 op/s 2023-10-26T06:46:29.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:28 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:46:29.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:28 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:29.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:28 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:29.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:28 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:29.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:28 smithi125 ceph-mon[130643]: pgmap v403: 97 pgs: 97 active+clean; 631 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 122 op/s 2023-10-26T06:46:29.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:28 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:46:29.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:28 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:29.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:28 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:29.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:28 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:29.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:28 smithi153 ceph-mon[131657]: pgmap v403: 97 pgs: 97 active+clean; 631 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 122 op/s 2023-10-26T06:46:29.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:28 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:46:29.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:28 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:29.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:28 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:29.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:28 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:29 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:30.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:29 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:30.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:29 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:30 smithi125 ceph-mon[130643]: pgmap v404: 97 pgs: 97 active+clean; 686 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 174 op/s 2023-10-26T06:46:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:30 smithi153 ceph-mon[131657]: pgmap v404: 97 pgs: 97 active+clean; 686 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 174 op/s 2023-10-26T06:46:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:30 smithi050 ceph-mon[94997]: pgmap v404: 97 pgs: 97 active+clean; 686 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 174 op/s 2023-10-26T06:46:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:32 smithi125 ceph-mon[130643]: pgmap v405: 97 pgs: 97 active+clean; 777 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 19 MiB/s wr, 496 op/s 2023-10-26T06:46:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:32 smithi153 ceph-mon[131657]: pgmap v405: 97 pgs: 97 active+clean; 777 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 19 MiB/s wr, 496 op/s 2023-10-26T06:46:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:32 smithi050 ceph-mon[94997]: pgmap v405: 97 pgs: 97 active+clean; 777 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 19 MiB/s wr, 496 op/s 2023-10-26T06:46:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:33 smithi153 ceph-mon[131657]: pgmap v406: 97 pgs: 97 active+clean; 912 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 30 MiB/s wr, 1.01k op/s 2023-10-26T06:46:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:33 smithi050 ceph-mon[94997]: pgmap v406: 97 pgs: 97 active+clean; 912 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 30 MiB/s wr, 1.01k op/s 2023-10-26T06:46:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:33 smithi125 ceph-mon[130643]: pgmap v406: 97 pgs: 97 active+clean; 912 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 30 MiB/s wr, 1.01k op/s 2023-10-26T06:46:35.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:35 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:35.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:35 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:35.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:35 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:36.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:36 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:36.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:36 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:36 smithi125 ceph-mon[130643]: pgmap v407: 97 pgs: 97 active+clean; 966 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 34 MiB/s wr, 1.22k op/s 2023-10-26T06:46:36.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:36 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:36.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:36 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:36.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:36 smithi153 ceph-mon[131657]: pgmap v407: 97 pgs: 97 active+clean; 966 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 34 MiB/s wr, 1.22k op/s 2023-10-26T06:46:36.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:36 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:36.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:36 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:36.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:36 smithi050 ceph-mon[94997]: pgmap v407: 97 pgs: 97 active+clean; 966 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 34 MiB/s wr, 1.22k op/s 2023-10-26T06:46:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:37 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:37 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:38.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:37 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:38 smithi125 ceph-mon[130643]: pgmap v408: 97 pgs: 97 active+clean; 981 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 34 MiB/s wr, 1.23k op/s 2023-10-26T06:46:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:38 smithi153 ceph-mon[131657]: pgmap v408: 97 pgs: 97 active+clean; 981 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 34 MiB/s wr, 1.23k op/s 2023-10-26T06:46:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:38 smithi050 ceph-mon[94997]: pgmap v408: 97 pgs: 97 active+clean; 981 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 34 MiB/s wr, 1.23k op/s 2023-10-26T06:46:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:40.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:40.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:40.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:40.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:40 smithi125 ceph-mon[130643]: pgmap v409: 97 pgs: 97 active+clean; 991 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 31 MiB/s wr, 1.20k op/s 2023-10-26T06:46:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:40 smithi153 ceph-mon[131657]: pgmap v409: 97 pgs: 97 active+clean; 991 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 31 MiB/s wr, 1.20k op/s 2023-10-26T06:46:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:40 smithi050 ceph-mon[94997]: pgmap v409: 97 pgs: 97 active+clean; 991 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 31 MiB/s wr, 1.20k op/s 2023-10-26T06:46:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:42 smithi125 ceph-mon[130643]: pgmap v410: 97 pgs: 97 active+clean; 991 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 26 MiB/s wr, 1.15k op/s 2023-10-26T06:46:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:42 smithi153 ceph-mon[131657]: pgmap v410: 97 pgs: 97 active+clean; 991 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 26 MiB/s wr, 1.15k op/s 2023-10-26T06:46:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:42 smithi050 ceph-mon[94997]: pgmap v410: 97 pgs: 97 active+clean; 991 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 26 MiB/s wr, 1.15k op/s 2023-10-26T06:46:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:43 smithi153 ceph-mon[131657]: pgmap v411: 97 pgs: 97 active+clean; 996 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 820 op/s 2023-10-26T06:46:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:43 smithi050 ceph-mon[94997]: pgmap v411: 97 pgs: 97 active+clean; 996 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 820 op/s 2023-10-26T06:46:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:43 smithi125 ceph-mon[130643]: pgmap v411: 97 pgs: 97 active+clean; 996 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 19 MiB/s wr, 820 op/s 2023-10-26T06:46:45.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:45.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:45.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:45.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:46:45.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:44 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:45.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:45.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:45.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:46:45.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:44 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:45.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:45.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:45.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:46:45.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:45.426 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:44 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:46.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:45 smithi153 ceph-mon[131657]: pgmap v412: 97 pgs: 97 active+clean; 1001 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.6 MiB/s wr, 311 op/s 2023-10-26T06:46:46.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:45 smithi050 ceph-mon[94997]: pgmap v412: 97 pgs: 97 active+clean; 1001 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.6 MiB/s wr, 311 op/s 2023-10-26T06:46:46.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:45 smithi125 ceph-mon[130643]: pgmap v412: 97 pgs: 97 active+clean; 1001 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.6 MiB/s wr, 311 op/s 2023-10-26T06:46:49.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:48 smithi050 ceph-mon[94997]: pgmap v413: 97 pgs: 97 active+clean; 1023 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.9 MiB/s wr, 154 op/s 2023-10-26T06:46:49.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:48 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:46:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:48 smithi125 ceph-mon[130643]: pgmap v413: 97 pgs: 97 active+clean; 1023 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.9 MiB/s wr, 154 op/s 2023-10-26T06:46:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:48 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:46:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:48 smithi153 ceph-mon[131657]: pgmap v413: 97 pgs: 97 active+clean; 1023 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.9 MiB/s wr, 154 op/s 2023-10-26T06:46:49.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:48 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:46:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:49 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:46:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:49 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:46:50.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:49 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:46:50.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:49 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:46:50.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:49 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:46:50.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:49 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:46:50.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:49 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:46:50.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:49 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:46:50.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:49 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:46:51.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:50 smithi125 ceph-mon[130643]: pgmap v414: 97 pgs: 97 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 217 op/s 2023-10-26T06:46:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:50 smithi153 ceph-mon[131657]: pgmap v414: 97 pgs: 97 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 217 op/s 2023-10-26T06:46:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:50 smithi050 ceph-mon[94997]: pgmap v414: 97 pgs: 97 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 217 op/s 2023-10-26T06:46:52.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:51 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:52.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:51 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:52.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:51 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:46:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:52 smithi125 ceph-mon[130643]: pgmap v415: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 244 op/s 2023-10-26T06:46:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:52 smithi153 ceph-mon[131657]: pgmap v415: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 244 op/s 2023-10-26T06:46:53.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:52 smithi050 ceph-mon[94997]: pgmap v415: 97 pgs: 97 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 244 op/s 2023-10-26T06:46:54.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:53 smithi153 ceph-mon[131657]: pgmap v416: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 622 op/s 2023-10-26T06:46:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:53 smithi050 ceph-mon[94997]: pgmap v416: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 622 op/s 2023-10-26T06:46:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:53 smithi125 ceph-mon[130643]: pgmap v416: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 622 op/s 2023-10-26T06:46:55.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:54 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:46:55.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:54 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:46:55.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:54 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:46:55.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:54 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:46:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:54 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:46:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:54 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:46:56.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:55 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:46:56.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:55 smithi153 ceph-mon[131657]: pgmap v417: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 15 MiB/s wr, 815 op/s 2023-10-26T06:46:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:55 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:46:56.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:55 smithi050 ceph-mon[94997]: pgmap v417: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 15 MiB/s wr, 815 op/s 2023-10-26T06:46:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:55 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:46:56.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:55 smithi125 ceph-mon[130643]: pgmap v417: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 15 MiB/s wr, 815 op/s 2023-10-26T06:46:58.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:46:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 -- 172.21.15.50:0/1710646712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 msgr2=0x7f5b14072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/1710646712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b14072f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009990 tx=0x7f5b04009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 -- 172.21.15.50:0/1710646712 shutdown_connections 2023-10-26T06:46:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/1710646712 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 0x7f5b141139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/1710646712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b14072f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/1710646712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b14111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 -- 172.21.15.50:0/1710646712 >> 172.21.15.50:0/1710646712 conn(0x7f5b140fc0c0 msgr2=0x7f5b140fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 -- 172.21.15.50:0/1710646712 shutdown_connections 2023-10-26T06:46:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.751+0000 7f5b18f9d700 1 -- 172.21.15.50:0/1710646712 wait complete. 2023-10-26T06:46:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 Processor -- start 2023-10-26T06:46:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 -- start start 2023-10-26T06:46:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b1419d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b1419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 0x7f5b141a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b141a1fd0 con 0x7f5b14072b90 2023-10-26T06:46:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b141a2140 con 0x7f5b141115c0 2023-10-26T06:46:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.753+0000 7f5b18f9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b141a2300 con 0x7f5b140734b0 2023-10-26T06:46:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b1419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b1419d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57182/0 (socket says 172.21.15.50:57182) 2023-10-26T06:46:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b1419d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 -- 172.21.15.50:0/3540243584 learned_addr learned my addr 172.21.15.50:0/3540243584 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:58.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b13fff700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 0x7f5b141a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 -- 172.21.15.50:0/3540243584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 msgr2=0x7f5b141a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 0x7f5b141a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 -- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 msgr2=0x7f5b1419d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b1419d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b0affd700 1 -- 172.21.15.50:0/3540243584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040095f0 con 0x7f5b140734b0 2023-10-26T06:46:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b137fe700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b1419d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.754+0000 7f5b13fff700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 0x7f5b141a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:58.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.755+0000 7f5b0affd700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b1419d5f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00e9a0 tx=0x7f5afc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.755+0000 7f5b117fa700 1 -- 172.21.15.50:0/3540243584 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc009790 con 0x7f5b140734b0 2023-10-26T06:46:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.755+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b141a25e0 con 0x7f5b140734b0 2023-10-26T06:46:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.755+0000 7f5b117fa700 1 -- 172.21.15.50:0/3540243584 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5afc00cbd0 con 0x7f5b140734b0 2023-10-26T06:46:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.755+0000 7f5b117fa700 1 -- 172.21.15.50:0/3540243584 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc018680 con 0x7f5b140734b0 2023-10-26T06:46:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.755+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b141a9e20 con 0x7f5b140734b0 2023-10-26T06:46:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.758+0000 7f5b117fa700 1 -- 172.21.15.50:0/3540243584 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5afc00cd40 con 0x7f5b140734b0 2023-10-26T06:46:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.760+0000 7f5b117fa700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b000a15f0 0x7f5b000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.760+0000 7f5b117fa700 1 -- 172.21.15.50:0/3540243584 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5afc014070 con 0x7f5b140734b0 2023-10-26T06:46:58.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.760+0000 7f5b137fe700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b000a15f0 0x7f5b000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 Processor -- start 2023-10-26T06:46:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 -- start start 2023-10-26T06:46:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b137fe700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b000a15f0 0x7f5b000a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b04006010 tx=0x7f5b0400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:58.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e976140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e9702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e970c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e8e36e0 con 0x55f81e975d60 2023-10-26T06:46:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e8c9c60 con 0x55f81e976680 2023-10-26T06:46:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.761+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e8c7580 con 0x55f81e970820 2023-10-26T06:46:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e976140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e9702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e976140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52652/0 (socket says 172.21.15.50:52652) 2023-10-26T06:46:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e9702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:33998/0 (socket says 172.21.15.50:33998) 2023-10-26T06:46:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b137fe700 1 -- 172.21.15.50:0/2335164015 learned_addr learned my addr 172.21.15.50:0/2335164015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:58.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b13fff700 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e970c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 -- 172.21.15.50:0/2335164015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 msgr2=0x55f81e970c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e970c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 -- 172.21.15.50:0/2335164015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 msgr2=0x55f81e976140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e976140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 -- 172.21.15.50:0/2335164015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f81e8803f0 con 0x55f81e976680 2023-10-26T06:46:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b137fe700 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e976140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.762+0000 7f5b0affd700 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e9702e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0cab00 tx=0x7f5afc099cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c03f9aac1eb6a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.763+0000 7f5b09ffb700 1 -- 172.21.15.50:0/2335164015 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc09e4e0 con 0x55f81e976680 2023-10-26T06:46:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.763+0000 7f5b09ffb700 1 -- 172.21.15.50:0/2335164015 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5afc0a2720 con 0x55f81e976680 2023-10-26T06:46:58.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.763+0000 7f5b09ffb700 1 -- 172.21.15.50:0/2335164015 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc099ae0 con 0x55f81e976680 2023-10-26T06:46:58.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.763+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2335164015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 msgr2=0x55f81e9702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.763+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e9702e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0cab00 tx=0x7f5afc099cf0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2335164015 shutdown_connections 2023-10-26T06:46:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e970c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e976140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2335164015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e9702e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2335164015 >> 172.21.15.50:0/2335164015 conn(0x55f81e8e4720 msgr2=0x55f81e96acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2335164015 shutdown_connections 2023-10-26T06:46:58.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2335164015 wait complete. 2023-10-26T06:46:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 -- start start 2023-10-26T06:46:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.764+0000 7f5b2dc05b80 1 Processor -- start 2023-10-26T06:46:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.765+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e97c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.765+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e979a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.765+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e97c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e97c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57196/0 (socket says 172.21.15.50:57196) 2023-10-26T06:46:58.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e979a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e979a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52662/0 (socket says 172.21.15.50:52662) 2023-10-26T06:46:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e97a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e8c2e70 con 0x55f81e975d60 2023-10-26T06:46:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b137fe700 1 -- 172.21.15.50:0/2955515572 learned_addr learned my addr 172.21.15.50:0/2955515572 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b13fff700 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e97a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e85f710 con 0x55f81e976680 2023-10-26T06:46:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.766+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e85f3b0 con 0x55f81e970820 2023-10-26T06:46:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b2dc05b80 10 client.0 _ll_register_callbacks cb 0x55f81e7a9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b13fff700 1 -- 172.21.15.50:0/2955515572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 msgr2=0x55f81e97c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b13fff700 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e97c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b13fff700 1 -- 172.21.15.50:0/2955515572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 msgr2=0x55f81e979a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b13fff700 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e979a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b13fff700 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b14114360 con 0x55f81e976680 2023-10-26T06:46:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b13fff700 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e97a080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0079c0 tx=0x7f5b0c0079f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22aeae8b69d03c0d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5af2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5af2ffd700 1 -- 172.21.15.50:0/2955515572 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00e030 con 0x55f81e976680 2023-10-26T06:46:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.767+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f81e8c7ef0 con 0x55f81e976680 2023-10-26T06:46:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5af2ffd700 1 -- 172.21.15.50:0/2955515572 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5b0c003c00 con 0x55f81e976680 2023-10-26T06:46:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5af2ffd700 1 -- 172.21.15.50:0/2955515572 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b0c003e00 con 0x55f81e976680 2023-10-26T06:46:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 10 client.26117 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f5b141a9e20 con 0x55f81e976680 2023-10-26T06:46:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5af2ffd700 1 -- 172.21.15.50:0/2955515572 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f81e8c7ef0 con 0x55f81e976680 2023-10-26T06:46:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5af2ffd700 1 -- 172.21.15.50:0/2955515572 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b0c004390 con 0x55f81e976680 2023-10-26T06:46:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 10 client.26117 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 10 client.26117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 20 client.26117 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e989ff0 0x55f81e98c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 4 client.26117 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:58.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.768+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f81e93f8b0 con 0x55f81e989ff0 2023-10-26T06:46:58.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.769+0000 7f5b137fe700 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e989ff0 0x55f81e98c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.769+0000 7f5b137fe700 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e989ff0 0x55f81e98c410 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4511aa02811bb9ab server_cookie=dad12301456153e0 in_seq=0 out_seq=0 2023-10-26T06:46:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.769+0000 7f5af2ffd700 10 client.26117 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5af2ffd700 1 -- 172.21.15.50:0/2955515572 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f81e93f8b0 con 0x55f81e989ff0 2023-10-26T06:46:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5af2ffd700 10 client.26117 handle_command_reply: tid=0 2023-10-26T06:46:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 client.26117 shutdown 2023-10-26T06:46:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 msgr2=0x55f81e97a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e97a080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0079c0 tx=0x7f5b0c0079f0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 shutdown_connections 2023-10-26T06:46:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e989ff0 0x55f81e98c410 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e976680 0x55f81e97a080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e970820 0x55f81e97c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5af2ffd700 0 client.26117 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/2955515572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e979a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 >> 172.21.15.50:0/2955515572 conn(0x55f81e8e4720 msgr2=0x55f81e96f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 shutdown_connections 2023-10-26T06:46:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/2955515572 wait complete. 2023-10-26T06:46:58.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.770+0000 7f5b2dc05b80 20 client.26117 trim_cache size 0 max 16384 2023-10-26T06:46:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.787+0000 7f5b2dc05b80 1 Processor -- start 2023-10-26T06:46:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 -- start start 2023-10-26T06:46:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 0x55f81e981060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e975d60 0x55f81e96c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e979a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e743920 con 0x55f81e970820 2023-10-26T06:46:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e9815a0 con 0x55f81e975d60 2023-10-26T06:46:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e97a960 con 0x55f81e976680 2023-10-26T06:46:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 0x55f81e981060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 0x55f81e981060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52666/0 (socket says 172.21.15.50:52666) 2023-10-26T06:46:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b137fe700 1 -- 172.21.15.50:0/3172788349 learned_addr learned my addr 172.21.15.50:0/3172788349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e979a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.788+0000 7f5b0affd700 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e975d60 0x55f81e96c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b137fe700 1 -- 172.21.15.50:0/3172788349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 msgr2=0x55f81e979a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b137fe700 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e979a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b137fe700 1 -- 172.21.15.50:0/3172788349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e975d60 msgr2=0x55f81e96c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b137fe700 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e975d60 0x55f81e96c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b137fe700 1 -- 172.21.15.50:0/3172788349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f81e6edde0 con 0x55f81e970820 2023-10-26T06:46:58.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b0affd700 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e975d60 0x55f81e96c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b137fe700 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 0x55f81e981060 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55f81e98ccf0 tx=0x7f5b04023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6ace2f92629b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b0a7fc700 1 -- 172.21.15.50:0/3172788349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0402d050 con 0x55f81e970820 2023-10-26T06:46:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b0a7fc700 1 -- 172.21.15.50:0/3172788349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b0402e040 con 0x55f81e970820 2023-10-26T06:46:58.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.789+0000 7f5b0a7fc700 1 -- 172.21.15.50:0/3172788349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400f460 con 0x55f81e970820 2023-10-26T06:46:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/3172788349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 msgr2=0x55f81e981060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 0x55f81e981060 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55f81e98ccf0 tx=0x7f5b04023000 comp rx=0 tx=0).stop 2023-10-26T06:46:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/3172788349 shutdown_connections 2023-10-26T06:46:58.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e979a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e970820 0x55f81e981060 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/3172788349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e975d60 0x55f81e96c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/3172788349 >> 172.21.15.50:0/3172788349 conn(0x55f81e8e4720 msgr2=0x55f81e96fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:58.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/3172788349 shutdown_connections 2023-10-26T06:46:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.790+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/3172788349 wait complete. 2023-10-26T06:46:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 -- start start 2023-10-26T06:46:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 Processor -- start 2023-10-26T06:46:58.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 0x55f81e981040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e97f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e97fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e980280 con 0x55f81e975d60 2023-10-26T06:46:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e9dde30 con 0x55f81e970820 2023-10-26T06:46:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81e9ddf70 con 0x55f81e976680 2023-10-26T06:46:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.791+0000 7f5b2dc05b80 10 client.0 _ll_register_callbacks cb 0x55f81e7a9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 0x55f81e981040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 0x55f81e981040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34030/0 (socket says 172.21.15.50:34030) 2023-10-26T06:46:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 -- 172.21.15.50:0/423141405 learned_addr learned my addr 172.21.15.50:0/423141405 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b13fff700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e97fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b0affd700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e97f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 -- 172.21.15.50:0/423141405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 msgr2=0x55f81e97fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e97fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 -- 172.21.15.50:0/423141405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 msgr2=0x55f81e97f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e97f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 -- 172.21.15.50:0/423141405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f81e8803f0 con 0x55f81e970820 2023-10-26T06:46:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b137fe700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 0x55f81e981040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b04037040 tx=0x7f5b040057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4533c5197efd9ce server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5af2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:46:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5af2ffd700 1 -- 172.21.15.50:0/423141405 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04034980 con 0x55f81e970820 2023-10-26T06:46:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5afc0a2720 con 0x55f81e970820 2023-10-26T06:46:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.792+0000 7f5af2ffd700 1 -- 172.21.15.50:0/423141405 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5b04029070 con 0x55f81e970820 2023-10-26T06:46:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5af2ffd700 1 -- 172.21.15.50:0/423141405 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b0402d020 con 0x55f81e970820 2023-10-26T06:46:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 10 client.26123 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f5b040051a0 con 0x55f81e970820 2023-10-26T06:46:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5af2ffd700 1 -- 172.21.15.50:0/423141405 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b0404b080 con 0x55f81e970820 2023-10-26T06:46:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5af2ffd700 1 -- 172.21.15.50:0/423141405 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b04045030 con 0x55f81e970820 2023-10-26T06:46:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 10 client.26123 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:58.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:46:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 20 client.26123 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e9df370 0x55f81e9e1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 4 client.26123 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:46:58.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f81e8bbe50 con 0x55f81e9df370 2023-10-26T06:46:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.793+0000 7f5b0affd700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e9df370 0x55f81e9e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.794+0000 7f5b0affd700 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e9df370 0x55f81e9e1790 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=659e18bf465e94b0 server_cookie=ddcb673db2a405eb in_seq=0 out_seq=0 2023-10-26T06:46:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.794+0000 7f5af2ffd700 10 client.26123 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5af2ffd700 1 -- 172.21.15.50:0/423141405 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f81e8bbe50 con 0x55f81e9df370 2023-10-26T06:46:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5af2ffd700 10 client.26123 handle_command_reply: tid=0 2023-10-26T06:46:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 client.26123 shutdown 2023-10-26T06:46:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 msgr2=0x55f81e981040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 0x55f81e981040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b04037040 tx=0x7f5b040057b0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 shutdown_connections 2023-10-26T06:46:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f81e9df370 0x55f81e9e1790 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f81e976680 0x55f81e97fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f81e970820 0x55f81e981040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5af2ffd700 0 client.26123 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:46:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 --2- 172.21.15.50:0/423141405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f81e975d60 0x55f81e97f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 >> 172.21.15.50:0/423141405 conn(0x55f81e8e4720 msgr2=0x55f81e96c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 shutdown_connections 2023-10-26T06:46:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 1 -- 172.21.15.50:0/423141405 wait complete. 2023-10-26T06:46:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.843+0000 7f5b2dc05b80 20 client.26123 trim_cache size 0 max 16384 2023-10-26T06:46:58.848 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:46:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:46:58.849 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:46:58.849 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:46:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b000a15f0 msgr2=0x7f5b000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b000a15f0 0x7f5b000a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b04006010 tx=0x7f5b0400b260 comp rx=0 tx=0).stop 2023-10-26T06:46:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 msgr2=0x7f5b1419d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b1419d5f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00e9a0 tx=0x7f5afc00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 shutdown_connections 2023-10-26T06:46:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b000a15f0 0x7f5b000a3ab0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b141115c0 0x7f5b141a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b14072b90 0x7f5b1419d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 --2- 172.21.15.50:0/3540243584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b140734b0 0x7f5b1419d5f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 >> 172.21.15.50:0/3540243584 conn(0x7f5b140fc0c0 msgr2=0x7f5b140fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 shutdown_connections 2023-10-26T06:46:58.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:58.844+0000 7f5b18f9d700 1 -- 172.21.15.50:0/3540243584 wait complete. 2023-10-26T06:46:58.861 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:58 smithi050 ceph-mon[94997]: pgmap v418: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-10-26T06:46:58.864 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:46:58.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:46:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 -- 172.21.15.50:0/3510630485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 msgr2=0x7f6470106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 --2- 172.21.15.50:0/3510630485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 0x7f6470106a90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f646c009990 tx=0x7f646c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 -- 172.21.15.50:0/3510630485 shutdown_connections 2023-10-26T06:46:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 --2- 172.21.15.50:0/3510630485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6470101060 0x7f647010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 --2- 172.21.15.50:0/3510630485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 0x7f6470106a90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 --2- 172.21.15.50:0/3510630485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64701006a0 0x7f6470100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 -- 172.21.15.50:0/3510630485 >> 172.21.15.50:0/3510630485 conn(0x7f64700fc170 msgr2=0x7f64700fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.084+0000 7f64775ff700 1 -- 172.21.15.50:0/3510630485 shutdown_connections 2023-10-26T06:46:59.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.085+0000 7f64775ff700 1 -- 172.21.15.50:0/3510630485 wait complete. 2023-10-26T06:46:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.087+0000 7f64775ff700 1 Processor -- start 2023-10-26T06:46:59.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 -- start start 2023-10-26T06:46:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64701006a0 0x7f6470072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 0x7f6470073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 0x7f6470073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701a4ed0 con 0x7f64701006a0 2023-10-26T06:46:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701a5040 con 0x7f6470101060 2023-10-26T06:46:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f64775ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701a5200 con 0x7f64701066b0 2023-10-26T06:46:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f647539b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64701006a0 0x7f6470072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f6474b9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 0x7f6470073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f6475b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 0x7f6470073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f6474b9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 0x7f6470073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34058/0 (socket says 172.21.15.50:34058) 2023-10-26T06:46:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.088+0000 7f6474b9a700 1 -- 172.21.15.50:0/461537443 learned_addr learned my addr 172.21.15.50:0/461537443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f6474b9a700 1 -- 172.21.15.50:0/461537443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 msgr2=0x7f6470073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f6474b9a700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 0x7f6470073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f6474b9a700 1 -- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64701006a0 msgr2=0x7f6470072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f6474b9a700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64701006a0 0x7f6470072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f6474b9a700 1 -- 172.21.15.50:0/461537443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468009c40 con 0x7f6470101060 2023-10-26T06:46:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f6474b9a700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 0x7f6470073030 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f646000e9a0 tx=0x7f646000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460009790 con 0x7f6470101060 2023-10-26T06:46:59.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.089+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c0095f0 con 0x7f6470101060 2023-10-26T06:46:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.090+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f646000ce80 con 0x7f6470101060 2023-10-26T06:46:59.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.090+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460018680 con 0x7f6470101060 2023-10-26T06:46:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.090+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64701a58b0 con 0x7f6470101060 2023-10-26T06:46:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.091+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470108c30 con 0x7f6470101060 2023-10-26T06:46:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.093+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6460010430 con 0x7f6470101060 2023-10-26T06:46:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.094+0000 7f64667fc700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f645c0a1670 0x7f645c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.094+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6460014070 con 0x7f6470101060 2023-10-26T06:46:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.094+0000 7f647539b700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f645c0a1670 0x7f645c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.095+0000 7f647539b700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f645c0a1670 0x7f645c0a3b30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f646c000c00 tx=0x7f646c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.100+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f64600966e0 con 0x7f6470101060 2023-10-26T06:46:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:58 smithi125 ceph-mon[130643]: pgmap v418: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-10-26T06:46:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:58 smithi153 ceph-mon[131657]: pgmap v418: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-10-26T06:46:59.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.363+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6470101de0 con 0x7f6470101060 2023-10-26T06:46:59.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.364+0000 7f64667fc700 1 -- 172.21.15.50:0/461537443 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11324 (secure 0 0 0) 0x7f6460099d00 con 0x7f6470101060 2023-10-26T06:46:59.365 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:46:59.366 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:45:14.436234+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:46:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f645c0a1670 msgr2=0x7f645c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f645c0a1670 0x7f645c0a3b30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f646c000c00 tx=0x7f646c00b260 comp rx=0 tx=0).stop 2023-10-26T06:46:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 msgr2=0x7f6470073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 0x7f6470073030 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f646000e9a0 tx=0x7f646000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 shutdown_connections 2023-10-26T06:46:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f645c0a1670 0x7f645c0a3b30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64701066b0 0x7f6470073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64701006a0 0x7f6470072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 --2- 172.21.15.50:0/461537443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6470101060 0x7f6470073030 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.366+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 >> 172.21.15.50:0/461537443 conn(0x7f64700fc170 msgr2=0x7f64700fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.367+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 shutdown_connections 2023-10-26T06:46:59.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.367+0000 7f64775ff700 1 -- 172.21.15.50:0/461537443 wait complete. 2023-10-26T06:46:59.371 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-10-26T06:46:59.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:46:59.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 -- 172.21.15.50:0/1335507008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc100720 msgr2=0x7f61cc100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 --2- 172.21.15.50:0/1335507008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc100720 0x7f61cc100ba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098f0 tx=0x7f61b4009c00 comp rx=0 tx=0).stop 2023-10-26T06:46:59.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 -- 172.21.15.50:0/1335507008 shutdown_connections 2023-10-26T06:46:59.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 --2- 172.21.15.50:0/1335507008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc1010e0 0x7f61cc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 --2- 172.21.15.50:0/1335507008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc106730 0x7f61cc106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 --2- 172.21.15.50:0/1335507008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc100720 0x7f61cc100ba0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 -- 172.21.15.50:0/1335507008 >> 172.21.15.50:0/1335507008 conn(0x7f61cc0fc1b0 msgr2=0x7f61cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 -- 172.21.15.50:0/1335507008 shutdown_connections 2023-10-26T06:46:59.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.612+0000 7f61d15ff700 1 -- 172.21.15.50:0/1335507008 wait complete. 2023-10-26T06:46:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.613+0000 7f61d15ff700 1 Processor -- start 2023-10-26T06:46:59.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 -- start start 2023-10-26T06:46:59.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc100720 0x7f61cc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 0x7f61cc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 0x7f61cc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a4f90 con 0x7f61cc100720 2023-10-26T06:46:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a5100 con 0x7f61cc106730 2023-10-26T06:46:59.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61d15ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a52c0 con 0x7f61cc1010e0 2023-10-26T06:46:59.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 0x7f61cc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61ca7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 0x7f61cc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61caffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc100720 0x7f61cc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 0x7f61cc073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34068/0 (socket says 172.21.15.50:34068) 2023-10-26T06:46:59.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61ca7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 0x7f61cc073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57244/0 (socket says 172.21.15.50:57244) 2023-10-26T06:46:59.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.614+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2830296478 learned_addr learned my addr 172.21.15.50:0/2830296478 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2830296478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 msgr2=0x7f61cc073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 0x7f61cc073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc100720 msgr2=0x7f61cc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc100720 0x7f61cc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2830296478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc009d00 con 0x7f61cc106730 2023-10-26T06:46:59.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 0x7f61cc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61caffd700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc100720 0x7f61cc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 0x7f61cc073570 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e940 tx=0x7f61c400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61c3fff700 1 -- 172.21.15.50:0/2830296478 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40097b0 con 0x7f61cc106730 2023-10-26T06:46:59.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61c3fff700 1 -- 172.21.15.50:0/2830296478 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61c4005020 con 0x7f61cc106730 2023-10-26T06:46:59.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b4009520 con 0x7f61cc106730 2023-10-26T06:46:59.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61c3fff700 1 -- 172.21.15.50:0/2830296478 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400cc40 con 0x7f61cc106730 2023-10-26T06:46:59.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.615+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc1a58f0 con 0x7f61cc106730 2023-10-26T06:46:59.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.618+0000 7f61c3fff700 1 -- 172.21.15.50:0/2830296478 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f61c4005400 con 0x7f61cc106730 2023-10-26T06:46:59.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 Processor -- start 2023-10-26T06:46:59.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 -- start start 2023-10-26T06:46:59.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61c3fff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f61b80a1740 0x7f61b80a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 0x5653f995dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995e500 0x5653f9958090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f9958a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61c3fff700 1 -- 172.21.15.50:0/2830296478 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f61c4014070 con 0x7f61cc106730 2023-10-26T06:46:59.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f98cb6e0 con 0x5653f995dbe0 2023-10-26T06:46:59.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f98b1c60 con 0x5653f995e500 2023-10-26T06:46:59.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.620+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f98af580 con 0x5653f99585d0 2023-10-26T06:46:59.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 0x5653f995dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f61b80a1740 0x7f61b80a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 0x5653f995dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52722/0 (socket says 172.21.15.50:52722) 2023-10-26T06:46:59.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 -- 172.21.15.50:0/2438933829 learned_addr learned my addr 172.21.15.50:0/2438933829 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995e500 0x5653f9958090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f9958a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 -- 172.21.15.50:0/2438933829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 msgr2=0x5653f9958a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f9958a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 -- 172.21.15.50:0/2438933829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995e500 msgr2=0x5653f9958090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995e500 0x5653f9958090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 -- 172.21.15.50:0/2438933829 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f98683f0 con 0x5653f995dbe0 2023-10-26T06:46:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995e500 0x5653f9958090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.621+0000 7f61caffd700 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 0x5653f995dfc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009550 tx=0x7f61bc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960a1ef50cc6b744 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f61b80a1740 0x7f61b80a3c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098c0 tx=0x7f61b4019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61c17fa700 1 -- 172.21.15.50:0/2438933829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00eea0 con 0x5653f995dbe0 2023-10-26T06:46:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61c17fa700 1 -- 172.21.15.50:0/2438933829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61bc00f040 con 0x5653f995dbe0 2023-10-26T06:46:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61c17fa700 1 -- 172.21.15.50:0/2438933829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc017e20 con 0x5653f995dbe0 2023-10-26T06:46:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2438933829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 msgr2=0x5653f995dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 0x5653f995dfc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009550 tx=0x7f61bc0099e0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2438933829 shutdown_connections 2023-10-26T06:46:59.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f9958a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995dbe0 0x5653f995dfc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2438933829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995e500 0x5653f9958090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.622+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2438933829 >> 172.21.15.50:0/2438933829 conn(0x5653f98cc720 msgr2=0x5653f9952b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.623+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2438933829 shutdown_connections 2023-10-26T06:46:59.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.623+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2438933829 wait complete. 2023-10-26T06:46:59.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.623+0000 7f61e4ea0b80 1 -- start start 2023-10-26T06:46:59.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.623+0000 7f61e4ea0b80 1 Processor -- start 2023-10-26T06:46:59.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f99643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f9961700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f9961d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f98aae70 con 0x5653f99585d0 2023-10-26T06:46:59.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9847710 con 0x5653f995dbe0 2023-10-26T06:46:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f98473b0 con 0x5653f995e500 2023-10-26T06:46:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61e4ea0b80 10 client.0 _ll_register_callbacks cb 0x5653f9791a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61caffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f99643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f9961d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61caffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f99643c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52736/0 (socket says 172.21.15.50:52736) 2023-10-26T06:46:59.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61caffd700 1 -- 172.21.15.50:0/826080749 learned_addr learned my addr 172.21.15.50:0/826080749 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f9961700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61cb7fe700 1 -- 172.21.15.50:0/826080749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 msgr2=0x5653f9961700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f9961700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61cb7fe700 1 -- 172.21.15.50:0/826080749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 msgr2=0x5653f99643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f99643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61cb7fe700 1 -- 172.21.15.50:0/826080749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc009200 con 0x5653f995e500 2023-10-26T06:46:59.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.624+0000 7f61caffd700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f99643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f9961d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ca960 tx=0x7f61c400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ef48f87f84a5a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61b27fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:46:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61b27fc700 1 -- 172.21.15.50:0/826080749 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c409e340 con 0x5653f995e500 2023-10-26T06:46:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653f98afef0 con 0x5653f995e500 2023-10-26T06:46:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61b27fc700 1 -- 172.21.15.50:0/826080749 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f61c40b1030 con 0x5653f995e500 2023-10-26T06:46:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61b27fc700 1 -- 172.21.15.50:0/826080749 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61c40a2580 con 0x5653f995e500 2023-10-26T06:46:59.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61e4ea0b80 10 client.26149 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:59.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5653f96d5de0 con 0x5653f995e500 2023-10-26T06:46:59.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.625+0000 7f61b27fc700 1 -- 172.21.15.50:0/826080749 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653f98afef0 con 0x5653f995e500 2023-10-26T06:46:59.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61b27fc700 1 -- 172.21.15.50:0/826080749 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f61c40996e0 con 0x5653f995e500 2023-10-26T06:46:59.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61e4ea0b80 10 client.26149 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61e4ea0b80 10 client.26149 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:46:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61e4ea0b80 20 client.26149 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f9971dc0 0x5653f99741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61e4ea0b80 4 client.26149 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:59.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653f99278b0 con 0x5653f9971dc0 2023-10-26T06:46:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61caffd700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f9971dc0 0x5653f99741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61caffd700 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f9971dc0 0x5653f99741e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=def50ed0d96eb09a server_cookie=3b20f952f734dd in_seq=0 out_seq=0 2023-10-26T06:46:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.626+0000 7f61b27fc700 10 client.26149 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61b27fc700 1 -- 172.21.15.50:0/826080749 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5653f99278b0 con 0x5653f9971dc0 2023-10-26T06:46:59.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61b27fc700 10 client.26149 handle_command_reply: tid=0 2023-10-26T06:46:59.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 client.26149 shutdown 2023-10-26T06:46:59.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 msgr2=0x5653f9961d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f9961d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ca960 tx=0x7f61c400cea0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 shutdown_connections 2023-10-26T06:46:59.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f9971dc0 0x5653f99741e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f9961d30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f99643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/826080749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f9961700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61b27fc700 0 client.26149 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.627+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 >> 172.21.15.50:0/826080749 conn(0x5653f98cc720 msgr2=0x5653f9957080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.628+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 shutdown_connections 2023-10-26T06:46:59.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.628+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/826080749 wait complete. 2023-10-26T06:46:59.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.628+0000 7f61e4ea0b80 20 client.26149 trim_cache size 0 max 16384 2023-10-26T06:46:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 Processor -- start 2023-10-26T06:46:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 -- start start 2023-10-26T06:46:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f9968eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f995b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f995bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f994daf0 con 0x5653f99585d0 2023-10-26T06:46:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f972b920 con 0x5653f995dbe0 2023-10-26T06:46:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.641+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9962c80 con 0x5653f995e500 2023-10-26T06:46:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f995bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61caffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f9968eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f995bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57266/0 (socket says 172.21.15.50:57266) 2023-10-26T06:46:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2519383887 learned_addr learned my addr 172.21.15.50:0/2519383887 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f995b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2519383887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 msgr2=0x5653f995b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f995b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2519383887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 msgr2=0x5653f9968eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f9968eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2519383887 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f96bec60 con 0x5653f995e500 2023-10-26T06:46:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61caffd700 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f9968eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.642+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f995bbf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f61c409a130 tx=0x7f61c400cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859bee9a6a2e5cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61c1ffb700 1 -- 172.21.15.50:0/2519383887 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c409e340 con 0x5653f995e500 2023-10-26T06:46:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61c1ffb700 1 -- 172.21.15.50:0/2519383887 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61c40a2580 con 0x5653f995e500 2023-10-26T06:46:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61c1ffb700 1 -- 172.21.15.50:0/2519383887 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40b8250 con 0x5653f995e500 2023-10-26T06:46:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2519383887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 msgr2=0x5653f995bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f995bbf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f61c409a130 tx=0x7f61c400cdc0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2519383887 shutdown_connections 2023-10-26T06:46:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f995e500 0x5653f995bbf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f99585d0 0x5653f9968eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2519383887 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f995b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2519383887 >> 172.21.15.50:0/2519383887 conn(0x5653f98cc720 msgr2=0x5653f9952aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2519383887 shutdown_connections 2023-10-26T06:46:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.643+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2519383887 wait complete. 2023-10-26T06:46:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 -- start start 2023-10-26T06:46:59.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 Processor -- start 2023-10-26T06:46:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f99bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f99bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995e500 0x5653f9962f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9963630 con 0x5653f995e500 2023-10-26T06:46:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f99637a0 con 0x5653f995dbe0 2023-10-26T06:46:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9963960 con 0x5653f99585d0 2023-10-26T06:46:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.644+0000 7f61e4ea0b80 10 client.0 _ll_register_callbacks cb 0x5653f9791a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:59.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61caffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f99bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61caffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f99bef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57272/0 (socket says 172.21.15.50:57272) 2023-10-26T06:46:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995e500 0x5653f9962f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61caffd700 1 -- 172.21.15.50:0/2916178951 learned_addr learned my addr 172.21.15.50:0/2916178951 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f99bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 msgr2=0x5653f99bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f99bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2916178951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 msgr2=0x5653f99bf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f99bf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 -- 172.21.15.50:0/2916178951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653f98683f0 con 0x5653f995e500 2023-10-26T06:46:59.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61ca7fc700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f99bf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:46:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61caffd700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f99bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61cb7fe700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995e500 0x5653f9962f50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f61c40adfd0 tx=0x7f61c40caef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae24267856258826 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61b27fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:46:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61b27fc700 1 -- 172.21.15.50:0/2916178951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c407a070 con 0x5653f995e500 2023-10-26T06:46:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61bc00f040 con 0x5653f995e500 2023-10-26T06:46:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.645+0000 7f61b27fc700 1 -- 172.21.15.50:0/2916178951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f61c40b1070 con 0x5653f995e500 2023-10-26T06:46:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61b27fc700 1 -- 172.21.15.50:0/2916178951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61c40996e0 con 0x5653f995e500 2023-10-26T06:46:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 10 client.16110 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5653f96d5de0 con 0x5653f995e500 2023-10-26T06:46:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61b27fc700 1 -- 172.21.15.50:0/2916178951 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61bc00f040 con 0x5653f995e500 2023-10-26T06:46:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61b27fc700 1 -- 172.21.15.50:0/2916178951 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f61c407d070 con 0x5653f995e500 2023-10-26T06:46:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 10 client.16110 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 10 client.16110 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:46:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 20 client.16110 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f99c6850 0x5653f99c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 4 client.16110 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:46:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653f98a3e50 con 0x5653f99c6850 2023-10-26T06:46:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.646+0000 7f61caffd700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f99c6850 0x5653f99c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61caffd700 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f99c6850 0x5653f99c8c40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=68726984bd13012e server_cookie=ecdc311124c66c0 in_seq=0 out_seq=0 2023-10-26T06:46:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61b27fc700 10 client.16110 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61b27fc700 1 -- 172.21.15.50:0/2916178951 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653f98a3e50 con 0x5653f99c6850 2023-10-26T06:46:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61b27fc700 10 client.16110 handle_command_reply: tid=0 2023-10-26T06:46:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 client.16110 shutdown 2023-10-26T06:46:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995e500 msgr2=0x5653f9962f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995e500 0x5653f9962f50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f61c40adfd0 tx=0x7f61c40caef0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 shutdown_connections 2023-10-26T06:46:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x5653f99c6850 0x5653f99c8c40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653f995e500 0x5653f9962f50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653f99585d0 0x5653f99bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 --2- 172.21.15.50:0/2916178951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5653f995dbe0 0x5653f99bf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61b27fc700 0 client.16110 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:46:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.647+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 >> 172.21.15.50:0/2916178951 conn(0x5653f98cc720 msgr2=0x5653f995fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.648+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 shutdown_connections 2023-10-26T06:46:59.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.648+0000 7f61e4ea0b80 1 -- 172.21.15.50:0/2916178951 wait complete. 2023-10-26T06:46:59.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.648+0000 7f61e4ea0b80 20 client.16110 trim_cache size 0 max 16384 2023-10-26T06:46:59.693 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:46:59.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f61b80a1740 msgr2=0x7f61b80a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f61b80a1740 0x7f61b80a3c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098c0 tx=0x7f61b4019040 comp rx=0 tx=0).stop 2023-10-26T06:46:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 msgr2=0x7f61cc073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 0x7f61cc073570 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e940 tx=0x7f61c400ec50 comp rx=0 tx=0).stop 2023-10-26T06:46:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 shutdown_connections 2023-10-26T06:46:59.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f61b80a1740 0x7f61b80a3c00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61cc106730 0x7f61cc073570 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61cc100720 0x7f61cc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 --2- 172.21.15.50:0/2830296478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61cc1010e0 0x7f61cc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 >> 172.21.15.50:0/2830296478 conn(0x7f61cc0fc1b0 msgr2=0x7f61cc0fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 shutdown_connections 2023-10-26T06:46:59.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.649+0000 7f61d15ff700 1 -- 172.21.15.50:0/2830296478 wait complete. 2023-10-26T06:46:59.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:46:59.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 -- 172.21.15.50:0/1102361009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10100720 msgr2=0x7fad10100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 --2- 172.21.15.50:0/1102361009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10100720 0x7fad10100ba0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad04009990 tx=0x7fad04009ca0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 -- 172.21.15.50:0/1102361009 shutdown_connections 2023-10-26T06:46:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 --2- 172.21.15.50:0/1102361009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad101010e0 0x7fad1010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 --2- 172.21.15.50:0/1102361009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad10106730 0x7fad10106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 --2- 172.21.15.50:0/1102361009 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10100720 0x7fad10100ba0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 -- 172.21.15.50:0/1102361009 >> 172.21.15.50:0/1102361009 conn(0x7fad100fc1b0 msgr2=0x7fad100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 -- 172.21.15.50:0/1102361009 shutdown_connections 2023-10-26T06:46:59.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.913+0000 7fad14bff700 1 -- 172.21.15.50:0/1102361009 wait complete. 2023-10-26T06:46:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 Processor -- start 2023-10-26T06:46:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 -- start start 2023-10-26T06:46:59.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad10100720 0x7fad1019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 0x7fad1019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10106730 0x7fad101969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad10197030 con 0x7fad10100720 2023-10-26T06:46:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad101971a0 con 0x7fad10106730 2023-10-26T06:46:59.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.914+0000 7fad14bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad10197360 con 0x7fad101010e0 2023-10-26T06:46:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 0x7fad1019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad10100720 0x7fad1019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 0x7fad1019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57282/0 (socket says 172.21.15.50:57282) 2023-10-26T06:46:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0dd9b700 1 -- 172.21.15.50:0/2343870328 learned_addr learned my addr 172.21.15.50:0/2343870328 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10106730 0x7fad101969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0e59c700 1 -- 172.21.15.50:0/2343870328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 msgr2=0x7fad1019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0e59c700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 0x7fad1019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0e59c700 1 -- 172.21.15.50:0/2343870328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10106730 msgr2=0x7fad101969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0e59c700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10106730 0x7fad101969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0e59c700 1 -- 172.21.15.50:0/2343870328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040095f0 con 0x7fad10100720 2023-10-26T06:46:59.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 0x7fad1019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.915+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10106730 0x7fad101969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.916+0000 7fad0e59c700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad10100720 0x7fad1019c8a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e9f0 tx=0x7fad0000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.916+0000 7facff7fe700 1 -- 172.21.15.50:0/2343870328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000c9c0 con 0x7fad10100720 2023-10-26T06:46:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.916+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad10197640 con 0x7fad10100720 2023-10-26T06:46:59.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.916+0000 7facff7fe700 1 -- 172.21.15.50:0/2343870328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad00010430 con 0x7fad10100720 2023-10-26T06:46:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.916+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad101a3890 con 0x7fad10100720 2023-10-26T06:46:59.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.916+0000 7facff7fe700 1 -- 172.21.15.50:0/2343870328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00018620 con 0x7fad10100720 2023-10-26T06:46:59.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.919+0000 7facff7fe700 1 -- 172.21.15.50:0/2343870328 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fad00010860 con 0x7fad10100720 2023-10-26T06:46:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.921+0000 7facff7fe700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facf80a15f0 0x7facf80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.921+0000 7facff7fe700 1 -- 172.21.15.50:0/2343870328 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fad00014070 con 0x7fad10100720 2023-10-26T06:46:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.921+0000 7fad2857db80 1 Processor -- start 2023-10-26T06:46:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.921+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facf80a15f0 0x7facf80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.921+0000 7fad2857db80 1 -- start start 2023-10-26T06:46:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad2857db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174690 0x562d74174a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad2857db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74178bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad2857db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d74179560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad2857db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d740e36e0 con 0x562d74174fb0 2023-10-26T06:46:59.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad2857db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d740c9c60 con 0x562d74174690 2023-10-26T06:46:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad2857db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d740c7580 con 0x562d74179100 2023-10-26T06:46:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d74179560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d74179560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57296/0 (socket says 172.21.15.50:57296) 2023-10-26T06:46:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 -- 172.21.15.50:0/2327426427 learned_addr learned my addr 172.21.15.50:0/2327426427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0e59c700 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174690 0x562d74174a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74178bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facf80a15f0 0x7facf80a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fad10197b90 tx=0x7fad0400b280 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 -- 172.21.15.50:0/2327426427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174690 msgr2=0x562d74174a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174690 0x562d74174a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 -- 172.21.15.50:0/2327426427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 msgr2=0x562d74178bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74178bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0ed9d700 1 -- 172.21.15.50:0/2327426427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d740803f0 con 0x562d74179100 2023-10-26T06:46:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.922+0000 7fad0e59c700 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174690 0x562d74174a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:46:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.923+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d74179560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fad08003eb0 tx=0x7fad08009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d2488327e428bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.923+0000 7facfcff9700 1 -- 172.21.15.50:0/2327426427 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad080092d0 con 0x562d74179100 2023-10-26T06:46:59.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.923+0000 7facfcff9700 1 -- 172.21.15.50:0/2327426427 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad0800f040 con 0x562d74179100 2023-10-26T06:46:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.923+0000 7facfcff9700 1 -- 172.21.15.50:0/2327426427 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800e8b0 con 0x562d74179100 2023-10-26T06:46:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 -- 172.21.15.50:0/2327426427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 msgr2=0x562d74179560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d74179560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fad08003eb0 tx=0x7fad08009920 comp rx=0 tx=0).stop 2023-10-26T06:46:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 -- 172.21.15.50:0/2327426427 shutdown_connections 2023-10-26T06:46:59.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d74179560 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174690 0x562d74174a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 --2- 172.21.15.50:0/2327426427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74178bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 -- 172.21.15.50:0/2327426427 >> 172.21.15.50:0/2327426427 conn(0x562d740e4720 msgr2=0x562d7416ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 -- 172.21.15.50:0/2327426427 shutdown_connections 2023-10-26T06:46:59.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.924+0000 7fad2857db80 1 -- 172.21.15.50:0/2327426427 wait complete. 2023-10-26T06:46:59.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.925+0000 7fad2857db80 1 -- start start 2023-10-26T06:46:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.925+0000 7fad2857db80 1 Processor -- start 2023-10-26T06:46:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74180910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d7417dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d7417e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d740c2e70 con 0x562d74174fb0 2023-10-26T06:46:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7405f710 con 0x562d74179100 2023-10-26T06:46:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7405f3b0 con 0x562d74174690 2023-10-26T06:46:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad2857db80 10 client.0 _ll_register_callbacks cb 0x562d73fa9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74180910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74180910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57308/0 (socket says 172.21.15.50:57308) 2023-10-26T06:46:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 -- 172.21.15.50:0/1604941968 learned_addr learned my addr 172.21.15.50:0/1604941968 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d7417dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d7417e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 -- 172.21.15.50:0/1604941968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 msgr2=0x562d7417e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d7417e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 -- 172.21.15.50:0/1604941968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 msgr2=0x562d7417dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d7417dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.926+0000 7fad0e59c700 1 -- 172.21.15.50:0/1604941968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad101a3890 con 0x562d74174690 2023-10-26T06:46:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7fad0e59c700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74180910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad00096be0 tx=0x7fad0009a960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c833f9a777ca3ec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7facf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:46:59.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7facf5ffb700 1 -- 172.21.15.50:0/1604941968 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00099860 con 0x562d74174690 2023-10-26T06:46:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7facf5ffb700 1 -- 172.21.15.50:0/1604941968 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fad0009e2c0 con 0x562d74174690 2023-10-26T06:46:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d740c7ef0 con 0x562d74174690 2023-10-26T06:46:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7facf5ffb700 1 -- 172.21.15.50:0/1604941968 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad000a2500 con 0x562d74174690 2023-10-26T06:46:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7fad2857db80 10 client.26167 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:59.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fad08003b90 con 0x562d74174690 2023-10-26T06:46:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7facf5ffb700 1 -- 172.21.15.50:0/1604941968 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad000b8020 con 0x562d74174690 2023-10-26T06:46:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.927+0000 7facf5ffb700 1 -- 172.21.15.50:0/1604941968 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fad000b8200 con 0x562d74174690 2023-10-26T06:46:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad2857db80 10 client.26167 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad2857db80 10 client.26167 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:46:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad2857db80 20 client.26167 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:59.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad2857db80 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d7418e1f0 0x562d74190610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad2857db80 4 client.26167 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:46:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d7413f8b0 con 0x562d7418e1f0 2023-10-26T06:46:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d7418e1f0 0x562d74190610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d7418e1f0 0x562d74190610 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cdb4e6990889d6 server_cookie=eafc76b99dbf014b in_seq=0 out_seq=0 2023-10-26T06:46:59.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.928+0000 7facf5ffb700 10 client.26167 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7facf5ffb700 1 -- 172.21.15.50:0/1604941968 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562d7413f8b0 con 0x562d7418e1f0 2023-10-26T06:46:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7facf5ffb700 10 client.26167 handle_command_reply: tid=0 2023-10-26T06:46:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 client.26167 shutdown 2023-10-26T06:46:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 msgr2=0x562d74180910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74180910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad00096be0 tx=0x7fad0009a960 comp rx=0 tx=0).stop 2023-10-26T06:46:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 shutdown_connections 2023-10-26T06:46:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d7418e1f0 0x562d74190610 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d7417e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74180910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7facf5ffb700 0 client.26167 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:59.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 --2- 172.21.15.50:0/1604941968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d7417dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 >> 172.21.15.50:0/1604941968 conn(0x562d740e4720 msgr2=0x562d7416f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.931+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 shutdown_connections 2023-10-26T06:46:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.932+0000 7fad2857db80 1 -- 172.21.15.50:0/1604941968 wait complete. 2023-10-26T06:46:59.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.932+0000 7fad2857db80 20 client.26167 trim_cache size 0 max 16384 2023-10-26T06:46:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 Processor -- start 2023-10-26T06:46:59.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 -- start start 2023-10-26T06:46:59.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 0x562d74185290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174fb0 0x562d7416f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d7417d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d73f43920 con 0x562d74174690 2023-10-26T06:46:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d74185840 con 0x562d74174fb0 2023-10-26T06:46:59.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.946+0000 7fad2857db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d74175410 con 0x562d74179100 2023-10-26T06:46:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 0x562d74185290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 0x562d74185290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52782/0 (socket says 172.21.15.50:52782) 2023-10-26T06:46:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 -- 172.21.15.50:0/84758544 learned_addr learned my addr 172.21.15.50:0/84758544 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d7417d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174fb0 0x562d7416f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 -- 172.21.15.50:0/84758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 msgr2=0x562d7417d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d7417d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 -- 172.21.15.50:0/84758544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174fb0 msgr2=0x562d7416f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174fb0 0x562d7416f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 -- 172.21.15.50:0/84758544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d73eedde0 con 0x562d74174690 2023-10-26T06:46:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7fad0e59c700 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 0x562d74185290 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fad00099e70 tx=0x7fad000cd020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f190b00addfc760 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.947+0000 7facfd7fa700 1 -- 172.21.15.50:0/84758544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000b83b0 con 0x562d74174690 2023-10-26T06:46:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7facfd7fa700 1 -- 172.21.15.50:0/84758544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad000b8040 con 0x562d74174690 2023-10-26T06:46:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7facfd7fa700 1 -- 172.21.15.50:0/84758544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000a22d0 con 0x562d74174690 2023-10-26T06:46:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 -- 172.21.15.50:0/84758544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 msgr2=0x562d74185290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 0x562d74185290 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fad00099e70 tx=0x7fad000cd020 comp rx=0 tx=0).stop 2023-10-26T06:46:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 -- 172.21.15.50:0/84758544 shutdown_connections 2023-10-26T06:46:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74179100 0x562d7417d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174690 0x562d74185290 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 --2- 172.21.15.50:0/84758544 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74174fb0 0x562d7416f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 -- 172.21.15.50:0/84758544 >> 172.21.15.50:0/84758544 conn(0x562d740e4720 msgr2=0x562d7416c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 -- 172.21.15.50:0/84758544 shutdown_connections 2023-10-26T06:46:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.948+0000 7fad2857db80 1 -- 172.21.15.50:0/84758544 wait complete. 2023-10-26T06:46:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 -- start start 2023-10-26T06:46:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 Processor -- start 2023-10-26T06:46:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74183950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74183e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d741843d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d741e20f0 con 0x562d74174fb0 2023-10-26T06:46:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.949+0000 7fad2857db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d741e2260 con 0x562d74179100 2023-10-26T06:46:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad2857db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d741e2420 con 0x562d74174690 2023-10-26T06:46:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad2857db80 10 client.0 _ll_register_callbacks cb 0x7fad00099b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:46:59.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74183950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74183950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57314/0 (socket says 172.21.15.50:57314) 2023-10-26T06:46:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 -- 172.21.15.50:0/412953763 learned_addr learned my addr 172.21.15.50:0/412953763 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:46:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74183e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0ed9d700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d741843d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 -- 172.21.15.50:0/412953763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 msgr2=0x562d741843d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d741843d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 -- 172.21.15.50:0/412953763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 msgr2=0x562d74183e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:46:59.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74183e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 -- 172.21.15.50:0/412953763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad08003b90 con 0x562d74174690 2023-10-26T06:46:59.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7fad0e59c700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74183950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fad0009a100 tx=0x7fad00009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385171b9f4bdcad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:46:59.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.950+0000 7facf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:46:59.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7facf5ffb700 1 -- 172.21.15.50:0/412953763 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000962b0 con 0x562d74174690 2023-10-26T06:46:59.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7facf5ffb700 1 -- 172.21.15.50:0/412953763 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fad000a2500 con 0x562d74174690 2023-10-26T06:46:59.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad0800f040 con 0x562d74174690 2023-10-26T06:46:59.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7facf5ffb700 1 -- 172.21.15.50:0/412953763 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad00099660 con 0x562d74174690 2023-10-26T06:46:59.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 10 client.26173 fetch_fsmap learned FSMap version 25 2023-10-26T06:46:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x562d73ed6c60 con 0x562d74174690 2023-10-26T06:46:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7facf5ffb700 1 -- 172.21.15.50:0/412953763 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad0800f040 con 0x562d74174690 2023-10-26T06:46:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7facf5ffb700 1 -- 172.21.15.50:0/412953763 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fad0009f000 con 0x562d74174690 2023-10-26T06:46:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 10 client.26173 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:46:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 10 client.26173 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:46:59.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 20 client.26173 populate_metadata read hostname 'smithi050' 2023-10-26T06:46:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d741e3770 0x562d741e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:46:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 4 client.26173 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:46:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.951+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562d740bbe50 con 0x562d741e3770 2023-10-26T06:46:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.952+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d741e3770 0x562d741e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:46:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.952+0000 7fad0dd9b700 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d741e3770 0x562d741e5b60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecfa971d3bc74a99 server_cookie=d73a9d61358ae5 in_seq=0 out_seq=0 2023-10-26T06:46:59.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.952+0000 7facf5ffb700 10 client.26173 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7facf5ffb700 1 -- 172.21.15.50:0/412953763 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562d740bbe50 con 0x562d741e3770 2023-10-26T06:46:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7facf5ffb700 10 client.26173 handle_command_reply: tid=0 2023-10-26T06:46:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 client.26173 shutdown 2023-10-26T06:46:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 msgr2=0x562d74183950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74183950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fad0009a100 tx=0x7fad00009ef0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 shutdown_connections 2023-10-26T06:46:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x562d741e3770 0x562d741e5b60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562d74179100 0x562d741843d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d74174690 0x562d74183950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 --2- 172.21.15.50:0/412953763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d74174fb0 0x562d74183e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7facf5ffb700 0 client.26173 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:46:59.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 >> 172.21.15.50:0/412953763 conn(0x562d740e4720 msgr2=0x562d7416a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 shutdown_connections 2023-10-26T06:46:59.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 1 -- 172.21.15.50:0/412953763 wait complete. 2023-10-26T06:46:59.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.953+0000 7fad2857db80 20 client.26173 trim_cache size 0 max 16384 2023-10-26T06:46:59.967 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:46:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facf80a15f0 msgr2=0x7facf80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facf80a15f0 0x7facf80a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fad10197b90 tx=0x7fad0400b280 comp rx=0 tx=0).stop 2023-10-26T06:46:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad10100720 msgr2=0x7fad1019c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:46:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad10100720 0x7fad1019c8a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e9f0 tx=0x7fad0000ed00 comp rx=0 tx=0).stop 2023-10-26T06:46:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 shutdown_connections 2023-10-26T06:46:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7facf80a15f0 0x7facf80a3ab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad10106730 0x7fad101969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad10100720 0x7fad1019c8a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 --2- 172.21.15.50:0/2343870328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad101010e0 0x7fad1019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:46:59.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 >> 172.21.15.50:0/2343870328 conn(0x7fad100fc1b0 msgr2=0x7fad100fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:46:59.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 shutdown_connections 2023-10-26T06:46:59.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:46:59.954+0000 7fad14bff700 1 -- 172.21.15.50:0/2343870328 wait complete. 2023-10-26T06:46:59.972 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:46:59 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/461537443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:46:59.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:47:00.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:46:59 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/461537443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:47:00.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 -- 172.21.15.50:0/814493801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5354100a40 msgr2=0x7f535410cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 --2- 172.21.15.50:0/814493801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5354100a40 0x7f535410cc50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5348009990 tx=0x7f5348009ca0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 -- 172.21.15.50:0/814493801 shutdown_connections 2023-10-26T06:47:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 --2- 172.21.15.50:0/814493801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f535410d190 0x7f535410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 --2- 172.21.15.50:0/814493801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5354100120 0x7f5354100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 --2- 172.21.15.50:0/814493801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5354100a40 0x7f535410cc50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 -- 172.21.15.50:0/814493801 >> 172.21.15.50:0/814493801 conn(0x7f53540767f0 msgr2=0x7f5354076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 -- 172.21.15.50:0/814493801 shutdown_connections 2023-10-26T06:47:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.210+0000 7f5359fff700 1 -- 172.21.15.50:0/814493801 wait complete. 2023-10-26T06:47:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 Processor -- start 2023-10-26T06:47:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 -- start start 2023-10-26T06:47:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5354100120 0x7f5354198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5354100a40 0x7f5354199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 0x7f535419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535419dd60 con 0x7f5354100120 2023-10-26T06:47:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535419ded0 con 0x7f5354100a40 2023-10-26T06:47:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.212+0000 7f5359fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535419e090 con 0x7f535410d190 2023-10-26T06:47:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 0x7f535419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f53537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5354100120 0x7f5354198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 0x7f535419d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57332/0 (socket says 172.21.15.50:57332) 2023-10-26T06:47:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5352ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5354100a40 0x7f5354199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 -- 172.21.15.50:0/3572653249 learned_addr learned my addr 172.21.15.50:0/3572653249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 -- 172.21.15.50:0/3572653249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5354100a40 msgr2=0x7f5354199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5354100a40 0x7f5354199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 -- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5354100120 msgr2=0x7f5354198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5354100120 0x7f5354198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.213+0000 7f5353fff700 1 -- 172.21.15.50:0/3572653249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480095f0 con 0x7f535410d190 2023-10-26T06:47:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.214+0000 7f5353fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 0x7f535419d720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f534c00efc0 tx=0x7f534c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.214+0000 7f5350ff9700 1 -- 172.21.15.50:0/3572653249 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c018070 con 0x7f535410d190 2023-10-26T06:47:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.214+0000 7f5350ff9700 1 -- 172.21.15.50:0/3572653249 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f534c00f040 con 0x7f535410d190 2023-10-26T06:47:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.214+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535419e310 con 0x7f535410d190 2023-10-26T06:47:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.214+0000 7f5350ff9700 1 -- 172.21.15.50:0/3572653249 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00cd00 con 0x7f535410d190 2023-10-26T06:47:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.214+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53541a5bb0 con 0x7f535410d190 2023-10-26T06:47:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.218+0000 7f5350ff9700 1 -- 172.21.15.50:0/3572653249 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f534c003a00 con 0x7f535410d190 2023-10-26T06:47:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.219+0000 7f536d96db80 1 Processor -- start 2023-10-26T06:47:00.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 -- start start 2023-10-26T06:47:00.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246e987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f5350ff9700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f533c0a15f0 0x7f533c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246e93260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246dfd6e0 con 0x556246e983f0 2023-10-26T06:47:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246de3c60 con 0x556246e92de0 2023-10-26T06:47:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5350ff9700 1 -- 172.21.15.50:0/3572653249 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f534c0ccb10 con 0x7f535410d190 2023-10-26T06:47:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f53537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246e987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f53537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246e987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52814/0 (socket says 172.21.15.50:52814) 2023-10-26T06:47:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5353fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246e93260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f53537fe700 1 -- 172.21.15.50:0/507306341 learned_addr learned my addr 172.21.15.50:0/507306341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.220+0000 7f536d96db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246de1580 con 0x556246e98d10 2023-10-26T06:47:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5352ffd700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f533c0a15f0 0x7f533c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5352ffd700 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5353fff700 1 -- 172.21.15.50:0/507306341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 msgr2=0x556246e928a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5353fff700 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e928a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5353fff700 1 -- 172.21.15.50:0/507306341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 msgr2=0x556246e987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5353fff700 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246e987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.221+0000 7f5353fff700 1 -- 172.21.15.50:0/507306341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556246d9a3f0 con 0x556246e92de0 2023-10-26T06:47:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.222+0000 7f5352ffd700 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e928a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:47:00.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.222+0000 7f5353fff700 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246e93260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f534c0ca310 tx=0x7f534c00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7f790283c6f7b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.222+0000 7f5339ffb700 1 -- 172.21.15.50:0/507306341 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c0996d0 con 0x556246e92de0 2023-10-26T06:47:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.222+0000 7f5339ffb700 1 -- 172.21.15.50:0/507306341 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f534c0994f0 con 0x556246e92de0 2023-10-26T06:47:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.222+0000 7f5339ffb700 1 -- 172.21.15.50:0/507306341 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c099b90 con 0x556246e92de0 2023-10-26T06:47:00.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 -- 172.21.15.50:0/507306341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 msgr2=0x556246e93260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246e93260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f534c0ca310 tx=0x7f534c00cf90 comp rx=0 tx=0).stop 2023-10-26T06:47:00.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f5352ffd700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f533c0a15f0 0x7f533c0a3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f535419a390 tx=0x7f534800b610 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:00.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 -- 172.21.15.50:0/507306341 shutdown_connections 2023-10-26T06:47:00.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246e93260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246e987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 --2- 172.21.15.50:0/507306341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e928a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 -- 172.21.15.50:0/507306341 >> 172.21.15.50:0/507306341 conn(0x556246dfe720 msgr2=0x556246e84b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:00.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 -- 172.21.15.50:0/507306341 shutdown_connections 2023-10-26T06:47:00.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.223+0000 7f536d96db80 1 -- 172.21.15.50:0/507306341 wait complete. 2023-10-26T06:47:00.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.224+0000 7f536d96db80 1 -- start start 2023-10-26T06:47:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.224+0000 7f536d96db80 1 Processor -- start 2023-10-26T06:47:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246e9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e9c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246ddce70 con 0x556246e92de0 2023-10-26T06:47:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246d79710 con 0x556246e983f0 2023-10-26T06:47:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246d793b0 con 0x556246e98d10 2023-10-26T06:47:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.225+0000 7f536d96db80 10 client.0 _ll_register_callbacks cb 0x556246cc3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e9c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f53537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246e9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5352ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e9c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57360/0 (socket says 172.21.15.50:57360) 2023-10-26T06:47:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 -- 172.21.15.50:0/3718749655 learned_addr learned my addr 172.21.15.50:0/3718749655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 -- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 msgr2=0x556246e9bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 -- 172.21.15.50:0/3718749655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 msgr2=0x556246e9ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246e9ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 -- 172.21.15.50:0/3718749655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53541a5bb0 con 0x556246e98d10 2023-10-26T06:47:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.226+0000 7f5353fff700 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e9c630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c6f0 tx=0x7f534c096550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa14645ab94365f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f5332ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:47:00.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f5332ffd700 1 -- 172.21.15.50:0/3718749655 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c01bee0 con 0x556246e98d10 2023-10-26T06:47:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f5332ffd700 1 -- 172.21.15.50:0/3718749655 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f534c09a290 con 0x556246e98d10 2023-10-26T06:47:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556246de1ef0 con 0x556246e98d10 2023-10-26T06:47:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f5332ffd700 1 -- 172.21.15.50:0/3718749655 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f534c01b320 con 0x556246e98d10 2023-10-26T06:47:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 10 client.26182 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:00.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556246c07de0 con 0x556246e98d10 2023-10-26T06:47:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f5332ffd700 1 -- 172.21.15.50:0/3718749655 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556246de1ef0 con 0x556246e98d10 2023-10-26T06:47:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f5332ffd700 1 -- 172.21.15.50:0/3718749655 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f534c0a1a00 con 0x556246e98d10 2023-10-26T06:47:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 10 client.26182 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:00.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 10 client.26182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 20 client.26182 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.227+0000 7f536d96db80 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246eac290 0x556246eae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.228+0000 7f536d96db80 4 client.26182 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.228+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556246e598b0 con 0x556246eac290 2023-10-26T06:47:00.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.228+0000 7f53537fe700 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246eac290 0x556246eae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.228+0000 7f53537fe700 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246eac290 0x556246eae6b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7dee3e2950e86f3 server_cookie=3475d8cf78076c6 in_seq=0 out_seq=0 2023-10-26T06:47:00.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.228+0000 7f5332ffd700 10 client.26182 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:00.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:46:59 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/461537443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:47:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.229+0000 7f5332ffd700 1 -- 172.21.15.50:0/3718749655 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556246e598b0 con 0x556246eac290 2023-10-26T06:47:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.229+0000 7f5332ffd700 10 client.26182 handle_command_reply: tid=0 2023-10-26T06:47:00.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.229+0000 7f536d96db80 1 client.26182 shutdown 2023-10-26T06:47:00.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.229+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 msgr2=0x556246e9c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.229+0000 7f536d96db80 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e9c630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c6f0 tx=0x7f534c096550 comp rx=0 tx=0).stop 2023-10-26T06:47:00.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 shutdown_connections 2023-10-26T06:47:00.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246eac290 0x556246eae6b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e9c630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246e9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f5332ffd700 0 client.26182 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 --2- 172.21.15.50:0/3718749655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 >> 172.21.15.50:0/3718749655 conn(0x556246dfe720 msgr2=0x556246e91890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 shutdown_connections 2023-10-26T06:47:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 1 -- 172.21.15.50:0/3718749655 wait complete. 2023-10-26T06:47:00.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.230+0000 7f536d96db80 20 client.26182 trim_cache size 0 max 16384 2023-10-26T06:47:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 Processor -- start 2023-10-26T06:47:00.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 -- start start 2023-10-26T06:47:00.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246ea36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e84810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246c5d920 con 0x556246e92de0 2023-10-26T06:47:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246e9cf00 con 0x556246e983f0 2023-10-26T06:47:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f536d96db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246e92860 con 0x556246e98d10 2023-10-26T06:47:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f5352ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.251+0000 7f5353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e84810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e84810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57370/0 (socket says 172.21.15.50:57370) 2023-10-26T06:47:00.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 -- 172.21.15.50:0/409607673 learned_addr learned my addr 172.21.15.50:0/409607673 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:00.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f53537fe700 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246ea36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 -- 172.21.15.50:0/409607673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 msgr2=0x556246e9b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 -- 172.21.15.50:0/409607673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 msgr2=0x556246ea36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246ea36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 -- 172.21.15.50:0/409607673 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556246bf0c60 con 0x556246e98d10 2023-10-26T06:47:00.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f53537fe700 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246ea36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.252+0000 7f5353fff700 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e84810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f534c099b20 tx=0x7f534c0964b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6d72b8b95b4712 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f533a7fc700 1 -- 172.21.15.50:0/409607673 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c01bee0 con 0x556246e98d10 2023-10-26T06:47:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f533a7fc700 1 -- 172.21.15.50:0/409607673 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f534c01b320 con 0x556246e98d10 2023-10-26T06:47:00.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f533a7fc700 1 -- 172.21.15.50:0/409607673 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c09dce0 con 0x556246e98d10 2023-10-26T06:47:00.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f536d96db80 1 -- 172.21.15.50:0/409607673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 msgr2=0x556246e84810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f536d96db80 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e84810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f534c099b20 tx=0x7f534c0964b0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f536d96db80 1 -- 172.21.15.50:0/409607673 shutdown_connections 2023-10-26T06:47:00.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.253+0000 7f536d96db80 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246e84810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e92de0 0x556246ea36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 --2- 172.21.15.50:0/409607673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e983f0 0x556246e9b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 -- 172.21.15.50:0/409607673 >> 172.21.15.50:0/409607673 conn(0x556246dfe720 msgr2=0x556246e863b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 -- 172.21.15.50:0/409607673 shutdown_connections 2023-10-26T06:47:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 -- 172.21.15.50:0/409607673 wait complete. 2023-10-26T06:47:00.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 -- start start 2023-10-26T06:47:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.254+0000 7f536d96db80 1 Processor -- start 2023-10-26T06:47:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246ea3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246ea16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246ea1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246ea2120 con 0x556246e983f0 2023-10-26T06:47:00.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246ea2260 con 0x556246e92de0 2023-10-26T06:47:00.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556246ea2420 con 0x556246e98d10 2023-10-26T06:47:00.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f536d96db80 10 client.0 _ll_register_callbacks cb 0x556246cc3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:00.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f53537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246ea3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f53537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246ea3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34194/0 (socket says 172.21.15.50:34194) 2023-10-26T06:47:00.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f53537fe700 1 -- 172.21.15.50:0/4145233824 learned_addr learned my addr 172.21.15.50:0/4145233824 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:00.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f5353fff700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246ea1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.255+0000 7f5352ffd700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246ea16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f53537fe700 1 -- 172.21.15.50:0/4145233824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 msgr2=0x556246ea1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f53537fe700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246ea1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f53537fe700 1 -- 172.21.15.50:0/4145233824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 msgr2=0x556246ea16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f53537fe700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246ea16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f53537fe700 1 -- 172.21.15.50:0/4145233824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5344004040 con 0x556246e92de0 2023-10-26T06:47:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f5353fff700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246ea1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:00.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f53537fe700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246ea3300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5344005d90 tx=0x7f53440044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de785975e4aedaf server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:00.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.256+0000 7f5332ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:47:00.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.257+0000 7f5332ffd700 1 -- 172.21.15.50:0/4145233824 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344017040 con 0x556246e92de0 2023-10-26T06:47:00.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.257+0000 7f5332ffd700 1 -- 172.21.15.50:0/4145233824 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f534401f9f0 con 0x556246e92de0 2023-10-26T06:47:00.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.257+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556246e93850 con 0x556246e92de0 2023-10-26T06:47:00.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f5332ffd700 1 -- 172.21.15.50:0/4145233824 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f534401f5c0 con 0x556246e92de0 2023-10-26T06:47:00.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 10 client.26183 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:00.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556246c07de0 con 0x556246e92de0 2023-10-26T06:47:00.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f5332ffd700 1 -- 172.21.15.50:0/4145233824 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556246e93850 con 0x556246e92de0 2023-10-26T06:47:00.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f5332ffd700 1 -- 172.21.15.50:0/4145233824 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5344030050 con 0x556246e92de0 2023-10-26T06:47:00.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 10 client.26183 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:00.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 10 client.26183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:00.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 20 client.26183 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:00.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246f016c0 0x556246f03ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:00.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 4 client.26183 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:47:00.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f534c0994f0 con 0x556246f016c0 2023-10-26T06:47:00.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.258+0000 7f5352ffd700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246f016c0 0x556246f03ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:00.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f5352ffd700 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246f016c0 0x556246f03ae0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a96c85118185b75 server_cookie=6cfa198d7b60836e in_seq=0 out_seq=0 2023-10-26T06:47:00.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f5332ffd700 10 client.26183 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:00.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f5332ffd700 1 -- 172.21.15.50:0/4145233824 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f534c0994f0 con 0x556246f016c0 2023-10-26T06:47:00.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f5332ffd700 10 client.26183 handle_command_reply: tid=0 2023-10-26T06:47:00.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 client.26183 shutdown 2023-10-26T06:47:00.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 msgr2=0x556246ea3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246ea3300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5344005d90 tx=0x7f53440044b0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 shutdown_connections 2023-10-26T06:47:00.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556246f016c0 0x556246f03ae0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556246e98d10 0x556246ea1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556246e92de0 0x556246ea3300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 --2- 172.21.15.50:0/4145233824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556246e983f0 0x556246ea16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.259+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 >> 172.21.15.50:0/4145233824 conn(0x556246dfe720 msgr2=0x556246e9a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:00.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f5332ffd700 0 client.26183 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:00.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 shutdown_connections 2023-10-26T06:47:00.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f536d96db80 1 -- 172.21.15.50:0/4145233824 wait complete. 2023-10-26T06:47:00.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f536d96db80 20 client.26183 trim_cache size 0 max 16384 2023-10-26T06:47:00.277 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:47:00.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f533c0a15f0 msgr2=0x7f533c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f5359fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f533c0a15f0 0x7f533c0a3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f535419a390 tx=0x7f534800b610 comp rx=0 tx=0).stop 2023-10-26T06:47:00.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 msgr2=0x7f535419d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:00.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.260+0000 7f5359fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 0x7f535419d720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f534c00efc0 tx=0x7f534c00c3a0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 shutdown_connections 2023-10-26T06:47:00.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f533c0a15f0 0x7f533c0a3ab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f535410d190 0x7f535419d720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5354100120 0x7f5354198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 --2- 172.21.15.50:0/3572653249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5354100a40 0x7f5354199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:00.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 >> 172.21.15.50:0/3572653249 conn(0x7f53540767f0 msgr2=0x7f535410e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:00.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 shutdown_connections 2023-10-26T06:47:00.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:00.261+0000 7f5359fff700 1 -- 172.21.15.50:0/3572653249 wait complete. 2023-10-26T06:47:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:00 smithi125 ceph-mon[130643]: pgmap v419: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 17 MiB/s wr, 950 op/s 2023-10-26T06:47:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:00 smithi153 ceph-mon[131657]: pgmap v419: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 17 MiB/s wr, 950 op/s 2023-10-26T06:47:01.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:00 smithi050 ceph-mon[94997]: pgmap v419: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 17 MiB/s wr, 950 op/s 2023-10-26T06:47:01.284 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:47:01.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:47:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 -- 172.21.15.50:0/847695615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440100720 msgr2=0x7f0440100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 --2- 172.21.15.50:0/847695615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440100720 0x7f0440100ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0430009990 tx=0x7f0430009ca0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 -- 172.21.15.50:0/847695615 shutdown_connections 2023-10-26T06:47:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 --2- 172.21.15.50:0/847695615 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04401010e0 0x7f044010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 --2- 172.21.15.50:0/847695615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0440106730 0x7f0440106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 --2- 172.21.15.50:0/847695615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440100720 0x7f0440100ba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 -- 172.21.15.50:0/847695615 >> 172.21.15.50:0/847695615 conn(0x7f04400fc1b0 msgr2=0x7f04400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 -- 172.21.15.50:0/847695615 shutdown_connections 2023-10-26T06:47:01.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.505+0000 7f04475ff700 1 -- 172.21.15.50:0/847695615 wait complete. 2023-10-26T06:47:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.506+0000 7f04475ff700 1 Processor -- start 2023-10-26T06:47:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 -- start start 2023-10-26T06:47:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 0x7f0440072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04401010e0 0x7f0440073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440106730 0x7f0440073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401a4fd0 con 0x7f04401010e0 2023-10-26T06:47:01.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401a5140 con 0x7f0440100720 2023-10-26T06:47:01.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f04475ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401a5300 con 0x7f0440106730 2023-10-26T06:47:01.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f044539b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 0x7f0440072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f044539b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 0x7f0440072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34216/0 (socket says 172.21.15.50:34216) 2023-10-26T06:47:01.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f0444b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04401010e0 0x7f0440073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f044539b700 1 -- 172.21.15.50:0/1372574293 learned_addr learned my addr 172.21.15.50:0/1372574293 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.507+0000 7f0445b9c700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440106730 0x7f0440073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f044539b700 1 -- 172.21.15.50:0/1372574293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440106730 msgr2=0x7f0440073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f044539b700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440106730 0x7f0440073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f044539b700 1 -- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04401010e0 msgr2=0x7f0440073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f044539b700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04401010e0 0x7f0440073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f044539b700 1 -- 172.21.15.50:0/1372574293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300095f0 con 0x7f0440100720 2023-10-26T06:47:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f0444b9a700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04401010e0 0x7f0440073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:01.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f044539b700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 0x7f0440072af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f043c00e9a0 tx=0x7f043c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f04367fc700 1 -- 172.21.15.50:0/1372574293 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c009790 con 0x7f0440100720 2023-10-26T06:47:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04401a55e0 con 0x7f0440100720 2023-10-26T06:47:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f04367fc700 1 -- 172.21.15.50:0/1372574293 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f043c010430 con 0x7f0440100720 2023-10-26T06:47:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f04367fc700 1 -- 172.21.15.50:0/1372574293 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c018680 con 0x7f0440100720 2023-10-26T06:47:01.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.508+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04401a5af0 con 0x7f0440100720 2023-10-26T06:47:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.512+0000 7f04367fc700 1 -- 172.21.15.50:0/1372574293 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f043c0105a0 con 0x7f0440100720 2023-10-26T06:47:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.513+0000 7f045b009b80 1 Processor -- start 2023-10-26T06:47:01.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.513+0000 7f045b009b80 1 -- start start 2023-10-26T06:47:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f045b009b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a548f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f045b009b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5489110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f045b009b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5489ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f045b009b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a53fc760 con 0x5644a548ec60 2023-10-26T06:47:01.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f045b009b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a53e2ce0 con 0x5644a5489650 2023-10-26T06:47:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f045b009b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a53e0600 con 0x5644a548f580 2023-10-26T06:47:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f04367fc700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f042c0a15f0 0x7f042c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5489110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f04367fc700 1 -- 172.21.15.50:0/1372574293 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f043c014070 con 0x7f0440100720 2023-10-26T06:47:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5489110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57394/0 (socket says 172.21.15.50:57394) 2023-10-26T06:47:01.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 -- 172.21.15.50:0/612464123 learned_addr learned my addr 172.21.15.50:0/612464123 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f0445b9c700 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a548f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f0444b9a700 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5489ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 -- 172.21.15.50:0/612464123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 msgr2=0x5644a5489ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5489ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 -- 172.21.15.50:0/612464123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 msgr2=0x5644a548f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a548f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f044539b700 1 -- 172.21.15.50:0/612464123 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a5399470 con 0x5644a548f580 2023-10-26T06:47:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.514+0000 7f0444b9a700 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5489ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.515+0000 7f0445b9c700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f042c0a15f0 0x7f042c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.515+0000 7f044539b700 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5489110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f043c0caa10 tx=0x7f043c007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba5685b7237259df server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.515+0000 7f042b7fe700 1 -- 172.21.15.50:0/612464123 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c09a940 con 0x5644a548f580 2023-10-26T06:47:01.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.515+0000 7f042b7fe700 1 -- 172.21.15.50:0/612464123 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f043c09b330 con 0x5644a548f580 2023-10-26T06:47:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.515+0000 7f042b7fe700 1 -- 172.21.15.50:0/612464123 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c09e390 con 0x5644a548f580 2023-10-26T06:47:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f0445b9c700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f042c0a15f0 0x7f042c0a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0438007820 tx=0x7f0438009130 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 -- 172.21.15.50:0/612464123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 msgr2=0x5644a5489110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5489110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f043c0caa10 tx=0x7f043c007f20 comp rx=0 tx=0).stop 2023-10-26T06:47:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 -- 172.21.15.50:0/612464123 shutdown_connections 2023-10-26T06:47:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5489ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a548f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 --2- 172.21.15.50:0/612464123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5489110 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 -- 172.21.15.50:0/612464123 >> 172.21.15.50:0/612464123 conn(0x5644a53fd7a0 msgr2=0x5644a5483be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 -- 172.21.15.50:0/612464123 shutdown_connections 2023-10-26T06:47:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.517+0000 7f045b009b80 1 -- 172.21.15.50:0/612464123 wait complete. 2023-10-26T06:47:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 -- start start 2023-10-26T06:47:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 Processor -- start 2023-10-26T06:47:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5495570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5492f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a53dbef0 con 0x5644a548ec60 2023-10-26T06:47:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5378790 con 0x5644a5489650 2023-10-26T06:47:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5378430 con 0x5644a548f580 2023-10-26T06:47:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.518+0000 7f045b009b80 10 client.0 _ll_register_callbacks cb 0x5644a52c2b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5492f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f044539b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5495570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5492f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57408/0 (socket says 172.21.15.50:57408) 2023-10-26T06:47:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 -- 172.21.15.50:0/1557994014 learned_addr learned my addr 172.21.15.50:0/1557994014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0444b9a700 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 -- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 msgr2=0x5644a5495570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5495570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 -- 172.21.15.50:0/1557994014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 msgr2=0x5644a54927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 -- 172.21.15.50:0/1557994014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04401a5af0 con 0x5644a548f580 2023-10-26T06:47:01.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0445b9c700 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5492f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04380196a0 tx=0x7f0438004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423cbc37b9e01915 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.519+0000 7f0428ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:47:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f0428ff9700 1 -- 172.21.15.50:0/1557994014 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438004bb0 con 0x5644a548f580 2023-10-26T06:47:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f0428ff9700 1 -- 172.21.15.50:0/1557994014 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0438004d10 con 0x5644a548f580 2023-10-26T06:47:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644a53e0f70 con 0x5644a548f580 2023-10-26T06:47:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f0428ff9700 1 -- 172.21.15.50:0/1557994014 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0438018570 con 0x5644a548f580 2023-10-26T06:47:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f045b009b80 10 client.26200 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5644a5206e60 con 0x5644a548f580 2023-10-26T06:47:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f0428ff9700 1 -- 172.21.15.50:0/1557994014 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0438032080 con 0x5644a548f580 2023-10-26T06:47:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f0428ff9700 1 -- 172.21.15.50:0/1557994014 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f043802c030 con 0x5644a548f580 2023-10-26T06:47:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f045b009b80 10 client.26200 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f045b009b80 10 client.26200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.520+0000 7f045b009b80 20 client.26200 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.521+0000 7f045b009b80 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54a30c0 0x5644a54a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.521+0000 7f045b009b80 4 client.26200 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.521+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644a5458930 con 0x5644a54a30c0 2023-10-26T06:47:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.521+0000 7f044539b700 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54a30c0 0x5644a54a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.521+0000 7f044539b700 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54a30c0 0x5644a54a54e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac0d494888c473 server_cookie=c1745eeff83b56a7 in_seq=0 out_seq=0 2023-10-26T06:47:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.521+0000 7f0428ff9700 10 client.26200 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f0428ff9700 1 -- 172.21.15.50:0/1557994014 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5644a5458930 con 0x5644a54a30c0 2023-10-26T06:47:01.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f0428ff9700 10 client.26200 handle_command_reply: tid=0 2023-10-26T06:47:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 client.26200 shutdown 2023-10-26T06:47:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 msgr2=0x5644a5492f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5492f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04380196a0 tx=0x7f0438004ad0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 shutdown_connections 2023-10-26T06:47:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54a30c0 0x5644a54a54e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5492f30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a5495570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f0428ff9700 0 client.26200 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 --2- 172.21.15.50:0/1557994014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 >> 172.21.15.50:0/1557994014 conn(0x5644a53fd7a0 msgr2=0x5644a5488100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 shutdown_connections 2023-10-26T06:47:01.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.522+0000 7f045b009b80 1 -- 172.21.15.50:0/1557994014 wait complete. 2023-10-26T06:47:01.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.523+0000 7f045b009b80 20 client.26200 trim_cache size 0 max 16384 2023-10-26T06:47:01.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 Processor -- start 2023-10-26T06:47:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 -- start start 2023-10-26T06:47:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 0x5644a548ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a548ec60 0x5644a5499f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548f580 0x5644a54950a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a525c9a0 con 0x5644a548f580 2023-10-26T06:47:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a54894e0 con 0x5644a548ec60 2023-10-26T06:47:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.543+0000 7f045b009b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a547c0a0 con 0x5644a5489650 2023-10-26T06:47:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 0x5644a548ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f0444b9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a548ec60 0x5644a5499f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 0x5644a548ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57410/0 (socket says 172.21.15.50:57410) 2023-10-26T06:47:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 -- 172.21.15.50:0/795320332 learned_addr learned my addr 172.21.15.50:0/795320332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f0445b9c700 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548f580 0x5644a54950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 -- 172.21.15.50:0/795320332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a548ec60 msgr2=0x5644a5499f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a548ec60 0x5644a5499f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 -- 172.21.15.50:0/795320332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548f580 msgr2=0x5644a54950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548f580 0x5644a54950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 -- 172.21.15.50:0/795320332 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a54aa110 con 0x5644a5489650 2023-10-26T06:47:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f044539b700 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 0x5644a548ce40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f043c096740 tx=0x7f043c007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4add1d58ca2a4eb server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f042bfff700 1 -- 172.21.15.50:0/795320332 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0a25d0 con 0x5644a5489650 2023-10-26T06:47:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f042bfff700 1 -- 172.21.15.50:0/795320332 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f043c09e390 con 0x5644a5489650 2023-10-26T06:47:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.544+0000 7f042bfff700 1 -- 172.21.15.50:0/795320332 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c09a6e0 con 0x5644a5489650 2023-10-26T06:47:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 -- 172.21.15.50:0/795320332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 msgr2=0x5644a548ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 0x5644a548ce40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f043c096740 tx=0x7f043c007f90 comp rx=0 tx=0).stop 2023-10-26T06:47:01.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 -- 172.21.15.50:0/795320332 shutdown_connections 2023-10-26T06:47:01.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548f580 0x5644a54950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a5489650 0x5644a548ce40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 --2- 172.21.15.50:0/795320332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a548ec60 0x5644a5499f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 -- 172.21.15.50:0/795320332 >> 172.21.15.50:0/795320332 conn(0x5644a53fd7a0 msgr2=0x5644a548c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 -- 172.21.15.50:0/795320332 shutdown_connections 2023-10-26T06:47:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.545+0000 7f045b009b80 1 -- 172.21.15.50:0/795320332 wait complete. 2023-10-26T06:47:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 -- start start 2023-10-26T06:47:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 Processor -- start 2023-10-26T06:47:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a54f1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5499280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5499850 con 0x5644a548ec60 2023-10-26T06:47:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a54999c0 con 0x5644a5489650 2023-10-26T06:47:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.546+0000 7f045b009b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5499b80 con 0x5644a548f580 2023-10-26T06:47:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f045b009b80 10 client.0 _ll_register_callbacks cb 0x5644a52c2b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:01.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f044539b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a54f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0444b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5499280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f044539b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a54f1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34262/0 (socket says 172.21.15.50:34262) 2023-10-26T06:47:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f044539b700 1 -- 172.21.15.50:0/901693045 learned_addr learned my addr 172.21.15.50:0/901693045 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 -- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 msgr2=0x5644a54f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a54f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 -- 172.21.15.50:0/901693045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 msgr2=0x5644a54f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 -- 172.21.15.50:0/901693045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644a5399470 con 0x5644a548f580 2023-10-26T06:47:01.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0445b9c700 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5499280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0438019670 tx=0x7f0438018d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba9d792086bca12 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.547+0000 7f0428ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:47:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f0428ff9700 1 -- 172.21.15.50:0/901693045 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380076c0 con 0x5644a548f580 2023-10-26T06:47:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f043c09b330 con 0x5644a548f580 2023-10-26T06:47:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f0428ff9700 1 -- 172.21.15.50:0/901693045 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0438004b40 con 0x5644a548f580 2023-10-26T06:47:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f0428ff9700 1 -- 172.21.15.50:0/901693045 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0438004d00 con 0x5644a548f580 2023-10-26T06:47:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 10 client.26206 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5644a51efce0 con 0x5644a548f580 2023-10-26T06:47:01.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f0428ff9700 1 -- 172.21.15.50:0/901693045 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f043c09b330 con 0x5644a548f580 2023-10-26T06:47:01.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f0428ff9700 1 -- 172.21.15.50:0/901693045 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f04380196d0 con 0x5644a548f580 2023-10-26T06:47:01.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 10 client.26206 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:01.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 10 client.26206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:01.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 20 client.26206 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:01.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54f94e0 0x5644a54fb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 4 client.26206 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:47:01.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.548+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5644a53d4ed0 con 0x5644a54f94e0 2023-10-26T06:47:01.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.549+0000 7f044539b700 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54f94e0 0x5644a54fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.549+0000 7f044539b700 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54f94e0 0x5644a54fb900 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb4b5fbcf606538 server_cookie=72d675fd706091d1 in_seq=0 out_seq=0 2023-10-26T06:47:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.549+0000 7f0428ff9700 10 client.26206 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.550+0000 7f0428ff9700 1 -- 172.21.15.50:0/901693045 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5644a53d4ed0 con 0x5644a54f94e0 2023-10-26T06:47:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.550+0000 7f0428ff9700 10 client.26206 handle_command_reply: tid=0 2023-10-26T06:47:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 client.26206 shutdown 2023-10-26T06:47:01.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 msgr2=0x5644a5499280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5499280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0438019670 tx=0x7f0438018d70 comp rx=0 tx=0).stop 2023-10-26T06:47:01.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 shutdown_connections 2023-10-26T06:47:01.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5644a54f94e0 0x5644a54fb900 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5644a548f580 0x5644a5499280 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5644a5489650 0x5644a54f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f0428ff9700 0 client.26206 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 --2- 172.21.15.50:0/901693045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644a548ec60 0x5644a54f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 >> 172.21.15.50:0/901693045 conn(0x5644a53fd7a0 msgr2=0x5644a548d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 shutdown_connections 2023-10-26T06:47:01.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 1 -- 172.21.15.50:0/901693045 wait complete. 2023-10-26T06:47:01.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.551+0000 7f045b009b80 20 client.26206 trim_cache size 0 max 16384 2023-10-26T06:47:01.565 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:47:01.565 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:47:01.565 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "b3cfb5b8-3c7e-46f6-94c1-e7238e67ab54", 2023-10-26T06:47:01.566 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:47:01.566 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:47:01.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f042c0a15f0 msgr2=0x7f042c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f042c0a15f0 0x7f042c0a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0438007820 tx=0x7f0438009130 comp rx=0 tx=0).stop 2023-10-26T06:47:01.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 msgr2=0x7f0440072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 0x7f0440072af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f043c00e9a0 tx=0x7f043c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 shutdown_connections 2023-10-26T06:47:01.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f042c0a15f0 0x7f042c0a3ab0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0440106730 0x7f0440073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0440100720 0x7f0440072af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 --2- 172.21.15.50:0/1372574293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04401010e0 0x7f0440073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 >> 172.21.15.50:0/1372574293 conn(0x7f04400fc1b0 msgr2=0x7f04400fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 shutdown_connections 2023-10-26T06:47:01.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.552+0000 7f04475ff700 1 -- 172.21.15.50:0/1372574293 wait complete. 2023-10-26T06:47:01.572 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:47:01.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.817+0000 7fef353ff700 1 -- 172.21.15.50:0/1847666681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef3010d190 msgr2=0x7fef3010f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.817+0000 7fef353ff700 1 --2- 172.21.15.50:0/1847666681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef3010d190 0x7fef3010f580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fef2800b0a0 tx=0x7fef2800b3b0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.817+0000 7fef353ff700 1 -- 172.21.15.50:0/1847666681 shutdown_connections 2023-10-26T06:47:01.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.817+0000 7fef353ff700 1 --2- 172.21.15.50:0/1847666681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef3010d190 0x7fef3010f580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.817+0000 7fef353ff700 1 --2- 172.21.15.50:0/1847666681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.817+0000 7fef353ff700 1 --2- 172.21.15.50:0/1847666681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef30100a40 0x7fef3010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.818+0000 7fef353ff700 1 -- 172.21.15.50:0/1847666681 >> 172.21.15.50:0/1847666681 conn(0x7fef300767f0 msgr2=0x7fef30076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.818+0000 7fef353ff700 1 -- 172.21.15.50:0/1847666681 shutdown_connections 2023-10-26T06:47:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.818+0000 7fef353ff700 1 -- 172.21.15.50:0/1847666681 wait complete. 2023-10-26T06:47:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.819+0000 7fef353ff700 1 Processor -- start 2023-10-26T06:47:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.819+0000 7fef353ff700 1 -- start start 2023-10-26T06:47:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef353ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef353ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef30100a40 0x7fef30199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef353ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3010d190 0x7fef3019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34282/0 (socket says 172.21.15.50:34282) 2023-10-26T06:47:01.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef353ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3019de00 con 0x7fef3010d190 2023-10-26T06:47:01.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef2effd700 1 -- 172.21.15.50:0/2732459795 learned_addr learned my addr 172.21.15.50:0/2732459795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3019df70 con 0x7fef30100120 2023-10-26T06:47:01.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3019e130 con 0x7fef30100a40 2023-10-26T06:47:01.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.820+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef30100a40 0x7fef30199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3010d190 0x7fef3019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2effd700 1 -- 172.21.15.50:0/2732459795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef30100a40 msgr2=0x7fef30199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2effd700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef30100a40 0x7fef30199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2effd700 1 -- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3010d190 msgr2=0x7fef3019d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2effd700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3010d190 0x7fef3019d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2effd700 1 -- 172.21.15.50:0/2732459795 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28009d00 con 0x7fef30100120 2023-10-26T06:47:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3010d190 0x7fef3019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:47:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef2effd700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30198ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e9a0 tx=0x7fef2000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef17fff700 1 -- 172.21.15.50:0/2732459795 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20009790 con 0x7fef30100120 2023-10-26T06:47:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3019e410 con 0x7fef30100120 2023-10-26T06:47:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.821+0000 7fef17fff700 1 -- 172.21.15.50:0/2732459795 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef2000cbd0 con 0x7fef30100120 2023-10-26T06:47:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.822+0000 7fef17fff700 1 -- 172.21.15.50:0/2732459795 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20018680 con 0x7fef30100120 2023-10-26T06:47:01.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.822+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef301a5c50 con 0x7fef30100120 2023-10-26T06:47:01.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.826+0000 7fef17fff700 1 -- 172.21.15.50:0/2732459795 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fef2000cd40 con 0x7fef30100120 2023-10-26T06:47:01.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 Processor -- start 2023-10-26T06:47:01.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 -- start start 2023-10-26T06:47:01.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a669e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a669ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a66116e0 con 0x55f6a66a3be0 2023-10-26T06:47:01.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a65f7c60 con 0x55f6a66a4500 2023-10-26T06:47:01.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.828+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a65f5580 con 0x55f6a669e5d0 2023-10-26T06:47:01.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef17fff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fef180a1670 0x7fef180a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef17fff700 1 -- 172.21.15.50:0/2732459795 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fef20014070 con 0x7fef30100120 2023-10-26T06:47:01.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a669e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a669ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a669e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34296/0 (socket says 172.21.15.50:34296) 2023-10-26T06:47:01.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 -- 172.21.15.50:0/2916899367 learned_addr learned my addr 172.21.15.50:0/2916899367 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fef180a1670 0x7fef180a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 -- 172.21.15.50:0/2916899367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 msgr2=0x55f6a669ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a669ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 -- 172.21.15.50:0/2916899367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 msgr2=0x55f6a66a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.829+0000 7fef2effd700 1 -- 172.21.15.50:0/2916899367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6a65ae3f0 con 0x55f6a66a4500 2023-10-26T06:47:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.830+0000 7fef2effd700 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a669e090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef20096d80 tx=0x7fef20099c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ed990b00003ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.830+0000 7fef157fa700 1 -- 172.21.15.50:0/2916899367 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2009a310 con 0x55f6a66a4500 2023-10-26T06:47:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.830+0000 7fef157fa700 1 -- 172.21.15.50:0/2916899367 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef2009e460 con 0x55f6a66a4500 2023-10-26T06:47:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.830+0000 7fef157fa700 1 -- 172.21.15.50:0/2916899367 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2009a570 con 0x55f6a66a4500 2023-10-26T06:47:01.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 -- 172.21.15.50:0/2916899367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 msgr2=0x55f6a669e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fef180a1670 0x7fef180a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef2800b070 tx=0x7fef28006210 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a669e090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef20096d80 tx=0x7fef20099c70 comp rx=0 tx=0).stop 2023-10-26T06:47:01.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 -- 172.21.15.50:0/2916899367 shutdown_connections 2023-10-26T06:47:01.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a669ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/2916899367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a669e090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 -- 172.21.15.50:0/2916899367 >> 172.21.15.50:0/2916899367 conn(0x55f6a6612720 msgr2=0x55f6a6698b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 -- 172.21.15.50:0/2916899367 shutdown_connections 2023-10-26T06:47:01.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.831+0000 7fef48cfbb80 1 -- 172.21.15.50:0/2916899367 wait complete. 2023-10-26T06:47:01.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.832+0000 7fef48cfbb80 1 -- start start 2023-10-26T06:47:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.832+0000 7fef48cfbb80 1 Processor -- start 2023-10-26T06:47:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a3be0 0x55f6a66a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a4500 0x55f6a66a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a65f0e70 con 0x55f6a66a4500 2023-10-26T06:47:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a658d710 con 0x55f6a669e5d0 2023-10-26T06:47:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a658d3b0 con 0x55f6a66a3be0 2023-10-26T06:47:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef48cfbb80 10 client.0 _ll_register_callbacks cb 0x55f6a64d7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:01.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a4500 0x55f6a66a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66aa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34298/0 (socket says 172.21.15.50:34298) 2023-10-26T06:47:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef2f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a4500 0x55f6a66a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52960/0 (socket says 172.21.15.50:52960) 2023-10-26T06:47:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.833+0000 7fef2effd700 1 -- 172.21.15.50:0/4225374670 learned_addr learned my addr 172.21.15.50:0/4225374670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef2effd700 1 -- 172.21.15.50:0/4225374670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a3be0 msgr2=0x55f6a66a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef2effd700 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a3be0 0x55f6a66a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef2effd700 1 -- 172.21.15.50:0/4225374670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a4500 msgr2=0x55f6a66a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef2effd700 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a4500 0x55f6a66a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef2effd700 1 -- 172.21.15.50:0/4225374670 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef301a5c50 con 0x55f6a669e5d0 2023-10-26T06:47:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef2effd700 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66aa4e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e970 tx=0x7fef2000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db83530927774ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:47:01.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef12ff5700 1 -- 172.21.15.50:0/4225374670 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200a9ea0 con 0x55f6a669e5d0 2023-10-26T06:47:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef12ff5700 1 -- 172.21.15.50:0/4225374670 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fef200b0020 con 0x55f6a669e5d0 2023-10-26T06:47:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.834+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6a65f5ef0 con 0x55f6a669e5d0 2023-10-26T06:47:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef12ff5700 1 -- 172.21.15.50:0/4225374670 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef2009a570 con 0x55f6a669e5d0 2023-10-26T06:47:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 10 client.26213 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:01.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55f6a641bde0 con 0x55f6a669e5d0 2023-10-26T06:47:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef12ff5700 1 -- 172.21.15.50:0/4225374670 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f6a65f5ef0 con 0x55f6a669e5d0 2023-10-26T06:47:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef12ff5700 1 -- 172.21.15.50:0/4225374670 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fef200a99a0 con 0x55f6a669e5d0 2023-10-26T06:47:01.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 10 client.26213 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 10 client.26213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 20 client.26213 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a66c8b70 0x55f6a66caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 4 client.26213 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:01.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.835+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6a666d8b0 con 0x55f6a66c8b70 2023-10-26T06:47:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.836+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a66c8b70 0x55f6a66caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.836+0000 7fef12ff5700 10 client.26213 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.836+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a66c8b70 0x55f6a66caf90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec72841072b262f1 server_cookie=9fd7a82b0f674e94 in_seq=0 out_seq=0 2023-10-26T06:47:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.837+0000 7fef12ff5700 1 -- 172.21.15.50:0/4225374670 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f6a666d8b0 con 0x55f6a66c8b70 2023-10-26T06:47:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.837+0000 7fef12ff5700 10 client.26213 handle_command_reply: tid=0 2023-10-26T06:47:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.837+0000 7fef48cfbb80 1 client.26213 shutdown 2023-10-26T06:47:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.837+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 msgr2=0x55f6a66aa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66aa4e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e970 tx=0x7fef2000ef60 comp rx=0 tx=0).stop 2023-10-26T06:47:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 shutdown_connections 2023-10-26T06:47:01.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a66c8b70 0x55f6a66caf90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a4500 0x55f6a66a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66aa4e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4225374670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a3be0 0x55f6a66a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 >> 172.21.15.50:0/4225374670 conn(0x55f6a6612720 msgr2=0x55f6a669d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef12ff5700 0 client.26213 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 shutdown_connections 2023-10-26T06:47:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4225374670 wait complete. 2023-10-26T06:47:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.838+0000 7fef48cfbb80 20 client.26213 trim_cache size 0 max 16384 2023-10-26T06:47:01.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 Processor -- start 2023-10-26T06:47:01.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 -- start start 2023-10-26T06:47:01.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66935d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a4500 0x55f6a669d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a6471920 con 0x55f6a66a3be0 2023-10-26T06:47:01.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a66aac90 con 0x55f6a669e5d0 2023-10-26T06:47:01.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.864+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a66c5950 con 0x55f6a66a4500 2023-10-26T06:47:01.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66935d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a4500 0x55f6a669d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66935d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:34302/0 (socket says 172.21.15.50:34302) 2023-10-26T06:47:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 -- 172.21.15.50:0/4027046435 learned_addr learned my addr 172.21.15.50:0/4027046435 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a4500 0x55f6a669d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57472/0 (socket says 172.21.15.50:57472) 2023-10-26T06:47:01.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 -- 172.21.15.50:0/4027046435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a4500 msgr2=0x55f6a669d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a4500 0x55f6a669d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 -- 172.21.15.50:0/4027046435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 msgr2=0x55f6a66aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2effd700 1 -- 172.21.15.50:0/4027046435 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6a6404c60 con 0x55f6a669e5d0 2023-10-26T06:47:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.865+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:47:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.866+0000 7fef2effd700 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66935d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef20096810 tx=0x7fef20010b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bbab7d7700dbf12 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.866+0000 7fef15ffb700 1 -- 172.21.15.50:0/4027046435 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200a9ea0 con 0x55f6a669e5d0 2023-10-26T06:47:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.866+0000 7fef15ffb700 1 -- 172.21.15.50:0/4027046435 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef20099270 con 0x55f6a669e5d0 2023-10-26T06:47:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.866+0000 7fef15ffb700 1 -- 172.21.15.50:0/4027046435 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200a2470 con 0x55f6a669e5d0 2023-10-26T06:47:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4027046435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 msgr2=0x55f6a66935d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66935d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef20096810 tx=0x7fef20010b50 comp rx=0 tx=0).stop 2023-10-26T06:47:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4027046435 shutdown_connections 2023-10-26T06:47:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a66a4500 0x55f6a669d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a669e5d0 0x55f6a66935d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/4027046435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4027046435 >> 172.21.15.50:0/4027046435 conn(0x55f6a6612720 msgr2=0x55f6a669e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4027046435 shutdown_connections 2023-10-26T06:47:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.867+0000 7fef48cfbb80 1 -- 172.21.15.50:0/4027046435 wait complete. 2023-10-26T06:47:01.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.868+0000 7fef48cfbb80 1 -- start start 2023-10-26T06:47:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.868+0000 7fef48cfbb80 1 Processor -- start 2023-10-26T06:47:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a66a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a6715a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a6715f40 con 0x55f6a66a3be0 2023-10-26T06:47:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a67160b0 con 0x55f6a66a4500 2023-10-26T06:47:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6a6716270 con 0x55f6a669e5d0 2023-10-26T06:47:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef48cfbb80 10 client.0 _ll_register_callbacks cb 0x55f6a64d7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef2effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a66a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef2effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a66a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:57474/0 (socket says 172.21.15.50:57474) 2023-10-26T06:47:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef2effd700 1 -- 172.21.15.50:0/1981804811 learned_addr learned my addr 172.21.15.50:0/1981804811 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a6715a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.869+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2effd700 1 -- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 msgr2=0x55f6a6715a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2effd700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a6715a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2effd700 1 -- 172.21.15.50:0/1981804811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 msgr2=0x55f6a66a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2effd700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2effd700 1 -- 172.21.15.50:0/1981804811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6a641bde0 con 0x55f6a669e5d0 2023-10-26T06:47:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:01.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2f7fe700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a6715a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef2effd700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a66a4ad0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef200967c0 tx=0x7fef200cab60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541cbf520637a094 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:47:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef12ff5700 1 -- 172.21.15.50:0/1981804811 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200a9ea0 con 0x55f6a669e5d0 2023-10-26T06:47:01.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.870+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef2009e460 con 0x55f6a669e5d0 2023-10-26T06:47:01.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.871+0000 7fef12ff5700 1 -- 172.21.15.50:0/1981804811 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fef200b0070 con 0x55f6a669e5d0 2023-10-26T06:47:01.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.871+0000 7fef12ff5700 1 -- 172.21.15.50:0/1981804811 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef200a2420 con 0x55f6a669e5d0 2023-10-26T06:47:01.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.871+0000 7fef48cfbb80 10 client.26221 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:01.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.871+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55f6a6442250 con 0x55f6a669e5d0 2023-10-26T06:47:01.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef12ff5700 1 -- 172.21.15.50:0/1981804811 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef2009e460 con 0x55f6a669e5d0 2023-10-26T06:47:01.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef12ff5700 1 -- 172.21.15.50:0/1981804811 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fef200a92f0 con 0x55f6a669e5d0 2023-10-26T06:47:01.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef48cfbb80 10 client.26221 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:01.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef48cfbb80 10 client.26221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:01.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef48cfbb80 20 client.26221 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:01.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a671d620 0x55f6a671fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:01.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef48cfbb80 4 client.26221 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:47:01.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f6a65e9e50 con 0x55f6a671d620 2023-10-26T06:47:01.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.872+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a671d620 0x55f6a671fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:01.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.873+0000 7fef2e7fc700 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a671d620 0x55f6a671fa10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9714910f3269381 server_cookie=f52d401f06e83396 in_seq=0 out_seq=0 2023-10-26T06:47:01.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.873+0000 7fef12ff5700 10 client.26221 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef12ff5700 1 -- 172.21.15.50:0/1981804811 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55f6a65e9e50 con 0x55f6a671d620 2023-10-26T06:47:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef12ff5700 10 client.26221 handle_command_reply: tid=0 2023-10-26T06:47:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 client.26221 shutdown 2023-10-26T06:47:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 msgr2=0x55f6a66a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a66a4ad0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef200967c0 tx=0x7fef200cab60 comp rx=0 tx=0).stop 2023-10-26T06:47:01.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 shutdown_connections 2023-10-26T06:47:01.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55f6a671d620 0x55f6a671fa10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f6a66a4500 0x55f6a6715a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f6a669e5d0 0x55f6a66a4ad0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 --2- 172.21.15.50:0/1981804811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f6a66a3be0 0x55f6a66a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef12ff5700 0 client.26221 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 >> 172.21.15.50:0/1981804811 conn(0x55f6a6612720 msgr2=0x55f6a66b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 shutdown_connections 2023-10-26T06:47:01.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 1 -- 172.21.15.50:0/1981804811 wait complete. 2023-10-26T06:47:01.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.874+0000 7fef48cfbb80 20 client.26221 trim_cache size 0 max 16384 2023-10-26T06:47:01.891 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:47:01.891 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (6177 inodes in the stack)", 2023-10-26T06:47:01.891 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:47:01.892 INFO:teuthology.orchestra.run.smithi050.stdout: "b3cfb5b8-3c7e-46f6-94c1-e7238e67ab54": { 2023-10-26T06:47:01.892 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:47:01.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "b3cfb5b8-3c7e-46f6-94c1-e7238e67ab54", 2023-10-26T06:47:01.893 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:47:01.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:47:01.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:47:01.893 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:47:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fef180a1670 msgr2=0x7fef180a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fef180a1670 0x7fef180a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fef2800b070 tx=0x7fef28006210 comp rx=0 tx=0).stop 2023-10-26T06:47:01.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 msgr2=0x7fef30198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:01.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30198ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef2000e9a0 tx=0x7fef2000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 shutdown_connections 2023-10-26T06:47:01.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fef180a1670 0x7fef180a3b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef3010d190 0x7fef3019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef30100120 0x7fef30198ee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 --2- 172.21.15.50:0/2732459795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef30100a40 0x7fef30199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:01.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.875+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 >> 172.21.15.50:0/2732459795 conn(0x7fef300767f0 msgr2=0x7fef3010e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:01.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.876+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 shutdown_connections 2023-10-26T06:47:01.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:01.876+0000 7fef353ff700 1 -- 172.21.15.50:0/2732459795 wait complete. 2023-10-26T06:47:01.898 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:01 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:47:01.902 INFO:tasks.cephfs.filesystem:scrub status for tag:b3cfb5b8-3c7e-46f6-94c1-e7238e67ab54 - {'path': '/', 'tag': 'b3cfb5b8-3c7e-46f6-94c1-e7238e67ab54', 'options': 'recursive,force'} 2023-10-26T06:47:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:01 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:47:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:01 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:47:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:02 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:47:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:02 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:03.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:02 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:47:03.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:02 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:47:03.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:02 smithi125 ceph-mon[130643]: pgmap v420: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 886 op/s 2023-10-26T06:47:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:02 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:47:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:02 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:03.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:02 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:47:03.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:02 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:47:03.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:02 smithi153 ceph-mon[131657]: pgmap v420: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 886 op/s 2023-10-26T06:47:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:02 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:47:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:02 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:02 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:47:03.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:02 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:47:03.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:02 smithi050 ceph-mon[94997]: pgmap v420: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 16 MiB/s wr, 886 op/s 2023-10-26T06:47:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:03 smithi153 ceph-mon[131657]: pgmap v421: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 850 op/s 2023-10-26T06:47:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:03 smithi050 ceph-mon[94997]: pgmap v421: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 850 op/s 2023-10-26T06:47:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:03 smithi125 ceph-mon[130643]: pgmap v421: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 850 op/s 2023-10-26T06:47:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:06 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:06 smithi125 ceph-mon[130643]: pgmap v422: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 480 op/s 2023-10-26T06:47:07.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:06 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:06 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:06 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:06 smithi153 ceph-mon[131657]: pgmap v422: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 480 op/s 2023-10-26T06:47:07.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:06 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:06 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:06 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:06 smithi050 ceph-mon[94997]: pgmap v422: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 480 op/s 2023-10-26T06:47:07.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:06 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:07.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:06 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:08 smithi125 ceph-mon[130643]: pgmap v423: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.4 MiB/s wr, 330 op/s 2023-10-26T06:47:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:08 smithi153 ceph-mon[131657]: pgmap v423: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.4 MiB/s wr, 330 op/s 2023-10-26T06:47:09.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:08 smithi050 ceph-mon[94997]: pgmap v423: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.4 MiB/s wr, 330 op/s 2023-10-26T06:47:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:10 smithi125 ceph-mon[130643]: pgmap v424: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 166 op/s 2023-10-26T06:47:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:10 smithi153 ceph-mon[131657]: pgmap v424: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 166 op/s 2023-10-26T06:47:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:10 smithi050 ceph-mon[94997]: pgmap v424: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 166 op/s 2023-10-26T06:47:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:12 smithi125 ceph-mon[130643]: pgmap v425: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 356 op/s 2023-10-26T06:47:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:12 smithi153 ceph-mon[131657]: pgmap v425: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 356 op/s 2023-10-26T06:47:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:12 smithi050 ceph-mon[94997]: pgmap v425: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 356 op/s 2023-10-26T06:47:14.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:13 smithi153 ceph-mon[131657]: pgmap v426: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.5 MiB/s wr, 761 op/s 2023-10-26T06:47:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:13 smithi050 ceph-mon[94997]: pgmap v426: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.5 MiB/s wr, 761 op/s 2023-10-26T06:47:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:13 smithi125 ceph-mon[130643]: pgmap v426: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.5 MiB/s wr, 761 op/s 2023-10-26T06:47:15.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:14 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:47:15.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:14 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:47:15.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:14 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:47:16.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:15 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:47:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:15 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:47:16.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:15 smithi153 ceph-mon[131657]: pgmap v427: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 833 op/s 2023-10-26T06:47:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:15 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:47:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:15 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:47:16.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:15 smithi050 ceph-mon[94997]: pgmap v427: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 833 op/s 2023-10-26T06:47:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:15 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:47:16.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:15 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:47:16.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:15 smithi125 ceph-mon[130643]: pgmap v427: 97 pgs: 97 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 833 op/s 2023-10-26T06:47:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:18 smithi125 ceph-mon[130643]: pgmap v428: 97 pgs: 97 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 1.06k op/s 2023-10-26T06:47:19.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:18 smithi153 ceph-mon[131657]: pgmap v428: 97 pgs: 97 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 1.06k op/s 2023-10-26T06:47:19.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:18 smithi050 ceph-mon[94997]: pgmap v428: 97 pgs: 97 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 1.06k op/s 2023-10-26T06:47:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:20 smithi125 ceph-mon[130643]: pgmap v429: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 1.48k op/s 2023-10-26T06:47:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:20 smithi153 ceph-mon[131657]: pgmap v429: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 1.48k op/s 2023-10-26T06:47:21.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:20 smithi050 ceph-mon[94997]: pgmap v429: 97 pgs: 97 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 1.48k op/s 2023-10-26T06:47:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:22 smithi125 ceph-mon[130643]: pgmap v430: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 1.66k op/s 2023-10-26T06:47:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:22 smithi153 ceph-mon[131657]: pgmap v430: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 1.66k op/s 2023-10-26T06:47:23.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:22 smithi050 ceph-mon[94997]: pgmap v430: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.1 MiB/s wr, 1.66k op/s 2023-10-26T06:47:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:23 smithi153 ceph-mon[131657]: pgmap v431: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.69k op/s 2023-10-26T06:47:24.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:23 smithi050 ceph-mon[94997]: pgmap v431: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.69k op/s 2023-10-26T06:47:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:23 smithi125 ceph-mon[130643]: pgmap v431: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.69k op/s 2023-10-26T06:47:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:+ cd linux-5.4 2023-10-26T06:47:25.287 INFO:tasks.workunit.client.0.smithi050.stderr:+ make defconfig 2023-10-26T06:47:26.148 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/basic/fixdep 2023-10-26T06:47:26.325 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/conf.o 2023-10-26T06:47:26.518 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/confdata.o 2023-10-26T06:47:26.810 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/expr.o 2023-10-26T06:47:27.039 INFO:tasks.workunit.client.0.smithi050.stdout: LEX scripts/kconfig/lexer.lex.c 2023-10-26T06:47:27.058 INFO:tasks.workunit.client.0.smithi050.stdout: YACC scripts/kconfig/parser.tab.[ch] 2023-10-26T06:47:27.115 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/lexer.lex.o 2023-10-26T06:47:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:26 smithi125 ceph-mon[130643]: pgmap v432: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-10-26T06:47:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:26 smithi153 ceph-mon[131657]: pgmap v432: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-10-26T06:47:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:26 smithi050 ceph-mon[94997]: pgmap v432: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-10-26T06:47:27.427 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/parser.tab.o 2023-10-26T06:47:27.831 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/preprocess.o 2023-10-26T06:47:27.967 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kconfig/symbol.o 2023-10-26T06:47:28.282 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTLD scripts/kconfig/conf 2023-10-26T06:47:28.314 INFO:tasks.workunit.client.0.smithi050.stdout:*** Default configuration is based on 'x86_64_defconfig' 2023-10-26T06:47:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:28 smithi125 ceph-mon[130643]: pgmap v433: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-10-26T06:47:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:28 smithi153 ceph-mon[131657]: pgmap v433: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-10-26T06:47:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:28 smithi050 ceph-mon[94997]: pgmap v433: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-10-26T06:47:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:30 smithi125 ceph-mon[130643]: pgmap v434: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 956 op/s 2023-10-26T06:47:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:30 smithi153 ceph-mon[131657]: pgmap v434: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 956 op/s 2023-10-26T06:47:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:30 smithi050 ceph-mon[94997]: pgmap v434: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 956 op/s 2023-10-26T06:47:31.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:47:32.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.110+0000 7fb609bff700 1 -- 172.21.15.50:0/2733310831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 msgr2=0x7fb604106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.110+0000 7fb609bff700 1 --2- 172.21.15.50:0/2733310831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604106b10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009990 tx=0x7fb5f4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.110+0000 7fb609bff700 1 -- 172.21.15.50:0/2733310831 shutdown_connections 2023-10-26T06:47:32.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.111+0000 7fb609bff700 1 --2- 172.21.15.50:0/2733310831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6041010e0 0x7fb60410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.111+0000 7fb609bff700 1 --2- 172.21.15.50:0/2733310831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604106b10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.111+0000 7fb609bff700 1 --2- 172.21.15.50:0/2733310831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb604100720 0x7fb604100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.111+0000 7fb609bff700 1 -- 172.21.15.50:0/2733310831 >> 172.21.15.50:0/2733310831 conn(0x7fb6040fc1b0 msgr2=0x7fb6040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.111+0000 7fb609bff700 1 -- 172.21.15.50:0/2733310831 shutdown_connections 2023-10-26T06:47:32.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.111+0000 7fb609bff700 1 -- 172.21.15.50:0/2733310831 wait complete. 2023-10-26T06:47:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 Processor -- start 2023-10-26T06:47:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 -- start start 2023-10-26T06:47:32.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 0x7fb60419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6041010e0 0x7fb60419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6041991f0 con 0x7fb604106730 2023-10-26T06:47:32.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604199360 con 0x7fb604100720 2023-10-26T06:47:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb609bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604199520 con 0x7fb6041010e0 2023-10-26T06:47:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 0x7fb60419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.112+0000 7fb603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 0x7fb60419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:55658/0 (socket says 172.21.15.50:55658) 2023-10-26T06:47:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 -- 172.21.15.50:0/1729305179 learned_addr learned my addr 172.21.15.50:0/1729305179 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb602ffd700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6041010e0 0x7fb60419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 -- 172.21.15.50:0/1729305179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6041010e0 msgr2=0x7fb60419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6041010e0 0x7fb60419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 -- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 msgr2=0x7fb604198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 -- 172.21.15.50:0/1729305179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f40095f0 con 0x7fb604100720 2023-10-26T06:47:32.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb603fff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:32.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb6037fe700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 0x7fb60419ea60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000c00 tx=0x7fb5f4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb600ff9700 1 -- 172.21.15.50:0/1729305179 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f401d070 con 0x7fb604100720 2023-10-26T06:47:32.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6041997a0 con 0x7fb604100720 2023-10-26T06:47:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb600ff9700 1 -- 172.21.15.50:0/1729305179 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5f4022470 con 0x7fb604100720 2023-10-26T06:47:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.113+0000 7fb600ff9700 1 -- 172.21.15.50:0/1729305179 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4017650 con 0x7fb604100720 2023-10-26T06:47:32.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.114+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6041a5a50 con 0x7fb604100720 2023-10-26T06:47:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.117+0000 7fb600ff9700 1 -- 172.21.15.50:0/1729305179 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb5f40225e0 con 0x7fb604100720 2023-10-26T06:47:32.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 Processor -- start 2023-10-26T06:47:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 -- start start 2023-10-26T06:47:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb600ff9700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5ec0a15f0 0x7fb5ec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb600ff9700 1 -- 172.21.15.50:0/1729305179 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb5f40ce200 con 0x7fb604100720 2023-10-26T06:47:32.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 0x55c5af8e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e1500 0x55c5af8db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8dba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af84e6e0 con 0x55c5af8e0be0 2023-10-26T06:47:32.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb603fff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5ec0a15f0 0x7fb5ec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af834c60 con 0x55c5af8db5d0 2023-10-26T06:47:32.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af832580 con 0x55c5af8e1500 2023-10-26T06:47:32.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.118+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 0x55c5af8e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 0x55c5af8e0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40928/0 (socket says 172.21.15.50:40928) 2023-10-26T06:47:32.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 -- 172.21.15.50:0/2238250952 learned_addr learned my addr 172.21.15.50:0/2238250952 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb602ffd700 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e1500 0x55c5af8db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb603fff700 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 -- 172.21.15.50:0/2238250952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e1500 msgr2=0x55c5af8db090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e1500 0x55c5af8db090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 -- 172.21.15.50:0/2238250952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 msgr2=0x55c5af8dba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8dba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 -- 172.21.15.50:0/2238250952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5af7eb3f0 con 0x55c5af8e0be0 2023-10-26T06:47:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb603fff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5ec0a15f0 0x7fb5ec0a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009ec0 tx=0x7fb5fc004570 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb6037fe700 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 0x55c5af8e0fc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb5f409b250 tx=0x7fb5f409aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01a4dea3d7bf50e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb5e9ffb700 1 -- 172.21.15.50:0/2238250952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f409b2c0 con 0x55c5af8e0be0 2023-10-26T06:47:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb5e9ffb700 1 -- 172.21.15.50:0/2238250952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5f409f410 con 0x55c5af8e0be0 2023-10-26T06:47:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.119+0000 7fb5e9ffb700 1 -- 172.21.15.50:0/2238250952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f409b760 con 0x55c5af8e0be0 2023-10-26T06:47:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2238250952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 msgr2=0x55c5af8e0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 0x55c5af8e0fc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb5f409b250 tx=0x7fb5f409aef0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2238250952 shutdown_connections 2023-10-26T06:47:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8dba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e0be0 0x55c5af8e0fc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2238250952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e1500 0x55c5af8db090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2238250952 >> 172.21.15.50:0/2238250952 conn(0x55c5af84f720 msgr2=0x55c5af8d5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2238250952 shutdown_connections 2023-10-26T06:47:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.120+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2238250952 wait complete. 2023-10-26T06:47:32.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.121+0000 7fb61d4c1b80 1 -- start start 2023-10-26T06:47:32.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.121+0000 7fb61d4c1b80 1 Processor -- start 2023-10-26T06:47:32.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.121+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 0x55c5af8e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e1500 0x55c5af8e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af82de70 con 0x55c5af8db5d0 2023-10-26T06:47:32.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af7ca710 con 0x55c5af8e1500 2023-10-26T06:47:32.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af7ca3b0 con 0x55c5af8e0be0 2023-10-26T06:47:32.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb61d4c1b80 10 client.0 _ll_register_callbacks cb 0x55c5af714a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:32.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 0x55c5af8e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 0x55c5af8e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40942/0 (socket says 172.21.15.50:40942) 2023-10-26T06:47:32.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb602ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 -- 172.21.15.50:0/870203366 learned_addr learned my addr 172.21.15.50:0/870203366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb603fff700 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e1500 0x55c5af8e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 -- 172.21.15.50:0/870203366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 msgr2=0x55c5af8e4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 -- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e1500 msgr2=0x55c5af8e4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e1500 0x55c5af8e4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 -- 172.21.15.50:0/870203366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6041a5a50 con 0x55c5af8db5d0 2023-10-26T06:47:32.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb6037fe700 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 0x55c5af8e73e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a3090 tx=0x7fb5f400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798be1db370460df server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.122+0000 7fb5e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/870203366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f409b2c0 con 0x55c5af8db5d0 2023-10-26T06:47:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/870203366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb5f409a9c0 con 0x55c5af8db5d0 2023-10-26T06:47:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5af832ef0 con 0x55c5af8db5d0 2023-10-26T06:47:32.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/870203366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5f409b520 con 0x55c5af8db5d0 2023-10-26T06:47:32.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 10 client.16188 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:32.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c5af658de0 con 0x55c5af8db5d0 2023-10-26T06:47:32.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/870203366 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c5af832ef0 con 0x55c5af8db5d0 2023-10-26T06:47:32.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/870203366 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb5f4097190 con 0x55c5af8db5d0 2023-10-26T06:47:32.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 10 client.16188 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:32.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:32.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 20 client.16188 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:32.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af8f4670 0x55c5af8f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 4 client.16188 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:32.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.123+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5af8aa8b0 con 0x55c5af8f4670 2023-10-26T06:47:32.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.124+0000 7fb602ffd700 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af8f4670 0x55c5af8f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.124+0000 7fb602ffd700 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af8f4670 0x55c5af8f6a90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd4a19ba42cfe1a server_cookie=7dcd26cfd82b7169 in_seq=0 out_seq=0 2023-10-26T06:47:32.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.124+0000 7fb5e2ffd700 10 client.16188 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:32.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/870203366 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c5af8aa8b0 con 0x55c5af8f4670 2023-10-26T06:47:32.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb5e2ffd700 10 client.16188 handle_command_reply: tid=0 2023-10-26T06:47:32.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 client.16188 shutdown 2023-10-26T06:47:32.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 msgr2=0x55c5af8e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 0x55c5af8e73e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a3090 tx=0x7fb5f400b610 comp rx=0 tx=0).stop 2023-10-26T06:47:32.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 shutdown_connections 2023-10-26T06:47:32.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af8f4670 0x55c5af8f6a90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e1500 0x55c5af8e4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8db5d0 0x55c5af8e73e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb5e2ffd700 0 client.16188 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:32.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/870203366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 >> 172.21.15.50:0/870203366 conn(0x55c5af84f720 msgr2=0x55c5af8da080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 shutdown_connections 2023-10-26T06:47:32.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/870203366 wait complete. 2023-10-26T06:47:32.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.125+0000 7fb61d4c1b80 20 client.16188 trim_cache size 0 max 16384 2023-10-26T06:47:32.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 Processor -- start 2023-10-26T06:47:32.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 -- start start 2023-10-26T06:47:32.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 0x55c5af8ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e0be0 0x55c5af8e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8e3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af6ae920 con 0x55c5af8e1500 2023-10-26T06:47:32.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af8aa8e0 con 0x55c5af8e0be0 2023-10-26T06:47:32.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af8dc030 con 0x55c5af8db5d0 2023-10-26T06:47:32.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 0x55c5af8ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 0x55c5af8ebc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47604/0 (socket says 172.21.15.50:47604) 2023-10-26T06:47:32.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.143+0000 7fb6037fe700 1 -- 172.21.15.50:0/2069327725 learned_addr learned my addr 172.21.15.50:0/2069327725 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb602ffd700 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e0be0 0x55c5af8e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb6037fe700 1 -- 172.21.15.50:0/2069327725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e0be0 msgr2=0x55c5af8e2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb6037fe700 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e0be0 0x55c5af8e2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb6037fe700 1 -- 172.21.15.50:0/2069327725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 msgr2=0x55c5af8e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb6037fe700 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8e3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb6037fe700 1 -- 172.21.15.50:0/2069327725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5af641c60 con 0x55c5af8db5d0 2023-10-26T06:47:32.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb6037fe700 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 0x55c5af8ebc30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a3780 tx=0x7fb5f4022c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1709d210af8a573 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb5ea7fc700 1 -- 172.21.15.50:0/2069327725 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40047a0 con 0x55c5af8db5d0 2023-10-26T06:47:32.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb5ea7fc700 1 -- 172.21.15.50:0/2069327725 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5f40b9520 con 0x55c5af8db5d0 2023-10-26T06:47:32.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.144+0000 7fb5ea7fc700 1 -- 172.21.15.50:0/2069327725 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a3330 con 0x55c5af8db5d0 2023-10-26T06:47:32.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2069327725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 msgr2=0x55c5af8ebc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 0x55c5af8ebc30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a3780 tx=0x7fb5f4022c80 comp rx=0 tx=0).stop 2023-10-26T06:47:32.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2069327725 shutdown_connections 2023-10-26T06:47:32.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8db5d0 0x55c5af8ebc30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/2069327725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8e0be0 0x55c5af8e2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2069327725 >> 172.21.15.50:0/2069327725 conn(0x55c5af84f720 msgr2=0x55c5af8da890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2069327725 shutdown_connections 2023-10-26T06:47:32.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/2069327725 wait complete. 2023-10-26T06:47:32.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.145+0000 7fb61d4c1b80 1 -- start start 2023-10-26T06:47:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 Processor -- start 2023-10-26T06:47:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8eb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8ea330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af8ea870 con 0x55c5af8e1500 2023-10-26T06:47:32.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af8ea9e0 con 0x55c5af8db5d0 2023-10-26T06:47:32.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5af8eaba0 con 0x55c5af8e0be0 2023-10-26T06:47:32.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb61d4c1b80 10 client.0 _ll_register_callbacks cb 0x55c5af714a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:32.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8eb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb6037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8eb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:55694/0 (socket says 172.21.15.50:55694) 2023-10-26T06:47:32.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb6037fe700 1 -- 172.21.15.50:0/1856562914 learned_addr learned my addr 172.21.15.50:0/1856562914 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.146+0000 7fb602ffd700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb603fff700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb6037fe700 1 -- 172.21.15.50:0/1856562914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 msgr2=0x55c5af8e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb6037fe700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb6037fe700 1 -- 172.21.15.50:0/1856562914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 msgr2=0x55c5af8ea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb6037fe700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8ea330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb6037fe700 1 -- 172.21.15.50:0/1856562914 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5af658de0 con 0x55c5af8db5d0 2023-10-26T06:47:32.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb6037fe700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8eb9b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5f409b250 tx=0x7fb5f40098c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd920dd609505818 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb5e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:47:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/1856562914 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b92c0 con 0x55c5af8db5d0 2023-10-26T06:47:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/1856562914 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb5f409b2c0 con 0x55c5af8db5d0 2023-10-26T06:47:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5f409f410 con 0x55c5af8db5d0 2023-10-26T06:47:32.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/1856562914 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5f409ae00 con 0x55c5af8db5d0 2023-10-26T06:47:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb61d4c1b80 10 client.26237 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.147+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c5af67f250 con 0x55c5af8db5d0 2023-10-26T06:47:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/1856562914 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5f409f410 con 0x55c5af8db5d0 2023-10-26T06:47:32.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/1856562914 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb5f40ab020 con 0x55c5af8db5d0 2023-10-26T06:47:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb61d4c1b80 10 client.26237 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb61d4c1b80 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb61d4c1b80 20 client.26237 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af949430 0x55c5af94b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb61d4c1b80 4 client.26237 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:47:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c5af826e50 con 0x55c5af949430 2023-10-26T06:47:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.148+0000 7fb602ffd700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af949430 0x55c5af94b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb602ffd700 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af949430 0x55c5af94b820 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2845eda96e775d server_cookie=488338b91bf66174 in_seq=0 out_seq=0 2023-10-26T06:47:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb5e2ffd700 10 client.26237 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:32.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb5e2ffd700 1 -- 172.21.15.50:0/1856562914 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c5af826e50 con 0x55c5af949430 2023-10-26T06:47:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb5e2ffd700 10 client.26237 handle_command_reply: tid=0 2023-10-26T06:47:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 client.26237 shutdown 2023-10-26T06:47:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 msgr2=0x55c5af8eb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8eb9b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5f409b250 tx=0x7fb5f40098c0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 shutdown_connections 2023-10-26T06:47:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c5af949430 0x55c5af94b820 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c5af8e1500 0x55c5af8ea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c5af8db5d0 0x55c5af8eb9b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb5e2ffd700 0 client.26237 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 --2- 172.21.15.50:0/1856562914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5af8e0be0 0x55c5af8e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 >> 172.21.15.50:0/1856562914 conn(0x55c5af84f720 msgr2=0x55c5af8e2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 shutdown_connections 2023-10-26T06:47:32.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 1 -- 172.21.15.50:0/1856562914 wait complete. 2023-10-26T06:47:32.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.149+0000 7fb61d4c1b80 20 client.26237 trim_cache size 0 max 16384 2023-10-26T06:47:32.176 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:47:32.176 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:47:32.176 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:47:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:47:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5ec0a15f0 msgr2=0x7fb5ec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5ec0a15f0 0x7fb5ec0a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009ec0 tx=0x7fb5fc004570 comp rx=0 tx=0).stop 2023-10-26T06:47:32.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 msgr2=0x7fb60419ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 0x7fb60419ea60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000c00 tx=0x7fb5f4004730 comp rx=0 tx=0).stop 2023-10-26T06:47:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 shutdown_connections 2023-10-26T06:47:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5ec0a15f0 0x7fb5ec0a3ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb604106730 0x7fb604198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb604100720 0x7fb60419ea60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 --2- 172.21.15.50:0/1729305179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6041010e0 0x7fb60419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 >> 172.21.15.50:0/1729305179 conn(0x7fb6040fc1b0 msgr2=0x7fb60410bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 shutdown_connections 2023-10-26T06:47:32.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.150+0000 7fb609bff700 1 -- 172.21.15.50:0/1729305179 wait complete. 2023-10-26T06:47:32.181 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:47:32.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:47:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 -- 172.21.15.50:0/1117085852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528101060 msgr2=0x7f152810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 --2- 172.21.15.50:0/1117085852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528101060 0x7f152810d570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f152000b0a0 tx=0x7f152000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 -- 172.21.15.50:0/1117085852 shutdown_connections 2023-10-26T06:47:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 --2- 172.21.15.50:0/1117085852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1528101060 0x7f152810d570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 --2- 172.21.15.50:0/1117085852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15281066b0 0x7f1528106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 --2- 172.21.15.50:0/1117085852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f1528100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 -- 172.21.15.50:0/1117085852 >> 172.21.15.50:0/1117085852 conn(0x7f15280fc170 msgr2=0x7f15280fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 -- 172.21.15.50:0/1117085852 shutdown_connections 2023-10-26T06:47:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.387+0000 7f152e5ff700 1 -- 172.21.15.50:0/1117085852 wait complete. 2023-10-26T06:47:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.388+0000 7f152e5ff700 1 Processor -- start 2023-10-26T06:47:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.388+0000 7f152e5ff700 1 -- start start 2023-10-26T06:47:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152e5ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f152819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152e5ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1528101060 0x7f152819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152e5ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15281066b0 0x7f1528198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152e5ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281991e0 con 0x7f15281006a0 2023-10-26T06:47:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152e5ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1528199350 con 0x7f1528101060 2023-10-26T06:47:32.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152e5ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1528199510 con 0x7f15281066b0 2023-10-26T06:47:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f152819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f152819e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40970/0 (socket says 172.21.15.50:40970) 2023-10-26T06:47:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 -- 172.21.15.50:0/3310343244 learned_addr learned my addr 172.21.15.50:0/3310343244 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f15277fe700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1528101060 0x7f152819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f152cb9c700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15281066b0 0x7f1528198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 -- 172.21.15.50:0/3310343244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15281066b0 msgr2=0x7f1528198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15281066b0 0x7f1528198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 -- 172.21.15.50:0/3310343244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1528101060 msgr2=0x7f152819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1528101060 0x7f152819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.389+0000 7f1527fff700 1 -- 172.21.15.50:0/3310343244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520009d00 con 0x7f15281006a0 2023-10-26T06:47:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.390+0000 7f1527fff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f152819e9a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f151800e9a0 tx=0x7f151800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.390+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518009790 con 0x7f15281006a0 2023-10-26T06:47:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.390+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15281997f0 con 0x7f15281006a0 2023-10-26T06:47:32.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.390+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1518010430 con 0x7f15281006a0 2023-10-26T06:47:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.390+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15281a5a40 con 0x7f15281006a0 2023-10-26T06:47:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.390+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518018620 con 0x7f15281006a0 2023-10-26T06:47:32.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.391+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528101de0 con 0x7f15281006a0 2023-10-26T06:47:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.393+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f15180105a0 con 0x7f15281006a0 2023-10-26T06:47:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.394+0000 7f15257fa700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15100a15f0 0x7f15100a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.394+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1518014070 con 0x7f15281006a0 2023-10-26T06:47:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.395+0000 7f15277fe700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15100a15f0 0x7f15100a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.395+0000 7f15277fe700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15100a15f0 0x7f15100a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f152819a220 tx=0x7f151c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.399+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1518052100 con 0x7f15281006a0 2023-10-26T06:47:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.662+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1528067530 con 0x7f15281006a0 2023-10-26T06:47:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.663+0000 7f15257fa700 1 -- 172.21.15.50:0/3310343244 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11324 (secure 0 0 0) 0x7f1518096530 con 0x7f15281006a0 2023-10-26T06:47:32.665 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:47:32.666 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:45:14.436234+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:47:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15100a15f0 msgr2=0x7f15100a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15100a15f0 0x7f15100a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f152819a220 tx=0x7f151c009260 comp rx=0 tx=0).stop 2023-10-26T06:47:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 msgr2=0x7f152819e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f152819e9a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f151800e9a0 tx=0x7f151800ecb0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 shutdown_connections 2023-10-26T06:47:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f15100a15f0 0x7f15100a3ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15281066b0 0x7f1528198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15281006a0 0x7f152819e9a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 --2- 172.21.15.50:0/3310343244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1528101060 0x7f152819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 >> 172.21.15.50:0/3310343244 conn(0x7f15280fc170 msgr2=0x7f15280fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 shutdown_connections 2023-10-26T06:47:32.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.666+0000 7f152e5ff700 1 -- 172.21.15.50:0/3310343244 wait complete. 2023-10-26T06:47:32.670 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-10-26T06:47:32.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 -- 172.21.15.50:0/2536484065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 msgr2=0x7efcc410f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 --2- 172.21.15.50:0/2536484065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc410f3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b0a0 tx=0x7efcbc00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 -- 172.21.15.50:0/2536484065 shutdown_connections 2023-10-26T06:47:32.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 --2- 172.21.15.50:0/2536484065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc410f3d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 --2- 172.21.15.50:0/2536484065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4072c20 0x7efcc4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 --2- 172.21.15.50:0/2536484065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcc4073540 0x7efcc410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 -- 172.21.15.50:0/2536484065 >> 172.21.15.50:0/2536484065 conn(0x7efcc40fc1b0 msgr2=0x7efcc40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 -- 172.21.15.50:0/2536484065 shutdown_connections 2023-10-26T06:47:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.895+0000 7efcca1ff700 1 -- 172.21.15.50:0/2536484065 wait complete. 2023-10-26T06:47:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.896+0000 7efcca1ff700 1 Processor -- start 2023-10-26T06:47:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.896+0000 7efcca1ff700 1 -- start start 2023-10-26T06:47:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcca1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcc4072c20 0x7efcc4198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcca1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4073540 0x7efcc4199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcca1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcca1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc419de50 con 0x7efcc410cf60 2023-10-26T06:47:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcca1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc419dfc0 con 0x7efcc4073540 2023-10-26T06:47:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcca1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc419e180 con 0x7efcc4072c20 2023-10-26T06:47:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40982/0 (socket says 172.21.15.50:40982) 2023-10-26T06:47:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 -- 172.21.15.50:0/1809926647 learned_addr learned my addr 172.21.15.50:0/1809926647 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc37fe700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcc4072c20 0x7efcc4198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4073540 0x7efcc4199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 -- 172.21.15.50:0/1809926647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcc4072c20 msgr2=0x7efcc4198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcc4072c20 0x7efcc4198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 -- 172.21.15.50:0/1809926647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4073540 msgr2=0x7efcc4199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4073540 0x7efcc4199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc3fff700 1 -- 172.21.15.50:0/1809926647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc009d00 con 0x7efcc410cf60 2023-10-26T06:47:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.897+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4073540 0x7efcc4199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.898+0000 7efcc3fff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc419d810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b070 tx=0x7efcbc0078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.898+0000 7efcc0ff9700 1 -- 172.21.15.50:0/1809926647 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00e040 con 0x7efcc410cf60 2023-10-26T06:47:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.898+0000 7efcc0ff9700 1 -- 172.21.15.50:0/1809926647 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcbc01d470 con 0x7efcc410cf60 2023-10-26T06:47:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.898+0000 7efcc0ff9700 1 -- 172.21.15.50:0/1809926647 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0052a0 con 0x7efcc410cf60 2023-10-26T06:47:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.898+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc419e400 con 0x7efcc410cf60 2023-10-26T06:47:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.898+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc41a5ca0 con 0x7efcc410cf60 2023-10-26T06:47:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.901+0000 7efcc0ff9700 1 -- 172.21.15.50:0/1809926647 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7efcbc01d850 con 0x7efcc410cf60 2023-10-26T06:47:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.903+0000 7efcddb3ab80 1 Processor -- start 2023-10-26T06:47:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.903+0000 7efcddb3ab80 1 -- start start 2023-10-26T06:47:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc0ff9700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efcac0a1670 0x7efcac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a93fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a8ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7a016e0 con 0x55aee7a94500 2023-10-26T06:47:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee79e7c60 con 0x55aee7a8e5d0 2023-10-26T06:47:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee79e5580 con 0x55aee7a93be0 2023-10-26T06:47:32.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc0ff9700 1 -- 172.21.15.50:0/1809926647 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efcbc0ce0c0 con 0x7efcc410cf60 2023-10-26T06:47:32.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efcac0a1670 0x7efcac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a93fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a93fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47672/0 (socket says 172.21.15.50:47672) 2023-10-26T06:47:32.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a8ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc37fe700 1 -- 172.21.15.50:0/2979810989 learned_addr learned my addr 172.21.15.50:0/2979810989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc3fff700 1 -- 172.21.15.50:0/2979810989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 msgr2=0x55aee7a93fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc3fff700 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a93fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc3fff700 1 -- 172.21.15.50:0/2979810989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 msgr2=0x55aee7a8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc3fff700 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.904+0000 7efcc3fff700 1 -- 172.21.15.50:0/2979810989 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aee799e3f0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.905+0000 7efcc37fe700 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a93fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.905+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efcac0a1670 0x7efcac0a3b30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009fd0 tx=0x7efcb8009b00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.905+0000 7efcc3fff700 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a8ea50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0cb860 tx=0x7efcbc00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fdacea1ed0037d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.905+0000 7efca9ffb700 1 -- 172.21.15.50:0/2979810989 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc09b180 con 0x55aee7a8e5d0 2023-10-26T06:47:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.905+0000 7efca9ffb700 1 -- 172.21.15.50:0/2979810989 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcbc09f2d0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.905+0000 7efca9ffb700 1 -- 172.21.15.50:0/2979810989 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc09b3e0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2979810989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 msgr2=0x55aee7a8ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a8ea50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0cb860 tx=0x7efcbc00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2979810989 shutdown_connections 2023-10-26T06:47:32.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a8ea50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a93fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2979810989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2979810989 >> 172.21.15.50:0/2979810989 conn(0x55aee7a02720 msgr2=0x55aee7a88b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2979810989 shutdown_connections 2023-10-26T06:47:32.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2979810989 wait complete. 2023-10-26T06:47:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.906+0000 7efcddb3ab80 1 -- start start 2023-10-26T06:47:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 Processor -- start 2023-10-26T06:47:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a97780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a94500 0x55aee7a97ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee79e0e70 con 0x55aee7a8e5d0 2023-10-26T06:47:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee797d710 con 0x55aee7a94500 2023-10-26T06:47:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee797d3b0 con 0x55aee7a93be0 2023-10-26T06:47:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcddb3ab80 10 client.0 _ll_register_callbacks cb 0x55aee78c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41010/0 (socket says 172.21.15.50:41010) 2023-10-26T06:47:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcc37fe700 1 -- 172.21.15.50:0/2493684741 learned_addr learned my addr 172.21.15.50:0/2493684741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.907+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a97780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc3fff700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a94500 0x55aee7a97ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc37fe700 1 -- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 msgr2=0x55aee7a97780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc37fe700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a97780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc37fe700 1 -- 172.21.15.50:0/2493684741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a94500 msgr2=0x55aee7a97ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc37fe700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a94500 0x55aee7a97ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc37fe700 1 -- 172.21.15.50:0/2493684741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40099e0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcc37fe700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9a490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efcb4012a10 tx=0x7efcb4012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d648bc8d2cd662 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efca2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efca2ffd700 1 -- 172.21.15.50:0/2493684741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4017070 con 0x55aee7a8e5d0 2023-10-26T06:47:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aee79e5ef0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.908+0000 7efca2ffd700 1 -- 172.21.15.50:0/2493684741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efcb4004050 con 0x55aee7a8e5d0 2023-10-26T06:47:32.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efca2ffd700 1 -- 172.21.15.50:0/2493684741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcb4004210 con 0x55aee7a8e5d0 2023-10-26T06:47:32.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 10 client.16212 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7efcc41a5ca0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efca2ffd700 1 -- 172.21.15.50:0/2493684741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aee79e5ef0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efca2ffd700 1 -- 172.21.15.50:0/2493684741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efcb4024020 con 0x55aee7a8e5d0 2023-10-26T06:47:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 10 client.16212 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:32.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 10 client.16212 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:47:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 20 client.16212 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7aa7b80 0x55aee7aa9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 4 client.16212 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.909+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aee7a5d8b0 con 0x55aee7aa7b80 2023-10-26T06:47:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.910+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7aa7b80 0x55aee7aa9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.910+0000 7efcc2ffd700 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7aa7b80 0x55aee7aa9fa0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=185af38314e6c780 server_cookie=18da1576c806748b in_seq=0 out_seq=0 2023-10-26T06:47:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.910+0000 7efca2ffd700 10 client.16212 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:47:32.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efca2ffd700 1 -- 172.21.15.50:0/2493684741 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aee7a5d8b0 con 0x55aee7aa7b80 2023-10-26T06:47:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efca2ffd700 10 client.16212 handle_command_reply: tid=0 2023-10-26T06:47:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efcddb3ab80 1 client.16212 shutdown 2023-10-26T06:47:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 msgr2=0x55aee7a9a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9a490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efcb4012a10 tx=0x7efcb4012d20 comp rx=0 tx=0).stop 2023-10-26T06:47:32.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 shutdown_connections 2023-10-26T06:47:32.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.911+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7aa7b80 0x55aee7aa9fa0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a94500 0x55aee7a97ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9a490 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/2493684741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a97780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efca2ffd700 0 client.16212 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:47:32.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 >> 172.21.15.50:0/2493684741 conn(0x55aee7a02720 msgr2=0x55aee7a8d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 shutdown_connections 2023-10-26T06:47:32.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 1 -- 172.21.15.50:0/2493684741 wait complete. 2023-10-26T06:47:32.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.912+0000 7efcddb3ab80 20 client.16212 trim_cache size 0 max 16384 2023-10-26T06:47:32.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.925+0000 7efcddb3ab80 1 Processor -- start 2023-10-26T06:47:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.925+0000 7efcddb3ab80 1 -- start start 2023-10-26T06:47:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a8e5d0 0x55aee7a835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a93be0 0x55aee7a9ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a97010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7861920 con 0x55aee7a94500 2023-10-26T06:47:32.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7a98d80 con 0x55aee7a93be0 2023-10-26T06:47:32.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7a85230 con 0x55aee7a8e5d0 2023-10-26T06:47:32.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a97010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a8e5d0 0x55aee7a835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a93be0 0x55aee7a9ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a97010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41018/0 (socket says 172.21.15.50:41018) 2023-10-26T06:47:32.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 -- 172.21.15.50:0/4003949858 learned_addr learned my addr 172.21.15.50:0/4003949858 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a8e5d0 0x55aee7a835d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47688/0 (socket says 172.21.15.50:47688) 2023-10-26T06:47:32.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 -- 172.21.15.50:0/4003949858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a8e5d0 msgr2=0x55aee7a835d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a8e5d0 0x55aee7a835d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 -- 172.21.15.50:0/4003949858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a93be0 msgr2=0x55aee7a9ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a93be0 0x55aee7a9ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.926+0000 7efcc3fff700 1 -- 172.21.15.50:0/4003949858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aee780bde0 con 0x55aee7a94500 2023-10-26T06:47:32.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcc3fff700 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a97010 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0994d0 tx=0x7efcbc01dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df016c8730f62ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcaa7fc700 1 -- 172.21.15.50:0/4003949858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc09b180 con 0x55aee7a94500 2023-10-26T06:47:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcaa7fc700 1 -- 172.21.15.50:0/4003949858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcbc0a3480 con 0x55aee7a94500 2023-10-26T06:47:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcaa7fc700 1 -- 172.21.15.50:0/4003949858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc09a670 con 0x55aee7a94500 2023-10-26T06:47:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 -- 172.21.15.50:0/4003949858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 msgr2=0x55aee7a97010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a97010 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0994d0 tx=0x7efcbc01dbf0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 -- 172.21.15.50:0/4003949858 shutdown_connections 2023-10-26T06:47:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7a97010 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a8e5d0 0x55aee7a835d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/4003949858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a93be0 0x55aee7a9ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.927+0000 7efcddb3ab80 1 -- 172.21.15.50:0/4003949858 >> 172.21.15.50:0/4003949858 conn(0x55aee7a02720 msgr2=0x55aee7a8d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.928+0000 7efcddb3ab80 1 -- 172.21.15.50:0/4003949858 shutdown_connections 2023-10-26T06:47:32.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.928+0000 7efcddb3ab80 1 -- 172.21.15.50:0/4003949858 wait complete. 2023-10-26T06:47:32.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.928+0000 7efcddb3ab80 1 -- start start 2023-10-26T06:47:32.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.928+0000 7efcddb3ab80 1 Processor -- start 2023-10-26T06:47:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.928+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a9d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcddb3ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7af4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7af4e80 con 0x55aee7a94500 2023-10-26T06:47:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7af4ff0 con 0x55aee7a8e5d0 2023-10-26T06:47:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcddb3ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee7af51b0 con 0x55aee7a93be0 2023-10-26T06:47:32.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcddb3ab80 10 client.0 _ll_register_callbacks cb 0x55aee78c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:32.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7af4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a9d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7af4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41034/0 (socket says 172.21.15.50:41034) 2023-10-26T06:47:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 -- 172.21.15.50:0/943998762 learned_addr learned my addr 172.21.15.50:0/943998762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:32.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc37fe700 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 -- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 msgr2=0x55aee7a9d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a9d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 -- 172.21.15.50:0/943998762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 msgr2=0x55aee7a9ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 -- 172.21.15.50:0/943998762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aee799e3f0 con 0x55aee7a94500 2023-10-26T06:47:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efcc3fff700 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7af4940 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009cd0 tx=0x7efcbc097ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49abb3bca89cbc27 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:32.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.929+0000 7efca2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:32.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efca2ffd700 1 -- 172.21.15.50:0/943998762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc09b180 con 0x55aee7a94500 2023-10-26T06:47:32.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efca2ffd700 1 -- 172.21.15.50:0/943998762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efcbc09b5f0 con 0x55aee7a94500 2023-10-26T06:47:32.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efcbc09f2d0 con 0x55aee7a94500 2023-10-26T06:47:32.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efca2ffd700 1 -- 172.21.15.50:0/943998762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcbc0a5080 con 0x55aee7a94500 2023-10-26T06:47:32.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 10 client.16218 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:32.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55aee77f4c60 con 0x55aee7a94500 2023-10-26T06:47:32.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efca2ffd700 1 -- 172.21.15.50:0/943998762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcbc09f2d0 con 0x55aee7a94500 2023-10-26T06:47:32.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efca2ffd700 1 -- 172.21.15.50:0/943998762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efcbc0b9120 con 0x55aee7a94500 2023-10-26T06:47:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 10 client.16218 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 10 client.16218 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:47:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 20 client.16218 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:32.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7afc450 0x55aee7afe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:32.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 4 client.16218 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:47:32.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.930+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aee79d9e50 con 0x55aee7afc450 2023-10-26T06:47:32.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.931+0000 7efcc37fe700 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7afc450 0x55aee7afe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:32.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.931+0000 7efcc37fe700 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7afc450 0x55aee7afe840 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1d3017be0c4ac08 server_cookie=6b3455b0c4fbccba in_seq=0 out_seq=0 2023-10-26T06:47:32.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.931+0000 7efca2ffd700 10 client.16218 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:47:32.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efca2ffd700 1 -- 172.21.15.50:0/943998762 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55aee79d9e50 con 0x55aee7afc450 2023-10-26T06:47:32.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efca2ffd700 10 client.16218 handle_command_reply: tid=0 2023-10-26T06:47:32.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 client.16218 shutdown 2023-10-26T06:47:32.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 msgr2=0x55aee7af4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7af4940 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009cd0 tx=0x7efcbc097ac0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 shutdown_connections 2023-10-26T06:47:32.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55aee7afc450 0x55aee7afe840 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aee7a94500 0x55aee7af4940 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aee7a8e5d0 0x55aee7a9ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efca2ffd700 0 client.16218 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:47:32.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 --2- 172.21.15.50:0/943998762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aee7a93be0 0x55aee7a9d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 >> 172.21.15.50:0/943998762 conn(0x55aee7a02720 msgr2=0x55aee7a97010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 shutdown_connections 2023-10-26T06:47:32.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 1 -- 172.21.15.50:0/943998762 wait complete. 2023-10-26T06:47:32.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.932+0000 7efcddb3ab80 20 client.16218 trim_cache size 0 max 16384 2023-10-26T06:47:32.958 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:47:32.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efcac0a1670 msgr2=0x7efcac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efcac0a1670 0x7efcac0a3b30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009fd0 tx=0x7efcb8009b00 comp rx=0 tx=0).stop 2023-10-26T06:47:32.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 msgr2=0x7efcc419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:32.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc419d810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00b070 tx=0x7efcbc0078c0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 shutdown_connections 2023-10-26T06:47:32.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7efcac0a1670 0x7efcac0a3b30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcc410cf60 0x7efcc419d810 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcc4072c20 0x7efcc4198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 --2- 172.21.15.50:0/1809926647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efcc4073540 0x7efcc4199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:32.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 >> 172.21.15.50:0/1809926647 conn(0x7efcc40fc1b0 msgr2=0x7efcc40fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:32.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 shutdown_connections 2023-10-26T06:47:32.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:32.933+0000 7efcca1ff700 1 -- 172.21.15.50:0/1809926647 wait complete. 2023-10-26T06:47:32.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:32 smithi050 ceph-mon[94997]: pgmap v435: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.5 MiB/s wr, 501 op/s 2023-10-26T06:47:32.962 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:32 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3310343244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:47:32.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:47:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 -- 172.21.15.50:0/3390535267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc106730 msgr2=0x7f07dc106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 --2- 172.21.15.50:0/3390535267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc106730 0x7f07dc106b10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009990 tx=0x7f07d8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 -- 172.21.15.50:0/3390535267 shutdown_connections 2023-10-26T06:47:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 --2- 172.21.15.50:0/3390535267 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc1010e0 0x7f07dc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 --2- 172.21.15.50:0/3390535267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc106730 0x7f07dc106b10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 --2- 172.21.15.50:0/3390535267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07dc100720 0x7f07dc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.169+0000 7f07e47ff700 1 -- 172.21.15.50:0/3390535267 >> 172.21.15.50:0/3390535267 conn(0x7f07dc0fc1b0 msgr2=0x7f07dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.170+0000 7f07e47ff700 1 -- 172.21.15.50:0/3390535267 shutdown_connections 2023-10-26T06:47:33.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.170+0000 7f07e47ff700 1 -- 172.21.15.50:0/3390535267 wait complete. 2023-10-26T06:47:33.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:32 smithi125 ceph-mon[130643]: pgmap v435: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.5 MiB/s wr, 501 op/s 2023-10-26T06:47:33.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:32 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3310343244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:47:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 Processor -- start 2023-10-26T06:47:33.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 -- start start 2023-10-26T06:47:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 0x7f07dc198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc1010e0 0x7f07dc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07dc106730 0x7f07dc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19dcf0 con 0x7f07dc100720 2023-10-26T06:47:33.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19de60 con 0x7f07dc1010e0 2023-10-26T06:47:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e47ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc19e020 con 0x7f07dc106730 2023-10-26T06:47:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 0x7f07dc198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e259b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 0x7f07dc198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41054/0 (socket says 172.21.15.50:41054) 2023-10-26T06:47:33.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.171+0000 7f07e259b700 1 -- 172.21.15.50:0/4037708352 learned_addr learned my addr 172.21.15.50:0/4037708352 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc1010e0 0x7f07dc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07dc106730 0x7f07dc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e259b700 1 -- 172.21.15.50:0/4037708352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07dc106730 msgr2=0x7f07dc19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e259b700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07dc106730 0x7f07dc19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e259b700 1 -- 172.21.15.50:0/4037708352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc1010e0 msgr2=0x7f07dc199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e259b700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc1010e0 0x7f07dc199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e259b700 1 -- 172.21.15.50:0/4037708352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80095f0 con 0x7f07dc100720 2023-10-26T06:47:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e259b700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 0x7f07dc198dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f07d80095c0 tx=0x7f07d800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07d37fe700 1 -- 172.21.15.50:0/4037708352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d801d070 con 0x7f07dc100720 2023-10-26T06:47:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07d37fe700 1 -- 172.21.15.50:0/4037708352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07d8005050 con 0x7f07dc100720 2023-10-26T06:47:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07d37fe700 1 -- 172.21.15.50:0/4037708352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8004b10 con 0x7f07dc100720 2023-10-26T06:47:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.172+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc19e2a0 con 0x7f07dc100720 2023-10-26T06:47:33.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.173+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc1a5b40 con 0x7f07dc100720 2023-10-26T06:47:33.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.176+0000 7f07d37fe700 1 -- 172.21.15.50:0/4037708352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f07d80051c0 con 0x7f07dc100720 2023-10-26T06:47:33.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.177+0000 7f07f804db80 1 Processor -- start 2023-10-26T06:47:33.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.177+0000 7f07d37fe700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07c80a15f0 0x7f07c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.177+0000 7f07d37fe700 1 -- 172.21.15.50:0/4037708352 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f07d80cded0 con 0x7f07dc100720 2023-10-26T06:47:33.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.177+0000 7f07f804db80 1 -- start start 2023-10-26T06:47:33.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07c80a15f0 0x7f07c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07f804db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1c9dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07f804db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1c98090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07f804db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c985d0 0x558fb1c98a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07f804db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1c0b6e0 con 0x558fb1c985d0 2023-10-26T06:47:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07f804db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1bf1c60 con 0x558fb1c9dbe0 2023-10-26T06:47:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07f804db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1bef580 con 0x558fb1c9e500 2023-10-26T06:47:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07e259b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1c9dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07e2d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c985d0 0x558fb1c98a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07e259b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1c9dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:55794/0 (socket says 172.21.15.50:55794) 2023-10-26T06:47:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07e259b700 1 -- 172.21.15.50:0/493045210 learned_addr learned my addr 172.21.15.50:0/493045210 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.178+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1c98090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07c80a15f0 0x7f07c80a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009c10 tx=0x7f07d4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e259b700 1 -- 172.21.15.50:0/493045210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 msgr2=0x558fb1c98090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e259b700 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1c98090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e259b700 1 -- 172.21.15.50:0/493045210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c985d0 msgr2=0x558fb1c98a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e259b700 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c985d0 0x558fb1c98a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e259b700 1 -- 172.21.15.50:0/493045210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fb1ba83f0 con 0x558fb1c9dbe0 2023-10-26T06:47:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07e259b700 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1c9dfc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07d8097490 tx=0x7f07d809b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b9685c1401a1aa server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07d0ff9700 1 -- 172.21.15.50:0/493045210 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80a3290 con 0x558fb1c9dbe0 2023-10-26T06:47:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07d0ff9700 1 -- 172.21.15.50:0/493045210 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07d80a1070 con 0x558fb1c9dbe0 2023-10-26T06:47:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.179+0000 7f07d0ff9700 1 -- 172.21.15.50:0/493045210 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d809b1f0 con 0x558fb1c9dbe0 2023-10-26T06:47:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 -- 172.21.15.50:0/493045210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 msgr2=0x558fb1c9dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1c9dfc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07d8097490 tx=0x7f07d809b710 comp rx=0 tx=0).stop 2023-10-26T06:47:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 -- 172.21.15.50:0/493045210 shutdown_connections 2023-10-26T06:47:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c985d0 0x558fb1c98a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1c9dfc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 --2- 172.21.15.50:0/493045210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1c98090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 -- 172.21.15.50:0/493045210 >> 172.21.15.50:0/493045210 conn(0x558fb1c0c720 msgr2=0x558fb1c92b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 -- 172.21.15.50:0/493045210 shutdown_connections 2023-10-26T06:47:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.180+0000 7f07f804db80 1 -- 172.21.15.50:0/493045210 wait complete. 2023-10-26T06:47:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.181+0000 7f07f804db80 1 -- start start 2023-10-26T06:47:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.181+0000 7f07f804db80 1 Processor -- start 2023-10-26T06:47:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1ca4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1beae70 con 0x558fb1c9e500 2023-10-26T06:47:33.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1b87710 con 0x558fb1c985d0 2023-10-26T06:47:33.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1b873b0 con 0x558fb1c9dbe0 2023-10-26T06:47:33.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07f804db80 10 client.0 _ll_register_callbacks cb 0x558fb1ad1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:33.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07e259b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1ca4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07e259b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1ca4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:55808/0 (socket says 172.21.15.50:55808) 2023-10-26T06:47:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07e259b700 1 -- 172.21.15.50:0/2009827013 learned_addr learned my addr 172.21.15.50:0/2009827013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.182+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07e259b700 1 -- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9dbe0 msgr2=0x558fb1ca1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07e259b700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07e259b700 1 -- 172.21.15.50:0/2009827013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 msgr2=0x558fb1ca1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07e259b700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07e259b700 1 -- 172.21.15.50:0/2009827013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc1a5b40 con 0x558fb1c985d0 2023-10-26T06:47:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07e259b700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1ca4510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07d80a2d60 tx=0x7f07d8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d57519dca01e1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:47:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07c5ffb700 1 -- 172.21.15.50:0/2009827013 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80a11e0 con 0x558fb1c985d0 2023-10-26T06:47:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07c5ffb700 1 -- 172.21.15.50:0/2009827013 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f07d80a3290 con 0x558fb1c985d0 2023-10-26T06:47:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fb1befef0 con 0x558fb1c985d0 2023-10-26T06:47:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07c5ffb700 1 -- 172.21.15.50:0/2009827013 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d809a690 con 0x558fb1c985d0 2023-10-26T06:47:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07f804db80 10 client.26273 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.183+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558fb1a15de0 con 0x558fb1c985d0 2023-10-26T06:47:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07c5ffb700 1 -- 172.21.15.50:0/2009827013 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558fb1befef0 con 0x558fb1c985d0 2023-10-26T06:47:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07c5ffb700 1 -- 172.21.15.50:0/2009827013 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f07d8095ba0 con 0x558fb1c985d0 2023-10-26T06:47:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07f804db80 10 client.26273 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07f804db80 10 client.26273 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:47:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07f804db80 20 client.26273 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07f804db80 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1cb1680 0x558fb1cb3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07f804db80 4 client.26273 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fb1c678b0 con 0x558fb1cb1680 2023-10-26T06:47:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.184+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1cb1680 0x558fb1cb3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.185+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1cb1680 0x558fb1cb3aa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f1be01e41be80202 server_cookie=890ba24b916be471 in_seq=0 out_seq=0 2023-10-26T06:47:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.185+0000 7f07c5ffb700 10 client.26273 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:47:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.185+0000 7f07c5ffb700 1 -- 172.21.15.50:0/2009827013 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558fb1c678b0 con 0x558fb1cb1680 2023-10-26T06:47:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.185+0000 7f07c5ffb700 10 client.26273 handle_command_reply: tid=0 2023-10-26T06:47:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 client.26273 shutdown 2023-10-26T06:47:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 msgr2=0x558fb1ca4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1ca4510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07d80a2d60 tx=0x7f07d8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 shutdown_connections 2023-10-26T06:47:33.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1cb1680 0x558fb1cb3aa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1ca4510 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 --2- 172.21.15.50:0/2009827013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07c5ffb700 0 client.26273 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:47:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 >> 172.21.15.50:0/2009827013 conn(0x558fb1c0c720 msgr2=0x558fb1c97080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 shutdown_connections 2023-10-26T06:47:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 1 -- 172.21.15.50:0/2009827013 wait complete. 2023-10-26T06:47:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.186+0000 7f07f804db80 20 client.26273 trim_cache size 0 max 16384 2023-10-26T06:47:33.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 Processor -- start 2023-10-26T06:47:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 -- start start 2023-10-26T06:47:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1cada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1ca4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1a6b920 con 0x558fb1c9dbe0 2023-10-26T06:47:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1ca2e00 con 0x558fb1c985d0 2023-10-26T06:47:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07f804db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1c93650 con 0x558fb1c9e500 2023-10-26T06:47:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07e1d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07e1d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41086/0 (socket says 172.21.15.50:41086) 2023-10-26T06:47:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07e1d9a700 1 -- 172.21.15.50:0/339502169 learned_addr learned my addr 172.21.15.50:0/339502169 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1ca4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.200+0000 7f07e259b700 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1cada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e1d9a700 1 -- 172.21.15.50:0/339502169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 msgr2=0x558fb1ca4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1ca4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e1d9a700 1 -- 172.21.15.50:0/339502169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 msgr2=0x558fb1cada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1cada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e1d9a700 1 -- 172.21.15.50:0/339502169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fb19fec60 con 0x558fb1c9dbe0 2023-10-26T06:47:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e259b700 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1cada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07e1d9a700 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca8c30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f07cc000c00 tx=0x7f07cc0073d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d392d53ecb944ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07d17fa700 1 -- 172.21.15.50:0/339502169 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc016030 con 0x558fb1c9dbe0 2023-10-26T06:47:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07d17fa700 1 -- 172.21.15.50:0/339502169 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07cc017040 con 0x558fb1c9dbe0 2023-10-26T06:47:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.201+0000 7f07d17fa700 1 -- 172.21.15.50:0/339502169 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc005280 con 0x558fb1c9dbe0 2023-10-26T06:47:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 -- 172.21.15.50:0/339502169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 msgr2=0x558fb1ca8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca8c30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f07cc000c00 tx=0x7f07cc0073d0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 -- 172.21.15.50:0/339502169 shutdown_connections 2023-10-26T06:47:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c9e500 0x558fb1ca4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c985d0 0x558fb1cada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 --2- 172.21.15.50:0/339502169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca8c30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 -- 172.21.15.50:0/339502169 >> 172.21.15.50:0/339502169 conn(0x558fb1c0c720 msgr2=0x558fb1cad380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 -- 172.21.15.50:0/339502169 shutdown_connections 2023-10-26T06:47:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 -- 172.21.15.50:0/339502169 wait complete. 2023-10-26T06:47:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.202+0000 7f07f804db80 1 -- start start 2023-10-26T06:47:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 Processor -- start 2023-10-26T06:47:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c985d0 0x558fb1ca76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1d05600 con 0x558fb1c9e500 2023-10-26T06:47:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1d05770 con 0x558fb1c9dbe0 2023-10-26T06:47:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb1d05930 con 0x558fb1c985d0 2023-10-26T06:47:33.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07f804db80 10 client.0 _ll_register_callbacks cb 0x558fb1ad1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07e2d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07e259b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c985d0 0x558fb1ca76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07e2d9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41090/0 (socket says 172.21.15.50:41090) 2023-10-26T06:47:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07e1d9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.203+0000 7f07e2d9c700 1 -- 172.21.15.50:0/509177827 learned_addr learned my addr 172.21.15.50:0/509177827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07e2d9c700 1 -- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c985d0 msgr2=0x558fb1ca76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c985d0 0x558fb1ca76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07e2d9c700 1 -- 172.21.15.50:0/509177827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 msgr2=0x558fb1ca7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07e2d9c700 1 -- 172.21.15.50:0/509177827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fb1a3c250 con 0x558fb1c9e500 2023-10-26T06:47:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07e2d9c700 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca8130 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f07d4016e40 tx=0x7f07d4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64192369cc64e7ea server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07c5ffb700 1 -- 172.21.15.50:0/509177827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4014cd0 con 0x558fb1c9e500 2023-10-26T06:47:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07c5ffb700 1 -- 172.21.15.50:0/509177827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f07d4014e30 con 0x558fb1c9e500 2023-10-26T06:47:33.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.204+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07d80a1070 con 0x558fb1c9e500 2023-10-26T06:47:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07c5ffb700 1 -- 172.21.15.50:0/509177827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d4025450 con 0x558fb1c9e500 2023-10-26T06:47:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 10 client.16236 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558fb1a142b0 con 0x558fb1c9e500 2023-10-26T06:47:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07c5ffb700 1 -- 172.21.15.50:0/509177827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07d80a1070 con 0x558fb1c9e500 2023-10-26T06:47:33.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07c5ffb700 1 -- 172.21.15.50:0/509177827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f07d4036050 con 0x558fb1c9e500 2023-10-26T06:47:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 10 client.16236 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 10 client.16236 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:47:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 20 client.16236 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1d07260 0x558fb1d09680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 4 client.16236 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:47:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558fb1be3e50 con 0x558fb1d07260 2023-10-26T06:47:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.205+0000 7f07e259b700 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1d07260 0x558fb1d09680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07e259b700 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1d07260 0x558fb1d09680 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=115d44453ee5a00e server_cookie=49f00a62b4b4ba69 in_seq=0 out_seq=0 2023-10-26T06:47:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07c5ffb700 10 client.16236 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:47:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07c5ffb700 1 -- 172.21.15.50:0/509177827 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558fb1be3e50 con 0x558fb1d07260 2023-10-26T06:47:33.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07c5ffb700 10 client.16236 handle_command_reply: tid=0 2023-10-26T06:47:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 client.16236 shutdown 2023-10-26T06:47:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 msgr2=0x558fb1ca8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca8130 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f07d4016e40 tx=0x7f07d4004b40 comp rx=0 tx=0).stop 2023-10-26T06:47:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 shutdown_connections 2023-10-26T06:47:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fb1c9e500 0x558fb1ca8130 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558fb1c985d0 0x558fb1ca76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x558fb1d07260 0x558fb1d09680 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 --2- 172.21.15.50:0/509177827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x558fb1c9dbe0 0x558fb1ca7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 >> 172.21.15.50:0/509177827 conn(0x558fb1c0c720 msgr2=0x558fb1c9b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07c5ffb700 0 client.16236 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:47:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.206+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 shutdown_connections 2023-10-26T06:47:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07f804db80 1 -- 172.21.15.50:0/509177827 wait complete. 2023-10-26T06:47:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07f804db80 20 client.16236 trim_cache size 0 max 16384 2023-10-26T06:47:33.227 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:47:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07c80a15f0 msgr2=0x7f07c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07c80a15f0 0x7f07c80a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009c10 tx=0x7f07d4009040 comp rx=0 tx=0).stop 2023-10-26T06:47:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 msgr2=0x7f07dc198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 0x7f07dc198dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f07d80095c0 tx=0x7f07d800f690 comp rx=0 tx=0).stop 2023-10-26T06:47:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 shutdown_connections 2023-10-26T06:47:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07c80a15f0 0x7f07c80a3ab0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07dc106730 0x7f07dc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07dc100720 0x7f07dc198dd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 --2- 172.21.15.50:0/4037708352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07dc1010e0 0x7f07dc199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 >> 172.21.15.50:0/4037708352 conn(0x7f07dc0fc1b0 msgr2=0x7f07dc0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 shutdown_connections 2023-10-26T06:47:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.207+0000 7f07e47ff700 1 -- 172.21.15.50:0/4037708352 wait complete. 2023-10-26T06:47:33.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:47:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:32 smithi153 ceph-mon[131657]: pgmap v435: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.5 MiB/s wr, 501 op/s 2023-10-26T06:47:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:32 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3310343244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:47:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 -- 172.21.15.50:0/1181781689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c1010e0 msgr2=0x7f8e2c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 --2- 172.21.15.50:0/1181781689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c10d5f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b0a0 tx=0x7f8e2400b3b0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 -- 172.21.15.50:0/1181781689 shutdown_connections 2023-10-26T06:47:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 --2- 172.21.15.50:0/1181781689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c10d5f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 --2- 172.21.15.50:0/1181781689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e2c106730 0x7f8e2c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 --2- 172.21.15.50:0/1181781689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c100720 0x7f8e2c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 -- 172.21.15.50:0/1181781689 >> 172.21.15.50:0/1181781689 conn(0x7f8e2c0fc1b0 msgr2=0x7f8e2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 -- 172.21.15.50:0/1181781689 shutdown_connections 2023-10-26T06:47:33.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.437+0000 7f8e313ff700 1 -- 172.21.15.50:0/1181781689 wait complete. 2023-10-26T06:47:33.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.438+0000 7f8e313ff700 1 Processor -- start 2023-10-26T06:47:33.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.438+0000 7f8e313ff700 1 -- start start 2023-10-26T06:47:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e313ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e2c100720 0x7f8e2c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e313ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e313ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 0x7f8e2c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e313ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c19cb40 con 0x7f8e2c106730 2023-10-26T06:47:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e313ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c19ccb0 con 0x7f8e2c1010e0 2023-10-26T06:47:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e313ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c19ce70 con 0x7f8e2c100720 2023-10-26T06:47:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 0x7f8e2c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 0x7f8e2c19c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41108/0 (socket says 172.21.15.50:41108) 2023-10-26T06:47:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/2166770509 learned_addr learned my addr 172.21.15.50:0/2166770509 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2affd700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e2c100720 0x7f8e2c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/2166770509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e2c100720 msgr2=0x7f8e2c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e2c100720 0x7f8e2c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/2166770509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c1010e0 msgr2=0x7f8e2c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/2166770509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24009d00 con 0x7f8e2c106730 2023-10-26T06:47:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.439+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.440+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 0x7f8e2c19c540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b070 tx=0x7f8e240077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.440+0000 7f8e13fff700 1 -- 172.21.15.50:0/2166770509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400e040 con 0x7f8e2c106730 2023-10-26T06:47:33.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.440+0000 7f8e13fff700 1 -- 172.21.15.50:0/2166770509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e240094c0 con 0x7f8e2c106730 2023-10-26T06:47:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.440+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c19d0f0 con 0x7f8e2c106730 2023-10-26T06:47:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.440+0000 7f8e13fff700 1 -- 172.21.15.50:0/2166770509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240043a0 con 0x7f8e2c106730 2023-10-26T06:47:33.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.440+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c1a5ab0 con 0x7f8e2c106730 2023-10-26T06:47:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.443+0000 7f8e13fff700 1 -- 172.21.15.50:0/2166770509 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8e24004500 con 0x7f8e2c106730 2023-10-26T06:47:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.444+0000 7f8e13fff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8e140a15f0 0x7f8e140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 Processor -- start 2023-10-26T06:47:33.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e13fff700 1 -- 172.21.15.50:0/2166770509 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8e240cdf10 con 0x7f8e2c106730 2023-10-26T06:47:33.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 -- start start 2023-10-26T06:47:33.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e2affd700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8e140a15f0 0x7f8e140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 0x556f508b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b25d0 0x556f508b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f508256e0 con 0x556f508b7be0 2023-10-26T06:47:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f5080bc60 con 0x556f508b25d0 2023-10-26T06:47:33.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.445+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f50809580 con 0x556f508b8500 2023-10-26T06:47:33.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 0x556f508b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 0x556f508b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41110/0 (socket says 172.21.15.50:41110) 2023-10-26T06:47:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47772/0 (socket says 172.21.15.50:47772) 2023-10-26T06:47:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2affd700 1 -- 172.21.15.50:0/331389659 learned_addr learned my addr 172.21.15.50:0/331389659 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b25d0 0x556f508b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2affd700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8e140a15f0 0x7f8e140a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009c30 tx=0x7f8e1c011440 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 -- 172.21.15.50:0/331389659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b25d0 msgr2=0x556f508b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b25d0 0x556f508b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 -- 172.21.15.50:0/331389659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 msgr2=0x556f508b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 0x556f508b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 -- 172.21.15.50:0/331389659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f507c23f0 con 0x556f508b8500 2023-10-26T06:47:33.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2affd700 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 0x556f508b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.446+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508b2090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c19a2c0 tx=0x7f8e200117a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4807c2d4cb1a1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.447+0000 7f8e117fa700 1 -- 172.21.15.50:0/331389659 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20004230 con 0x556f508b8500 2023-10-26T06:47:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.447+0000 7f8e117fa700 1 -- 172.21.15.50:0/331389659 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e20004cf0 con 0x556f508b8500 2023-10-26T06:47:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.447+0000 7f8e117fa700 1 -- 172.21.15.50:0/331389659 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20005630 con 0x556f508b8500 2023-10-26T06:47:33.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.447+0000 7f8e44dddb80 1 -- 172.21.15.50:0/331389659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 msgr2=0x556f508b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.447+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508b2090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c19a2c0 tx=0x7f8e200117a0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 -- 172.21.15.50:0/331389659 shutdown_connections 2023-10-26T06:47:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b25d0 0x556f508b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b7be0 0x556f508b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/331389659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508b2090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 -- 172.21.15.50:0/331389659 >> 172.21.15.50:0/331389659 conn(0x556f50826720 msgr2=0x556f508acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 -- 172.21.15.50:0/331389659 shutdown_connections 2023-10-26T06:47:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 -- 172.21.15.50:0/331389659 wait complete. 2023-10-26T06:47:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.448+0000 7f8e44dddb80 1 -- start start 2023-10-26T06:47:33.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 Processor -- start 2023-10-26T06:47:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f50804e70 con 0x556f508b25d0 2023-10-26T06:47:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f507a1710 con 0x556f508b7be0 2023-10-26T06:47:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.449+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f507a13b0 con 0x556f508b8500 2023-10-26T06:47:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e44dddb80 10 client.0 _ll_register_callbacks cb 0x556f506eba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508bb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41120/0 (socket says 172.21.15.50:41120) 2023-10-26T06:47:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 -- 172.21.15.50:0/3231413081 learned_addr learned my addr 172.21.15.50:0/3231413081 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 -- 172.21.15.50:0/3231413081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 msgr2=0x556f508bc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508bc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 -- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 msgr2=0x556f508bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 -- 172.21.15.50:0/3231413081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c011bc0 con 0x556f508b25d0 2023-10-26T06:47:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e2affd700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508bb820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00fac0 tx=0x7f8e1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba153a7ea717425 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.450+0000 7f8e0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3231413081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c01e860 con 0x556f508b25d0 2023-10-26T06:47:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3231413081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8e1c01e9c0 con 0x556f508b25d0 2023-10-26T06:47:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f50809ef0 con 0x556f508b25d0 2023-10-26T06:47:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3231413081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e1c01ebc0 con 0x556f508b25d0 2023-10-26T06:47:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 10 client.16248 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f8e20009c90 con 0x556f508b25d0 2023-10-26T06:47:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3231413081 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e1c034080 con 0x556f508b25d0 2023-10-26T06:47:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3231413081 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8e1c02e030 con 0x556f508b25d0 2023-10-26T06:47:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 10 client.16248 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 20 client.16248 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f508cc060 0x556f508ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 4 client.16248 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.451+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f508818b0 con 0x556f508cc060 2023-10-26T06:47:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.452+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f508cc060 0x556f508ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.452+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f508cc060 0x556f508ce480 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174daaa3fac598f6 server_cookie=85d03291b811675c in_seq=0 out_seq=0 2023-10-26T06:47:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.452+0000 7f8e0eff5700 10 client.16248 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.453+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3231413081 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556f508818b0 con 0x556f508cc060 2023-10-26T06:47:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.453+0000 7f8e0eff5700 10 client.16248 handle_command_reply: tid=0 2023-10-26T06:47:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.453+0000 7f8e44dddb80 1 client.16248 shutdown 2023-10-26T06:47:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.453+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 msgr2=0x556f508bb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.453+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508bb820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00fac0 tx=0x7f8e1c0047c0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 shutdown_connections 2023-10-26T06:47:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f508cc060 0x556f508ce480 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b8500 0x556f508bc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508bb820 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3231413081 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e0eff5700 0 client.16248 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 >> 172.21.15.50:0/3231413081 conn(0x556f50826720 msgr2=0x556f508b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 shutdown_connections 2023-10-26T06:47:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3231413081 wait complete. 2023-10-26T06:47:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.454+0000 7f8e44dddb80 20 client.16248 trim_cache size 0 max 16384 2023-10-26T06:47:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 Processor -- start 2023-10-26T06:47:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 -- start start 2023-10-26T06:47:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b25d0 0x556f508b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 0x556f508b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f50685920 con 0x556f508b8500 2023-10-26T06:47:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f508818e0 con 0x556f508b7be0 2023-10-26T06:47:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.467+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f508adbf0 con 0x556f508b25d0 2023-10-26T06:47:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 0x556f508b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 0x556f508b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41130/0 (socket says 172.21.15.50:41130) 2023-10-26T06:47:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/4085784058 learned_addr learned my addr 172.21.15.50:0/4085784058 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2affd700 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b25d0 0x556f508b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/4085784058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b25d0 msgr2=0x556f508b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b25d0 0x556f508b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/4085784058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 msgr2=0x556f508c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 -- 172.21.15.50:0/4085784058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f5062fde0 con 0x556f508b8500 2023-10-26T06:47:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.468+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 0x556f508b7030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e2409af60 tx=0x7f8e240099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7f6c327b33e07a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e11ffb700 1 -- 172.21.15.50:0/4085784058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400be20 con 0x556f508b8500 2023-10-26T06:47:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e11ffb700 1 -- 172.21.15.50:0/4085784058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e24079e90 con 0x556f508b8500 2023-10-26T06:47:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e11ffb700 1 -- 172.21.15.50:0/4085784058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24099370 con 0x556f508b8500 2023-10-26T06:47:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 -- 172.21.15.50:0/4085784058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 msgr2=0x556f508b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 0x556f508b7030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e2409af60 tx=0x7f8e240099e0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 -- 172.21.15.50:0/4085784058 shutdown_connections 2023-10-26T06:47:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b8500 0x556f508b7030 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b25d0 0x556f508b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/4085784058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b7be0 0x556f508c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 -- 172.21.15.50:0/4085784058 >> 172.21.15.50:0/4085784058 conn(0x556f50826720 msgr2=0x556f508b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 -- 172.21.15.50:0/4085784058 shutdown_connections 2023-10-26T06:47:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.469+0000 7f8e44dddb80 1 -- 172.21.15.50:0/4085784058 wait complete. 2023-10-26T06:47:33.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 -- start start 2023-10-26T06:47:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 Processor -- start 2023-10-26T06:47:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b7be0 0x556f508c1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b8500 0x556f508c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f508c1a80 con 0x556f508b25d0 2023-10-26T06:47:33.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f508c1bf0 con 0x556f508b8500 2023-10-26T06:47:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f508c1db0 con 0x556f508b7be0 2023-10-26T06:47:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.470+0000 7f8e44dddb80 10 client.0 _ll_register_callbacks cb 0x556f506eba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508c2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41142/0 (socket says 172.21.15.50:41142) 2023-10-26T06:47:33.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 -- 172.21.15.50:0/3215119026 learned_addr learned my addr 172.21.15.50:0/3215119026 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:33.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b7be0 0x556f508c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2b7fe700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b8500 0x556f508c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 -- 172.21.15.50:0/3215119026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b7be0 msgr2=0x556f508c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b7be0 0x556f508c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 -- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b8500 msgr2=0x556f508c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:33.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b8500 0x556f508c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 -- 172.21.15.50:0/3215119026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c1a5ab0 con 0x556f508b25d0 2023-10-26T06:47:33.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e2affd700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508c2c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0053b0 tx=0x7f8e1c01eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea1a16730531d17 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:33.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:33.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3215119026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004830 con 0x556f508b25d0 2023-10-26T06:47:33.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3215119026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8e1c004990 con 0x556f508b25d0 2023-10-26T06:47:33.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.471+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e20004cf0 con 0x556f508b25d0 2023-10-26T06:47:33.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3215119026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e1c004b50 con 0x556f508b25d0 2023-10-26T06:47:33.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 10 client.16254 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:33.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556f50618c60 con 0x556f508b25d0 2023-10-26T06:47:33.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3215119026 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e20004cf0 con 0x556f508b25d0 2023-10-26T06:47:33.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3215119026 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8e1c00faf0 con 0x556f508b25d0 2023-10-26T06:47:33.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 10 client.16254 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:33.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:33.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 20 client.16254 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:33.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f50921400 0x556f50923820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:33.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 4 client.16254 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:47:33.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.472+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556f507fde50 con 0x556f50921400 2023-10-26T06:47:33.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f50921400 0x556f50923820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:33.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e2a7fc700 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f50921400 0x556f50923820 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d207791c0925be05 server_cookie=7d162694fe272e9f in_seq=0 out_seq=0 2023-10-26T06:47:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e0eff5700 10 client.16254 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e0eff5700 1 -- 172.21.15.50:0/3215119026 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556f507fde50 con 0x556f50921400 2023-10-26T06:47:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e0eff5700 10 client.16254 handle_command_reply: tid=0 2023-10-26T06:47:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e44dddb80 1 client.16254 shutdown 2023-10-26T06:47:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 msgr2=0x556f508c2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.473+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508c2c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0053b0 tx=0x7f8e1c01eec0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 shutdown_connections 2023-10-26T06:47:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556f50921400 0x556f50923820 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f508b8500 0x556f508c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f508b25d0 0x556f508c2c10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e0eff5700 0 client.16254 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 --2- 172.21.15.50:0/3215119026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f508b7be0 0x556f508c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 >> 172.21.15.50:0/3215119026 conn(0x556f50826720 msgr2=0x556f508b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 shutdown_connections 2023-10-26T06:47:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 1 -- 172.21.15.50:0/3215119026 wait complete. 2023-10-26T06:47:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e44dddb80 20 client.16254 trim_cache size 0 max 16384 2023-10-26T06:47:33.498 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:47:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8e140a15f0 msgr2=0x7f8e140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8e140a15f0 0x7f8e140a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009c30 tx=0x7f8e1c011440 comp rx=0 tx=0).stop 2023-10-26T06:47:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 msgr2=0x7f8e2c19c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 0x7f8e2c19c540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b070 tx=0x7f8e240077f0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 shutdown_connections 2023-10-26T06:47:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8e140a15f0 0x7f8e140a3ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e2c106730 0x7f8e2c19c540 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e2c100720 0x7f8e2c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 --2- 172.21.15.50:0/2166770509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e2c1010e0 0x7f8e2c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.474+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 >> 172.21.15.50:0/2166770509 conn(0x7f8e2c0fc1b0 msgr2=0x7f8e2c10be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:33.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.475+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 shutdown_connections 2023-10-26T06:47:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:33.475+0000 7f8e313ff700 1 -- 172.21.15.50:0/2166770509 wait complete. 2023-10-26T06:47:34.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:33 smithi153 ceph-mon[131657]: pgmap v436: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 288 op/s 2023-10-26T06:47:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:33 smithi050 ceph-mon[94997]: pgmap v436: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 288 op/s 2023-10-26T06:47:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:33 smithi125 ceph-mon[130643]: pgmap v436: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 288 op/s 2023-10-26T06:47:34.503 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:47:34.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:47:34.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 -- 172.21.15.50:0/3455861039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795410cf60 msgr2=0x7f795410f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 --2- 172.21.15.50:0/3455861039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795410cf60 0x7f795410f3d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f794c00b0a0 tx=0x7f794c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 -- 172.21.15.50:0/3455861039 shutdown_connections 2023-10-26T06:47:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 --2- 172.21.15.50:0/3455861039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795410cf60 0x7f795410f3d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 --2- 172.21.15.50:0/3455861039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7954072c20 0x7f7954073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 --2- 172.21.15.50:0/3455861039 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954073540 0x7f795410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.717+0000 7f7958bff700 1 -- 172.21.15.50:0/3455861039 >> 172.21.15.50:0/3455861039 conn(0x7f79540fc1b0 msgr2=0x7f79540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.718+0000 7f7958bff700 1 -- 172.21.15.50:0/3455861039 shutdown_connections 2023-10-26T06:47:34.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.718+0000 7f7958bff700 1 -- 172.21.15.50:0/3455861039 wait complete. 2023-10-26T06:47:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.719+0000 7f7958bff700 1 Processor -- start 2023-10-26T06:47:34.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.719+0000 7f7958bff700 1 -- start start 2023-10-26T06:47:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7958bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 0x7f7954198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7958bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954073540 0x7f79541993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7958bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795410cf60 0x7f795419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7958bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419ddb0 con 0x7f7954073540 2023-10-26T06:47:34.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7958bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419df20 con 0x7f7954072c20 2023-10-26T06:47:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7958bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419e0e0 con 0x7f795410cf60 2023-10-26T06:47:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f795259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 0x7f7954198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f795259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 0x7f7954198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56058/0 (socket says 172.21.15.50:56058) 2023-10-26T06:47:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f794bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954073540 0x7f79541993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f795259c700 1 -- 172.21.15.50:0/1600244978 learned_addr learned my addr 172.21.15.50:0/1600244978 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.720+0000 7f7952d9d700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795410cf60 0x7f795419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f795259c700 1 -- 172.21.15.50:0/1600244978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795410cf60 msgr2=0x7f795419d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f795259c700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795410cf60 0x7f795419d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f795259c700 1 -- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954073540 msgr2=0x7f79541993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f795259c700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954073540 0x7f79541993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f795259c700 1 -- 172.21.15.50:0/1600244978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009d00 con 0x7f7954072c20 2023-10-26T06:47:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f794bfff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954073540 0x7f79541993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f795259c700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 0x7f7954198e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f794400e9a0 tx=0x7f794400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f794b7fe700 1 -- 172.21.15.50:0/1600244978 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944009790 con 0x7f7954072c20 2023-10-26T06:47:34.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795419e3c0 con 0x7f7954072c20 2023-10-26T06:47:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f794b7fe700 1 -- 172.21.15.50:0/1600244978 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7944010430 con 0x7f7954072c20 2023-10-26T06:47:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f794b7fe700 1 -- 172.21.15.50:0/1600244978 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944018680 con 0x7f7954072c20 2023-10-26T06:47:34.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.721+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79541a5c00 con 0x7f7954072c20 2023-10-26T06:47:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.724+0000 7f794b7fe700 1 -- 172.21.15.50:0/1600244978 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f79440105a0 con 0x7f7954072c20 2023-10-26T06:47:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.725+0000 7f796c439b80 1 Processor -- start 2023-10-26T06:47:34.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 -- start start 2023-10-26T06:47:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f794b7fe700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79400a1670 0x7f79400a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f794b7fe700 1 -- 172.21.15.50:0/1600244978 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7944014070 con 0x7f7954072c20 2023-10-26T06:47:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 0x565149749040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149749580 0x565149743110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149743650 0x565149743ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f7952d9d700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79400a1670 0x7f79400a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651496b6760 con 0x565149749580 2023-10-26T06:47:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x56514969cce0 con 0x565149743650 2023-10-26T06:47:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.726+0000 7f796c439b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56514969a600 con 0x565149748c60 2023-10-26T06:47:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f794bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149749580 0x565149743110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 0x565149749040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 0x565149749040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:36752/0 (socket says 172.21.15.50:36752) 2023-10-26T06:47:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 -- 172.21.15.50:0/2774209998 learned_addr learned my addr 172.21.15.50:0/2774209998 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f7952d9d700 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149743650 0x565149743ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 -- 172.21.15.50:0/2774209998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149743650 msgr2=0x565149743ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149743650 0x565149743ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 -- 172.21.15.50:0/2774209998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149749580 msgr2=0x565149743110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149749580 0x565149743110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 -- 172.21.15.50:0/2774209998 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565149653470 con 0x565149748c60 2023-10-26T06:47:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f794bfff700 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149749580 0x565149743110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:34.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f7952d9d700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79400a1670 0x7f79400a3b30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f794c009cd0 tx=0x7f794c007da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.727+0000 7f795259c700 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 0x565149749040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7944096c80 tx=0x7f7944099e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39b873f012e213a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f7948ff9700 1 -- 172.21.15.50:0/2774209998 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794409e170 con 0x565149748c60 2023-10-26T06:47:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f7948ff9700 1 -- 172.21.15.50:0/2774209998 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f794409e360 con 0x565149748c60 2023-10-26T06:47:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f7948ff9700 1 -- 172.21.15.50:0/2774209998 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944099700 con 0x565149748c60 2023-10-26T06:47:34.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 -- 172.21.15.50:0/2774209998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 msgr2=0x565149749040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 0x565149749040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7944096c80 tx=0x7f7944099e80 comp rx=0 tx=0).stop 2023-10-26T06:47:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 -- 172.21.15.50:0/2774209998 shutdown_connections 2023-10-26T06:47:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149743650 0x565149743ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149748c60 0x565149749040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 --2- 172.21.15.50:0/2774209998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149749580 0x565149743110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.728+0000 7f796c439b80 1 -- 172.21.15.50:0/2774209998 >> 172.21.15.50:0/2774209998 conn(0x5651496b77a0 msgr2=0x56514973dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.729+0000 7f796c439b80 1 -- 172.21.15.50:0/2774209998 shutdown_connections 2023-10-26T06:47:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.729+0000 7f796c439b80 1 -- 172.21.15.50:0/2774209998 wait complete. 2023-10-26T06:47:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.729+0000 7f796c439b80 1 -- start start 2023-10-26T06:47:34.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 Processor -- start 2023-10-26T06:47:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x56514974c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x56514974cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x56514974d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x565149695ef0 con 0x565149743650 2023-10-26T06:47:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x565149632790 con 0x565149748c60 2023-10-26T06:47:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x565149632430 con 0x565149749580 2023-10-26T06:47:34.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.730+0000 7f796c439b80 10 client.0 _ll_register_callbacks cb 0x56514957cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x56514974c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x56514974c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50898/0 (socket says 172.21.15.50:50898) 2023-10-26T06:47:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 -- 172.21.15.50:0/3859023770 learned_addr learned my addr 172.21.15.50:0/3859023770 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f794bfff700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x56514974cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f7952d9d700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x56514974d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 -- 172.21.15.50:0/3859023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 msgr2=0x56514974d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x56514974d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 -- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 msgr2=0x56514974cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x56514974cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 -- 172.21.15.50:0/3859023770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c009c90 con 0x565149743650 2023-10-26T06:47:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f795259c700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x56514974c880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f794409a1a0 tx=0x7f794400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b88499e933869c server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.731+0000 7f7939ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f7939ffb700 1 -- 172.21.15.50:0/3859023770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440a2620 con 0x565149743650 2023-10-26T06:47:34.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f7939ffb700 1 -- 172.21.15.50:0/3859023770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f794409a680 con 0x565149743650 2023-10-26T06:47:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56514969af70 con 0x565149743650 2023-10-26T06:47:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f7939ffb700 1 -- 172.21.15.50:0/3859023770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79440a2110 con 0x565149743650 2023-10-26T06:47:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 10 client.16266 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f79541a5c00 con 0x565149743650 2023-10-26T06:47:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f7939ffb700 1 -- 172.21.15.50:0/3859023770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56514969af70 con 0x565149743650 2023-10-26T06:47:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f7939ffb700 1 -- 172.21.15.50:0/3859023770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f794407e020 con 0x565149743650 2023-10-26T06:47:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 10 client.16266 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:34.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 20 client.16266 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56514975ccb0 0x56514975f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 4 client.16266 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.732+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565149712930 con 0x56514975ccb0 2023-10-26T06:47:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.733+0000 7f794bfff700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56514975ccb0 0x56514975f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.733+0000 7f794bfff700 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56514975ccb0 0x56514975f0d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5e0b4cbefb1bbd server_cookie=6e851bef8fc75b57 in_seq=0 out_seq=0 2023-10-26T06:47:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.733+0000 7f7939ffb700 10 client.16266 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.734+0000 7f7939ffb700 1 -- 172.21.15.50:0/3859023770 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565149712930 con 0x56514975ccb0 2023-10-26T06:47:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.734+0000 7f7939ffb700 10 client.16266 handle_command_reply: tid=0 2023-10-26T06:47:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.734+0000 7f796c439b80 1 client.16266 shutdown 2023-10-26T06:47:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 msgr2=0x56514974c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x56514974c880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f794409a1a0 tx=0x7f794400c4d0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 shutdown_connections 2023-10-26T06:47:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x56514975ccb0 0x56514975f0d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x56514974d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x56514974c880 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f7939ffb700 0 client.16266 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 --2- 172.21.15.50:0/3859023770 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x56514974cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 >> 172.21.15.50:0/3859023770 conn(0x5651496b77a0 msgr2=0x565149742100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 shutdown_connections 2023-10-26T06:47:34.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 1 -- 172.21.15.50:0/3859023770 wait complete. 2023-10-26T06:47:34.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.735+0000 7f796c439b80 20 client.16266 trim_cache size 0 max 16384 2023-10-26T06:47:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 Processor -- start 2023-10-26T06:47:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 -- start start 2023-10-26T06:47:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x5651497481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x565149753f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x565149737c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651495169a0 con 0x565149743650 2023-10-26T06:47:34.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x565149749040 con 0x565149748c60 2023-10-26T06:47:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f796c439b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x565149736130 con 0x565149749580 2023-10-26T06:47:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f795259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x5651497481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f795259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x5651497481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50914/0 (socket says 172.21.15.50:50914) 2023-10-26T06:47:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f794bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x565149753f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.753+0000 7f795259c700 1 -- 172.21.15.50:0/3865265578 learned_addr learned my addr 172.21.15.50:0/3865265578 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f7952d9d700 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x565149737c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f795259c700 1 -- 172.21.15.50:0/3865265578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 msgr2=0x565149737c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f795259c700 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x565149737c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f795259c700 1 -- 172.21.15.50:0/3865265578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 msgr2=0x565149753f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f795259c700 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x565149753f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f795259c700 1 -- 172.21.15.50:0/3865265578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651494c0e60 con 0x565149743650 2023-10-26T06:47:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f7952d9d700 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x565149737c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:47:34.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f795259c700 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x5651497481f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f794400c2d0 tx=0x7f7944099e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba96b4938dfa79b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f79497fa700 1 -- 172.21.15.50:0/3865265578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440a25a0 con 0x565149743650 2023-10-26T06:47:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f79497fa700 1 -- 172.21.15.50:0/3865265578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79440985b0 con 0x565149743650 2023-10-26T06:47:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.754+0000 7f79497fa700 1 -- 172.21.15.50:0/3865265578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440a2110 con 0x565149743650 2023-10-26T06:47:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 -- 172.21.15.50:0/3865265578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 msgr2=0x5651497481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x5651497481f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f794400c2d0 tx=0x7f7944099e80 comp rx=0 tx=0).stop 2023-10-26T06:47:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 -- 172.21.15.50:0/3865265578 shutdown_connections 2023-10-26T06:47:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149749580 0x565149737c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149743650 0x5651497481f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 --2- 172.21.15.50:0/3865265578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149748c60 0x565149753f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 -- 172.21.15.50:0/3865265578 >> 172.21.15.50:0/3865265578 conn(0x5651496b77a0 msgr2=0x565149737530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:34.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 -- 172.21.15.50:0/3865265578 shutdown_connections 2023-10-26T06:47:34.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 -- 172.21.15.50:0/3865265578 wait complete. 2023-10-26T06:47:34.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.755+0000 7f796c439b80 1 -- start start 2023-10-26T06:47:34.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 Processor -- start 2023-10-26T06:47:34.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 0x5651497532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149748c60 0x565149753800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149749580 0x5651497a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651497aa100 con 0x565149748c60 2023-10-26T06:47:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651497aa270 con 0x565149749580 2023-10-26T06:47:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651497aa430 con 0x565149743650 2023-10-26T06:47:34.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f796c439b80 10 client.0 _ll_register_callbacks cb 0x56514957cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:34.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f795259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 0x5651497532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f794bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149748c60 0x565149753800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f795259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 0x5651497532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:36764/0 (socket says 172.21.15.50:36764) 2023-10-26T06:47:34.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f795259c700 1 -- 172.21.15.50:0/2506640349 learned_addr learned my addr 172.21.15.50:0/2506640349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:34.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.756+0000 7f7952d9d700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149749580 0x5651497a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f794bfff700 1 -- 172.21.15.50:0/2506640349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 msgr2=0x5651497532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f794bfff700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 0x5651497532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f794bfff700 1 -- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149749580 msgr2=0x5651497a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:34.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f794bfff700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149749580 0x5651497a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f794bfff700 1 -- 172.21.15.50:0/2506640349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79541a5c00 con 0x565149748c60 2023-10-26T06:47:34.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f795259c700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 0x5651497532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:34.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f794bfff700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149748c60 0x565149753800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x56514974ddc0 tx=0x7f793c01e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d59f57f44a2fe2e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:34.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f7939ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:47:34.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f7939ffb700 1 -- 172.21.15.50:0/2506640349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c015040 con 0x565149748c60 2023-10-26T06:47:34.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f7939ffb700 1 -- 172.21.15.50:0/2506640349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f793c003e70 con 0x565149748c60 2023-10-26T06:47:34.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.757+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651497440c0 con 0x565149748c60 2023-10-26T06:47:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f7939ffb700 1 -- 172.21.15.50:0/2506640349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f793c01e980 con 0x565149748c60 2023-10-26T06:47:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 10 client.16272 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5651494a9ce0 con 0x565149748c60 2023-10-26T06:47:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f7939ffb700 1 -- 172.21.15.50:0/2506640349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5651497440c0 con 0x565149748c60 2023-10-26T06:47:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f7939ffb700 1 -- 172.21.15.50:0/2506640349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f793c02e050 con 0x565149748c60 2023-10-26T06:47:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 10 client.16272 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 20 client.16272 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5651497b3030 0x5651497b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:34.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 4 client.16272 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:47:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f794409e360 con 0x5651497b3030 2023-10-26T06:47:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.758+0000 7f795259c700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5651497b3030 0x5651497b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.759+0000 7f795259c700 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5651497b3030 0x5651497b5450 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ee0ed38069eb76 server_cookie=e2c5d31d483a9821 in_seq=0 out_seq=0 2023-10-26T06:47:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.759+0000 7f7939ffb700 10 client.16272 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:34.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f7939ffb700 1 -- 172.21.15.50:0/2506640349 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f794409e360 con 0x5651497b3030 2023-10-26T06:47:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f7939ffb700 10 client.16272 handle_command_reply: tid=0 2023-10-26T06:47:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 client.16272 shutdown 2023-10-26T06:47:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149748c60 msgr2=0x565149753800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149748c60 0x565149753800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x56514974ddc0 tx=0x7f793c01e610 comp rx=0 tx=0).stop 2023-10-26T06:47:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 shutdown_connections 2023-10-26T06:47:34.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5651497b3030 0x5651497b5450 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x565149749580 0x5651497a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565149743650 0x5651497532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f7939ffb700 0 client.16272 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 --2- 172.21.15.50:0/2506640349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565149748c60 0x565149753800 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 >> 172.21.15.50:0/2506640349 conn(0x5651496b77a0 msgr2=0x56514974d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:34.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 shutdown_connections 2023-10-26T06:47:34.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 1 -- 172.21.15.50:0/2506640349 wait complete. 2023-10-26T06:47:34.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.760+0000 7f796c439b80 20 client.16272 trim_cache size 0 max 16384 2023-10-26T06:47:34.775 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:47:34.776 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:47:34.776 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "62dbbc5c-5b61-4b5d-926c-29e4a335170d", 2023-10-26T06:47:34.776 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:47:34.776 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:47:34.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79400a1670 msgr2=0x7f79400a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79400a1670 0x7f79400a3b30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f794c009cd0 tx=0x7f794c007da0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 msgr2=0x7f7954198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 0x7f7954198e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f794400e9a0 tx=0x7f794400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 shutdown_connections 2023-10-26T06:47:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f79400a1670 0x7f79400a3b30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795410cf60 0x7f795419d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7954072c20 0x7f7954198e90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 --2- 172.21.15.50:0/1600244978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7954073540 0x7f79541993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:34.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 >> 172.21.15.50:0/1600244978 conn(0x7f79540fc1b0 msgr2=0x7f79540fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:34.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 shutdown_connections 2023-10-26T06:47:34.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:34.761+0000 7f7958bff700 1 -- 172.21.15.50:0/1600244978 wait complete. 2023-10-26T06:47:34.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:47:35.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.026+0000 7fcaf7bff700 1 -- 172.21.15.50:0/3260512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf0100710 msgr2=0x7fcaf0100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.026+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/3260512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf0100710 0x7fcaf0100b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009990 tx=0x7fcae0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.026+0000 7fcaf7bff700 1 -- 172.21.15.50:0/3260512941 shutdown_connections 2023-10-26T06:47:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.026+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/3260512941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf01010d0 0x7fcaf010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.026+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/3260512941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf0106720 0x7fcaf0106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.026+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/3260512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf0100710 0x7fcaf0100b90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.027+0000 7fcaf7bff700 1 -- 172.21.15.50:0/3260512941 >> 172.21.15.50:0/3260512941 conn(0x7fcaf00fc200 msgr2=0x7fcaf00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.027+0000 7fcaf7bff700 1 -- 172.21.15.50:0/3260512941 shutdown_connections 2023-10-26T06:47:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.027+0000 7fcaf7bff700 1 -- 172.21.15.50:0/3260512941 wait complete. 2023-10-26T06:47:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.028+0000 7fcaf7bff700 1 Processor -- start 2023-10-26T06:47:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.028+0000 7fcaf7bff700 1 -- start start 2023-10-26T06:47:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf7bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf0100710 0x7fcaf0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf7bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 0x7fcaf0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf7bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf0106720 0x7fcaf0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf7bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01a4f40 con 0x7fcaf0106720 2023-10-26T06:47:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf7bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01a50b0 con 0x7fcaf0100710 2023-10-26T06:47:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf7bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01a5270 con 0x7fcaf01010d0 2023-10-26T06:47:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 0x7fcaf0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 0x7fcaf0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:36774/0 (socket says 172.21.15.50:36774) 2023-10-26T06:47:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf519a700 1 -- 172.21.15.50:0/34667070 learned_addr learned my addr 172.21.15.50:0/34667070 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf599b700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf0100710 0x7fcaf0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.029+0000 7fcaf619c700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf0106720 0x7fcaf0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf519a700 1 -- 172.21.15.50:0/34667070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf0100710 msgr2=0x7fcaf0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf519a700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf0100710 0x7fcaf0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf519a700 1 -- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf0106720 msgr2=0x7fcaf0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf519a700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf0106720 0x7fcaf0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf519a700 1 -- 172.21.15.50:0/34667070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec009520 con 0x7fcaf01010d0 2023-10-26T06:47:35.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf519a700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 0x7fcaf0073030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcae0005910 tx=0x7fcae0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcae6ffd700 1 -- 172.21.15.50:0/34667070 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae001d070 con 0x7fcaf01010d0 2023-10-26T06:47:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcae6ffd700 1 -- 172.21.15.50:0/34667070 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcae0022470 con 0x7fcaf01010d0 2023-10-26T06:47:35.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae00095f0 con 0x7fcaf01010d0 2023-10-26T06:47:35.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcae6ffd700 1 -- 172.21.15.50:0/34667070 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0017650 con 0x7fcaf01010d0 2023-10-26T06:47:35.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.030+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf01a5840 con 0x7fcaf01010d0 2023-10-26T06:47:35.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.034+0000 7fcae6ffd700 1 -- 172.21.15.50:0/34667070 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcae00225e0 con 0x7fcaf01010d0 2023-10-26T06:47:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.036+0000 7fcb0b470b80 1 Processor -- start 2023-10-26T06:47:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.036+0000 7fcb0b470b80 1 -- start start 2023-10-26T06:47:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f14e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcae6ffd700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcadc0a15f0 0x7fcadc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 0x556cf6f18fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f19500 0x556cf6f19960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6e7f6e0 con 0x556cf6f14a90 2023-10-26T06:47:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6e65c60 con 0x556cf6f19500 2023-10-26T06:47:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6e63580 con 0x556cf6f153b0 2023-10-26T06:47:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 0x556cf6f18fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcaf599b700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcadc0a15f0 0x7fcadc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 0x556cf6f18fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:36778/0 (socket says 172.21.15.50:36778) 2023-10-26T06:47:35.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcaf519a700 1 -- 172.21.15.50:0/175454152 learned_addr learned my addr 172.21.15.50:0/175454152 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:35.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcae6ffd700 1 -- 172.21.15.50:0/34667070 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcae00ce310 con 0x7fcaf01010d0 2023-10-26T06:47:35.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.037+0000 7fcaf619c700 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f14e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf619c700 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f19500 0x556cf6f19960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf519a700 1 -- 172.21.15.50:0/175454152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f19500 msgr2=0x556cf6f19960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf519a700 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f19500 0x556cf6f19960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf519a700 1 -- 172.21.15.50:0/175454152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 msgr2=0x556cf6f14e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf519a700 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f14e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf519a700 1 -- 172.21.15.50:0/175454152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cf6e1c3f0 con 0x556cf6f153b0 2023-10-26T06:47:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf619c700 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f19500 0x556cf6f19960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:47:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf599b700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcadc0a15f0 0x7fcadc0a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009d70 tx=0x7fcaec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:35.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.038+0000 7fcaf519a700 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 0x556cf6f18fc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcae0097e40 tx=0x7fcae0097710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64c3b35a455a959e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.039+0000 7fcadbfff700 1 -- 172.21.15.50:0/175454152 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae009ad30 con 0x556cf6f153b0 2023-10-26T06:47:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.039+0000 7fcadbfff700 1 -- 172.21.15.50:0/175454152 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcae00b3fe0 con 0x556cf6f153b0 2023-10-26T06:47:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.039+0000 7fcadbfff700 1 -- 172.21.15.50:0/175454152 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a36d0 con 0x556cf6f153b0 2023-10-26T06:47:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.039+0000 7fcb0b470b80 1 -- 172.21.15.50:0/175454152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 msgr2=0x556cf6f18fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.039+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 0x556cf6f18fc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcae0097e40 tx=0x7fcae0097710 comp rx=0 tx=0).stop 2023-10-26T06:47:35.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 -- 172.21.15.50:0/175454152 shutdown_connections 2023-10-26T06:47:35.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f19500 0x556cf6f19960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f14e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/175454152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f153b0 0x556cf6f18fc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 -- 172.21.15.50:0/175454152 >> 172.21.15.50:0/175454152 conn(0x556cf6e80720 msgr2=0x556cf6f06b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:35.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 -- 172.21.15.50:0/175454152 shutdown_connections 2023-10-26T06:47:35.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 -- 172.21.15.50:0/175454152 wait complete. 2023-10-26T06:47:35.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.040+0000 7fcb0b470b80 1 -- start start 2023-10-26T06:47:35.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 Processor -- start 2023-10-26T06:47:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f20ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f1e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6e5ee70 con 0x556cf6f19500 2023-10-26T06:47:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6dfb710 con 0x556cf6f153b0 2023-10-26T06:47:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.041+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6dfb3b0 con 0x556cf6f14a90 2023-10-26T06:47:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcb0b470b80 10 client.0 _ll_register_callbacks cb 0x556cf6d45a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:35.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf599b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f20ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56112/0 (socket says 172.21.15.50:56112) 2023-10-26T06:47:35.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 -- 172.21.15.50:0/492948742 learned_addr learned my addr 172.21.15.50:0/492948742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:35.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 -- 172.21.15.50:0/492948742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 msgr2=0x556cf6f20ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f20ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 -- 172.21.15.50:0/492948742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 msgr2=0x556cf6f1e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f1e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 -- 172.21.15.50:0/492948742 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf01a5840 con 0x556cf6f153b0 2023-10-26T06:47:35.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcaf519a700 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1e0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcae00a31a0 tx=0x7fcae0022af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a080c5384ab0d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:35.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.042+0000 7fcad97fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:47:35.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcad97fa700 1 -- 172.21.15.50:0/492948742 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00b3e00 con 0x556cf6f153b0 2023-10-26T06:47:35.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcad97fa700 1 -- 172.21.15.50:0/492948742 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcae009bad0 con 0x556cf6f153b0 2023-10-26T06:47:35.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556cf6e63ef0 con 0x556cf6f153b0 2023-10-26T06:47:35.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcad97fa700 1 -- 172.21.15.50:0/492948742 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae00a36d0 con 0x556cf6f153b0 2023-10-26T06:47:35.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcb0b470b80 10 client.26324 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:35.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556cf6c89de0 con 0x556cf6f153b0 2023-10-26T06:47:35.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcad97fa700 1 -- 172.21.15.50:0/492948742 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556cf6e63ef0 con 0x556cf6f153b0 2023-10-26T06:47:35.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.043+0000 7fcad97fa700 1 -- 172.21.15.50:0/492948742 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcae009a9c0 con 0x556cf6f153b0 2023-10-26T06:47:35.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcb0b470b80 10 client.26324 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:35.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcb0b470b80 10 client.26324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:35.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcb0b470b80 20 client.26324 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:35.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f2e0e0 0x556cf6f30500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcb0b470b80 4 client.26324 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:47:35.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cf6edb8b0 con 0x556cf6f2e0e0 2023-10-26T06:47:35.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.044+0000 7fcaf599b700 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f2e0e0 0x556cf6f30500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.045+0000 7fcad97fa700 10 client.26324 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:35.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.045+0000 7fcaf599b700 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f2e0e0 0x556cf6f30500 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b92791d6c538626 server_cookie=6c8e6da4c34896a5 in_seq=0 out_seq=0 2023-10-26T06:47:35.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.046+0000 7fcad97fa700 1 -- 172.21.15.50:0/492948742 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556cf6edb8b0 con 0x556cf6f2e0e0 2023-10-26T06:47:35.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.046+0000 7fcad97fa700 10 client.26324 handle_command_reply: tid=0 2023-10-26T06:47:35.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.046+0000 7fcb0b470b80 1 client.26324 shutdown 2023-10-26T06:47:35.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 msgr2=0x556cf6f1e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1e0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcae00a31a0 tx=0x7fcae0022af0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 shutdown_connections 2023-10-26T06:47:35.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f2e0e0 0x556cf6f30500 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f1e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f20ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/492948742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1e0d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcad97fa700 0 client.26324 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:35.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 >> 172.21.15.50:0/492948742 conn(0x556cf6e80720 msgr2=0x556cf6f0b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:35.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 shutdown_connections 2023-10-26T06:47:35.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 1 -- 172.21.15.50:0/492948742 wait complete. 2023-10-26T06:47:35.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.047+0000 7fcb0b470b80 20 client.26324 trim_cache size 0 max 16384 2023-10-26T06:47:35.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 Processor -- start 2023-10-26T06:47:35.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 -- start start 2023-10-26T06:47:35.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f16ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f0b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6cdf920 con 0x556cf6f19500 2023-10-26T06:47:35.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6f08600 con 0x556cf6f153b0 2023-10-26T06:47:35.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.070+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6f0beb0 con 0x556cf6f14a90 2023-10-26T06:47:35.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.071+0000 7fcaf619c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.071+0000 7fcaf599b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f16ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.071+0000 7fcaf619c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f253b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50972/0 (socket says 172.21.15.50:50972) 2023-10-26T06:47:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.071+0000 7fcaf619c700 1 -- 172.21.15.50:0/1102379944 learned_addr learned my addr 172.21.15.50:0/1102379944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.071+0000 7fcaf519a700 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f0b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.071+0000 7fcaf599b700 1 -- 172.21.15.50:0/1102379944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 msgr2=0x556cf6f0b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf599b700 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f0b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf599b700 1 -- 172.21.15.50:0/1102379944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 msgr2=0x556cf6f253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf599b700 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f253b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf599b700 1 -- 172.21.15.50:0/1102379944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cf6c72c60 con 0x556cf6f14a90 2023-10-26T06:47:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf619c700 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f253b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf519a700 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f0b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcaf599b700 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f16ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x556cf6f2e4c0 tx=0x7fcaec014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb8214bbc46f5d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcae4bff700 1 -- 172.21.15.50:0/1102379944 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec026320 con 0x556cf6f14a90 2023-10-26T06:47:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcae4bff700 1 -- 172.21.15.50:0/1102379944 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaec026480 con 0x556cf6f14a90 2023-10-26T06:47:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.072+0000 7fcae4bff700 1 -- 172.21.15.50:0/1102379944 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec003c70 con 0x556cf6f14a90 2023-10-26T06:47:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.073+0000 7fcb0b470b80 1 -- 172.21.15.50:0/1102379944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 msgr2=0x556cf6f16ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.073+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f16ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x556cf6f2e4c0 tx=0x7fcaec014000 comp rx=0 tx=0).stop 2023-10-26T06:47:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 -- 172.21.15.50:0/1102379944 shutdown_connections 2023-10-26T06:47:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f19500 0x556cf6f253b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f14a90 0x556cf6f16ec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/1102379944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f0b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 -- 172.21.15.50:0/1102379944 >> 172.21.15.50:0/1102379944 conn(0x556cf6e80720 msgr2=0x556cf6f1d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:35.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 -- 172.21.15.50:0/1102379944 shutdown_connections 2023-10-26T06:47:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 -- 172.21.15.50:0/1102379944 wait complete. 2023-10-26T06:47:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.074+0000 7fcb0b470b80 1 -- start start 2023-10-26T06:47:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.075+0000 7fcb0b470b80 1 Processor -- start 2023-10-26T06:47:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.075+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f20d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.075+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.075+0000 7fcb0b470b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f19500 0x556cf6f1ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6f20610 con 0x556cf6f14a90 2023-10-26T06:47:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6f81ef0 con 0x556cf6f153b0 2023-10-26T06:47:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcb0b470b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cf6f82030 con 0x556cf6f19500 2023-10-26T06:47:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcb0b470b80 10 client.0 _ll_register_callbacks cb 0x556cf6d45a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:47:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf599b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f20d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:56130/0 (socket says 172.21.15.50:56130) 2023-10-26T06:47:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 -- 172.21.15.50:0/2172947157 learned_addr learned my addr 172.21.15.50:0/2172947157 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:47:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf619c700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f19500 0x556cf6f1ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 -- 172.21.15.50:0/2172947157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f19500 msgr2=0x556cf6f1ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f19500 0x556cf6f1ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 -- 172.21.15.50:0/2172947157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 msgr2=0x556cf6f20d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:47:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f20d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf519a700 1 -- 172.21.15.50:0/2172947157 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cf6c89de0 con 0x556cf6f153b0 2023-10-26T06:47:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf619c700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f19500 0x556cf6f1ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:47:35.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.076+0000 7fcaf599b700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f20d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:47:35.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcaf519a700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1f7c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcae0097e40 tx=0x7fcae00cbb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26797a90c8d60a08 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:47:35.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcad97fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:47:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcad97fa700 1 -- 172.21.15.50:0/2172947157 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00b3e00 con 0x556cf6f153b0 2023-10-26T06:47:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcad97fa700 1 -- 172.21.15.50:0/2172947157 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcae00a36d0 con 0x556cf6f153b0 2023-10-26T06:47:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcae00b3fe0 con 0x556cf6f153b0 2023-10-26T06:47:35.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcad97fa700 1 -- 172.21.15.50:0/2172947157 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae009b3d0 con 0x556cf6f153b0 2023-10-26T06:47:35.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcb0b470b80 10 client.26330 fetch_fsmap learned FSMap version 25 2023-10-26T06:47:35.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.077+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fcae8003ae0 con 0x556cf6f153b0 2023-10-26T06:47:35.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcad97fa700 1 -- 172.21.15.50:0/2172947157 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcae00b3fe0 con 0x556cf6f153b0 2023-10-26T06:47:35.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcad97fa700 1 -- 172.21.15.50:0/2172947157 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcae00b9350 con 0x556cf6f153b0 2023-10-26T06:47:35.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcb0b470b80 10 client.26330 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:47:35.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcb0b470b80 10 client.26330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:47:35.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcb0b470b80 20 client.26330 populate_metadata read hostname 'smithi050' 2023-10-26T06:47:35.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f83400 0x556cf6f85820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:47:35.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcb0b470b80 4 client.26330 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:47:35.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556cf6e57e50 con 0x556cf6f83400 2023-10-26T06:47:35.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.078+0000 7fcaf599b700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f83400 0x556cf6f85820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:47:35.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcaf599b700 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f83400 0x556cf6f85820 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483b0cbe1898399c server_cookie=8acebf006b82d192 in_seq=0 out_seq=0 2023-10-26T06:47:35.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcad97fa700 10 client.26330 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcad97fa700 1 -- 172.21.15.50:0/2172947157 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x556cf6e57e50 con 0x556cf6f83400 2023-10-26T06:47:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcad97fa700 10 client.26330 handle_command_reply: tid=0 2023-10-26T06:47:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 client.26330 shutdown 2023-10-26T06:47:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 msgr2=0x556cf6f1f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1f7c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcae0097e40 tx=0x7fcae00cbb90 comp rx=0 tx=0).stop 2023-10-26T06:47:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 shutdown_connections 2023-10-26T06:47:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556cf6f83400 0x556cf6f85820 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556cf6f19500 0x556cf6f1ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556cf6f14a90 0x556cf6f20d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 --2- 172.21.15.50:0/2172947157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556cf6f153b0 0x556cf6f1f7c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcad97fa700 0 client.26330 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:47:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.079+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 >> 172.21.15.50:0/2172947157 conn(0x556cf6e80720 msgr2=0x556cf6f0b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:35.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.080+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 shutdown_connections 2023-10-26T06:47:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.080+0000 7fcb0b470b80 1 -- 172.21.15.50:0/2172947157 wait complete. 2023-10-26T06:47:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.080+0000 7fcb0b470b80 20 client.26330 trim_cache size 0 max 16384 2023-10-26T06:47:35.095 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:47:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (7220 inodes in the stack)", 2023-10-26T06:47:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:47:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "62dbbc5c-5b61-4b5d-926c-29e4a335170d": { 2023-10-26T06:47:35.096 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:47:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "62dbbc5c-5b61-4b5d-926c-29e4a335170d", 2023-10-26T06:47:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:47:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:47:35.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:47:35.097 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:47:35.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcadc0a15f0 msgr2=0x7fcadc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcadc0a15f0 0x7fcadc0a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009d70 tx=0x7fcaec009260 comp rx=0 tx=0).stop 2023-10-26T06:47:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 msgr2=0x7fcaf0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:47:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 0x7fcaf0073030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcae0005910 tx=0x7fcae0004730 comp rx=0 tx=0).stop 2023-10-26T06:47:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 shutdown_connections 2023-10-26T06:47:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fcadc0a15f0 0x7fcadc0a3ab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcaf0106720 0x7fcaf0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcaf0100710 0x7fcaf0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 --2- 172.21.15.50:0/34667070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaf01010d0 0x7fcaf0073030 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:47:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 >> 172.21.15.50:0/34667070 conn(0x7fcaf00fc200 msgr2=0x7fcaf00fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:47:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 shutdown_connections 2023-10-26T06:47:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:47:35.081+0000 7fcaf7bff700 1 -- 172.21.15.50:0/34667070 wait complete. 2023-10-26T06:47:35.106 INFO:tasks.cephfs.filesystem:scrub status for tag:62dbbc5c-5b61-4b5d-926c-29e4a335170d - {'path': '/', 'tag': '62dbbc5c-5b61-4b5d-926c-29e4a335170d', 'options': 'recursive,force'} 2023-10-26T06:47:35.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:35 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:47:35.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:35 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:47:35.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:35 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:47:36.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:36 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:47:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:36 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:36 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:47:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:36 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:47:36.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:36 smithi125 ceph-mon[130643]: pgmap v437: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 67 op/s 2023-10-26T06:47:36.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:36 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:47:36.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:36 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:36.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:36 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:47:36.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:36 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:47:36.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:36 smithi153 ceph-mon[131657]: pgmap v437: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 67 op/s 2023-10-26T06:47:36.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:36 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:47:36.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:36 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:36.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:36 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:47:36.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:36 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:47:36.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:36 smithi050 ceph-mon[94997]: pgmap v437: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 67 op/s 2023-10-26T06:47:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:38 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:38 smithi125 ceph-mon[130643]: pgmap v438: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-10-26T06:47:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:38 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:38 smithi153 ceph-mon[131657]: pgmap v438: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-10-26T06:47:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:38 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:38 smithi050 ceph-mon[94997]: pgmap v438: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-10-26T06:47:40.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:39 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:40.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:39 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:40.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:39 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:40.933 INFO:tasks.workunit.client.0.smithi050.stdout:# 2023-10-26T06:47:40.933 INFO:tasks.workunit.client.0.smithi050.stdout:# configuration written to .config 2023-10-26T06:47:40.933 INFO:tasks.workunit.client.0.smithi050.stdout:# 2023-10-26T06:47:40.938 INFO:tasks.workunit.client.0.smithi050.stderr:++ grep -c processor /proc/cpuinfo 2023-10-26T06:47:40.940 INFO:tasks.workunit.client.0.smithi050.stderr:+ make -j8 2023-10-26T06:47:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:40 smithi125 ceph-mon[130643]: pgmap v439: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 432 op/s 2023-10-26T06:47:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:40 smithi153 ceph-mon[131657]: pgmap v439: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 432 op/s 2023-10-26T06:47:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:40 smithi050 ceph-mon[94997]: pgmap v439: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 432 op/s 2023-10-26T06:47:42.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:41 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:42.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:41 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:41 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:47:42.739 INFO:tasks.workunit.client.0.smithi050.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_32.h 2023-10-26T06:47:42.740 INFO:tasks.workunit.client.0.smithi050.stdout: SYSHDR arch/x86/include/generated/asm/unistd_32_ia32.h 2023-10-26T06:47:42.741 INFO:tasks.workunit.client.0.smithi050.stdout: SYSHDR arch/x86/include/generated/asm/unistd_64_x32.h 2023-10-26T06:47:42.741 INFO:tasks.workunit.client.0.smithi050.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_64.h 2023-10-26T06:47:42.743 INFO:tasks.workunit.client.0.smithi050.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_32.h 2023-10-26T06:47:42.744 INFO:tasks.workunit.client.0.smithi050.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_64.h 2023-10-26T06:47:42.747 INFO:tasks.workunit.client.0.smithi050.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_x32.h 2023-10-26T06:47:42.762 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/bpf_perf_event.h 2023-10-26T06:47:42.770 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/errno.h 2023-10-26T06:47:42.779 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/fcntl.h 2023-10-26T06:47:42.787 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctl.h 2023-10-26T06:47:42.793 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctls.h 2023-10-26T06:47:42.798 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/ipcbuf.h 2023-10-26T06:47:42.803 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/param.h 2023-10-26T06:47:42.808 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/poll.h 2023-10-26T06:47:42.813 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/resource.h 2023-10-26T06:47:42.818 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/socket.h 2023-10-26T06:47:42.823 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/sockios.h 2023-10-26T06:47:42.827 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC arch/x86/tools/relocs_32.o 2023-10-26T06:47:42.829 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/termbits.h 2023-10-26T06:47:42.835 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/termios.h 2023-10-26T06:47:42.837 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC arch/x86/tools/relocs_64.o 2023-10-26T06:47:42.840 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/uapi/asm/types.h 2023-10-26T06:47:42.853 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC arch/x86/tools/relocs_common.o 2023-10-26T06:47:42.932 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/asm/dma-contiguous.h 2023-10-26T06:47:42.938 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/asm/early_ioremap.h 2023-10-26T06:47:42.941 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/generated/uapi/linux/version.h 2023-10-26T06:47:42.944 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/asm/export.h 2023-10-26T06:47:42.948 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/asm/mcs_spinlock.h 2023-10-26T06:47:42.952 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/asm/mm-arch-hooks.h 2023-10-26T06:47:42.957 INFO:tasks.workunit.client.0.smithi050.stdout: WRAP arch/x86/include/generated/asm/mmiowb.h 2023-10-26T06:47:43.007 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/kallsyms 2023-10-26T06:47:43.029 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/selinux/genheaders/genheaders 2023-10-26T06:47:43.061 INFO:tasks.workunit.client.0.smithi050.stdout: DESCEND objtool 2023-10-26T06:47:43.099 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/config/kernel.release 2023-10-26T06:47:43.130 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/selinux/mdp/mdp 2023-10-26T06:47:43.171 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTLD arch/x86/tools/relocs 2023-10-26T06:47:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:42 smithi125 ceph-mon[130643]: pgmap v440: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 628 op/s 2023-10-26T06:47:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:42 smithi153 ceph-mon[131657]: pgmap v440: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 628 op/s 2023-10-26T06:47:43.235 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/pnmtologo 2023-10-26T06:47:43.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:42 smithi050 ceph-mon[94997]: pgmap v440: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 628 op/s 2023-10-26T06:47:43.288 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/fixdep.o 2023-10-26T06:47:43.412 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTLD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/fixdep-in.o 2023-10-26T06:47:43.420 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/conmakehash 2023-10-26T06:47:43.423 INFO:tasks.workunit.client.0.smithi050.stdout: LINK /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/fixdep 2023-10-26T06:47:43.424 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/sortextable 2023-10-26T06:47:43.538 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/asn1_compiler 2023-10-26T06:47:43.605 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/exec-cmd.o 2023-10-26T06:47:43.681 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/help.o 2023-10-26T06:47:43.810 INFO:tasks.workunit.client.0.smithi050.stdout: MKDIR /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/arch/x86/lib/ 2023-10-26T06:47:43.826 INFO:tasks.workunit.client.0.smithi050.stdout: GEN /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/arch/x86/lib/inat-tables.c 2023-10-26T06:47:43.848 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/builtin-check.o 2023-10-26T06:47:43.879 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/arch/x86/decode.o 2023-10-26T06:47:43.982 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/extract-cert 2023-10-26T06:47:44.120 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/builtin-orc.o 2023-10-26T06:47:44.196 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/check.o 2023-10-26T06:47:44.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:43 smithi153 ceph-mon[131657]: pgmap v441: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 901 KiB/s wr, 611 op/s 2023-10-26T06:47:44.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:43 smithi050 ceph-mon[94997]: pgmap v441: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 901 KiB/s wr, 611 op/s 2023-10-26T06:47:44.341 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/pager.o 2023-10-26T06:47:44.411 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/parse-options.o 2023-10-26T06:47:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:43 smithi125 ceph-mon[130643]: pgmap v441: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 901 KiB/s wr, 611 op/s 2023-10-26T06:47:44.551 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/run-command.o 2023-10-26T06:47:44.575 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/orc_gen.o 2023-10-26T06:47:44.596 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/sigchain.o 2023-10-26T06:47:44.766 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/subcmd-config.o 2023-10-26T06:47:44.781 INFO:tasks.workunit.client.0.smithi050.stdout: LD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/arch/x86/objtool-in.o 2023-10-26T06:47:44.794 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/orc_dump.o 2023-10-26T06:47:44.843 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/elf.o 2023-10-26T06:47:44.868 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/special.o 2023-10-26T06:47:45.021 INFO:tasks.workunit.client.0.smithi050.stdout: LD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/libsubcmd-in.o 2023-10-26T06:47:45.064 INFO:tasks.workunit.client.0.smithi050.stdout: AR /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/libsubcmd.a 2023-10-26T06:47:45.069 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/objtool.o 2023-10-26T06:47:45.074 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/libstring.o 2023-10-26T06:47:45.258 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/libctype.o 2023-10-26T06:47:45.335 INFO:tasks.workunit.client.0.smithi050.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/str_error_r.o 2023-10-26T06:47:45.657 INFO:tasks.workunit.client.0.smithi050.stdout: LD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/objtool-in.o 2023-10-26T06:47:45.792 INFO:tasks.workunit.client.0.smithi050.stdout:/home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool 2023-10-26T06:47:45.795 INFO:tasks.workunit.client.0.smithi050.stdout: LINK /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-5.4/tools/objtool/objtool 2023-10-26T06:47:46.509 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/generated/utsrelease.h 2023-10-26T06:47:46.567 INFO:tasks.workunit.client.0.smithi050.stdout: CC scripts/mod/empty.o 2023-10-26T06:47:46.574 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/mod/mk_elfconfig 2023-10-26T06:47:46.587 INFO:tasks.workunit.client.0.smithi050.stdout: CC scripts/mod/devicetable-offsets.s 2023-10-26T06:47:46.719 INFO:tasks.workunit.client.0.smithi050.stdout: MKELF scripts/mod/elfconfig.h 2023-10-26T06:47:46.746 INFO:tasks.workunit.client.0.smithi050.stdout: UPD scripts/mod/devicetable-offsets.h 2023-10-26T06:47:46.756 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/mod/sumversion.o 2023-10-26T06:47:46.757 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/mod/modpost.o 2023-10-26T06:47:46.781 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC scripts/mod/file2alias.o 2023-10-26T06:47:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:46 smithi125 ceph-mon[130643]: pgmap v442: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 883 KiB/s wr, 625 op/s 2023-10-26T06:47:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:46 smithi153 ceph-mon[131657]: pgmap v442: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 883 KiB/s wr, 625 op/s 2023-10-26T06:47:47.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:46 smithi050 ceph-mon[94997]: pgmap v442: 97 pgs: 97 active+clean; 1.3 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 883 KiB/s wr, 625 op/s 2023-10-26T06:47:47.485 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTLD scripts/mod/modpost 2023-10-26T06:47:47.636 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/bounds.s 2023-10-26T06:47:47.637 INFO:tasks.workunit.client.0.smithi050.stdout: CALL scripts/atomic/check-atomics.sh 2023-10-26T06:47:47.671 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/generated/timeconst.h 2023-10-26T06:47:47.761 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/generated/bounds.h 2023-10-26T06:47:47.769 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/asm-offsets.s 2023-10-26T06:47:48.502 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/generated/asm-offsets.h 2023-10-26T06:47:48.510 INFO:tasks.workunit.client.0.smithi050.stdout: CALL scripts/checksyscalls.sh 2023-10-26T06:47:48.597 INFO:tasks.workunit.client.0.smithi050.stdout: CHK include/generated/compile.h 2023-10-26T06:47:48.603 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC usr/gen_init_cpio 2023-10-26T06:47:48.606 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/main.o 2023-10-26T06:47:48.610 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/do_mounts.o 2023-10-26T06:47:48.614 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/do_mounts_md.o 2023-10-26T06:47:48.614 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/do_mounts_initrd.o 2023-10-26T06:47:48.666 INFO:tasks.workunit.client.0.smithi050.stdout: UPD include/generated/compile.h 2023-10-26T06:47:49.172 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/initramfs.o 2023-10-26T06:47:49.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:48 smithi125 ceph-mon[130643]: pgmap v443: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 654 op/s 2023-10-26T06:47:49.231 INFO:tasks.workunit.client.0.smithi050.stdout: CC certs/system_keyring.o 2023-10-26T06:47:49.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:48 smithi153 ceph-mon[131657]: pgmap v443: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 654 op/s 2023-10-26T06:47:49.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:48 smithi050 ceph-mon[94997]: pgmap v443: 97 pgs: 97 active+clean; 1.3 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 654 op/s 2023-10-26T06:47:50.095 INFO:tasks.workunit.client.0.smithi050.stdout: EXTRACT_CERTS 2023-10-26T06:47:50.107 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/calibrate.o 2023-10-26T06:47:50.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:49 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:47:50.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:49 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:47:50.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:49 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:47:50.183 INFO:tasks.workunit.client.0.smithi050.stdout: AS certs/system_certificates.o 2023-10-26T06:47:50.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:49 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:47:50.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:49 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:47:50.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:49 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:47:50.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:49 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:47:50.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:49 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:47:50.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:49 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:47:50.471 INFO:tasks.workunit.client.0.smithi050.stdout: AR certs/built-in.a 2023-10-26T06:47:50.524 INFO:tasks.workunit.client.0.smithi050.stdout: GEN usr/initramfs_data.cpio 2023-10-26T06:47:50.540 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/init_task.o 2023-10-26T06:47:50.576 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/filemap.o 2023-10-26T06:47:50.597 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vsyscall/vsyscall_64.o 2023-10-26T06:47:50.648 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/crypto/built-in.a 2023-10-26T06:47:50.677 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/vsyscall/vsyscall_emu_64.o 2023-10-26T06:47:50.812 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/amd/core.o 2023-10-26T06:47:50.929 INFO:tasks.workunit.client.0.smithi050.stdout: AS usr/initramfs_data.o 2023-10-26T06:47:50.987 INFO:tasks.workunit.client.0.smithi050.stdout: CC init/version.o 2023-10-26T06:47:51.158 INFO:tasks.workunit.client.0.smithi050.stdout: AR usr/built-in.a 2023-10-26T06:47:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:50 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:47:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:50 smithi125 ceph-mon[130643]: pgmap v444: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 674 op/s 2023-10-26T06:47:51.193 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/amd/uncore.o 2023-10-26T06:47:51.208 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/core.o 2023-10-26T06:47:51.226 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/entry/vsyscall/built-in.a 2023-10-26T06:47:51.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:50 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:47:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:50 smithi153 ceph-mon[131657]: pgmap v444: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 674 op/s 2023-10-26T06:47:51.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:50 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:47:51.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:50 smithi050 ceph-mon[94997]: pgmap v444: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 674 op/s 2023-10-26T06:47:51.297 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/bpf/core.o 2023-10-26T06:47:51.334 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/init.o 2023-10-26T06:47:51.778 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vma.o 2023-10-26T06:47:51.807 INFO:tasks.workunit.client.0.smithi050.stdout: AR init/built-in.a 2023-10-26T06:47:51.847 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/amd/ibs.o 2023-10-26T06:47:51.872 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/debugfs/inode.o 2023-10-26T06:47:51.883 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/amd/iommu.o 2023-10-26T06:47:51.910 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/inode.o 2023-10-26T06:47:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:51 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:47:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:51 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:47:52.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:51 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:47:52.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:51 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:47:52.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:51 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:47:52.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:51 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:47:52.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:51 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:47:52.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:51 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:47:52.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:51 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:47:52.438 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vdso32-setup.o 2023-10-26T06:47:52.460 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/bts.o 2023-10-26T06:47:52.556 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/root.o 2023-10-26T06:47:52.608 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mempool.o 2023-10-26T06:47:52.621 INFO:tasks.workunit.client.0.smithi050.stdout: LDS arch/x86/entry/vdso/vdso.lds 2023-10-26T06:47:52.676 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/ds.o 2023-10-26T06:47:52.721 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/vdso/vdso-note.o 2023-10-26T06:47:52.731 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/debugfs/file.o 2023-10-26T06:47:52.788 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/events/amd/built-in.a 2023-10-26T06:47:52.803 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vclock_gettime.o 2023-10-26T06:47:52.861 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/knc.o 2023-10-26T06:47:53.122 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/bpf/built-in.a 2023-10-26T06:47:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:52 smithi125 ceph-mon[130643]: pgmap v445: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 415 op/s 2023-10-26T06:47:53.186 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/cgroup.o 2023-10-26T06:47:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:52 smithi153 ceph-mon[131657]: pgmap v445: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 415 op/s 2023-10-26T06:47:53.240 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/dma/mapping.o 2023-10-26T06:47:53.243 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vgetcpu.o 2023-10-26T06:47:53.247 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/symlink.o 2023-10-26T06:47:53.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:52 smithi050 ceph-mon[94997]: pgmap v445: 97 pgs: 97 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 415 op/s 2023-10-26T06:47:53.418 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/oom_kill.o 2023-10-26T06:47:53.469 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC arch/x86/entry/vdso/vdso2c 2023-10-26T06:47:53.558 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/dma/direct.o 2023-10-26T06:47:53.647 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/debugfs/built-in.a 2023-10-26T06:47:53.708 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/devpts/inode.o 2023-10-26T06:47:53.709 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/waitq.o 2023-10-26T06:47:53.852 INFO:tasks.workunit.client.0.smithi050.stdout: LDS arch/x86/entry/vdso/vdso32/vdso32.lds 2023-10-26T06:47:53.910 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vdso32/vclock_gettime.o 2023-10-26T06:47:53.929 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/lbr.o 2023-10-26T06:47:54.007 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/ia32/sys_ia32.o 2023-10-26T06:47:54.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:53 smithi153 ceph-mon[131657]: pgmap v446: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 2.9 MiB/s wr, 277 op/s 2023-10-26T06:47:54.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:53 smithi050 ceph-mon[94997]: pgmap v446: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 2.9 MiB/s wr, 277 op/s 2023-10-26T06:47:54.417 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/dma/dummy.o 2023-10-26T06:47:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:53 smithi125 ceph-mon[130643]: pgmap v446: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 2.9 MiB/s wr, 277 op/s 2023-10-26T06:47:54.511 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/expire.o 2023-10-26T06:47:54.696 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/devpts/built-in.a 2023-10-26T06:47:54.698 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/vdso/vdso32/note.o 2023-10-26T06:47:54.784 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] fs/efivarfs/inode.o 2023-10-26T06:47:55.009 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/fadvise.o 2023-10-26T06:47:55.153 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/dma/swiotlb.o 2023-10-26T06:47:55.202 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/autofs/dev-ioctl.o 2023-10-26T06:47:55.226 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/vdso/vdso32/system_call.o 2023-10-26T06:47:55.258 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] fs/efivarfs/file.o 2023-10-26T06:47:55.287 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/p4.o 2023-10-26T06:47:55.304 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/vdso/vdso32/sigreturn.o 2023-10-26T06:47:55.444 INFO:tasks.workunit.client.0.smithi050.stdout: VDSO arch/x86/entry/vdso/vdso64.so.dbg 2023-10-26T06:47:55.517 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/ia32/ia32_signal.o 2023-10-26T06:47:55.521 INFO:tasks.workunit.client.0.smithi050.stdout: VDSO arch/x86/entry/vdso/vdso32.so.dbg 2023-10-26T06:47:55.570 INFO:tasks.workunit.client.0.smithi050.stdout: OBJCOPY arch/x86/entry/vdso/vdso64.so 2023-10-26T06:47:55.583 INFO:tasks.workunit.client.0.smithi050.stdout: OBJCOPY arch/x86/entry/vdso/vdso32.so 2023-10-26T06:47:55.596 INFO:tasks.workunit.client.0.smithi050.stdout: VDSO2C arch/x86/entry/vdso/vdso-image-64.c 2023-10-26T06:47:55.607 INFO:tasks.workunit.client.0.smithi050.stdout: VDSO2C arch/x86/entry/vdso/vdso-image-32.c 2023-10-26T06:47:55.627 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vdso-image-64.o 2023-10-26T06:47:55.665 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/maccess.o 2023-10-26T06:47:55.811 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] fs/efivarfs/super.o 2023-10-26T06:47:55.897 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/vdso/vdso-image-32.o 2023-10-26T06:47:55.999 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/autofs/built-in.a 2023-10-26T06:47:56.037 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/dma/built-in.a 2023-10-26T06:47:56.076 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/ia32/audit.o 2023-10-26T06:47:56.085 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/p6.o 2023-10-26T06:47:56.126 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/acpi/boot.o 2023-10-26T06:47:56.153 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/entry/vdso/built-in.a 2023-10-26T06:47:56.185 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/entry_64.o 2023-10-26T06:47:56.201 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/page-writeback.o 2023-10-26T06:47:56.223 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/acpi/sleep.o 2023-10-26T06:47:56.272 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/ia32/built-in.a 2023-10-26T06:47:56.314 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/rstat.o 2023-10-26T06:47:56.375 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/thunk_64.o 2023-10-26T06:47:56.448 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/core.o 2023-10-26T06:47:56.524 INFO:tasks.workunit.client.0.smithi050.stdout: LD [M] fs/efivarfs/efivarfs.o 2023-10-26T06:47:56.579 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/exportfs/expfs.o 2023-10-26T06:47:56.600 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/syscall_64.o 2023-10-26T06:47:56.726 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/pt.o 2023-10-26T06:47:56.906 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/namespace.o 2023-10-26T06:47:56.941 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/common.o 2023-10-26T06:47:57.009 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/compat.o 2023-10-26T06:47:57.140 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/exportfs/built-in.a 2023-10-26T06:47:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:56 smithi125 ceph-mon[130643]: pgmap v447: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 3.2 MiB/s wr, 319 op/s 2023-10-26T06:47:57.177 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/kernel/acpi/wakeup_64.o 2023-10-26T06:47:57.206 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/balloc.o 2023-10-26T06:47:57.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:56 smithi153 ceph-mon[131657]: pgmap v447: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 3.2 MiB/s wr, 319 op/s 2023-10-26T06:47:57.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:56 smithi050 ceph-mon[94997]: pgmap v447: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 3.2 MiB/s wr, 319 op/s 2023-10-26T06:47:57.270 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/acpi/cppc_msr.o 2023-10-26T06:47:57.540 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/cgroup-v1.o 2023-10-26T06:47:57.688 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/util.o 2023-10-26T06:47:57.734 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/readahead.o 2023-10-26T06:47:57.744 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/rapl.o 2023-10-26T06:47:57.816 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/acpi/cstate.o 2023-10-26T06:47:57.906 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/entry/entry_64_compat.o 2023-10-26T06:47:57.952 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/probe.o 2023-10-26T06:47:58.138 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/entry/syscall_32.o 2023-10-26T06:47:58.337 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/freezer.o 2023-10-26T06:47:58.455 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/acpi/built-in.a 2023-10-26T06:47:58.496 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/entry/built-in.a 2023-10-26T06:47:58.536 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/apic.o 2023-10-26T06:47:58.539 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/legacy_freezer.o 2023-10-26T06:47:58.549 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/uncore.o 2023-10-26T06:47:58.569 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/bitmap.o 2023-10-26T06:47:58.570 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/msgutil.o 2023-10-26T06:47:58.581 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/swap.o 2023-10-26T06:47:58.633 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/msg.o 2023-10-26T06:47:59.071 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/apic_common.o 2023-10-26T06:47:59.159 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cgroup/cpuset.o 2023-10-26T06:47:59.163 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/cache.o 2023-10-26T06:47:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:47:58 smithi125 ceph-mon[130643]: pgmap v448: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 349 op/s 2023-10-26T06:47:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:47:58 smithi153 ceph-mon[131657]: pgmap v448: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 349 op/s 2023-10-26T06:47:59.256 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/block_validity.o 2023-10-26T06:47:59.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:47:58 smithi050 ceph-mon[94997]: pgmap v448: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 349 op/s 2023-10-26T06:47:59.623 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/dir.o 2023-10-26T06:47:59.752 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/sem.o 2023-10-26T06:47:59.866 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/uncore_nhmex.o 2023-10-26T06:47:59.938 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/msr.o 2023-10-26T06:48:00.066 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/apic_noop.o 2023-10-26T06:48:00.074 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/truncate.o 2023-10-26T06:48:00.198 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/dir.o 2023-10-26T06:48:00.941 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/ipi.o 2023-10-26T06:48:00.963 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/uncore_snb.o 2023-10-26T06:48:00.971 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/cgroup/built-in.a 2023-10-26T06:48:00.981 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/vmscan.o 2023-10-26T06:48:00.992 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/fatent.o 2023-10-26T06:48:01.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/init.o 2023-10-26T06:48:01.023 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/events/core.o 2023-10-26T06:48:01.043 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/shm.o 2023-10-26T06:48:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:00 smithi125 ceph-mon[130643]: pgmap v449: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 402 op/s 2023-10-26T06:48:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:00 smithi153 ceph-mon[131657]: pgmap v449: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 402 op/s 2023-10-26T06:48:01.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:00 smithi050 ceph-mon[94997]: pgmap v449: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 402 op/s 2023-10-26T06:48:01.343 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/ext4_jbd2.o 2023-10-26T06:48:01.358 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/vector.o 2023-10-26T06:48:01.706 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/uncore_snbep.o 2023-10-26T06:48:01.928 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/file.o 2023-10-26T06:48:02.068 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/init_64.o 2023-10-26T06:48:02.235 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/syscall.o 2023-10-26T06:48:02.477 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/hw_nmi.o 2023-10-26T06:48:02.531 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/extents.o 2023-10-26T06:48:02.789 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/inode.o 2023-10-26T06:48:02.893 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/ipc_sysctl.o 2023-10-26T06:48:03.047 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/io_apic.o 2023-10-26T06:48:03.072 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/events/intel/cstate.o 2023-10-26T06:48:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:02 smithi125 ceph-mon[130643]: pgmap v450: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 343 op/s 2023-10-26T06:48:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:02 smithi153 ceph-mon[131657]: pgmap v450: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 343 op/s 2023-10-26T06:48:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:02 smithi050 ceph-mon[94997]: pgmap v450: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 343 op/s 2023-10-26T06:48:03.284 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/fault.o 2023-10-26T06:48:03.384 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/shmem.o 2023-10-26T06:48:03.449 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/mqueue.o 2023-10-26T06:48:03.804 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/events/intel/built-in.a 2023-10-26T06:48:03.864 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/events/built-in.a 2023-10-26T06:48:03.931 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/util.o 2023-10-26T06:48:04.001 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/misc.o 2023-10-26T06:48:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:03 smithi153 ceph-mon[131657]: pgmap v451: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 2.3 MiB/s wr, 304 op/s 2023-10-26T06:48:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:03 smithi050 ceph-mon[94997]: pgmap v451: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 2.3 MiB/s wr, 304 op/s 2023-10-26T06:48:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:03 smithi125 ceph-mon[130643]: pgmap v451: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 2.3 MiB/s wr, 304 op/s 2023-10-26T06:48:04.450 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/msi.o 2023-10-26T06:48:04.502 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/ioremap.o 2023-10-26T06:48:04.664 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/nfs.o 2023-10-26T06:48:04.888 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/events/ring_buffer.o 2023-10-26T06:48:04.940 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/integrity/iint.o 2023-10-26T06:48:04.971 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/namespace.o 2023-10-26T06:48:05.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:48:05.172 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/apic_flat_64.o 2023-10-26T06:48:05.331 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/namei_vfat.o 2023-10-26T06:48:05.335 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mmzone.o 2023-10-26T06:48:05.444 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/extable.o 2023-10-26T06:48:05.504 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/extents_status.o 2023-10-26T06:48:05.572 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/integrity/integrity_audit.o 2023-10-26T06:48:05.594 INFO:tasks.workunit.client.0.smithi050.stdout: CC ipc/mq_sysctl.o 2023-10-26T06:48:05.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.635+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1836663632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840a4ff0 msgr2=0x7f9f840a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.635+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1836663632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840a4ff0 0x7f9f840a53d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009920 tx=0x7f9f80009c30 comp rx=0 tx=0).stop 2023-10-26T06:48:05.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1836663632 shutdown_connections 2023-10-26T06:48:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1836663632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840ac130 0x7f9f840b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1836663632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840a4ff0 0x7f9f840a53d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1836663632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f840a59a0 0x7f9f840aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1836663632 >> 172.21.15.50:0/1836663632 conn(0x7f9f8401a670 msgr2=0x7f9f8401aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1836663632 shutdown_connections 2023-10-26T06:48:05.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.639+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1836663632 wait complete. 2023-10-26T06:48:05.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.641+0000 7f9f8b59e700 1 Processor -- start 2023-10-26T06:48:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.641+0000 7f9f8b59e700 1 -- start start 2023-10-26T06:48:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.642+0000 7f9f8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 0x7f9f8413d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.642+0000 7f9f8b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840ac130 0x7f9f8413d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 0x7f9f8413d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 0x7f9f8413d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51100/0 (socket says 172.21.15.50:51100) 2023-10-26T06:48:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8a59c700 1 -- 172.21.15.50:0/1954315989 learned_addr learned my addr 172.21.15.50:0/1954315989 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f84141c30 0x7f9f841420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841426b0 con 0x7f9f840a4ff0 2023-10-26T06:48:05.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840ac130 0x7f9f8413d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84142820 con 0x7f9f840ac130 2023-10-26T06:48:05.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.643+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841429e0 con 0x7f9f84141c30 2023-10-26T06:48:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.646+0000 7f9f8ad9d700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f84141c30 0x7f9f841420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.647+0000 7f9f8ad9d700 1 -- 172.21.15.50:0/1954315989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840ac130 msgr2=0x7f9f8413d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.647+0000 7f9f8ad9d700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840ac130 0x7f9f8413d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.647+0000 7f9f8ad9d700 1 -- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 msgr2=0x7f9f8413d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.647+0000 7f9f8ad9d700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 0x7f9f8413d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.647+0000 7f9f8ad9d700 1 -- 172.21.15.50:0/1954315989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c04ed30 con 0x7f9f84141c30 2023-10-26T06:48:05.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.647+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 0x7f9f8413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.648+0000 7f9f8ad9d700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f84141c30 0x7f9f841420b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c066470 tx=0x7f9f8c06f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.648+0000 7f9f7b7fe700 1 -- 172.21.15.50:0/1954315989 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c06fda0 con 0x7f9f84141c30 2023-10-26T06:48:05.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.648+0000 7f9f7b7fe700 1 -- 172.21.15.50:0/1954315989 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f8c0738f0 con 0x7f9f84141c30 2023-10-26T06:48:05.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.648+0000 7f9f7b7fe700 1 -- 172.21.15.50:0/1954315989 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c07b860 con 0x7f9f84141c30 2023-10-26T06:48:05.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.650+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f80009520 con 0x7f9f84141c30 2023-10-26T06:48:05.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.650+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f840a6a80 con 0x7f9f84141c30 2023-10-26T06:48:05.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.661+0000 7f9f7b7fe700 1 -- 172.21.15.50:0/1954315989 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9f8c073430 con 0x7f9f84141c30 2023-10-26T06:48:05.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.667+0000 7f9fa4452b80 1 Processor -- start 2023-10-26T06:48:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.667+0000 7f9fa4452b80 1 -- start start 2023-10-26T06:48:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e2fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e2f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2f8820 0x55c19e2f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e26b6e0 con 0x55c19e2fe680 2023-10-26T06:48:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e251c60 con 0x55c19e2fdd60 2023-10-26T06:48:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e24f580 con 0x55c19e2f8820 2023-10-26T06:48:05.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e2fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e2fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44296/0 (socket says 172.21.15.50:44296) 2023-10-26T06:48:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9f89d9b700 1 -- 172.21.15.50:0/3462775350 learned_addr learned my addr 172.21.15.50:0/3462775350 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.668+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2f8820 0x55c19e2f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f7b7fe700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f740a1660 0x7f9f740a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f89d9b700 1 -- 172.21.15.50:0/3462775350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2f8820 msgr2=0x55c19e2f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2f8820 0x55c19e2f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f89d9b700 1 -- 172.21.15.50:0/3462775350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 msgr2=0x55c19e2f82e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f7b7fe700 1 -- 172.21.15.50:0/1954315989 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9f8c12fa40 con 0x7f9f84141c30 2023-10-26T06:48:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f8ad9d700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f740a1660 0x7f9f740a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.669+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e2f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.673+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e2f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.673+0000 7f9f89d9b700 1 -- 172.21.15.50:0/3462775350 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c19e2083f0 con 0x55c19e2fdd60 2023-10-26T06:48:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.673+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e2f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.673+0000 7f9f8ad9d700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f740a1660 0x7f9f740a3b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c066240 tx=0x7f9f8c0666f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.673+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e2fe140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c012560 tx=0x7f9f7c005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9371e8a368fb4c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.674+0000 7f9f78ff9700 1 -- 172.21.15.50:0/3462775350 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c030620 con 0x55c19e2fdd60 2023-10-26T06:48:05.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.674+0000 7f9f78ff9700 1 -- 172.21.15.50:0/3462775350 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f7c012e70 con 0x55c19e2fdd60 2023-10-26T06:48:05.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.674+0000 7f9f78ff9700 1 -- 172.21.15.50:0/3462775350 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02f6c0 con 0x55c19e2fdd60 2023-10-26T06:48:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3462775350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 msgr2=0x55c19e2fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e2fe140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c012560 tx=0x7f9f7c005de0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3462775350 shutdown_connections 2023-10-26T06:48:05.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2f8820 0x55c19e2f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e2fe140 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3462775350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e2f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3462775350 >> 172.21.15.50:0/3462775350 conn(0x55c19e26c720 msgr2=0x55c19e2f2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3462775350 shutdown_connections 2023-10-26T06:48:05.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.675+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3462775350 wait complete. 2023-10-26T06:48:05.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.676+0000 7f9fa4452b80 1 -- start start 2023-10-26T06:48:05.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.676+0000 7f9fa4452b80 1 Processor -- start 2023-10-26T06:48:05.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.678+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e301a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e301fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fe680 0x55c19e302500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e24ae70 con 0x55c19e2f8820 2023-10-26T06:48:05.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e1e7710 con 0x55c19e2fe680 2023-10-26T06:48:05.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e1e73b0 con 0x55c19e2fdd60 2023-10-26T06:48:05.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9fa4452b80 10 client.0 _ll_register_callbacks cb 0x55c19e131a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:05.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e301a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.682+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e301a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51112/0 (socket says 172.21.15.50:51112) 2023-10-26T06:48:05.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1581689788 learned_addr learned my addr 172.21.15.50:0/1581689788 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:05.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e301fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1581689788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 msgr2=0x55c19e301fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:05.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e301fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fe680 msgr2=0x55c19e302500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fe680 0x55c19e302500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1581689788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c01a040 con 0x55c19e2f8820 2023-10-26T06:48:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.683+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e301fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:05.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.684+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e301a80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c012d00 tx=0x7f9f7c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ae124c8bb02235 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.684+0000 7f9f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.685+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1581689788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c005450 con 0x55c19e2f8820 2023-10-26T06:48:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.685+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1581689788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9f7c0055b0 con 0x55c19e2f8820 2023-10-26T06:48:05.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.685+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c19e24fef0 con 0x55c19e2f8820 2023-10-26T06:48:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.685+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1581689788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f7c00f3f0 con 0x55c19e2f8820 2023-10-26T06:48:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.685+0000 7f9fa4452b80 10 client.16296 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.685+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c19e075de0 con 0x55c19e2f8820 2023-10-26T06:48:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1581689788 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c19e24fef0 con 0x55c19e2f8820 2023-10-26T06:48:05.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1581689788 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9f7c043470 con 0x55c19e2f8820 2023-10-26T06:48:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9fa4452b80 10 client.16296 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9fa4452b80 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9fa4452b80 20 client.16296 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e312000 0x55c19e314420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9fa4452b80 4 client.16296 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:05.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.686+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c19e2c78b0 con 0x55c19e312000 2023-10-26T06:48:05.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.687+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e312000 0x55c19e314420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.691+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e312000 0x55c19e314420 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb4e5d5f9e729f9b server_cookie=654d8adbf67b2cc in_seq=0 out_seq=0 2023-10-26T06:48:05.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.691+0000 7f9f71ffb700 10 client.16296 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:05.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.692+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1581689788 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c19e2c78b0 con 0x55c19e312000 2023-10-26T06:48:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.692+0000 7f9f71ffb700 10 client.16296 handle_command_reply: tid=0 2023-10-26T06:48:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.692+0000 7f9fa4452b80 1 client.16296 shutdown 2023-10-26T06:48:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 msgr2=0x55c19e301a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e301a80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c012d00 tx=0x7f9f7c00be50 comp rx=0 tx=0).stop 2023-10-26T06:48:05.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 shutdown_connections 2023-10-26T06:48:05.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e312000 0x55c19e314420 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fe680 0x55c19e302500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e301a80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9f71ffb700 0 client.16296 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1581689788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e301fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.693+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 >> 172.21.15.50:0/1581689788 conn(0x55c19e26c720 msgr2=0x55c19e2f72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.694+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 shutdown_connections 2023-10-26T06:48:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.694+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1581689788 wait complete. 2023-10-26T06:48:05.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.696+0000 7f9fa4452b80 20 client.16296 trim_cache size 0 max 16384 2023-10-26T06:48:05.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.750+0000 7f9fa4452b80 1 Processor -- start 2023-10-26T06:48:05.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 -- start start 2023-10-26T06:48:05.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2f8820 0x55c19e3090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e2f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e30d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e0cb920 con 0x55c19e2fe680 2023-10-26T06:48:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e304550 con 0x55c19e2f8820 2023-10-26T06:48:05.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.754+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e30ec70 con 0x55c19e2fdd60 2023-10-26T06:48:05.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.755+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2f8820 0x55c19e3090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.755+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2f8820 0x55c19e3090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44306/0 (socket says 172.21.15.50:44306) 2023-10-26T06:48:05.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.755+0000 7f9f89d9b700 1 -- 172.21.15.50:0/3307670209 learned_addr learned my addr 172.21.15.50:0/3307670209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:05.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.755+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e30d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.755+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e2f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.756+0000 7f9f8a59c700 1 -- 172.21.15.50:0/3307670209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2f8820 msgr2=0x55c19e3090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:05.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.756+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2f8820 0x55c19e3090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.756+0000 7f9f8a59c700 1 -- 172.21.15.50:0/3307670209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 msgr2=0x55c19e30d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:05.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.756+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e30d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.756+0000 7f9f8a59c700 1 -- 172.21.15.50:0/3307670209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c19e05ec60 con 0x55c19e2fdd60 2023-10-26T06:48:05.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.756+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e30d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:05.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.757+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e2f7c60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55c19e302f20 tx=0x7f9f80019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ac0a7f591dc161 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:05.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.758+0000 7f9f797fa700 1 -- 172.21.15.50:0/3307670209 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8001c040 con 0x55c19e2fdd60 2023-10-26T06:48:05.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.758+0000 7f9f797fa700 1 -- 172.21.15.50:0/3307670209 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f8002b070 con 0x55c19e2fdd60 2023-10-26T06:48:05.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.758+0000 7f9f797fa700 1 -- 172.21.15.50:0/3307670209 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000b560 con 0x55c19e2fdd60 2023-10-26T06:48:05.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3307670209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 msgr2=0x55c19e2f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e2f7c60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55c19e302f20 tx=0x7f9f80019040 comp rx=0 tx=0).stop 2023-10-26T06:48:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3307670209 shutdown_connections 2023-10-26T06:48:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2fe680 0x55c19e30d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2f8820 0x55c19e3090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/3307670209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fdd60 0x55c19e2f7c60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3307670209 >> 172.21.15.50:0/3307670209 conn(0x55c19e26c720 msgr2=0x55c19e302360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3307670209 shutdown_connections 2023-10-26T06:48:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.759+0000 7f9fa4452b80 1 -- 172.21.15.50:0/3307670209 wait complete. 2023-10-26T06:48:05.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.760+0000 7f9fa4452b80 1 -- start start 2023-10-26T06:48:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.760+0000 7f9fa4452b80 1 Processor -- start 2023-10-26T06:48:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.761+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e35f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.761+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e35fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.762+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e35f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.762+0000 7f9f89d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e35f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51126/0 (socket says 172.21.15.50:51126) 2023-10-26T06:48:05.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9fa4452b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fe680 0x55c19e359d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e35a480 con 0x55c19e2f8820 2023-10-26T06:48:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e35a5f0 con 0x55c19e2fdd60 2023-10-26T06:48:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9fa4452b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c19e35a7b0 con 0x55c19e2fe680 2023-10-26T06:48:05.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9fa4452b80 10 client.0 _ll_register_callbacks cb 0x55c19e131a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1545204522 learned_addr learned my addr 172.21.15.50:0/1545204522 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:05.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.765+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e35fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.766+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1545204522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fe680 msgr2=0x55c19e359d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.766+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fe680 0x55c19e359d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.766+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 msgr2=0x55c19e35fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:05.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.766+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e35fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.766+0000 7f9f89d9b700 1 -- 172.21.15.50:0/1545204522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c19e075de0 con 0x55c19e2f8820 2023-10-26T06:48:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.767+0000 7f9f89d9b700 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e35f530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c014010 tx=0x7f9f7c005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9563ab352f9efc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.767+0000 7f9f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.767+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1545204522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00fea0 con 0x55c19e2f8820 2023-10-26T06:48:05.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.767+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1545204522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9f7c04b070 con 0x55c19e2f8820 2023-10-26T06:48:05.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.767+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f7c012e70 con 0x55c19e2f8820 2023-10-26T06:48:05.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.768+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1545204522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f7c043aa0 con 0x55c19e2f8820 2023-10-26T06:48:05.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.768+0000 7f9fa4452b80 10 client.16302 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.768+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f9f840b44a0 con 0x55c19e2f8820 2023-10-26T06:48:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1545204522 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f7c012e70 con 0x55c19e2f8820 2023-10-26T06:48:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1545204522 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9f7c058020 con 0x55c19e2f8820 2023-10-26T06:48:05.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9fa4452b80 10 client.16302 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9fa4452b80 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9fa4452b80 20 client.16302 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e367220 0x55c19e369640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9fa4452b80 4 client.16302 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:48:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.769+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c19e243e50 con 0x55c19e367220 2023-10-26T06:48:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.770+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e367220 0x55c19e369640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.770+0000 7f9f8a59c700 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e367220 0x55c19e369640 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51e006094e2413 server_cookie=c8ab4bd4a9550740 in_seq=0 out_seq=0 2023-10-26T06:48:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.770+0000 7f9f71ffb700 10 client.16302 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9f71ffb700 1 -- 172.21.15.50:0/1545204522 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c19e243e50 con 0x55c19e367220 2023-10-26T06:48:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9f71ffb700 10 client.16302 handle_command_reply: tid=0 2023-10-26T06:48:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 client.16302 shutdown 2023-10-26T06:48:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 msgr2=0x55c19e35f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e35f530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c014010 tx=0x7f9f7c005480 comp rx=0 tx=0).stop 2023-10-26T06:48:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 shutdown_connections 2023-10-26T06:48:05.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55c19e367220 0x55c19e369640 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c19e2fe680 0x55c19e359d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c19e2f8820 0x55c19e35f530 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 --2- 172.21.15.50:0/1545204522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55c19e2fdd60 0x55c19e35fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 >> 172.21.15.50:0/1545204522 conn(0x55c19e26c720 msgr2=0x55c19e2f2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9f71ffb700 0 client.16302 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.771+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 shutdown_connections 2023-10-26T06:48:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.772+0000 7f9fa4452b80 1 -- 172.21.15.50:0/1545204522 wait complete. 2023-10-26T06:48:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.772+0000 7f9fa4452b80 20 client.16302 trim_cache size 0 max 16384 2023-10-26T06:48:05.779 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:48:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:48:05.779 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:48:05.780 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:48:05.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f740a1660 msgr2=0x7f9f740a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f740a1660 0x7f9f740a3b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c066240 tx=0x7f9f8c0666f0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f84141c30 msgr2=0x7f9f841420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f84141c30 0x7f9f841420b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c066470 tx=0x7f9f8c06f5b0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 shutdown_connections 2023-10-26T06:48:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9f740a1660 0x7f9f740a3b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f84141c30 0x7f9f841420b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f840a4ff0 0x7f9f8413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 --2- 172.21.15.50:0/1954315989 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f840ac130 0x7f9f8413d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.774+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 >> 172.21.15.50:0/1954315989 conn(0x7f9f8401a670 msgr2=0x7f9f840a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:05.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.778+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 shutdown_connections 2023-10-26T06:48:05.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:05.778+0000 7f9f8b59e700 1 -- 172.21.15.50:0/1954315989 wait complete. 2023-10-26T06:48:05.822 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/apic/probe_64.o 2023-10-26T06:48:05.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:48:05.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:48:05.890 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/events/callchain.o 2023-10-26T06:48:05.905 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/vmstat.o 2023-10-26T06:48:06.074 INFO:tasks.workunit.client.0.smithi050.stdout: AR ipc/built-in.a 2023-10-26T06:48:06.191 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/apic/built-in.a 2023-10-26T06:48:06.226 INFO:tasks.workunit.client.0.smithi050.stdout: AR security/integrity/built-in.a 2023-10-26T06:48:06.256 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/pageattr.o 2023-10-26T06:48:06.297 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/gc.o 2023-10-26T06:48:06.333 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fat/namei_msdos.o 2023-10-26T06:48:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 -- 172.21.15.50:0/3303327767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f4103120 msgr2=0x7f22f41035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 --2- 172.21.15.50:0/3303327767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f4103120 0x7f22f41035d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009990 tx=0x7f22e8009ca0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 -- 172.21.15.50:0/3303327767 shutdown_connections 2023-10-26T06:48:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 --2- 172.21.15.50:0/3303327767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f4103120 0x7f22f41035d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 --2- 172.21.15.50:0/3303327767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f41055d0 0x7f22f41059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 --2- 172.21.15.50:0/3303327767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f40678c0 0x7f22f4067d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 -- 172.21.15.50:0/3303327767 >> 172.21.15.50:0/3303327767 conn(0x7f22f4076400 msgr2=0x7f22f4076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:06.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.350+0000 7f22f9dff700 1 -- 172.21.15.50:0/3303327767 shutdown_connections 2023-10-26T06:48:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.351+0000 7f22f9dff700 1 -- 172.21.15.50:0/3303327767 wait complete. 2023-10-26T06:48:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.352+0000 7f22f9dff700 1 Processor -- start 2023-10-26T06:48:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.357+0000 7f22f9dff700 1 -- start start 2023-10-26T06:48:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.357+0000 7f22f9dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f40678c0 0x7f22f419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.357+0000 7f22f9dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f4103120 0x7f22f419d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.357+0000 7f22f9dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 0x7f22f41a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 0x7f22f41a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 0x7f22f41a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47134/0 (socket says 172.21.15.50:47134) 2023-10-26T06:48:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f3fff700 1 -- 172.21.15.50:0/881751202 learned_addr learned my addr 172.21.15.50:0/881751202 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41a1f60 con 0x7f22f4103120 2023-10-26T06:48:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41a20d0 con 0x7f22f40678c0 2023-10-26T06:48:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41a2290 con 0x7f22f41055d0 2023-10-26T06:48:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f37fe700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f40678c0 0x7f22f419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.358+0000 7f22f2ffd700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f4103120 0x7f22f419d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f37fe700 1 -- 172.21.15.50:0/881751202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 msgr2=0x7f22f41a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f37fe700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 0x7f22f41a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f37fe700 1 -- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f4103120 msgr2=0x7f22f419d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f37fe700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f4103120 0x7f22f419d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f37fe700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80095f0 con 0x7f22f40678c0 2023-10-26T06:48:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f2ffd700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f4103120 0x7f22f419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f3fff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 0x7f22f41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f37fe700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f40678c0 0x7f22f419d040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00bd50 tx=0x7f22ec00bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00cc90 con 0x7f22f40678c0 2023-10-26T06:48:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22ec00cdf0 con 0x7f22f40678c0 2023-10-26T06:48:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f41a2570 con 0x7f22f40678c0 2023-10-26T06:48:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.359+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0127e0 con 0x7f22f40678c0 2023-10-26T06:48:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.360+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f41a9db0 con 0x7f22f40678c0 2023-10-26T06:48:06.365 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/core.o 2023-10-26T06:48:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.365+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f40ffc00 con 0x7f22f40678c0 2023-10-26T06:48:06.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.368+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f22ec014b20 con 0x7f22f40678c0 2023-10-26T06:48:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.371+0000 7f22f0ff9700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22dc0a16b0 0x7f22dc0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:06.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.371+0000 7f22f2ffd700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22dc0a16b0 0x7f22dc0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:06.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.373+0000 7f22f2ffd700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22dc0a16b0 0x7f22dc0a3b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22e4005950 tx=0x7f22e40058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:06.374 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/asymmetric_type.o 2023-10-26T06:48:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.375+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f22ec09a090 con 0x7f22f40678c0 2023-10-26T06:48:06.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.376+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f22ec096460 con 0x7f22f40678c0 2023-10-26T06:48:06.711 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/events/hw_breakpoint.o 2023-10-26T06:48:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.952+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22f419e340 con 0x7f22f40678c0 2023-10-26T06:48:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.954+0000 7f22f0ff9700 1 -- 172.21.15.50:0/881751202 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11324 (secure 0 0 0) 0x7f22ec019020 con 0x7f22f40678c0 2023-10-26T06:48:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:48:06.959 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:45:14.436234+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:48:06.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.959+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22dc0a16b0 msgr2=0x7f22dc0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:06.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.959+0000 7f22f9dff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22dc0a16b0 0x7f22dc0a3b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22e4005950 tx=0x7f22e40058e0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.959+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f40678c0 msgr2=0x7f22f419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:06.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.959+0000 7f22f9dff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f40678c0 0x7f22f419d040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00bd50 tx=0x7f22ec00bd80 comp rx=0 tx=0).stop 2023-10-26T06:48:06.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.963+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 shutdown_connections 2023-10-26T06:48:06.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.963+0000 7f22f9dff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f22dc0a16b0 0x7f22dc0a3b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.963+0000 7f22f9dff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22f41055d0 0x7f22f41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.963+0000 7f22f9dff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22f40678c0 0x7f22f419d040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.963+0000 7f22f9dff700 1 --2- 172.21.15.50:0/881751202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f4103120 0x7f22f419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.963+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 >> 172.21.15.50:0/881751202 conn(0x7f22f4076400 msgr2=0x7f22f4101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:06.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.966+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 shutdown_connections 2023-10-26T06:48:06.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:06.966+0000 7f22f9dff700 1 -- 172.21.15.50:0/881751202 wait complete. 2023-10-26T06:48:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-10-26T06:48:07.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:48:07.125 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/key.o 2023-10-26T06:48:07.150 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/fat/built-in.a 2023-10-26T06:48:07.160 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/restrict.o 2023-10-26T06:48:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:06 smithi125 ceph-mon[130643]: pgmap v452: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 242 op/s 2023-10-26T06:48:07.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:06 smithi050 ceph-mon[94997]: pgmap v452: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 242 op/s 2023-10-26T06:48:07.208 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/events/uprobes.o 2023-10-26T06:48:07.214 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/file.o 2023-10-26T06:48:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:06 smithi153 ceph-mon[131657]: pgmap v452: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 242 op/s 2023-10-26T06:48:07.326 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/backing-dev.o 2023-10-26T06:48:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.480+0000 7fd585bff700 1 -- 172.21.15.50:0/1559531470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 msgr2=0x7fd58011c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.480+0000 7fd585bff700 1 --2- 172.21.15.50:0/1559531470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd58011c070 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd57801c0d0 tx=0x7fd57801c3e0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 -- 172.21.15.50:0/1559531470 shutdown_connections 2023-10-26T06:48:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 --2- 172.21.15.50:0/1559531470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd58011c070 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 --2- 172.21.15.50:0/1559531470 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58010c8d0 0x7fd58010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 --2- 172.21.15.50:0/1559531470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580119740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 -- 172.21.15.50:0/1559531470 >> 172.21.15.50:0/1559531470 conn(0x7fd58006b650 msgr2=0x7fd58006ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:07.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 -- 172.21.15.50:0/1559531470 shutdown_connections 2023-10-26T06:48:07.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.483+0000 7fd585bff700 1 -- 172.21.15.50:0/1559531470 wait complete. 2023-10-26T06:48:07.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.484+0000 7fd585bff700 1 Processor -- start 2023-10-26T06:48:07.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 -- start start 2023-10-26T06:48:07.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58010c8d0 0x7fd5801152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd580118bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5801191f0 con 0x7fd580119c80 2023-10-26T06:48:07.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580119360 con 0x7fd58010c8d0 2023-10-26T06:48:07.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.488+0000 7fd585bff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580119520 con 0x7fd58010d1f0 2023-10-26T06:48:07.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.489+0000 7fd57effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.489+0000 7fd57effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47142/0 (socket says 172.21.15.50:47142) 2023-10-26T06:48:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.489+0000 7fd57effd700 1 -- 172.21.15.50:0/2902180594 learned_addr learned my addr 172.21.15.50:0/2902180594 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.489+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd580118bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.489+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58010c8d0 0x7fd5801152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.489+0000 7fd57effd700 1 -- 172.21.15.50:0/2902180594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58010c8d0 msgr2=0x7fd5801152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.490+0000 7fd57effd700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58010c8d0 0x7fd5801152c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.490+0000 7fd57effd700 1 -- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 msgr2=0x7fd580118bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.490+0000 7fd57effd700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd580118bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.490+0000 7fd57effd700 1 -- 172.21.15.50:0/2902180594 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57801ad10 con 0x7fd58010d1f0 2023-10-26T06:48:07.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.490+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd580118bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:07.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.490+0000 7fd57effd700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580115840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd57000e9a0 tx=0x7fd57000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:07.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.491+0000 7fd57cff9700 1 -- 172.21.15.50:0/2902180594 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000cbd0 con 0x7fd58010d1f0 2023-10-26T06:48:07.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.491+0000 7fd57cff9700 1 -- 172.21.15.50:0/2902180594 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd57000cd30 con 0x7fd58010d1f0 2023-10-26T06:48:07.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.491+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd580119800 con 0x7fd58010d1f0 2023-10-26T06:48:07.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.491+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5801a9df0 con 0x7fd58010d1f0 2023-10-26T06:48:07.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.491+0000 7fd57cff9700 1 -- 172.21.15.50:0/2902180594 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570018680 con 0x7fd58010d1f0 2023-10-26T06:48:07.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.503+0000 7fd57cff9700 1 -- 172.21.15.50:0/2902180594 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd570010430 con 0x7fd58010d1f0 2023-10-26T06:48:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.505+0000 7fd59950fb80 1 Processor -- start 2023-10-26T06:48:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.507+0000 7fd59950fb80 1 -- start start 2023-10-26T06:48:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.508+0000 7fd57cff9700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5680a16f0 0x7fd5680a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.508+0000 7fd57cff9700 1 -- 172.21.15.50:0/2902180594 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd570014070 con 0x7fd58010d1f0 2023-10-26T06:48:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.509+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5680a16f0 0x7fd5680a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.511+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5680a16f0 0x7fd5680a3bb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd57801c7b0 tx=0x7fd57801cbc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.511+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 0x560d8e11d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.511+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11ddf0 0x560d8e1219d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.511+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd59950fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e0906e0 con 0x560d8e121f10 2023-10-26T06:48:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd59950fb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e076c60 con 0x560d8e11d4d0 2023-10-26T06:48:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd59950fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e074580 con 0x560d8e11ddf0 2023-10-26T06:48:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 0x560d8e11d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 0x560d8e11d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44342/0 (socket says 172.21.15.50:44342) 2023-10-26T06:48:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 -- 172.21.15.50:0/3795641666 learned_addr learned my addr 172.21.15.50:0/3795641666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57ffff700 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 -- 172.21.15.50:0/3795641666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11ddf0 msgr2=0x560d8e1219d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11ddf0 0x560d8e1219d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 -- 172.21.15.50:0/3795641666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 msgr2=0x560d8e122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.512+0000 7fd57f7fe700 1 -- 172.21.15.50:0/3795641666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d8e02d3f0 con 0x560d8e11d4d0 2023-10-26T06:48:07.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.513+0000 7fd57ffff700 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.514+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 0x560d8e11d8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd574008c10 tx=0x7fd574008f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a98960da51d414 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.514+0000 7fd565ffb700 1 -- 172.21.15.50:0/3795641666 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400edc0 con 0x560d8e11d4d0 2023-10-26T06:48:07.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.514+0000 7fd565ffb700 1 -- 172.21.15.50:0/3795641666 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd574019920 con 0x560d8e11d4d0 2023-10-26T06:48:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.514+0000 7fd565ffb700 1 -- 172.21.15.50:0/3795641666 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574010970 con 0x560d8e11d4d0 2023-10-26T06:48:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.515+0000 7fd59950fb80 1 -- 172.21.15.50:0/3795641666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 msgr2=0x560d8e11d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.515+0000 7fd59950fb80 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 0x560d8e11d8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd574008c10 tx=0x7fd574008f20 comp rx=0 tx=0).stop 2023-10-26T06:48:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.518+0000 7fd59950fb80 1 -- 172.21.15.50:0/3795641666 shutdown_connections 2023-10-26T06:48:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.518+0000 7fd59950fb80 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.518+0000 7fd59950fb80 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11d4d0 0x560d8e11d8b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.518+0000 7fd59950fb80 1 --2- 172.21.15.50:0/3795641666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11ddf0 0x560d8e1219d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.518+0000 7fd59950fb80 1 -- 172.21.15.50:0/3795641666 >> 172.21.15.50:0/3795641666 conn(0x560d8e091720 msgr2=0x560d8e117d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:07.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.519+0000 7fd59950fb80 1 -- 172.21.15.50:0/3795641666 shutdown_connections 2023-10-26T06:48:07.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.519+0000 7fd59950fb80 1 -- 172.21.15.50:0/3795641666 wait complete. 2023-10-26T06:48:07.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.519+0000 7fd59950fb80 1 -- start start 2023-10-26T06:48:07.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.520+0000 7fd59950fb80 1 Processor -- start 2023-10-26T06:48:07.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.521+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e11d4d0 0x560d8e1296d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.524+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e126a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.524+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e121f10 0x560d8e127100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.524+0000 7fd59950fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e06fe70 con 0x560d8e11d4d0 2023-10-26T06:48:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.524+0000 7fd59950fb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e00c710 con 0x560d8e11ddf0 2023-10-26T06:48:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.524+0000 7fd59950fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e00c3b0 con 0x560d8e121f10 2023-10-26T06:48:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.524+0000 7fd59950fb80 10 client.0 _ll_register_callbacks cb 0x560d8df56a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e11d4d0 0x560d8e1296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e11d4d0 0x560d8e1296d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51192/0 (socket says 172.21.15.50:51192) 2023-10-26T06:48:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57f7fe700 1 -- 172.21.15.50:0/2154015862 learned_addr learned my addr 172.21.15.50:0/2154015862 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57effd700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e126a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e121f10 0x560d8e127100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57effd700 1 -- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e121f10 msgr2=0x560d8e127100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57effd700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e121f10 0x560d8e127100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57effd700 1 -- 172.21.15.50:0/2154015862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e11d4d0 msgr2=0x560d8e1296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57effd700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e11d4d0 0x560d8e1296d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.525+0000 7fd57effd700 1 -- 172.21.15.50:0/2154015862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd574008870 con 0x560d8e11ddf0 2023-10-26T06:48:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.526+0000 7fd57effd700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e126a80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd5700ca9b0 tx=0x7fd5700caf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617aea7493830f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.526+0000 7fd55effd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.526+0000 7fd55effd700 1 -- 172.21.15.50:0/2154015862 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57009e160 con 0x560d8e11ddf0 2023-10-26T06:48:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.526+0000 7fd55effd700 1 -- 172.21.15.50:0/2154015862 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd57009e390 con 0x560d8e11ddf0 2023-10-26T06:48:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.526+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d8e074ef0 con 0x560d8e11ddf0 2023-10-26T06:48:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.526+0000 7fd55effd700 1 -- 172.21.15.50:0/2154015862 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5700a25d0 con 0x560d8e11ddf0 2023-10-26T06:48:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.527+0000 7fd59950fb80 10 client.26357 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:07.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.527+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x560d8de9ade0 con 0x560d8e11ddf0 2023-10-26T06:48:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.527+0000 7fd55effd700 1 -- 172.21.15.50:0/2154015862 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560d8e074ef0 con 0x560d8e11ddf0 2023-10-26T06:48:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd55effd700 1 -- 172.21.15.50:0/2154015862 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd570096030 con 0x560d8e11ddf0 2023-10-26T06:48:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd59950fb80 10 client.26357 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd59950fb80 10 client.26357 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:48:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd59950fb80 20 client.26357 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1396d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd59950fb80 4 client.26357 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.528+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d8e0ec8b0 con 0x560d8e1372b0 2023-10-26T06:48:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.529+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.531+0000 7fd55effd700 10 client.26357 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.531+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1396d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5e98880565ea28e server_cookie=fce6fe90cf0d9e77 in_seq=0 out_seq=0 2023-10-26T06:48:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.532+0000 7fd55effd700 1 -- 172.21.15.50:0/2154015862 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560d8e0ec8b0 con 0x560d8e1372b0 2023-10-26T06:48:07.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.532+0000 7fd55effd700 10 client.26357 handle_command_reply: tid=0 2023-10-26T06:48:07.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.532+0000 7fd59950fb80 1 client.26357 shutdown 2023-10-26T06:48:07.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.532+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 msgr2=0x560d8e126a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.532+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e126a80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd5700ca9b0 tx=0x7fd5700caf10 comp rx=0 tx=0).stop 2023-10-26T06:48:07.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 shutdown_connections 2023-10-26T06:48:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1396d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e121f10 0x560d8e127100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd55effd700 0 client.26357 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e11d4d0 0x560d8e1296d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2154015862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e126a80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.533+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 >> 172.21.15.50:0/2154015862 conn(0x560d8e091720 msgr2=0x560d8e11c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.536+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 shutdown_connections 2023-10-26T06:48:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.536+0000 7fd59950fb80 1 -- 172.21.15.50:0/2154015862 wait complete. 2023-10-26T06:48:07.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.536+0000 7fd59950fb80 20 client.26357 trim_cache size 0 max 16384 2023-10-26T06:48:07.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.565+0000 7fd59950fb80 1 Processor -- start 2023-10-26T06:48:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.565+0000 7fd59950fb80 1 -- start start 2023-10-26T06:48:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.566+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e11f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.566+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e112820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.567+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e123300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.567+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e11f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd59950fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8def0920 con 0x560d8e121f10 2023-10-26T06:48:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd59950fb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e1277b0 con 0x560d8e11ddf0 2023-10-26T06:48:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd59950fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e124fd0 con 0x560d8e11d4d0 2023-10-26T06:48:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e11f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47166/0 (socket says 172.21.15.50:47166) 2023-10-26T06:48:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd57f7fe700 1 -- 172.21.15.50:0/1902864430 learned_addr learned my addr 172.21.15.50:0/1902864430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd57effd700 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e112820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.568+0000 7fd57f7fe700 1 -- 172.21.15.50:0/1902864430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 msgr2=0x560d8e112820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.569+0000 7fd57ffff700 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.569+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e112820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.569+0000 7fd57f7fe700 1 -- 172.21.15.50:0/1902864430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 msgr2=0x560d8e123300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.569+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e123300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.569+0000 7fd57f7fe700 1 -- 172.21.15.50:0/1902864430 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d8de83c60 con 0x560d8e11d4d0 2023-10-26T06:48:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.570+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e11f860 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd574008c10 tx=0x7fd574010430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8abe1b656326cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.570+0000 7fd57effd700 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e112820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.573+0000 7fd5667fc700 1 -- 172.21.15.50:0/1902864430 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57401d040 con 0x560d8e11d4d0 2023-10-26T06:48:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.573+0000 7fd5667fc700 1 -- 172.21.15.50:0/1902864430 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd57401e040 con 0x560d8e11d4d0 2023-10-26T06:48:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.573+0000 7fd5667fc700 1 -- 172.21.15.50:0/1902864430 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740273d0 con 0x560d8e11d4d0 2023-10-26T06:48:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.574+0000 7fd59950fb80 1 -- 172.21.15.50:0/1902864430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 msgr2=0x560d8e11f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.574+0000 7fd59950fb80 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e11f860 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd574008c10 tx=0x7fd574010430 comp rx=0 tx=0).stop 2023-10-26T06:48:07.576 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/net/built-in.a 2023-10-26T06:48:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.578+0000 7fd59950fb80 1 -- 172.21.15.50:0/1902864430 shutdown_connections 2023-10-26T06:48:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.578+0000 7fd59950fb80 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e123300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.578+0000 7fd59950fb80 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e11f860 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.578+0000 7fd59950fb80 1 --2- 172.21.15.50:0/1902864430 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e112820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.578+0000 7fd59950fb80 1 -- 172.21.15.50:0/1902864430 >> 172.21.15.50:0/1902864430 conn(0x560d8e091720 msgr2=0x560d8e11c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:07.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.579+0000 7fd59950fb80 1 -- 172.21.15.50:0/1902864430 shutdown_connections 2023-10-26T06:48:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.580+0000 7fd59950fb80 1 -- 172.21.15.50:0/1902864430 wait complete. 2023-10-26T06:48:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.580+0000 7fd59950fb80 1 -- start start 2023-10-26T06:48:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.580+0000 7fd59950fb80 1 Processor -- start 2023-10-26T06:48:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e12e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e1222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e122d70 con 0x560d8e121f10 2023-10-26T06:48:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e122ee0 con 0x560d8e11ddf0 2023-10-26T06:48:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8e1230a0 con 0x560d8e11d4d0 2023-10-26T06:48:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.581+0000 7fd59950fb80 10 client.0 _ll_register_callbacks cb 0x560d8df56a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.582+0000 7fd57effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e1222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.582+0000 7fd57effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e1222f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44382/0 (socket says 172.21.15.50:44382) 2023-10-26T06:48:07.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.582+0000 7fd57effd700 1 -- 172.21.15.50:0/2507326813 learned_addr learned my addr 172.21.15.50:0/2507326813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:07.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.582+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e12e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.582+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.583+0000 7fd57f7fe700 1 -- 172.21.15.50:0/2507326813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 msgr2=0x560d8e1222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.583+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e1222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.583+0000 7fd57f7fe700 1 -- 172.21.15.50:0/2507326813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 msgr2=0x560d8e122830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.583+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.583+0000 7fd57f7fe700 1 -- 172.21.15.50:0/2507326813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d8e02d3f0 con 0x560d8e11d4d0 2023-10-26T06:48:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.583+0000 7fd57ffff700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.584+0000 7fd55effd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.584+0000 7fd57f7fe700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e12e1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd574006010 tx=0x7fd574027b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d03d61539b5c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:07.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.585+0000 7fd55effd700 1 -- 172.21.15.50:0/2507326813 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57401d070 con 0x560d8e11d4d0 2023-10-26T06:48:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.585+0000 7fd55effd700 1 -- 172.21.15.50:0/2507326813 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd574028e40 con 0x560d8e11d4d0 2023-10-26T06:48:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.586+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd574019920 con 0x560d8e11d4d0 2023-10-26T06:48:07.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.586+0000 7fd55effd700 1 -- 172.21.15.50:0/2507326813 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd57401d070 con 0x560d8e11d4d0 2023-10-26T06:48:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.588+0000 7fd59950fb80 10 client.26368 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.588+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x560d8dec1250 con 0x560d8e11d4d0 2023-10-26T06:48:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.588+0000 7fd55effd700 1 -- 172.21.15.50:0/2507326813 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd574019920 con 0x560d8e11d4d0 2023-10-26T06:48:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd55effd700 1 -- 172.21.15.50:0/2507326813 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd574003800 con 0x560d8e11d4d0 2023-10-26T06:48:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd59950fb80 10 client.26368 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd59950fb80 10 client.26368 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:48:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd59950fb80 20 client.26368 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd59950fb80 4 client.26368 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:48:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560d8e068e50 con 0x560d8e1372b0 2023-10-26T06:48:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.589+0000 7fd57effd700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.590+0000 7fd57effd700 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1b0250 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6bd29e9f720f2f73 server_cookie=3f88924640552059 in_seq=0 out_seq=0 2023-10-26T06:48:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.590+0000 7fd55effd700 10 client.26368 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.590+0000 7fd55effd700 1 -- 172.21.15.50:0/2507326813 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560d8e068e50 con 0x560d8e1372b0 2023-10-26T06:48:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.590+0000 7fd55effd700 10 client.26368 handle_command_reply: tid=0 2023-10-26T06:48:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.590+0000 7fd59950fb80 1 client.26368 shutdown 2023-10-26T06:48:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.592+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 msgr2=0x560d8e12e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.592+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e12e1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd574006010 tx=0x7fd574027b60 comp rx=0 tx=0).stop 2023-10-26T06:48:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.595+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 shutdown_connections 2023-10-26T06:48:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.595+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x560d8e1372b0 0x560d8e1b0250 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.595+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8e121f10 0x560d8e122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.595+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560d8e11d4d0 0x560d8e12e1c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.595+0000 7fd59950fb80 1 --2- 172.21.15.50:0/2507326813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x560d8e11ddf0 0x560d8e1222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.595+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 >> 172.21.15.50:0/2507326813 conn(0x560d8e091720 msgr2=0x560d8e1201a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.596+0000 7fd55effd700 0 client.26368 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.596+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 shutdown_connections 2023-10-26T06:48:07.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.596+0000 7fd59950fb80 1 -- 172.21.15.50:0/2507326813 wait complete. 2023-10-26T06:48:07.602 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:48:07.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.600+0000 7fd59950fb80 20 client.26368 trim_cache size 0 max 16384 2023-10-26T06:48:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5680a16f0 msgr2=0x7fd5680a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5680a16f0 0x7fd5680a3bb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd57801c7b0 tx=0x7fd57801cbc0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 msgr2=0x7fd580115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580115840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd57000e9a0 tx=0x7fd57000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 shutdown_connections 2023-10-26T06:48:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd5680a16f0 0x7fd5680a3bb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd580119c80 0x7fd580118bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.602+0000 7fd585bff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58010c8d0 0x7fd5801152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.603+0000 7fd585bff700 1 --2- 172.21.15.50:0/2902180594 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58010d1f0 0x7fd580115840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.603+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 >> 172.21.15.50:0/2902180594 conn(0x7fd58006b650 msgr2=0x7fd58011b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.603+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 shutdown_connections 2023-10-26T06:48:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:07.603+0000 7fd585bff700 1 -- 172.21.15.50:0/2902180594 wait complete. 2023-10-26T06:48:07.612 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/signature.o 2023-10-26T06:48:07.633 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/irqdesc.o 2023-10-26T06:48:07.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:48:07.737 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/mmap.o 2023-10-26T06:48:07.952 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/severity.o 2023-10-26T06:48:08.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:07 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/881751202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:48:08.068 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/keyring.o 2023-10-26T06:48:08.085 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/fsmap.o 2023-10-26T06:48:08.143 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/public_key.o 2023-10-26T06:48:08.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:07 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/881751202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:48:08.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.186+0000 7f13205ff700 1 -- 172.21.15.50:0/4098326574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1318107a60 msgr2=0x7f1318107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.186+0000 7f13205ff700 1 --2- 172.21.15.50:0/4098326574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1318107a60 0x7f1318107e40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f13080085a0 tx=0x7f130800acb0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.187+0000 7f13205ff700 1 -- 172.21.15.50:0/4098326574 shutdown_connections 2023-10-26T06:48:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.187+0000 7f13205ff700 1 --2- 172.21.15.50:0/4098326574 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f131810c500 0x7f1318114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.187+0000 7f13205ff700 1 --2- 172.21.15.50:0/4098326574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1318107a60 0x7f1318107e40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.187+0000 7f13205ff700 1 --2- 172.21.15.50:0/4098326574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1318108410 0x7f131810bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.187+0000 7f13205ff700 1 -- 172.21.15.50:0/4098326574 >> 172.21.15.50:0/4098326574 conn(0x7f131806b840 msgr2=0x7f131806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.191+0000 7f13205ff700 1 -- 172.21.15.50:0/4098326574 shutdown_connections 2023-10-26T06:48:08.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.191+0000 7f13205ff700 1 -- 172.21.15.50:0/4098326574 wait complete. 2023-10-26T06:48:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.193+0000 7f13205ff700 1 Processor -- start 2023-10-26T06:48:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.193+0000 7f13205ff700 1 -- start start 2023-10-26T06:48:08.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.194+0000 7f13205ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1318107a60 0x7f13181a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.194+0000 7f13205ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f131810c500 0x7f13181a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.194+0000 7f13205ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 0x7f13181a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.194+0000 7f13205ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13181a6a00 con 0x7f131810c500 2023-10-26T06:48:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.194+0000 7f13205ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13181a6b70 con 0x7f1318107a60 2023-10-26T06:48:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.194+0000 7f13205ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13181a6d30 con 0x7f13181a5f80 2023-10-26T06:48:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131eb9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 0x7f13181a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131e39b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1318107a60 0x7f13181a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131eb9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 0x7f13181a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47188/0 (socket says 172.21.15.50:47188) 2023-10-26T06:48:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131eb9c700 1 -- 172.21.15.50:0/2353809900 learned_addr learned my addr 172.21.15.50:0/2353809900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131db9a700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f131810c500 0x7f13181a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131eb9c700 1 -- 172.21.15.50:0/2353809900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1318107a60 msgr2=0x7f13181a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131eb9c700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1318107a60 0x7f13181a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.195+0000 7f131eb9c700 1 -- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f131810c500 msgr2=0x7f13181a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.196+0000 7f131eb9c700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f131810c500 0x7f13181a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.196+0000 7f131eb9c700 1 -- 172.21.15.50:0/2353809900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080081d0 con 0x7f13181a5f80 2023-10-26T06:48:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.196+0000 7f131db9a700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f131810c500 0x7f13181a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.196+0000 7f131eb9c700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 0x7f13181a6400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f131000e2f0 tx=0x7f131000e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.197+0000 7f130f7fe700 1 -- 172.21.15.50:0/2353809900 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310010040 con 0x7f13181a5f80 2023-10-26T06:48:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.199+0000 7f130f7fe700 1 -- 172.21.15.50:0/2353809900 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f131000eec0 con 0x7f13181a5f80 2023-10-26T06:48:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.199+0000 7f130f7fe700 1 -- 172.21.15.50:0/2353809900 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310009a70 con 0x7f13181a5f80 2023-10-26T06:48:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.200+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131819cfe0 con 0x7f13181a5f80 2023-10-26T06:48:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.201+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131819d470 con 0x7f13181a5f80 2023-10-26T06:48:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.210+0000 7f130f7fe700 1 -- 172.21.15.50:0/2353809900 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1310009bd0 con 0x7f13181a5f80 2023-10-26T06:48:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.210+0000 7f1333e76b80 1 Processor -- start 2023-10-26T06:48:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.216+0000 7f1333e76b80 1 -- start start 2023-10-26T06:48:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.216+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9dd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.216+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 0x55ed9c9e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f1333e76b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c93f6e0 con 0x55ed9c9ddbb0 2023-10-26T06:48:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f1333e76b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c925c60 con 0x55ed9c9dd290 2023-10-26T06:48:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f1333e76b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c923580 con 0x55ed9c9e1d00 2023-10-26T06:48:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f131e39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 0x55ed9c9e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f131e39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 0x55ed9c9e17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51248/0 (socket says 172.21.15.50:51248) 2023-10-26T06:48:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.217+0000 7f131e39b700 1 -- 172.21.15.50:0/4250578665 learned_addr learned my addr 172.21.15.50:0/4250578665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131db9a700 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131e39b700 1 -- 172.21.15.50:0/4250578665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 msgr2=0x55ed9c9e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131e39b700 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131e39b700 1 -- 172.21.15.50:0/4250578665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 msgr2=0x55ed9c9dd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131e39b700 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9dd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131e39b700 1 -- 172.21.15.50:0/4250578665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed9c8dc3f0 con 0x55ed9c9ddbb0 2023-10-26T06:48:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f130f7fe700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f13040a1670 0x7f13040a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.218+0000 7f131db9a700 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9dd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:08.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.219+0000 7f130f7fe700 1 -- 172.21.15.50:0/2353809900 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f13100ccc80 con 0x7f13181a5f80 2023-10-26T06:48:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.219+0000 7f131db9a700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f13040a1670 0x7f13040a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.221+0000 7f131db9a700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f13040a1670 0x7f13040a3b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f13181a2bf0 tx=0x7f1314007c80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.221+0000 7f131e39b700 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 0x55ed9c9e17c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f13080085a0 tx=0x7f1308005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc67804eac96f668 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.222+0000 7f130cbfe700 1 -- 172.21.15.50:0/4250578665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308008d80 con 0x55ed9c9ddbb0 2023-10-26T06:48:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.222+0000 7f130cbfe700 1 -- 172.21.15.50:0/4250578665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f130800b5f0 con 0x55ed9c9ddbb0 2023-10-26T06:48:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.222+0000 7f130cbfe700 1 -- 172.21.15.50:0/4250578665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080052a0 con 0x55ed9c9ddbb0 2023-10-26T06:48:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 -- 172.21.15.50:0/4250578665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 msgr2=0x55ed9c9e17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 0x55ed9c9e17c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f13080085a0 tx=0x7f1308005f00 comp rx=0 tx=0).stop 2023-10-26T06:48:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 -- 172.21.15.50:0/4250578665 shutdown_connections 2023-10-26T06:48:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9dd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 --2- 172.21.15.50:0/4250578665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9ddbb0 0x55ed9c9e17c0 secure :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f13080085a0 tx=0x7f1308005f00 comp rx=0 tx=0).stop 2023-10-26T06:48:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.223+0000 7f1333e76b80 1 -- 172.21.15.50:0/4250578665 >> 172.21.15.50:0/4250578665 conn(0x55ed9c940720 msgr2=0x55ed9c9c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.229+0000 7f1333e76b80 1 -- 172.21.15.50:0/4250578665 shutdown_connections 2023-10-26T06:48:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.230+0000 7f1333e76b80 1 -- 172.21.15.50:0/4250578665 wait complete. 2023-10-26T06:48:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.230+0000 7f1333e76b80 1 -- start start 2023-10-26T06:48:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.231+0000 7f1333e76b80 1 Processor -- start 2023-10-26T06:48:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c91ee70 con 0x55ed9c9e7480 2023-10-26T06:48:08.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c8bb710 con 0x55ed9c9dd290 2023-10-26T06:48:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c8bb3b0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f1333e76b80 10 client.0 _ll_register_callbacks cb 0x55ed9c805a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:08.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:07 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/881751202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:48:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f131db9a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f131eb9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f131db9a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47214/0 (socket says 172.21.15.50:47214) 2023-10-26T06:48:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.232+0000 7f131db9a700 1 -- 172.21.15.50:0/893016563 learned_addr learned my addr 172.21.15.50:0/893016563 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.233+0000 7f131db9a700 1 -- 172.21.15.50:0/893016563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 msgr2=0x55ed9c9e6a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.233+0000 7f131db9a700 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9e6a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.233+0000 7f131db9a700 1 -- 172.21.15.50:0/893016563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 msgr2=0x55ed9c9d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.233+0000 7f131db9a700 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9d5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.236+0000 7f131db9a700 1 -- 172.21.15.50:0/893016563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13181148c0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.236+0000 7f131eb9c700 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.236+0000 7f131db9a700 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e6f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13140126b0 tx=0x7f1314004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2866ce5cc951a8fa server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.236+0000 7f1301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.237+0000 7f1301ffb700 1 -- 172.21.15.50:0/893016563 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131401f830 con 0x55ed9c9e1d00 2023-10-26T06:48:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.237+0000 7f1301ffb700 1 -- 172.21.15.50:0/893016563 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1314018070 con 0x55ed9c9e1d00 2023-10-26T06:48:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.237+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed9c923ef0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.237+0000 7f1301ffb700 1 -- 172.21.15.50:0/893016563 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f131401f990 con 0x55ed9c9e1d00 2023-10-26T06:48:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.239+0000 7f1333e76b80 10 client.26377 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.239+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ed9c749de0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.239+0000 7f1301ffb700 1 -- 172.21.15.50:0/893016563 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ed9c923ef0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1301ffb700 1 -- 172.21.15.50:0/893016563 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f13140273f0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1333e76b80 10 client.26377 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1333e76b80 10 client.26377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:48:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1333e76b80 20 client.26377 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1333e76b80 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9c9d9a50 0x55ed9c9dbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1333e76b80 4 client.26377 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed9c99b8b0 con 0x55ed9c9d9a50 2023-10-26T06:48:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.240+0000 7f131e39b700 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9c9d9a50 0x55ed9c9dbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.241+0000 7f131e39b700 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9c9d9a50 0x55ed9c9dbe70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=408a1d0c54cad244 server_cookie=b9f3dbed8a0ae715 in_seq=0 out_seq=0 2023-10-26T06:48:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.241+0000 7f1301ffb700 10 client.26377 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.245+0000 7f1301ffb700 1 -- 172.21.15.50:0/893016563 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed9c99b8b0 con 0x55ed9c9d9a50 2023-10-26T06:48:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.245+0000 7f1301ffb700 10 client.26377 handle_command_reply: tid=0 2023-10-26T06:48:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 client.26377 shutdown 2023-10-26T06:48:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 msgr2=0x55ed9c9e6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e6f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13140126b0 tx=0x7f1314004750 comp rx=0 tx=0).stop 2023-10-26T06:48:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 shutdown_connections 2023-10-26T06:48:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9c9d9a50 0x55ed9c9dbe70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 --2- 172.21.15.50:0/893016563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9e6f40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1301ffb700 0 client.26377 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 >> 172.21.15.50:0/893016563 conn(0x55ed9c940720 msgr2=0x55ed9c9cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.248+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 shutdown_connections 2023-10-26T06:48:08.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.249+0000 7f1333e76b80 1 -- 172.21.15.50:0/893016563 wait complete. 2023-10-26T06:48:08.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.249+0000 7f1333e76b80 20 client.26377 trim_cache size 0 max 16384 2023-10-26T06:48:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.293+0000 7f1333e76b80 1 Processor -- start 2023-10-26T06:48:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.294+0000 7f1333e76b80 1 -- start start 2023-10-26T06:48:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.294+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 0x55ed9c9d5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.294+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.295+0000 7f131e39b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 0x55ed9c9d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.295+0000 7f131e39b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 0x55ed9c9d5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47220/0 (socket says 172.21.15.50:47220) 2023-10-26T06:48:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131e39b700 1 -- 172.21.15.50:0/2695227203 learned_addr learned my addr 172.21.15.50:0/2695227203 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f1333e76b80 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c79f920 con 0x55ed9c9e7480 2023-10-26T06:48:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c9d7060 con 0x55ed9c9e1d00 2023-10-26T06:48:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c9c85d0 con 0x55ed9c9dd290 2023-10-26T06:48:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131db9a700 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131e39b700 1 -- 172.21.15.50:0/2695227203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9e1d00 msgr2=0x55ed9c9d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131e39b700 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131e39b700 1 -- 172.21.15.50:0/2695227203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 msgr2=0x55ed9c9df730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131e39b700 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131e39b700 1 -- 172.21.15.50:0/2695227203 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed9c732c60 con 0x55ed9c9dd290 2023-10-26T06:48:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.297+0000 7f131db9a700 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:08.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.299+0000 7f131e39b700 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 0x55ed9c9d5a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f130800bd70 tx=0x7f1308005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf8c8d62eb13778 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.300+0000 7f130d3ff700 1 -- 172.21.15.50:0/2695227203 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130804c040 con 0x55ed9c9dd290 2023-10-26T06:48:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.300+0000 7f130d3ff700 1 -- 172.21.15.50:0/2695227203 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f130804e2e0 con 0x55ed9c9dd290 2023-10-26T06:48:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.300+0000 7f130d3ff700 1 -- 172.21.15.50:0/2695227203 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130804c040 con 0x55ed9c9dd290 2023-10-26T06:48:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.301+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 msgr2=0x55ed9c9d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.301+0000 7f1333e76b80 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 0x55ed9c9d5a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f130800bd70 tx=0x7f1308005da0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 shutdown_connections 2023-10-26T06:48:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9dd290 0x55ed9c9d5a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 --2- 172.21.15.50:0/2695227203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 >> 172.21.15.50:0/2695227203 conn(0x55ed9c940720 msgr2=0x55ed9c9e52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 shutdown_connections 2023-10-26T06:48:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 -- 172.21.15.50:0/2695227203 wait complete. 2023-10-26T06:48:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.305+0000 7f1333e76b80 1 -- start start 2023-10-26T06:48:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.306+0000 7f1333e76b80 1 Processor -- start 2023-10-26T06:48:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.306+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.307+0000 7f1333e76b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9dead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.309+0000 7f131e39b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.309+0000 7f131e39b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44448/0 (socket says 172.21.15.50:44448) 2023-10-26T06:48:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f131db9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9dead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f131db9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9dead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51266/0 (socket says 172.21.15.50:51266) 2023-10-26T06:48:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f131e39b700 1 -- 172.21.15.50:0/3913565559 learned_addr learned my addr 172.21.15.50:0/3913565559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c9df6d0 con 0x55ed9c9e1d00 2023-10-26T06:48:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9c9df840 con 0x55ed9c9dd290 2023-10-26T06:48:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9ca39ca0 con 0x55ed9c9e7480 2023-10-26T06:48:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.311+0000 7f1333e76b80 10 client.0 _ll_register_callbacks cb 0x55ed9c805a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131eb9c700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131e39b700 1 -- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e7480 msgr2=0x55ed9c9df010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131e39b700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131e39b700 1 -- 172.21.15.50:0/3913565559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 msgr2=0x55ed9c9dead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131e39b700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9dead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131e39b700 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed9c8dc3f0 con 0x55ed9c9dd290 2023-10-26T06:48:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.312+0000 7f131db9a700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9dead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.313+0000 7f131e39b700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9edda0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1308000c00 tx=0x7f130800ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d3ac9e9688ce95 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.314+0000 7f1301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.314+0000 7f1301ffb700 1 -- 172.21.15.50:0/3913565559 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130804c040 con 0x55ed9c9dd290 2023-10-26T06:48:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.314+0000 7f1301ffb700 1 -- 172.21.15.50:0/3913565559 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1308003890 con 0x55ed9c9dd290 2023-10-26T06:48:08.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.314+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f130800b5f0 con 0x55ed9c9dd290 2023-10-26T06:48:08.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.315+0000 7f1301ffb700 1 -- 172.21.15.50:0/3913565559 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1308008b80 con 0x55ed9c9dd290 2023-10-26T06:48:08.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.315+0000 7f1333e76b80 10 client.26372 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:08.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.315+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ed9c770250 con 0x55ed9c9dd290 2023-10-26T06:48:08.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.316+0000 7f1301ffb700 1 -- 172.21.15.50:0/3913565559 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f130800b5f0 con 0x55ed9c9dd290 2023-10-26T06:48:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.317+0000 7f1301ffb700 1 -- 172.21.15.50:0/3913565559 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f130805f070 con 0x55ed9c9dd290 2023-10-26T06:48:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.317+0000 7f1333e76b80 10 client.26372 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.317+0000 7f1333e76b80 10 client.26372 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:48:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.317+0000 7f1333e76b80 20 client.26372 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:08.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.318+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9ca3aeb0 0x55ed9ca3d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.318+0000 7f1333e76b80 4 client.26372 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:48:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.318+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ed9c917e50 con 0x55ed9ca3aeb0 2023-10-26T06:48:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.318+0000 7f131db9a700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9ca3aeb0 0x55ed9ca3d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f131db9a700 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9ca3aeb0 0x55ed9ca3d2a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f5167f08db862123 server_cookie=8d9fec66c63525f1 in_seq=0 out_seq=0 2023-10-26T06:48:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f1301ffb700 10 client.26372 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f1301ffb700 1 -- 172.21.15.50:0/3913565559 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ed9c917e50 con 0x55ed9ca3aeb0 2023-10-26T06:48:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f1301ffb700 10 client.26372 handle_command_reply: tid=0 2023-10-26T06:48:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f1333e76b80 1 client.26372 shutdown 2023-10-26T06:48:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 msgr2=0x55ed9c9edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.321+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9edda0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1308000c00 tx=0x7f130800ac30 comp rx=0 tx=0).stop 2023-10-26T06:48:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 shutdown_connections 2023-10-26T06:48:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed9c9e7480 0x55ed9c9df010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55ed9ca3aeb0 0x55ed9ca3d2a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55ed9c9dd290 0x55ed9c9edda0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 --2- 172.21.15.50:0/3913565559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed9c9e1d00 0x55ed9c9dead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1301ffb700 0 client.26372 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 >> 172.21.15.50:0/3913565559 conn(0x55ed9c940720 msgr2=0x55ed9c9e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.322+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 shutdown_connections 2023-10-26T06:48:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.326+0000 7f1333e76b80 1 -- 172.21.15.50:0/3913565559 wait complete. 2023-10-26T06:48:08.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.326+0000 7f1333e76b80 20 client.26372 trim_cache size 0 max 16384 2023-10-26T06:48:08.328 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:48:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.331+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f13040a1670 msgr2=0x7f13040a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.331+0000 7f13205ff700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f13040a1670 0x7f13040a3b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f13181a2bf0 tx=0x7f1314007c80 comp rx=0 tx=0).stop 2023-10-26T06:48:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.331+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 msgr2=0x7f13181a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.331+0000 7f13205ff700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 0x7f13181a6400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f131000e2f0 tx=0x7f131000e600 comp rx=0 tx=0).stop 2023-10-26T06:48:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 shutdown_connections 2023-10-26T06:48:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f13040a1670 0x7f13040a3b30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13181a5f80 0x7f13181a6400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1318107a60 0x7f13181a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 --2- 172.21.15.50:0/2353809900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f131810c500 0x7f13181a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 >> 172.21.15.50:0/2353809900 conn(0x7f131806b840 msgr2=0x7f13180706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 shutdown_connections 2023-10-26T06:48:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.333+0000 7f13205ff700 1 -- 172.21.15.50:0/2353809900 wait complete. 2023-10-26T06:48:08.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:48:08.388 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/handle.o 2023-10-26T06:48:08.431 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/pat.o 2023-10-26T06:48:08.512 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/genpool.o 2023-10-26T06:48:08.574 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mm_init.o 2023-10-26T06:48:08.741 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/events/built-in.a 2023-10-26T06:48:08.816 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/keyctl.o 2023-10-26T06:48:08.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.887+0000 7ff9dc99d700 1 -- 172.21.15.50:0/1091264725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a4e10 msgr2=0x7ff9d00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.887+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/1091264725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a4e10 0x7ff9d00a51f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8063e90 tx=0x7ff9d804ef00 comp rx=0 tx=0).stop 2023-10-26T06:48:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 -- 172.21.15.50:0/1091264725 shutdown_connections 2023-10-26T06:48:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/1091264725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d00b7aa0 0x7ff9d00b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/1091264725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a4e10 0x7ff9d00a51f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/1091264725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 -- 172.21.15.50:0/1091264725 >> 172.21.15.50:0/1091264725 conn(0x7ff9d001a670 msgr2=0x7ff9d001aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 -- 172.21.15.50:0/1091264725 shutdown_connections 2023-10-26T06:48:08.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.888+0000 7ff9dc99d700 1 -- 172.21.15.50:0/1091264725 wait complete. 2023-10-26T06:48:08.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.890+0000 7ff9dc99d700 1 Processor -- start 2023-10-26T06:48:08.895 INFO:tasks.workunit.client.0.smithi050.stdout: ASN.1 crypto/asymmetric_keys/x509.asn1.[ch] 2023-10-26T06:48:08.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.891+0000 7ff9dc99d700 1 -- start start 2023-10-26T06:48:08.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.891+0000 7ff9dc99d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d00a4e10 0x7ff9d00b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.891+0000 7ff9dc99d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.891+0000 7ff9dc99d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00b7aa0 0x7ff9d0140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.892+0000 7ff9d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.892+0000 7ff9d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44470/0 (socket says 172.21.15.50:44470) 2023-10-26T06:48:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/2911285000 learned_addr learned my addr 172.21.15.50:0/2911285000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01410b0 con 0x7ff9d00b7aa0 2023-10-26T06:48:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0141220 con 0x7ff9d00a5730 2023-10-26T06:48:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01413e0 con 0x7ff9d00a4e10 2023-10-26T06:48:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00b7aa0 0x7ff9d0140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/2911285000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d00a4e10 msgr2=0x7ff9d00b3000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-26T06:48:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d00a4e10 0x7ff9d00b3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00b7aa0 msgr2=0x7ff9d0140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00b7aa0 0x7ff9d0140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/2911285000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d804ed70 con 0x7ff9d00a5730 2023-10-26T06:48:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.894+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00b7aa0 0x7ff9d0140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.895+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b3540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00e9a0 tx=0x7ff9cc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.895+0000 7ff9d4ff9700 1 -- 172.21.15.50:0/2911285000 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00cbd0 con 0x7ff9d00a5730 2023-10-26T06:48:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.895+0000 7ff9d4ff9700 1 -- 172.21.15.50:0/2911285000 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9cc00cd30 con 0x7ff9d00a5730 2023-10-26T06:48:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.895+0000 7ff9d4ff9700 1 -- 172.21.15.50:0/2911285000 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc018710 con 0x7ff9d00a5730 2023-10-26T06:48:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.895+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d01416c0 con 0x7ff9d00a5730 2023-10-26T06:48:08.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.896+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0147d00 con 0x7ff9d00a5730 2023-10-26T06:48:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.905+0000 7ff9d4ff9700 1 -- 172.21.15.50:0/2911285000 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ff9cc010980 con 0x7ff9d00a5730 2023-10-26T06:48:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.905+0000 7ff9f1559b80 1 Processor -- start 2023-10-26T06:48:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.905+0000 7ff9f1559b80 1 -- start start 2023-10-26T06:48:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 0x5562fe2ec140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe2596e0 con 0x5562fe2e6820 2023-10-26T06:48:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe23fc60 con 0x5562fe2ec680 2023-10-26T06:48:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe23d580 con 0x5562fe2ebd60 2023-10-26T06:48:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 0x5562fe2ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 0x5562fe2ec140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47244/0 (socket says 172.21.15.50:47244) 2023-10-26T06:48:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.906+0000 7ff9d7fff700 1 -- 172.21.15.50:0/1352182610 learned_addr learned my addr 172.21.15.50:0/1352182610 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.907+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.908+0000 7ff9d7fff700 1 -- 172.21.15.50:0/1352182610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 msgr2=0x5562fe2e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.908+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.908+0000 7ff9d7fff700 1 -- 172.21.15.50:0/1352182610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 msgr2=0x5562fe2e6c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.908+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2e6c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.908+0000 7ff9d7fff700 1 -- 172.21.15.50:0/1352182610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562fe1f63f0 con 0x5562fe2ebd60 2023-10-26T06:48:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.908+0000 7ff9d4ff9700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9c80a1670 0x7ff9c80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.915 INFO:tasks.workunit.client.0.smithi050.stdout: ASN.1 crypto/asymmetric_keys/x509_akid.asn1.[ch] 2023-10-26T06:48:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.910+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 0x5562fe2ec140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009bf0 tx=0x7ff9c4009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564887a68e62c8bb server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.910+0000 7ff9c1ffb700 1 -- 172.21.15.50:0/1352182610 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4004230 con 0x5562fe2ebd60 2023-10-26T06:48:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.910+0000 7ff9c1ffb700 1 -- 172.21.15.50:0/1352182610 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9c400fdd0 con 0x5562fe2ebd60 2023-10-26T06:48:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.910+0000 7ff9c1ffb700 1 -- 172.21.15.50:0/1352182610 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4003ea0 con 0x5562fe2ebd60 2023-10-26T06:48:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.911+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1352182610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 msgr2=0x5562fe2ec140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.911+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 0x5562fe2ec140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009bf0 tx=0x7ff9c4009f00 comp rx=0 tx=0).stop 2023-10-26T06:48:08.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.913+0000 7ff9d4ff9700 1 -- 172.21.15.50:0/2911285000 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff9cc014070 con 0x7ff9d00a5730 2023-10-26T06:48:08.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.914+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1352182610 shutdown_connections 2023-10-26T06:48:08.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.914+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.914+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ebd60 0x5562fe2ec140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.914+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1352182610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.914+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1352182610 >> 172.21.15.50:0/1352182610 conn(0x5562fe25a720 msgr2=0x5562fe2e0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.917+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9c80a1670 0x7ff9c80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.917+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1352182610 shutdown_connections 2023-10-26T06:48:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.918+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9c80a1670 0x7ff9c80a3b30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff9d804f7d0 tx=0x7ff9d8066430 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.918+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1352182610 wait complete. 2023-10-26T06:48:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.919+0000 7ff9f1559b80 1 -- start start 2023-10-26T06:48:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.920+0000 7ff9f1559b80 1 Processor -- start 2023-10-26T06:48:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.922+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe238e70 con 0x5562fe2e6820 2023-10-26T06:48:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe1d5710 con 0x5562fe2ebd60 2023-10-26T06:48:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe1d53b0 con 0x5562fe2ec680 2023-10-26T06:48:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9f1559b80 10 client.0 _ll_register_callbacks cb 0x5562fe11fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.923+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51304/0 (socket says 172.21.15.50:51304) 2023-10-26T06:48:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 -- 172.21.15.50:0/824445638 learned_addr learned my addr 172.21.15.50:0/824445638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 -- 172.21.15.50:0/824445638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 msgr2=0x5562fe2f00d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f00d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 -- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 msgr2=0x5562fe2ef9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2ef9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.924+0000 7ff9d77fe700 1 -- 172.21.15.50:0/824445638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40098a0 con 0x5562fe2e6820 2023-10-26T06:48:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.925+0000 7ff9b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:08.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.925+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2f26a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8063810 tx=0x7ff9d80669d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb52c25e7f655827 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.926+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/824445638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8092070 con 0x5562fe2e6820 2023-10-26T06:48:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.926+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562fe23def0 con 0x5562fe2e6820 2023-10-26T06:48:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.926+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/824445638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff9d8068800 con 0x5562fe2e6820 2023-10-26T06:48:08.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.926+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/824445638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9d8092070 con 0x5562fe2e6820 2023-10-26T06:48:08.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.926+0000 7ff9f1559b80 10 client.16344 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:08.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.926+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5562fe063de0 con 0x5562fe2e6820 2023-10-26T06:48:08.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.927+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/824445638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562fe23def0 con 0x5562fe2e6820 2023-10-26T06:48:08.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.928+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/824445638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff9d809a420 con 0x5562fe2e6820 2023-10-26T06:48:08.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9f1559b80 10 client.16344 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:08.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9f1559b80 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:08.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9f1559b80 20 client.16344 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:08.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe300130 0x5562fe302570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9f1559b80 4 client.16344 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:08.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562fe2b58b0 con 0x5562fe300130 2023-10-26T06:48:08.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.929+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe300130 0x5562fe302570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.930+0000 7ff9b6ffd700 10 client.16344 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.930+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe300130 0x5562fe302570 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e45f9828f223c8 server_cookie=50445a202de1c62e in_seq=0 out_seq=0 2023-10-26T06:48:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.931+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/824445638 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5562fe2b58b0 con 0x5562fe300130 2023-10-26T06:48:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.931+0000 7ff9b6ffd700 10 client.16344 handle_command_reply: tid=0 2023-10-26T06:48:08.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.931+0000 7ff9f1559b80 1 client.16344 shutdown 2023-10-26T06:48:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.932+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 msgr2=0x5562fe2f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.932+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2f26a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8063810 tx=0x7ff9d80669d0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 shutdown_connections 2023-10-26T06:48:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe300130 0x5562fe302570 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2f26a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/824445638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9b6ffd700 0 client.16344 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.936+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 >> 172.21.15.50:0/824445638 conn(0x5562fe25a720 msgr2=0x5562fe2e52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.938+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 shutdown_connections 2023-10-26T06:48:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.938+0000 7ff9f1559b80 1 -- 172.21.15.50:0/824445638 wait complete. 2023-10-26T06:48:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.942+0000 7ff9f1559b80 20 client.16344 trim_cache size 0 max 16384 2023-10-26T06:48:08.947 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/x509_public_key.o 2023-10-26T06:48:08.966 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/manage.o 2023-10-26T06:48:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.979+0000 7ff9f1559b80 1 Processor -- start 2023-10-26T06:48:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.979+0000 7ff9f1559b80 1 -- start start 2023-10-26T06:48:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.980+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2fc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2db820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9f1559b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe0b9920 con 0x5562fe2e6820 2023-10-26T06:48:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2db820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9d6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2db820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44514/0 (socket says 172.21.15.50:44514) 2023-10-26T06:48:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/1383070684 learned_addr learned my addr 172.21.15.50:0/1383070684 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.981+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.982+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe2e71e0 con 0x5562fe2ebd60 2023-10-26T06:48:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.982+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe2f0a00 con 0x5562fe2ec680 2023-10-26T06:48:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.983+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/1383070684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 msgr2=0x5562fe2f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.983+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.983+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/1383070684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 msgr2=0x5562fe2fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.983+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.983+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/1383070684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562fe04cc60 con 0x5562fe2ebd60 2023-10-26T06:48:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.983+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.984+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2db820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc096440 tx=0x7ff9cc00efa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cfddfc24ae49bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.984+0000 7ff9c27fc700 1 -- 172.21.15.50:0/1383070684 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc020e30 con 0x5562fe2ebd60 2023-10-26T06:48:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.985+0000 7ff9c27fc700 1 -- 172.21.15.50:0/1383070684 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9cc09a6c0 con 0x5562fe2ebd60 2023-10-26T06:48:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.985+0000 7ff9c27fc700 1 -- 172.21.15.50:0/1383070684 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc020e30 con 0x5562fe2ebd60 2023-10-26T06:48:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.986+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 msgr2=0x5562fe2db820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:08.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.986+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2db820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc096440 tx=0x7ff9cc00efa0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 shutdown_connections 2023-10-26T06:48:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2ec680 0x5562fe2f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2e6820 0x5562fe2fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/1383070684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ebd60 0x5562fe2db820 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 >> 172.21.15.50:0/1383070684 conn(0x5562fe25a720 msgr2=0x5562fe2e27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 shutdown_connections 2023-10-26T06:48:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.989+0000 7ff9f1559b80 1 -- 172.21.15.50:0/1383070684 wait complete. 2023-10-26T06:48:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.990+0000 7ff9f1559b80 1 -- start start 2023-10-26T06:48:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.990+0000 7ff9f1559b80 1 Processor -- start 2023-10-26T06:48:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.992+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2e6820 0x5562fe2f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.993+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2ebd60 0x5562fe2f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.993+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2e6820 0x5562fe2f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.993+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2e6820 0x5562fe2f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47260/0 (socket says 172.21.15.50:47260) 2023-10-26T06:48:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.993+0000 7ff9f1559b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.993+0000 7ff9d77fe700 1 -- 172.21.15.50:0/3297480514 learned_addr learned my addr 172.21.15.50:0/3297480514 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:08.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.993+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2ebd60 0x5562fe2f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.995+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe2f5f60 con 0x5562fe2ebd60 2023-10-26T06:48:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe2f60d0 con 0x5562fe2ec680 2023-10-26T06:48:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562fe2f6290 con 0x5562fe2e6820 2023-10-26T06:48:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9f1559b80 10 client.0 _ll_register_callbacks cb 0x5562fe11fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/3297480514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2e6820 msgr2=0x5562fe2f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2e6820 0x5562fe2f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 msgr2=0x5562fe2f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9d6ffd700 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562fe1f63f0 con 0x5562fe2ebd60 2023-10-26T06:48:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.996+0000 7ff9d7fff700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.997+0000 7ff9b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.997+0000 7ff9d6ffd700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2ebd60 0x5562fe2f54a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0a2c10 tx=0x7ff9cc0ba170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dbaa47eda5d0c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.998+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/3297480514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc09e810 con 0x5562fe2ebd60 2023-10-26T06:48:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.998+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9c400fdd0 con 0x5562fe2ebd60 2023-10-26T06:48:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.999+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/3297480514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff9cc0a2a50 con 0x5562fe2ebd60 2023-10-26T06:48:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.999+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/3297480514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9cc09e810 con 0x5562fe2ebd60 2023-10-26T06:48:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.999+0000 7ff9f1559b80 10 client.16347 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:08.999+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7ff9d0147d00 con 0x5562fe2ebd60 2023-10-26T06:48:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.000+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/3297480514 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9c400fdd0 con 0x5562fe2ebd60 2023-10-26T06:48:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.000+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/3297480514 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff9cc0b6070 con 0x5562fe2ebd60 2023-10-26T06:48:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.001+0000 7ff9f1559b80 10 client.16347 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.001+0000 7ff9f1559b80 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.001+0000 7ff9f1559b80 20 client.16347 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.001+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe355530 0x5562fe357950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.001+0000 7ff9f1559b80 4 client.16347 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:48:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.002+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe355530 0x5562fe357950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:09.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.002+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562fe231e50 con 0x5562fe355530 2023-10-26T06:48:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.003+0000 7ff9d77fe700 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe355530 0x5562fe357950 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82e087f4bad0e0 server_cookie=6173b085dec7034b in_seq=0 out_seq=0 2023-10-26T06:48:09.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.003+0000 7ff9b6ffd700 10 client.16347 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.004+0000 7ff9b6ffd700 1 -- 172.21.15.50:0/3297480514 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562fe231e50 con 0x5562fe355530 2023-10-26T06:48:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.004+0000 7ff9b6ffd700 10 client.16347 handle_command_reply: tid=0 2023-10-26T06:48:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.004+0000 7ff9f1559b80 1 client.16347 shutdown 2023-10-26T06:48:09.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.004+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2ebd60 msgr2=0x5562fe2f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.004+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2ebd60 0x5562fe2f54a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0a2c10 tx=0x7ff9cc0ba170 comp rx=0 tx=0).stop 2023-10-26T06:48:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 shutdown_connections 2023-10-26T06:48:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5562fe355530 0x5562fe357950 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9b6ffd700 0 client.16347 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5562fe2ec680 0x5562fe2f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562fe2e6820 0x5562fe2f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9f1559b80 1 --2- 172.21.15.50:0/3297480514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5562fe2ebd60 0x5562fe2f54a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.005+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 >> 172.21.15.50:0/3297480514 conn(0x5562fe25a720 msgr2=0x5562fe2da700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.006+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 shutdown_connections 2023-10-26T06:48:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.006+0000 7ff9f1559b80 1 -- 172.21.15.50:0/3297480514 wait complete. 2023-10-26T06:48:09.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.006+0000 7ff9f1559b80 20 client.16347 trim_cache size 0 max 16384 2023-10-26T06:48:09.009 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:48:09.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9c80a1670 msgr2=0x7ff9c80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9c80a1670 0x7ff9c80a3b30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff9d804f7d0 tx=0x7ff9d8066430 comp rx=0 tx=0).stop 2023-10-26T06:48:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 msgr2=0x7ff9d00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b3540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00e9a0 tx=0x7ff9cc00ed60 comp rx=0 tx=0).stop 2023-10-26T06:48:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 shutdown_connections 2023-10-26T06:48:09.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ff9c80a1670 0x7ff9c80a3b30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9d00b7aa0 0x7ff9d0140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9d00a4e10 0x7ff9d00b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:09.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 --2- 172.21.15.50:0/2911285000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9d00a5730 0x7ff9d00b3540 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00e9a0 tx=0x7ff9cc00ed60 comp rx=0 tx=0).stop 2023-10-26T06:48:09.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 >> 172.21.15.50:0/2911285000 conn(0x7ff9d001a670 msgr2=0x7ff9d00b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:09.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 shutdown_connections 2023-10-26T06:48:09.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:09.011+0000 7ff9dc99d700 1 -- 172.21.15.50:0/2911285000 wait complete. 2023-10-26T06:48:09.075 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:08 smithi050 ceph-mon[94997]: pgmap v453: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.7 MiB/s wr, 214 op/s 2023-10-26T06:48:09.123 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/intel.o 2023-10-26T06:48:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:08 smithi125 ceph-mon[130643]: pgmap v453: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.7 MiB/s wr, 214 op/s 2023-10-26T06:48:09.210 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/fpu/init.o 2023-10-26T06:48:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:08 smithi153 ceph-mon[131657]: pgmap v453: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.7 MiB/s wr, 214 op/s 2023-10-26T06:48:09.251 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mmu_context.o 2023-10-26T06:48:09.347 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/pgtable.o 2023-10-26T06:48:09.467 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/fsync.o 2023-10-26T06:48:09.522 INFO:tasks.workunit.client.0.smithi050.stdout: ASN.1 crypto/asymmetric_keys/pkcs7.asn1.[ch] 2023-10-26T06:48:09.568 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/pkcs7_trust.o 2023-10-26T06:48:09.709 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/amd.o 2023-10-26T06:48:09.880 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/percpu.o 2023-10-26T06:48:09.922 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/fpu/bugs.o 2023-10-26T06:48:09.969 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/permission.o 2023-10-26T06:48:09.982 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/pkcs7_verify.o 2023-10-26T06:48:10.085 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:48:10.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:48:10.171 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/spurious.o 2023-10-26T06:48:10.333 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/physaddr.o 2023-10-26T06:48:10.564 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/process_keys.o 2023-10-26T06:48:10.600 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/x509.asn1.o 2023-10-26T06:48:10.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 -- 172.21.15.50:0/2390439491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010ef10 msgr2=0x7f98001077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 --2- 172.21.15.50:0/2390439491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010ef10 0x7f98001077f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f97f40098f0 tx=0x7f97f4009c00 comp rx=0 tx=0).stop 2023-10-26T06:48:10.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 -- 172.21.15.50:0/2390439491 shutdown_connections 2023-10-26T06:48:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 --2- 172.21.15.50:0/2390439491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 0x7f980011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 --2- 172.21.15.50:0/2390439491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010ef10 0x7f98001077f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 --2- 172.21.15.50:0/2390439491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f980010f380 0x7f9800107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.603+0000 7f98071ff700 1 -- 172.21.15.50:0/2390439491 >> 172.21.15.50:0/2390439491 conn(0x7f980006b840 msgr2=0x7f980006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:10.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.604+0000 7f98071ff700 1 -- 172.21.15.50:0/2390439491 shutdown_connections 2023-10-26T06:48:10.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.604+0000 7f98071ff700 1 -- 172.21.15.50:0/2390439491 wait complete. 2023-10-26T06:48:10.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.606+0000 7f98071ff700 1 Processor -- start 2023-10-26T06:48:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.606+0000 7f98071ff700 1 -- start start 2023-10-26T06:48:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.607+0000 7f98071ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 0x7f9800119610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.608+0000 7f98071ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 0x7f9800115720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.608+0000 7f98071ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9800115c60 0x7f9800116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.608+0000 7f98071ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800119e00 con 0x7f9800119fd0 2023-10-26T06:48:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.608+0000 7f98071ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98001a9cf0 con 0x7f980010f380 2023-10-26T06:48:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.608+0000 7f98071ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98001a9e60 con 0x7f9800115c60 2023-10-26T06:48:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.608+0000 7f9804f9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 0x7f9800119610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 0x7f9800119610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44552/0 (socket says 172.21.15.50:44552) 2023-10-26T06:48:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 -- 172.21.15.50:0/1064183322 learned_addr learned my addr 172.21.15.50:0/1064183322 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f97fffff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 0x7f9800115720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f980579c700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9800115c60 0x7f9800116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 -- 172.21.15.50:0/1064183322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9800115c60 msgr2=0x7f9800116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9800115c60 0x7f9800116110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 -- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 msgr2=0x7f9800115720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 0x7f9800115720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.609+0000 7f9804f9b700 1 -- 172.21.15.50:0/1064183322 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4009520 con 0x7f980010f380 2023-10-26T06:48:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.610+0000 7f97fffff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 0x7f9800115720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:10.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.610+0000 7f9804f9b700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 0x7f9800119610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97f4000c00 tx=0x7f97f400f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.611+0000 7f97fdffb700 1 -- 172.21.15.50:0/1064183322 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f401c070 con 0x7f980010f380 2023-10-26T06:48:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.611+0000 7f97fdffb700 1 -- 172.21.15.50:0/1064183322 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97f400ba20 con 0x7f980010f380 2023-10-26T06:48:10.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.611+0000 7f97fdffb700 1 -- 172.21.15.50:0/1064183322 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4003680 con 0x7f980010f380 2023-10-26T06:48:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.611+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98001aa0e0 con 0x7f980010f380 2023-10-26T06:48:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.611+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98001aa450 con 0x7f980010f380 2023-10-26T06:48:10.618 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/fpu/core.o 2023-10-26T06:48:10.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.617+0000 7f97fdffb700 1 -- 172.21.15.50:0/1064183322 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f97f4020030 con 0x7f980010f380 2023-10-26T06:48:10.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.620+0000 7f97fdffb700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f97f00a17c0 0x7f97f00a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.620+0000 7f97fdffb700 1 -- 172.21.15.50:0/1064183322 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f97f40cdd10 con 0x7f980010f380 2023-10-26T06:48:10.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.621+0000 7f981ab4ab80 1 Processor -- start 2023-10-26T06:48:10.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 -- start start 2023-10-26T06:48:10.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adc4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adbe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adbead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ad31760 con 0x557f3adbe650 2023-10-26T06:48:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ad17ce0 con 0x557f3adc4580 2023-10-26T06:48:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.622+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ad15600 con 0x557f3adc3c60 2023-10-26T06:48:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adc4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adc4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47290/0 (socket says 172.21.15.50:47290) 2023-10-26T06:48:10.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 -- 172.21.15.50:0/3958218467 learned_addr learned my addr 172.21.15.50:0/3958218467 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f97fffff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f97f00a17c0 0x7f97f00a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f980579c700 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adbead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 -- 172.21.15.50:0/3958218467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 msgr2=0x557f3adbe110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adbe110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 -- 172.21.15.50:0/3958218467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 msgr2=0x557f3adbead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adbead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f9804f9b700 1 -- 172.21.15.50:0/3958218467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f3acce470 con 0x557f3adc3c60 2023-10-26T06:48:10.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.623+0000 7f980579c700 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adbead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.624+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adc4040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97f40a2ba0 tx=0x7f97f40050c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fade7d455e6e9a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.624+0000 7f97eaffd700 1 -- 172.21.15.50:0/3958218467 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40a1070 con 0x557f3adc3c60 2023-10-26T06:48:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.624+0000 7f97eaffd700 1 -- 172.21.15.50:0/3958218467 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97f409b4d0 con 0x557f3adc3c60 2023-10-26T06:48:10.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.624+0000 7f97eaffd700 1 -- 172.21.15.50:0/3958218467 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4021380 con 0x557f3adc3c60 2023-10-26T06:48:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.625+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3958218467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 msgr2=0x557f3adc4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.625+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adc4040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97f40a2ba0 tx=0x7f97f40050c0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.626+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3958218467 shutdown_connections 2023-10-26T06:48:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.626+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adbead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.626+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adc4040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.626+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3958218467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adbe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.626+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3958218467 >> 172.21.15.50:0/3958218467 conn(0x557f3ad327a0 msgr2=0x557f3adb8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:10.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.626+0000 7f97fffff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f97f00a17c0 0x7f97f00a3c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9800116e00 tx=0x7f97ec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:10.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.630+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3958218467 shutdown_connections 2023-10-26T06:48:10.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.631+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3958218467 wait complete. 2023-10-26T06:48:10.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.631+0000 7f981ab4ab80 1 -- start start 2023-10-26T06:48:10.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.632+0000 7f981ab4ab80 1 Processor -- start 2023-10-26T06:48:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.637+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adbe650 0x557f3adca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.637+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc3c60 0x557f3adc7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.638+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 0x557f3adc7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.638+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ad10ef0 con 0x557f3adc4580 2023-10-26T06:48:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.638+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3acad790 con 0x557f3adc3c60 2023-10-26T06:48:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.638+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3acad430 con 0x557f3adbe650 2023-10-26T06:48:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.638+0000 7f981ab4ab80 10 client.0 _ll_register_callbacks cb 0x557f3abf7b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.638+0000 7f980579c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 0x557f3adc7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f980579c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 0x557f3adc7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51346/0 (socket says 172.21.15.50:51346) 2023-10-26T06:48:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f980579c700 1 -- 172.21.15.50:0/3788605582 learned_addr learned my addr 172.21.15.50:0/3788605582 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f97fffff700 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc3c60 0x557f3adc7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f980579c700 1 -- 172.21.15.50:0/3788605582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adbe650 msgr2=0x557f3adca550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f980579c700 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adbe650 0x557f3adca550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f980579c700 1 -- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc3c60 msgr2=0x557f3adc7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.639+0000 7f980579c700 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc3c60 0x557f3adc7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.640+0000 7f980579c700 1 -- 172.21.15.50:0/3788605582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98001aa450 con 0x557f3adc4580 2023-10-26T06:48:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.641+0000 7f980579c700 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 0x557f3adc7e00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97f8018c20 tx=0x7f97f80074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ef4755a6ae0947 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.641+0000 7f97dffff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:10.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.642+0000 7f97dffff700 1 -- 172.21.15.50:0/3788605582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f801f040 con 0x557f3adc4580 2023-10-26T06:48:10.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.643+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f3ad15f70 con 0x557f3adc4580 2023-10-26T06:48:10.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.643+0000 7f97dffff700 1 -- 172.21.15.50:0/3788605582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f97f80182b0 con 0x557f3adc4580 2023-10-26T06:48:10.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.643+0000 7f97dffff700 1 -- 172.21.15.50:0/3788605582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97f80113f0 con 0x557f3adc4580 2023-10-26T06:48:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 10 client.16359 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:10.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x557f3ab3be60 con 0x557f3adc4580 2023-10-26T06:48:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f97dffff700 1 -- 172.21.15.50:0/3788605582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557f3ad15f70 con 0x557f3adc4580 2023-10-26T06:48:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f97dffff700 1 -- 172.21.15.50:0/3788605582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f97f80105d0 con 0x557f3adc4580 2023-10-26T06:48:10.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 10 client.16359 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 20 client.16359 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3add7b70 0x557f3add9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 4 client.16359 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:10.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.644+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f3ad8d930 con 0x557f3add7b70 2023-10-26T06:48:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.646+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3add7b70 0x557f3add9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.647+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3add7b70 0x557f3add9f90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f273637723a57c server_cookie=50869eab2a1cb7a0 in_seq=0 out_seq=0 2023-10-26T06:48:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.647+0000 7f97dffff700 10 client.16359 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:10.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.648+0000 7f97dffff700 1 -- 172.21.15.50:0/3788605582 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557f3ad8d930 con 0x557f3add7b70 2023-10-26T06:48:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.648+0000 7f97dffff700 10 client.16359 handle_command_reply: tid=0 2023-10-26T06:48:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.648+0000 7f981ab4ab80 1 client.16359 shutdown 2023-10-26T06:48:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 msgr2=0x557f3adc7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 0x557f3adc7e00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97f8018c20 tx=0x7f97f80074a0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 shutdown_connections 2023-10-26T06:48:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3add7b70 0x557f3add9f90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adc4580 0x557f3adc7e00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adbe650 0x557f3adca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.650+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3788605582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc3c60 0x557f3adc7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.650+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 >> 172.21.15.50:0/3788605582 conn(0x557f3ad327a0 msgr2=0x557f3adbd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.649+0000 7f97dffff700 0 client.16359 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:10.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.650+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 shutdown_connections 2023-10-26T06:48:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.650+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3788605582 wait complete. 2023-10-26T06:48:10.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.652+0000 7f981ab4ab80 20 client.16359 trim_cache size 0 max 16384 2023-10-26T06:48:10.695 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/hash.o 2023-10-26T06:48:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.692+0000 7f981ab4ab80 1 Processor -- start 2023-10-26T06:48:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.692+0000 7f981ab4ab80 1 -- start start 2023-10-26T06:48:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.692+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.692+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3add3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ab919a0 con 0x557f3adbe650 2023-10-26T06:48:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3adbf080 con 0x557f3adc4580 2023-10-26T06:48:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f981ab4ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3adb9920 con 0x557f3adc3c60 2023-10-26T06:48:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f980579c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3add3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f980579c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3add3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44580/0 (socket says 172.21.15.50:44580) 2023-10-26T06:48:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.693+0000 7f9804f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.694+0000 7f9804f9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51362/0 (socket says 172.21.15.50:51362) 2023-10-26T06:48:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.694+0000 7f980579c700 1 -- 172.21.15.50:0/933275114 learned_addr learned my addr 172.21.15.50:0/933275114 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.694+0000 7f9804f9b700 1 -- 172.21.15.50:0/933275114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 msgr2=0x557f3adca080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.695+0000 7f9804f9b700 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adca080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.695+0000 7f9804f9b700 1 -- 172.21.15.50:0/933275114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 msgr2=0x557f3add3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.695+0000 7f9804f9b700 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3add3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.695+0000 7f9804f9b700 1 -- 172.21.15.50:0/933275114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f3adc72e0 con 0x557f3adbe650 2023-10-26T06:48:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.696+0000 7f9804f9b700 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcecb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97f40a2ba0 tx=0x7f97f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd6aacd4577a7d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.696+0000 7f97eb7fe700 1 -- 172.21.15.50:0/933275114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f409ef20 con 0x557f3adbe650 2023-10-26T06:48:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.696+0000 7f97eb7fe700 1 -- 172.21.15.50:0/933275114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97f409add0 con 0x557f3adbe650 2023-10-26T06:48:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.696+0000 7f97eb7fe700 1 -- 172.21.15.50:0/933275114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4021380 con 0x557f3adbe650 2023-10-26T06:48:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.697+0000 7f981ab4ab80 1 -- 172.21.15.50:0/933275114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 msgr2=0x557f3adcecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcecb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97f40a2ba0 tx=0x7f97f4009c00 comp rx=0 tx=0).stop 2023-10-26T06:48:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 -- 172.21.15.50:0/933275114 shutdown_connections 2023-10-26T06:48:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3add3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcecb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/933275114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 -- 172.21.15.50:0/933275114 >> 172.21.15.50:0/933275114 conn(0x557f3ad327a0 msgr2=0x557f3adc6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:10.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.698+0000 7f981ab4ab80 1 -- 172.21.15.50:0/933275114 shutdown_connections 2023-10-26T06:48:10.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.699+0000 7f981ab4ab80 1 -- 172.21.15.50:0/933275114 wait complete. 2023-10-26T06:48:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.699+0000 7f981ab4ab80 1 -- start start 2023-10-26T06:48:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.700+0000 7f981ab4ab80 1 Processor -- start 2023-10-26T06:48:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.702+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.702+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adcdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.703+0000 7f981ab4ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adcdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.703+0000 7f97fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adcdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.703+0000 7f97fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adcdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47320/0 (socket says 172.21.15.50:47320) 2023-10-26T06:48:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.703+0000 7f97fffff700 1 -- 172.21.15.50:0/3601210751 learned_addr learned my addr 172.21.15.50:0/3601210751 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.703+0000 7f980579c700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adcdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.703+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ae2b9f0 con 0x557f3adbe650 2023-10-26T06:48:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.704+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ae2bb60 con 0x557f3adc4580 2023-10-26T06:48:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.704+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f3ae2bd20 con 0x557f3adc3c60 2023-10-26T06:48:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.704+0000 7f981ab4ab80 10 client.0 _ll_register_callbacks cb 0x557f3abf7b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.704+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f9804f9b700 1 -- 172.21.15.50:0/3601210751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 msgr2=0x557f3adcdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adcdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f9804f9b700 1 -- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 msgr2=0x557f3adcdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adcdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f9804f9b700 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f3acce470 con 0x557f3adbe650 2023-10-26T06:48:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f9804f9b700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcd560 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x557f3adc8f50 tx=0x7f97f4097710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ba27e0ec3a6e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.705+0000 7f97dffff700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.706+0000 7f97fffff700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adcdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.706+0000 7f980579c700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adcdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.706+0000 7f97dffff700 1 -- 172.21.15.50:0/3601210751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f409ef20 con 0x557f3adbe650 2023-10-26T06:48:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.706+0000 7f97dffff700 1 -- 172.21.15.50:0/3601210751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f97f4099170 con 0x557f3adbe650 2023-10-26T06:48:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.706+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97f409b4d0 con 0x557f3adbe650 2023-10-26T06:48:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.707+0000 7f97dffff700 1 -- 172.21.15.50:0/3601210751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97f40cb730 con 0x557f3adbe650 2023-10-26T06:48:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.707+0000 7f981ab4ab80 10 client.16365 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.707+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x557f3ab24ce0 con 0x557f3adbe650 2023-10-26T06:48:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.707+0000 7f97dffff700 1 -- 172.21.15.50:0/3601210751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97f409b4d0 con 0x557f3adbe650 2023-10-26T06:48:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f97dffff700 1 -- 172.21.15.50:0/3601210751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f97f4081070 con 0x557f3adbe650 2023-10-26T06:48:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f981ab4ab80 10 client.16365 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f981ab4ab80 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f981ab4ab80 20 client.16365 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3ae2d100 0x557f3ae2f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f981ab4ab80 4 client.16365 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:48:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.708+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557f3ad09ed0 con 0x557f3ae2d100 2023-10-26T06:48:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.709+0000 7f97fffff700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3ae2d100 0x557f3ae2f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.710+0000 7f97fffff700 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3ae2d100 0x557f3ae2f520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8209da14a173d85b server_cookie=7f3c40d79c9b1132 in_seq=0 out_seq=0 2023-10-26T06:48:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.710+0000 7f97dffff700 10 client.16365 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f97dffff700 1 -- 172.21.15.50:0/3601210751 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557f3ad09ed0 con 0x557f3ae2d100 2023-10-26T06:48:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f97dffff700 10 client.16365 handle_command_reply: tid=0 2023-10-26T06:48:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 client.16365 shutdown 2023-10-26T06:48:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 msgr2=0x557f3adcd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcd560 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x557f3adc8f50 tx=0x7f97f4097710 comp rx=0 tx=0).stop 2023-10-26T06:48:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 shutdown_connections 2023-10-26T06:48:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x557f3ae2d100 0x557f3ae2f520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x557f3adc4580 0x557f3adcdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f3adbe650 0x557f3adcd560 secure :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0x557f3adc8f50 tx=0x7f97f4097710 comp rx=0 tx=0).stop 2023-10-26T06:48:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 --2- 172.21.15.50:0/3601210751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f3adc3c60 0x557f3adcdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 >> 172.21.15.50:0/3601210751 conn(0x557f3ad327a0 msgr2=0x557f3adc1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.712+0000 7f97dffff700 0 client.16365 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.713+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 shutdown_connections 2023-10-26T06:48:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.713+0000 7f981ab4ab80 1 -- 172.21.15.50:0/3601210751 wait complete. 2023-10-26T06:48:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.714+0000 7f981ab4ab80 20 client.16365 trim_cache size 0 max 16384 2023-10-26T06:48:10.720 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:48:10.720 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:48:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "fe45ff63-1011-4317-b35a-ba64ca32925f", 2023-10-26T06:48:10.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:48:10.721 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:48:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.716+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f97f00a17c0 msgr2=0x7f97f00a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.716+0000 7f98071ff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f97f00a17c0 0x7f97f00a3c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9800116e00 tx=0x7f97ec009260 comp rx=0 tx=0).stop 2023-10-26T06:48:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.716+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 msgr2=0x7f9800119610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.716+0000 7f98071ff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 0x7f9800119610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97f4000c00 tx=0x7f97f400f9e0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.720+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 shutdown_connections 2023-10-26T06:48:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.720+0000 7f98071ff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f97f00a17c0 0x7f97f00a3c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.720+0000 7f98071ff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9800115c60 0x7f9800116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.720+0000 7f98071ff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f980010f380 0x7f9800119610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.720+0000 7f98071ff700 1 --2- 172.21.15.50:0/1064183322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9800119fd0 0x7f9800115720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.720+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 >> 172.21.15.50:0/1064183322 conn(0x7f980006b840 msgr2=0x7f980010bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.723+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 shutdown_connections 2023-10-26T06:48:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:10.723+0000 7f98071ff700 1 -- 172.21.15.50:0/1064183322 wait complete. 2023-10-26T06:48:10.754 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/resend.o 2023-10-26T06:48:10.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:48:10.821 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/x509_akid.asn1.o 2023-10-26T06:48:10.988 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/x509_cert_parser.o 2023-10-26T06:48:11.074 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/setup_nx.o 2023-10-26T06:48:11.083 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/threshold.o 2023-10-26T06:48:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:10 smithi125 ceph-mon[130643]: pgmap v454: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2023-10-26T06:48:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:10 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:48:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:10 smithi153 ceph-mon[131657]: pgmap v454: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2023-10-26T06:48:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:10 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:48:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:10 smithi050 ceph-mon[94997]: pgmap v454: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2023-10-26T06:48:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:10 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:48:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.502+0000 7fb4ebfff700 1 -- 172.21.15.50:0/4255580704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 msgr2=0x7fb4ec104300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.502+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/4255580704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 0x7fb4ec104300 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0098f0 tx=0x7fb4dc009c00 comp rx=0 tx=0).stop 2023-10-26T06:48:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.503+0000 7fb4ebfff700 1 -- 172.21.15.50:0/4255580704 shutdown_connections 2023-10-26T06:48:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.503+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/4255580704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 0x7fb4ec104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.506+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/4255580704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 0x7fb4ec0ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.506+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/4255580704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 0x7fb4ec104300 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.506+0000 7fb4ebfff700 1 -- 172.21.15.50:0/4255580704 >> 172.21.15.50:0/4255580704 conn(0x7fb4ec0faf50 msgr2=0x7fb4ec0fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.508+0000 7fb4ebfff700 1 -- 172.21.15.50:0/4255580704 shutdown_connections 2023-10-26T06:48:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.509+0000 7fb4ebfff700 1 -- 172.21.15.50:0/4255580704 wait complete. 2023-10-26T06:48:11.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.511+0000 7fb4ebfff700 1 Processor -- start 2023-10-26T06:48:11.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.513+0000 7fb4ebfff700 1 -- start start 2023-10-26T06:48:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.514+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 0x7fb4ec071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.514+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 0x7fb4ec071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.514+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 0x7fb4ec071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47342/0 (socket says 172.21.15.50:47342) 2023-10-26T06:48:11.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.514+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 0x7fb4ec0723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.515+0000 7fb4eaffd700 1 -- 172.21.15.50:0/2041108140 learned_addr learned my addr 172.21.15.50:0/2041108140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:11.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.515+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 0x7fb4ec06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.515+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec06b7b0 con 0x7fb4ec0ffe40 2023-10-26T06:48:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.515+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec06b920 con 0x7fb4ec104920 2023-10-26T06:48:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.515+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 0x7fb4ec06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.515+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec06bae0 con 0x7fb4ec0ff520 2023-10-26T06:48:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.516+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/2041108140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 msgr2=0x7fb4ec071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.516+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 0x7fb4ec071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.516+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 msgr2=0x7fb4ec0723a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-26T06:48:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.516+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 0x7fb4ec0723a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.517+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/2041108140 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009d00 con 0x7fb4ec104920 2023-10-26T06:48:11.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.519+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 0x7fb4ec06afe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009cd0 tx=0x7fb4e400c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.520+0000 7fb4e3fff700 1 -- 172.21.15.50:0/2041108140 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4017070 con 0x7fb4ec104920 2023-10-26T06:48:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.521+0000 7fb4e3fff700 1 -- 172.21.15.50:0/2041108140 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4e400f040 con 0x7fb4ec104920 2023-10-26T06:48:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.521+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc009520 con 0x7fb4ec104920 2023-10-26T06:48:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.521+0000 7fb4e3fff700 1 -- 172.21.15.50:0/2041108140 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400e050 con 0x7fb4ec104920 2023-10-26T06:48:11.524 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/chip.o 2023-10-26T06:48:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.525+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec06fb90 con 0x7fb4ec104920 2023-10-26T06:48:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.538+0000 7fb4e3fff700 1 -- 172.21.15.50:0/2041108140 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb4e4003a00 con 0x7fb4ec104920 2023-10-26T06:48:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.541+0000 7fb4e3fff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb4d00a1730 0x7fb4d00a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.541+0000 7fb4e3fff700 1 -- 172.21.15.50:0/2041108140 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb4e40cc450 con 0x7fb4ec104920 2023-10-26T06:48:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.547+0000 7fb5051cdb80 1 Processor -- start 2023-10-26T06:48:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.548+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb4d00a1730 0x7fb4d00a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.549+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb4d00a1730 0x7fb4d00a3bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800ad70 tx=0x7fb4d8005f90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.549+0000 7fb5051cdb80 1 -- start start 2023-10-26T06:48:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.550+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b18b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.550+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b1852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.550+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b185820 0x55af5b185c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.550+0000 7fb5051cdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b0f86e0 con 0x55af5b185820 2023-10-26T06:48:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.551+0000 7fb5051cdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b0dec60 con 0x55af5b18ad60 2023-10-26T06:48:11.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.551+0000 7fb5051cdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b0dc580 con 0x55af5b18b680 2023-10-26T06:48:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.551+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b18b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.551+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b18b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44620/0 (socket says 172.21.15.50:44620) 2023-10-26T06:48:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.551+0000 7fb4eaffd700 1 -- 172.21.15.50:0/78174051 learned_addr learned my addr 172.21.15.50:0/78174051 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.551+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b185820 0x55af5b185c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.552+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/78174051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 msgr2=0x55af5b1852e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.552+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b1852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b1852e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/78174051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 msgr2=0x55af5b18b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b18b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/78174051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af5b0953f0 con 0x55af5b185820 2023-10-26T06:48:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b18b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b1852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.556+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b185820 0x55af5b185c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40c9bf0 tx=0x7fb4e4098de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c299ba48eade23e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.558+0000 7fb4e17fa700 1 -- 172.21.15.50:0/78174051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4099b80 con 0x55af5b185820 2023-10-26T06:48:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.559+0000 7fb4e17fa700 1 -- 172.21.15.50:0/78174051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4e4099480 con 0x55af5b185820 2023-10-26T06:48:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.559+0000 7fb4e17fa700 1 -- 172.21.15.50:0/78174051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e409d3d0 con 0x55af5b185820 2023-10-26T06:48:11.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.562+0000 7fb5051cdb80 1 -- 172.21.15.50:0/78174051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b185820 msgr2=0x55af5b185c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.562+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b185820 0x55af5b185c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40c9bf0 tx=0x7fb4e4098de0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.562+0000 7fb5051cdb80 1 -- 172.21.15.50:0/78174051 shutdown_connections 2023-10-26T06:48:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.562+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b185820 0x55af5b185c80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.562+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b18b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.562+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/78174051 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b1852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.563+0000 7fb5051cdb80 1 -- 172.21.15.50:0/78174051 >> 172.21.15.50:0/78174051 conn(0x55af5b0f9720 msgr2=0x55af5b17fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:11.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.564+0000 7fb5051cdb80 1 -- 172.21.15.50:0/78174051 shutdown_connections 2023-10-26T06:48:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.564+0000 7fb5051cdb80 1 -- 172.21.15.50:0/78174051 wait complete. 2023-10-26T06:48:11.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.565+0000 7fb5051cdb80 1 -- start start 2023-10-26T06:48:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.569+0000 7fb5051cdb80 1 Processor -- start 2023-10-26T06:48:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.569+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b18ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.569+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b18ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.569+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18b680 0x55af5b18f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.570+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b18ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.570+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b18ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:47362/0 (socket says 172.21.15.50:47362) 2023-10-26T06:48:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18b680 0x55af5b18f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18b680 0x55af5b18f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44624/0 (socket says 172.21.15.50:44624) 2023-10-26T06:48:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb4ea7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b18ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb4ea7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b18ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51412/0 (socket says 172.21.15.50:51412) 2023-10-26T06:48:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb4eaffd700 1 -- 172.21.15.50:0/413815947 learned_addr learned my addr 172.21.15.50:0/413815947 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b0d7e70 con 0x55af5b18ad60 2023-10-26T06:48:11.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b074710 con 0x55af5b18b680 2023-10-26T06:48:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.571+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b0743b0 con 0x55af5b185820 2023-10-26T06:48:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.572+0000 7fb5051cdb80 10 client.0 _ll_register_callbacks cb 0x55af5afbea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.573+0000 7fb4ea7fc700 1 -- 172.21.15.50:0/413815947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 msgr2=0x55af5b18ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.573+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b18ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.573+0000 7fb4ea7fc700 1 -- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18b680 msgr2=0x55af5b18f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.573+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18b680 0x55af5b18f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.573+0000 7fb4ea7fc700 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d800fc40 con 0x55af5b18ad60 2023-10-26T06:48:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.573+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b18ef70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009230 tx=0x7fb4dc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc884ff7805f307 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.574+0000 7fb4ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:11.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.577+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/413815947 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc01c070 con 0x55af5b18ad60 2023-10-26T06:48:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.578+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/413815947 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb4dc005b00 con 0x55af5b18ad60 2023-10-26T06:48:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.578+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af5b0dcef0 con 0x55af5b18ad60 2023-10-26T06:48:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.578+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/413815947 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4dc0050c0 con 0x55af5b18ad60 2023-10-26T06:48:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.578+0000 7fb5051cdb80 10 client.16374 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.578+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fb4ec06fb90 con 0x55af5b18ad60 2023-10-26T06:48:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.580+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/413815947 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55af5b0dcef0 con 0x55af5b18ad60 2023-10-26T06:48:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.580+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/413815947 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4dc027050 con 0x55af5b18ad60 2023-10-26T06:48:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.580+0000 7fb5051cdb80 10 client.16374 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.581+0000 7fb5051cdb80 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.581+0000 7fb5051cdb80 20 client.16374 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.581+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b19eef0 0x55af5b1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.581+0000 7fb5051cdb80 4 client.16374 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.581+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af5b1548b0 con 0x55af5b19eef0 2023-10-26T06:48:11.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.582+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b19eef0 0x55af5b1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.585+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b19eef0 0x55af5b1a1310 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06e69173fb4cd95 server_cookie=81fb0bcc099d1dd7 in_seq=0 out_seq=0 2023-10-26T06:48:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.588+0000 7fb4ce7fc700 10 client.16374 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.588+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/413815947 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55af5b1548b0 con 0x55af5b19eef0 2023-10-26T06:48:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.588+0000 7fb4ce7fc700 10 client.16374 handle_command_reply: tid=0 2023-10-26T06:48:11.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.588+0000 7fb5051cdb80 1 client.16374 shutdown 2023-10-26T06:48:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.588+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 msgr2=0x55af5b18ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.588+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b18ef70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009230 tx=0x7fb4dc00f740 comp rx=0 tx=0).stop 2023-10-26T06:48:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.589+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 shutdown_connections 2023-10-26T06:48:11.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.589+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b19eef0 0x55af5b1a1310 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.589+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18b680 0x55af5b18f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.589+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b18ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.589+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/413815947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b18ef70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.590+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 >> 172.21.15.50:0/413815947 conn(0x55af5b0f9720 msgr2=0x55af5b1842d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.589+0000 7fb4ce7fc700 0 client.16374 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.590+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 shutdown_connections 2023-10-26T06:48:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.591+0000 7fb5051cdb80 1 -- 172.21.15.50:0/413815947 wait complete. 2023-10-26T06:48:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.592+0000 7fb5051cdb80 20 client.16374 trim_cache size 0 max 16384 2023-10-26T06:48:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.682+0000 7fb5051cdb80 1 Processor -- start 2023-10-26T06:48:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.682+0000 7fb5051cdb80 1 -- start start 2023-10-26T06:48:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.683+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 0x55af5b188fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.683+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b196030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.683+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 0x55af5b188fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.683+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 0x55af5b188fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:44626/0 (socket says 172.21.15.50:44626) 2023-10-26T06:48:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b18ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5af58920 con 0x55af5b18ad60 2023-10-26T06:48:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb4eaffd700 1 -- 172.21.15.50:0/1349259598 learned_addr learned my addr 172.21.15.50:0/1349259598 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b185c00 con 0x55af5b185820 2023-10-26T06:48:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b1861e0 con 0x55af5b18b680 2023-10-26T06:48:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b18ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/1349259598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 msgr2=0x55af5b188fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 0x55af5b188fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/1349259598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 msgr2=0x55af5b196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.684+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.685+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/1349259598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af5af02de0 con 0x55af5b18b680 2023-10-26T06:48:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.685+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b18ef80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4e409d790 tx=0x7fb4e400e1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a6b5565efc63b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.685+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 0x55af5b188fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.685+0000 7fb4e1ffb700 1 -- 172.21.15.50:0/1349259598 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e409d5d0 con 0x55af5b18b680 2023-10-26T06:48:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.685+0000 7fb4e1ffb700 1 -- 172.21.15.50:0/1349259598 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4e40194d0 con 0x55af5b18b680 2023-10-26T06:48:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.687+0000 7fb4e1ffb700 1 -- 172.21.15.50:0/1349259598 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40996e0 con 0x55af5b18b680 2023-10-26T06:48:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.688+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 msgr2=0x55af5b18ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.688+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b18ef80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb4e409d790 tx=0x7fb4e400e1b0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.689+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 shutdown_connections 2023-10-26T06:48:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.689+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b18b680 0x55af5b18ef80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.689+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b185820 0x55af5b188fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.689+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1349259598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18ad60 0x55af5b196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.689+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 >> 172.21.15.50:0/1349259598 conn(0x55af5b0f9720 msgr2=0x55af5b1888d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.690+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 shutdown_connections 2023-10-26T06:48:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.690+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1349259598 wait complete. 2023-10-26T06:48:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.690+0000 7fb5051cdb80 1 -- start start 2023-10-26T06:48:11.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.691+0000 7fb5051cdb80 1 Processor -- start 2023-10-26T06:48:11.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.693+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b195d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.696+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b194110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.696+0000 7fb5051cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 0x55af5b194650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.696+0000 7fb5051cdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b194b90 con 0x55af5b18b680 2023-10-26T06:48:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.696+0000 7fb5051cdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b194d00 con 0x55af5b18ad60 2023-10-26T06:48:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.696+0000 7fb5051cdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5b194ec0 con 0x55af5b185820 2023-10-26T06:48:11.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.696+0000 7fb5051cdb80 10 client.0 _ll_register_callbacks cb 0x55af5afbea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.697+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 0x55af5b194650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.697+0000 7fb4eaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.697+0000 7fb4eb7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 0x55af5b194650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51424/0 (socket says 172.21.15.50:51424) 2023-10-26T06:48:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.697+0000 7fb4eb7fe700 1 -- 172.21.15.50:0/1632775565 learned_addr learned my addr 172.21.15.50:0/1632775565 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.698+0000 7fb4eaffd700 1 -- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 msgr2=0x55af5b194110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.698+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b194110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.698+0000 7fb4eaffd700 1 -- 172.21.15.50:0/1632775565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 msgr2=0x55af5b194650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.698+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 0x55af5b194650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.698+0000 7fb4eaffd700 1 -- 172.21.15.50:0/1632775565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d801d040 con 0x55af5b185820 2023-10-26T06:48:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.698+0000 7fb4eb7fe700 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 0x55af5b194650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.699+0000 7fb4eaffd700 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b195d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800ffe0 tx=0x7fb4d80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd9649d15540d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:11.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.699+0000 7fb4ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:11.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.699+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/1632775565 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8022040 con 0x55af5b185820 2023-10-26T06:48:11.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.699+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/1632775565 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb4d801db30 con 0x55af5b185820 2023-10-26T06:48:11.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.700+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4e4099480 con 0x55af5b185820 2023-10-26T06:48:11.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.701+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/1632775565 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d801dcf0 con 0x55af5b185820 2023-10-26T06:48:11.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.701+0000 7fb5051cdb80 10 client.26416 fetch_fsmap learned FSMap version 25 2023-10-26T06:48:11.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.701+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55af5b0953f0 con 0x55af5b185820 2023-10-26T06:48:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.702+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/1632775565 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4e4099480 con 0x55af5b185820 2023-10-26T06:48:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.703+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/1632775565 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 25) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4d8038020 con 0x55af5b185820 2023-10-26T06:48:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.703+0000 7fb5051cdb80 10 client.26416 fetch_fsmap finished waiting for FSMap version 25 2023-10-26T06:48:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.704+0000 7fb5051cdb80 10 client.26416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.704+0000 7fb5051cdb80 20 client.26416 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.704+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b1f4190 0x55af5b1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.704+0000 7fb5051cdb80 4 client.26416 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:48:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.704+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55af5b0d0e50 con 0x55af5b1f4190 2023-10-26T06:48:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.705+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b1f4190 0x55af5b1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.706+0000 7fb4ce7fc700 10 client.26416 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.706+0000 7fb4ea7fc700 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b1f4190 0x55af5b1f65b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5f9f46ee26b269 server_cookie=fd47ba28eb02a0ca in_seq=0 out_seq=0 2023-10-26T06:48:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.706+0000 7fb4ce7fc700 1 -- 172.21.15.50:0/1632775565 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55af5b0d0e50 con 0x55af5b1f4190 2023-10-26T06:48:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.706+0000 7fb4ce7fc700 10 client.26416 handle_command_reply: tid=0 2023-10-26T06:48:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.706+0000 7fb5051cdb80 1 client.26416 shutdown 2023-10-26T06:48:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.707+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 msgr2=0x55af5b195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.707+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b195d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800ffe0 tx=0x7fb4d80047c0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.707+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 shutdown_connections 2023-10-26T06:48:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55af5b1f4190 0x55af5b1f65b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af5b18b680 0x55af5b194650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55af5b185820 0x55af5b195d20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 --2- 172.21.15.50:0/1632775565 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55af5b18ad60 0x55af5b194110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 >> 172.21.15.50:0/1632775565 conn(0x55af5b0f9720 msgr2=0x55af5b179700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb4ce7fc700 0 client.26416 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 shutdown_connections 2023-10-26T06:48:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.708+0000 7fb5051cdb80 1 -- 172.21.15.50:0/1632775565 wait complete. 2023-10-26T06:48:11.716 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:48:11.716 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (6248 inodes in the stack)", 2023-10-26T06:48:11.716 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:48:11.716 INFO:teuthology.orchestra.run.smithi050.stdout: "fe45ff63-1011-4317-b35a-ba64ca32925f": { 2023-10-26T06:48:11.716 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:48:11.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "fe45ff63-1011-4317-b35a-ba64ca32925f", 2023-10-26T06:48:11.717 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:48:11.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:48:11.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:48:11.717 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:48:11.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.714+0000 7fb5051cdb80 20 client.26416 trim_cache size 0 max 16384 2023-10-26T06:48:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.717+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb4d00a1730 msgr2=0x7fb4d00a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.717+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb4d00a1730 0x7fb4d00a3bf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800ad70 tx=0x7fb4d8005f90 comp rx=0 tx=0).stop 2023-10-26T06:48:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.718+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 msgr2=0x7fb4ec06afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.718+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 0x7fb4ec06afe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009cd0 tx=0x7fb4e400c620 comp rx=0 tx=0).stop 2023-10-26T06:48:11.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.719+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 shutdown_connections 2023-10-26T06:48:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.719+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb4d00a1730 0x7fb4d00a3bf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.719+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4ec104920 0x7fb4ec06afe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.719+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4ec0ff520 0x7fb4ec071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.719+0000 7fb4ebfff700 1 --2- 172.21.15.50:0/2041108140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4ec0ffe40 0x7fb4ec0723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:11.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.719+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 >> 172.21.15.50:0/2041108140 conn(0x7fb4ec0faf50 msgr2=0x7fb4ec0fbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.721+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 shutdown_connections 2023-10-26T06:48:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:11.721+0000 7fb4ebfff700 1 -- 172.21.15.50:0/2041108140 wait complete. 2023-10-26T06:48:11.729 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/tlb.o 2023-10-26T06:48:11.804 INFO:tasks.cephfs.filesystem:scrub status for tag:fe45ff63-1011-4317-b35a-ba64ca32925f - {'path': '/', 'tag': 'fe45ff63-1011-4317-b35a-ba64ca32925f', 'options': 'recursive,force'} 2023-10-26T06:48:11.832 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/pkcs7.asn1.o 2023-10-26T06:48:11.835 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/request_key.o 2023-10-26T06:48:11.924 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/ialloc.o 2023-10-26T06:48:11.994 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/asymmetric_keys/pkcs7_parser.o 2023-10-26T06:48:12.132 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/slab_common.o 2023-10-26T06:48:12.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:11 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:48:12.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:11 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:12.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:11 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:48:12.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:11 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:48:12.174 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/fpu/regset.o 2023-10-26T06:48:12.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:11 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:48:12.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:11 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:12.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:11 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:48:12.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:11 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:48:12.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:11 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:48:12.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:11 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:12.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:11 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:48:12.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:11 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:48:12.711 INFO:tasks.workunit.client.0.smithi050.stdout: AR crypto/asymmetric_keys/built-in.a 2023-10-26T06:48:12.712 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/dummychip.o 2023-10-26T06:48:12.731 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mce/therm_throt.o 2023-10-26T06:48:12.791 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/api.o 2023-10-26T06:48:12.892 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/fpu/signal.o 2023-10-26T06:48:12.912 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/request_key_auth.o 2023-10-26T06:48:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:12 smithi125 ceph-mon[130643]: pgmap v455: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 842 KiB/s wr, 92 op/s 2023-10-26T06:48:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:12 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:12 smithi153 ceph-mon[131657]: pgmap v455: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 842 KiB/s wr, 92 op/s 2023-10-26T06:48:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:12 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:12 smithi050 ceph-mon[94997]: pgmap v455: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 842 KiB/s wr, 92 op/s 2023-10-26T06:48:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:12 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:13.337 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/devres.o 2023-10-26T06:48:13.558 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/cpu_entry_area.o 2023-10-26T06:48:13.683 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/cpu/mce/built-in.a 2023-10-26T06:48:13.695 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/user_defined.o 2023-10-26T06:48:13.768 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/microcode/core.o 2023-10-26T06:48:13.857 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/compaction.o 2023-10-26T06:48:13.896 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/fpu/xstate.o 2023-10-26T06:48:13.996 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/autoprobe.o 2023-10-26T06:48:14.252 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/indirect.o 2023-10-26T06:48:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:13 smithi050 ceph-mon[94997]: pgmap v456: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 868 KiB/s wr, 137 op/s 2023-10-26T06:48:14.351 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/pat_rbtree.o 2023-10-26T06:48:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:13 smithi125 ceph-mon[130643]: pgmap v456: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 868 KiB/s wr, 137 op/s 2023-10-26T06:48:14.475 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/cipher.o 2023-10-26T06:48:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:13 smithi153 ceph-mon[131657]: pgmap v456: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 868 KiB/s wr, 137 op/s 2023-10-26T06:48:14.512 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/compat.o 2023-10-26T06:48:14.802 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/irqdomain.o 2023-10-26T06:48:14.887 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/microcode/intel.o 2023-10-26T06:48:15.258 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/hugetlbpage.o 2023-10-26T06:48:15.426 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/fpu/built-in.a 2023-10-26T06:48:15.442 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/compress.o 2023-10-26T06:48:15.503 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/proc.o 2023-10-26T06:48:15.545 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/inline.o 2023-10-26T06:48:15.901 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/microcode/amd.o 2023-10-26T06:48:15.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:15 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:15.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:15 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:16.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:15 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:16.203 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/numa.o 2023-10-26T06:48:16.300 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/proc.o 2023-10-26T06:48:16.321 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/sysctl.o 2023-10-26T06:48:16.322 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/memneq.o 2023-10-26T06:48:16.412 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/algapi.o 2023-10-26T06:48:16.619 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/vmacache.o 2023-10-26T06:48:16.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:16 smithi125 ceph-mon[130643]: pgmap v457: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 709 KiB/s wr, 215 op/s 2023-10-26T06:48:16.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:16 smithi153 ceph-mon[131657]: pgmap v457: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 709 KiB/s wr, 215 op/s 2023-10-26T06:48:17.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:16 smithi050 ceph-mon[94997]: pgmap v457: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 709 KiB/s wr, 215 op/s 2023-10-26T06:48:17.101 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/cpu/microcode/built-in.a 2023-10-26T06:48:17.130 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/keys/keyctl_pkey.o 2023-10-26T06:48:17.178 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mtrr/mtrr.o 2023-10-26T06:48:17.220 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/migration.o 2023-10-26T06:48:17.232 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/atom/built-in.a 2023-10-26T06:48:17.291 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/ce4100/built-in.a 2023-10-26T06:48:17.292 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/interval_tree.o 2023-10-26T06:48:17.360 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/platform/efi/quirks.o 2023-10-26T06:48:17.400 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/inode.o 2023-10-26T06:48:17.533 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/numa_64.o 2023-10-26T06:48:17.760 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/cpuhotplug.o 2023-10-26T06:48:17.828 INFO:tasks.workunit.client.0.smithi050.stdout: AR security/keys/built-in.a 2023-10-26T06:48:17.922 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/scatterwalk.o 2023-10-26T06:48:17.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:17 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:17.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:17 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:17.998 INFO:tasks.workunit.client.0.smithi050.stdout: GEN security/selinux/flask.h security/selinux/av_permissions.h 2023-10-26T06:48:18.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:17 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:18.062 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/avc.o 2023-10-26T06:48:18.135 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/amdtopology.o 2023-10-26T06:48:18.236 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/list_lru.o 2023-10-26T06:48:18.237 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mtrr/if.o 2023-10-26T06:48:18.387 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/pm.o 2023-10-26T06:48:18.510 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/platform/efi/efi.o 2023-10-26T06:48:18.880 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/proc.o 2023-10-26T06:48:18.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:18 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:18.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:18 smithi125 ceph-mon[130643]: pgmap v458: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 955 KiB/s wr, 402 op/s 2023-10-26T06:48:18.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:18 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:18.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:18 smithi153 ceph-mon[131657]: pgmap v458: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 955 KiB/s wr, 402 op/s 2023-10-26T06:48:18.984 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/srat.o 2023-10-26T06:48:19.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:18 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:19.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:18 smithi050 ceph-mon[94997]: pgmap v458: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 955 KiB/s wr, 402 op/s 2023-10-26T06:48:19.104 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mtrr/generic.o 2023-10-26T06:48:19.237 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/msi.o 2023-10-26T06:48:19.284 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/workingset.o 2023-10-26T06:48:19.722 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/aead.o 2023-10-26T06:48:19.735 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/pkeys.o 2023-10-26T06:48:19.814 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/platform/efi/efi_64.o 2023-10-26T06:48:20.010 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/hooks.o 2023-10-26T06:48:20.058 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/affinity.o 2023-10-26T06:48:20.152 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/mtrr/cleanup.o 2023-10-26T06:48:20.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:19 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:20.224 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/debug.o 2023-10-26T06:48:20.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:19 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:20.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:19 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:20.520 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/kaslr.o 2023-10-26T06:48:20.662 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq/matrix.o 2023-10-26T06:48:20.712 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/ablkcipher.o 2023-10-26T06:48:20.809 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/cpu/mtrr/built-in.a 2023-10-26T06:48:20.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/cacheinfo.o 2023-10-26T06:48:21.004 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/gup.o 2023-10-26T06:48:21.049 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/platform/efi/efi_stub_64.o 2023-10-26T06:48:21.115 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/mm/pti.o 2023-10-26T06:48:21.124 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/platform/efi/efi_thunk_64.o 2023-10-26T06:48:21.137 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/ioctl.o 2023-10-26T06:48:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:20 smithi125 ceph-mon[130643]: pgmap v459: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 983 KiB/s wr, 597 op/s 2023-10-26T06:48:21.211 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/efi/built-in.a 2023-10-26T06:48:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:20 smithi153 ceph-mon[131657]: pgmap v459: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 983 KiB/s wr, 597 op/s 2023-10-26T06:48:21.254 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/geode/built-in.a 2023-10-26T06:48:21.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:20 smithi050 ceph-mon[94997]: pgmap v459: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 983 KiB/s wr, 597 op/s 2023-10-26T06:48:21.295 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/goldfish/built-in.a 2023-10-26T06:48:21.347 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/platform/intel/iosf_mbi.o 2023-10-26T06:48:21.531 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/blkcipher.o 2023-10-26T06:48:21.636 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/irq/built-in.a 2023-10-26T06:48:21.699 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/livepatch/built-in.a 2023-10-26T06:48:21.752 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/mutex.o 2023-10-26T06:48:21.797 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/scattered.o 2023-10-26T06:48:21.859 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/mm/built-in.a 2023-10-26T06:48:21.914 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/highmem.o 2023-10-26T06:48:22.074 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/intel/built-in.a 2023-10-26T06:48:22.117 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/intel-mid/built-in.a 2023-10-26T06:48:22.159 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/intel-quark/built-in.a 2023-10-26T06:48:22.203 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/iris/built-in.a 2023-10-26T06:48:22.212 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/topology.o 2023-10-26T06:48:22.247 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/olpc/built-in.a 2023-10-26T06:48:22.293 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/scx200/built-in.a 2023-10-26T06:48:22.308 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/selinuxfs.o 2023-10-26T06:48:22.336 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/sfi/built-in.a 2023-10-26T06:48:22.377 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/ts5500/built-in.a 2023-10-26T06:48:22.422 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/skcipher.o 2023-10-26T06:48:22.424 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/uv/built-in.a 2023-10-26T06:48:22.436 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/semaphore.o 2023-10-26T06:48:22.459 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/platform/built-in.a 2023-10-26T06:48:22.524 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/memory.o 2023-10-26T06:48:22.584 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/commoncap.o 2023-10-26T06:48:22.622 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/mballoc.o 2023-10-26T06:48:22.629 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/common.o 2023-10-26T06:48:23.058 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/migrate.o 2023-10-26T06:48:23.073 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/rwsem.o 2023-10-26T06:48:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:22 smithi125 ceph-mon[130643]: pgmap v460: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 605 op/s 2023-10-26T06:48:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:22 smithi153 ceph-mon[131657]: pgmap v460: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 605 op/s 2023-10-26T06:48:23.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:22 smithi050 ceph-mon[94997]: pgmap v460: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 605 op/s 2023-10-26T06:48:23.683 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/seqiv.o 2023-10-26T06:48:24.086 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/netlink.o 2023-10-26T06:48:24.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:23 smithi153 ceph-mon[131657]: pgmap v461: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 612 op/s 2023-10-26T06:48:24.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:23 smithi050 ceph-mon[94997]: pgmap v461: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 612 op/s 2023-10-26T06:48:24.351 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/rdrand.o 2023-10-26T06:48:24.352 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/kprobes/core.o 2023-10-26T06:48:24.354 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/echainiv.o 2023-10-26T06:48:24.364 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/min_addr.o 2023-10-26T06:48:24.400 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/percpu-rwsem.o 2023-10-26T06:48:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:23 smithi125 ceph-mon[130643]: pgmap v461: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 612 op/s 2023-10-26T06:48:24.568 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mincore.o 2023-10-26T06:48:24.824 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/match.o 2023-10-26T06:48:24.839 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/spinlock.o 2023-10-26T06:48:25.155 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/ahash.o 2023-10-26T06:48:25.203 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/nlmsgtab.o 2023-10-26T06:48:25.249 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/kprobes/opt.o 2023-10-26T06:48:25.259 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/bugs.o 2023-10-26T06:48:25.273 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/osq_lock.o 2023-10-26T06:48:25.376 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/mmp.o 2023-10-26T06:48:25.475 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mlock.o 2023-10-26T06:48:25.520 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/partitions/check.o 2023-10-26T06:48:25.648 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/qspinlock.o 2023-10-26T06:48:25.959 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/kprobes/built-in.a 2023-10-26T06:48:26.037 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/rtmutex.o 2023-10-26T06:48:26.038 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/shash.o 2023-10-26T06:48:26.056 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/qos.o 2023-10-26T06:48:26.181 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/netif.o 2023-10-26T06:48:26.189 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/partitions/msdos.o 2023-10-26T06:48:26.193 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/move_extent.o 2023-10-26T06:48:26.263 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/aperfmperf.o 2023-10-26T06:48:26.507 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mmap.o 2023-10-26T06:48:26.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/locking/qrwlock.o 2023-10-26T06:48:26.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/cpuid-deps.o 2023-10-26T06:48:26.934 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/partitions/efi.o 2023-10-26T06:48:26.941 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/akcipher.o 2023-10-26T06:48:27.064 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/main.o 2023-10-26T06:48:27.078 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/locking/built-in.a 2023-10-26T06:48:27.095 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/namei.o 2023-10-26T06:48:27.142 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/page-io.o 2023-10-26T06:48:27.147 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/umwait.o 2023-10-26T06:48:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:26 smithi125 ceph-mon[130643]: pgmap v462: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 557 op/s 2023-10-26T06:48:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:26 smithi153 ceph-mon[131657]: pgmap v462: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 557 op/s 2023-10-26T06:48:27.254 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/netnode.o 2023-10-26T06:48:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:26 smithi050 ceph-mon[94997]: pgmap v462: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 557 op/s 2023-10-26T06:48:27.634 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/kpp.o 2023-10-26T06:48:27.733 INFO:tasks.workunit.client.0.smithi050.stdout: AR block/partitions/built-in.a 2023-10-26T06:48:27.780 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/bio.o 2023-10-26T06:48:27.835 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/proc.o 2023-10-26T06:48:27.968 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/console.o 2023-10-26T06:48:28.039 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/elevator.o 2023-10-26T06:48:28.283 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mmu_gather.o 2023-10-26T06:48:28.309 INFO:tasks.workunit.client.0.smithi050.stdout: ASN.1 crypto/rsapubkey.asn1.[ch] 2023-10-26T06:48:28.319 INFO:tasks.workunit.client.0.smithi050.stdout: ASN.1 crypto/rsaprivkey.asn1.[ch] 2023-10-26T06:48:28.337 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/rsa.o 2023-10-26T06:48:28.345 INFO:tasks.workunit.client.0.smithi050.stdout: MKCAP arch/x86/kernel/cpu/capflags.c 2023-10-26T06:48:28.346 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/netport.o 2023-10-26T06:48:28.706 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/process.o 2023-10-26T06:48:29.012 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/rsa_helper.o 2023-10-26T06:48:29.016 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mprotect.o 2023-10-26T06:48:29.081 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/rsa-pkcs1pad.o 2023-10-26T06:48:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:28 smithi125 ceph-mon[130643]: pgmap v463: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 501 op/s 2023-10-26T06:48:29.217 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/powerflags.o 2023-10-26T06:48:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:28 smithi153 ceph-mon[131657]: pgmap v463: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 501 op/s 2023-10-26T06:48:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:28 smithi050 ceph-mon[94997]: pgmap v463: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 501 op/s 2023-10-26T06:48:29.307 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-core.o 2023-10-26T06:48:29.308 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/readpage.o 2023-10-26T06:48:29.416 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ibpkey.o 2023-10-26T06:48:29.436 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/process_64.o 2023-10-26T06:48:29.666 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/suspend.o 2023-10-26T06:48:30.030 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/acompress.o 2023-10-26T06:48:30.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:29 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:48:30.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:29 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:48:30.215 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mremap.o 2023-10-26T06:48:30.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:29 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:48:30.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:29 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:48:30.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:29 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:48:30.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:29 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:48:30.342 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/resize.o 2023-10-26T06:48:30.573 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/hibernate.o 2023-10-26T06:48:30.651 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/ebitmap.o 2023-10-26T06:48:30.797 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/scompress.o 2023-10-26T06:48:30.806 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/init.o 2023-10-26T06:48:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:30 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:48:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:30 smithi125 ceph-mon[130643]: pgmap v464: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-10-26T06:48:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:30 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:48:31.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:30 smithi153 ceph-mon[131657]: pgmap v464: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-10-26T06:48:31.247 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/msync.o 2023-10-26T06:48:31.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:30 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:48:31.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:30 smithi050 ceph-mon[94997]: pgmap v464: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-10-26T06:48:31.389 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/header.o 2023-10-26T06:48:31.402 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-sysfs.o 2023-10-26T06:48:31.482 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/trampoline_64.o 2023-10-26T06:48:31.550 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/algboss.o 2023-10-26T06:48:31.584 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/stack.o 2023-10-26T06:48:31.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/snapshot.o 2023-10-26T06:48:31.667 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/reboot.o 2023-10-26T06:48:31.742 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/super.o 2023-10-26T06:48:31.754 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/wakeup_asm.o 2023-10-26T06:48:31.775 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/hashtab.o 2023-10-26T06:48:31.844 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/rm/wakemain.o 2023-10-26T06:48:31.897 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/page_vma_mapped.o 2023-10-26T06:48:32.030 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/rm/video-mode.o 2023-10-26T06:48:32.229 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/copy.o 2023-10-26T06:48:32.260 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/symtab.o 2023-10-26T06:48:32.306 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-flush.o 2023-10-26T06:48:32.306 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rm/bioscall.o 2023-10-26T06:48:32.390 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/rm/regs.o 2023-10-26T06:48:32.427 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/testmgr.o 2023-10-26T06:48:32.455 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/sidtab.o 2023-10-26T06:48:32.544 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/rm/video-vga.o 2023-10-26T06:48:32.623 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/pagewalk.o 2023-10-26T06:48:32.716 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/rm/video-vesa.o 2023-10-26T06:48:32.885 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/realmode/rm/video-bios.o 2023-10-26T06:48:32.915 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/swap.o 2023-10-26T06:48:33.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-settings.o 2023-10-26T06:48:33.035 INFO:tasks.workunit.client.0.smithi050.stdout: PASYMS arch/x86/realmode/rm/pasyms.h 2023-10-26T06:48:33.057 INFO:tasks.workunit.client.0.smithi050.stdout: LDS arch/x86/realmode/rm/realmode.lds 2023-10-26T06:48:33.085 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/cmac.o 2023-10-26T06:48:33.099 INFO:tasks.workunit.client.0.smithi050.stdout: LD arch/x86/realmode/rm/realmode.elf 2023-10-26T06:48:33.123 INFO:tasks.workunit.client.0.smithi050.stdout: RELOCS arch/x86/realmode/rm/realmode.relocs 2023-10-26T06:48:33.136 INFO:tasks.workunit.client.0.smithi050.stdout: OBJCOPY arch/x86/realmode/rm/realmode.bin 2023-10-26T06:48:33.165 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/realmode/rmpiggy.o 2023-10-26T06:48:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:32 smithi125 ceph-mon[130643]: pgmap v465: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.4 MiB/s wr, 190 op/s 2023-10-26T06:48:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:32 smithi153 ceph-mon[131657]: pgmap v465: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.4 MiB/s wr, 190 op/s 2023-10-26T06:48:33.253 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/realmode/built-in.a 2023-10-26T06:48:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:32 smithi050 ceph-mon[94997]: pgmap v465: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.4 MiB/s wr, 190 op/s 2023-10-26T06:48:33.293 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/security.o 2023-10-26T06:48:33.310 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/pgtable-generic.o 2023-10-26T06:48:33.579 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/avtab.o 2023-10-26T06:48:33.803 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/hmac.o 2023-10-26T06:48:33.885 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-ioc.o 2023-10-26T06:48:34.001 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/rmap.o 2023-10-26T06:48:34.029 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/user.o 2023-10-26T06:48:34.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:33 smithi050 ceph-mon[94997]: pgmap v466: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.3 MiB/s wr, 223 op/s 2023-10-26T06:48:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:33 smithi125 ceph-mon[130643]: pgmap v466: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.3 MiB/s wr, 223 op/s 2023-10-26T06:48:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:33 smithi153 ceph-mon[131657]: pgmap v466: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.3 MiB/s wr, 223 op/s 2023-10-26T06:48:34.548 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/crypto_null.o 2023-10-26T06:48:34.632 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-map.o 2023-10-26T06:48:34.692 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/policydb.o 2023-10-26T06:48:34.807 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/power/poweroff.o 2023-10-26T06:48:35.146 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/power/built-in.a 2023-10-26T06:48:35.170 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/vmalloc.o 2023-10-26T06:48:35.249 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/printk/printk.o 2023-10-26T06:48:35.264 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/md5.o 2023-10-26T06:48:35.408 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-exec.o 2023-10-26T06:48:35.588 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsargs.o 2023-10-26T06:48:36.017 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/sha1_generic.o 2023-10-26T06:48:36.048 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dscontrol.o 2023-10-26T06:48:36.049 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-merge.o 2023-10-26T06:48:36.490 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsdebug.o 2023-10-26T06:48:36.630 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/services.o 2023-10-26T06:48:36.724 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/sha256_generic.o 2023-10-26T06:48:36.884 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/printk/printk_safe.o 2023-10-26T06:48:36.902 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsfield.o 2023-10-26T06:48:37.065 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/process_vm_access.o 2023-10-26T06:48:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:36 smithi125 ceph-mon[130643]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.2 MiB/s wr, 222 op/s 2023-10-26T06:48:37.223 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-softirq.o 2023-10-26T06:48:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:36 smithi153 ceph-mon[131657]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.2 MiB/s wr, 222 op/s 2023-10-26T06:48:37.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:36 smithi050 ceph-mon[94997]: pgmap v467: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.2 MiB/s wr, 222 op/s 2023-10-26T06:48:37.313 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/printk/built-in.a 2023-10-26T06:48:37.371 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/symlink.o 2023-10-26T06:48:37.385 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/rcu/update.o 2023-10-26T06:48:37.398 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/gf128mul.o 2023-10-26T06:48:37.417 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsinit.o 2023-10-26T06:48:37.856 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsmethod.o 2023-10-26T06:48:37.895 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-timeout.o 2023-10-26T06:48:37.928 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/page_alloc.o 2023-10-26T06:48:38.009 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/cbc.o 2023-10-26T06:48:38.070 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/sysfs.o 2023-10-26T06:48:38.359 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsmthdat.o 2023-10-26T06:48:38.548 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-lib.o 2023-10-26T06:48:38.721 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/conditional.o 2023-10-26T06:48:38.722 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/rcu/sync.o 2023-10-26T06:48:38.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/ctr.o 2023-10-26T06:48:38.809 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsobject.o 2023-10-26T06:48:38.833 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/xattr.o 2023-10-26T06:48:39.124 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/rcu/srcutree.o 2023-10-26T06:48:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:38 smithi125 ceph-mon[130643]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 1.3 MiB/s wr, 217 op/s 2023-10-26T06:48:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:38 smithi153 ceph-mon[131657]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 1.3 MiB/s wr, 217 op/s 2023-10-26T06:48:39.242 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq.o 2023-10-26T06:48:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:38 smithi050 ceph-mon[94997]: pgmap v468: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 1.3 MiB/s wr, 217 op/s 2023-10-26T06:48:39.304 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsopcode.o 2023-10-26T06:48:39.464 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/gcm.o 2023-10-26T06:48:39.874 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/mls.o 2023-10-26T06:48:39.973 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/rcu/tree.o 2023-10-26T06:48:39.973 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dspkginit.o 2023-10-26T06:48:40.292 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/intel.o 2023-10-26T06:48:40.487 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dsutils.o 2023-10-26T06:48:40.515 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/ccm.o 2023-10-26T06:48:40.559 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/xattr_trusted.o 2023-10-26T06:48:40.877 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/init-mm.o 2023-10-26T06:48:40.974 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dswexec.o 2023-10-26T06:48:40.988 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/intel_pconfig.o 2023-10-26T06:48:41.065 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/ss/status.o 2023-10-26T06:48:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:40 smithi125 ceph-mon[130643]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.1 MiB/s wr, 181 op/s 2023-10-26T06:48:41.227 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/xattr_user.o 2023-10-26T06:48:41.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:40 smithi153 ceph-mon[131657]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.1 MiB/s wr, 181 op/s 2023-10-26T06:48:41.260 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/tsx.o 2023-10-26T06:48:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:40 smithi050 ceph-mon[94997]: pgmap v469: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.1 MiB/s wr, 181 op/s 2023-10-26T06:48:41.373 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/memblock.o 2023-10-26T06:48:41.443 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/des_generic.o 2023-10-26T06:48:41.459 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dswload.o 2023-10-26T06:48:41.517 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/intel_epb.o 2023-10-26T06:48:41.518 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq-tag.o 2023-10-26T06:48:41.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:48:41.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/aes_generic.o 2023-10-26T06:48:41.911 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/acl.o 2023-10-26T06:48:41.952 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dswload2.o 2023-10-26T06:48:42.017 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/amd.o 2023-10-26T06:48:42.210 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/selinux/netlabel.o 2023-10-26T06:48:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.307+0000 7fe6419ff700 1 -- 172.21.15.50:0/2568618426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 msgr2=0x7fe63c107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.307+0000 7fe6419ff700 1 --2- 172.21.15.50:0/2568618426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c107d30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe630009990 tx=0x7fe630009ca0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.309+0000 7fe6419ff700 1 -- 172.21.15.50:0/2568618426 shutdown_connections 2023-10-26T06:48:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.309+0000 7fe6419ff700 1 --2- 172.21.15.50:0/2568618426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe63c119fd0 0x7fe63c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.309+0000 7fe6419ff700 1 --2- 172.21.15.50:0/2568618426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 0x7fe63c1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.309+0000 7fe6419ff700 1 --2- 172.21.15.50:0/2568618426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c107d30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.309+0000 7fe6419ff700 1 -- 172.21.15.50:0/2568618426 >> 172.21.15.50:0/2568618426 conn(0x7fe63c06b840 msgr2=0x7fe63c06bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.309+0000 7fe6419ff700 1 -- 172.21.15.50:0/2568618426 shutdown_connections 2023-10-26T06:48:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.313+0000 7fe6419ff700 1 -- 172.21.15.50:0/2568618426 wait complete. 2023-10-26T06:48:42.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.314+0000 7fe6419ff700 1 Processor -- start 2023-10-26T06:48:42.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.317+0000 7fe6419ff700 1 -- start start 2023-10-26T06:48:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe6419ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 0x7fe63c1ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe6419ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c1abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe6419ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe63c119fd0 0x7fe63c1a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe6419ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c1a5fd0 con 0x7fe63c10ef10 2023-10-26T06:48:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe6419ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c1a6140 con 0x7fe63c10f380 2023-10-26T06:48:42.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe6419ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c1a6300 con 0x7fe63c119fd0 2023-10-26T06:48:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe63a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c1abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe63a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c1abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47630/0 (socket says 172.21.15.50:47630) 2023-10-26T06:48:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe63a7fc700 1 -- 172.21.15.50:0/3951793363 learned_addr learned my addr 172.21.15.50:0/3951793363 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe63affd700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 0x7fe63c1ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.318+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe63c119fd0 0x7fe63c1a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.319+0000 7fe63affd700 1 -- 172.21.15.50:0/3951793363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe63c119fd0 msgr2=0x7fe63c1a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.319+0000 7fe63affd700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe63c119fd0 0x7fe63c1a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.319+0000 7fe63affd700 1 -- 172.21.15.50:0/3951793363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 msgr2=0x7fe63c1abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.319+0000 7fe63affd700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c1abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.319+0000 7fe63affd700 1 -- 172.21.15.50:0/3951793363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300095f0 con 0x7fe63c10ef10 2023-10-26T06:48:42.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.320+0000 7fe63affd700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 0x7fe63c1ab840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe634007d60 tx=0x7fe63400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.320+0000 7fe6409fd700 1 -- 172.21.15.50:0/3951793363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400ac90 con 0x7fe63c10ef10 2023-10-26T06:48:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.320+0000 7fe6409fd700 1 -- 172.21.15.50:0/3951793363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe63400adf0 con 0x7fe63c10ef10 2023-10-26T06:48:42.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.320+0000 7fe6409fd700 1 -- 172.21.15.50:0/3951793363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634011670 con 0x7fe63c10ef10 2023-10-26T06:48:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.322+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c1a65e0 con 0x7fe63c10ef10 2023-10-26T06:48:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.322+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c1b2830 con 0x7fe63c10ef10 2023-10-26T06:48:42.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.332+0000 7fe6409fd700 1 -- 172.21.15.50:0/3951793363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe634012420 con 0x7fe63c10ef10 2023-10-26T06:48:42.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.333+0000 7fe655370b80 1 Processor -- start 2023-10-26T06:48:42.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.336+0000 7fe6409fd700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6240a16b0 0x7fe6240a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.337+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6240a16b0 0x7fe6240a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.338+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6240a16b0 0x7fe6240a3b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005950 tx=0x7fe62c00b390 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.338+0000 7fe6409fd700 1 -- 172.21.15.50:0/3951793363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe6340ccde0 con 0x7fe63c10ef10 2023-10-26T06:48:42.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 -- start start 2023-10-26T06:48:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052b500 0x562b40525090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b405255d0 0x562b40525a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b404986e0 con 0x562b405255d0 2023-10-26T06:48:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b4047ec60 con 0x562b4052abe0 2023-10-26T06:48:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.342+0000 7fe655370b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b4047c580 con 0x562b4052b500 2023-10-26T06:48:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.343+0000 7fe63affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.343+0000 7fe63b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b405255d0 0x562b40525a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.343+0000 7fe63affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47646/0 (socket says 172.21.15.50:47646) 2023-10-26T06:48:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.343+0000 7fe63affd700 1 -- 172.21.15.50:0/1103145509 learned_addr learned my addr 172.21.15.50:0/1103145509 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.344+0000 7fe63b7fe700 1 -- 172.21.15.50:0/1103145509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052b500 msgr2=0x562b40525090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.344+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052b500 0x562b40525090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.344+0000 7fe63b7fe700 1 -- 172.21.15.50:0/1103145509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 msgr2=0x562b4052afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.344+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.344+0000 7fe63b7fe700 1 -- 172.21.15.50:0/1103145509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b404353f0 con 0x562b405255d0 2023-10-26T06:48:42.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.344+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b405255d0 0x562b40525a50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0039a0 tx=0x7fe62c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8983babe293464 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.346+0000 7fe621ffb700 1 -- 172.21.15.50:0/1103145509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c004a30 con 0x562b405255d0 2023-10-26T06:48:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.346+0000 7fe621ffb700 1 -- 172.21.15.50:0/1103145509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe62c015070 con 0x562b405255d0 2023-10-26T06:48:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 -- 172.21.15.50:0/1103145509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b405255d0 msgr2=0x562b40525a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe621ffb700 1 -- 172.21.15.50:0/1103145509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c004a30 con 0x562b405255d0 2023-10-26T06:48:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b405255d0 0x562b40525a50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0039a0 tx=0x7fe62c013000 comp rx=0 tx=0).stop 2023-10-26T06:48:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 -- 172.21.15.50:0/1103145509 shutdown_connections 2023-10-26T06:48:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b405255d0 0x562b40525a50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 --2- 172.21.15.50:0/1103145509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052b500 0x562b40525090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.347+0000 7fe655370b80 1 -- 172.21.15.50:0/1103145509 >> 172.21.15.50:0/1103145509 conn(0x562b40499720 msgr2=0x562b4051fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.348+0000 7fe655370b80 1 -- 172.21.15.50:0/1103145509 shutdown_connections 2023-10-26T06:48:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.348+0000 7fe655370b80 1 -- 172.21.15.50:0/1103145509 wait complete. 2023-10-26T06:48:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.348+0000 7fe655370b80 1 -- start start 2023-10-26T06:48:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.349+0000 7fe655370b80 1 Processor -- start 2023-10-26T06:48:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.350+0000 7fe655370b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b40531510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.350+0000 7fe655370b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.350+0000 7fe63affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b40531510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.350+0000 7fe63affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b40531510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:49302/0 (socket says 172.21.15.50:49302) 2023-10-26T06:48:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.350+0000 7fe63affd700 1 -- 172.21.15.50:0/2100072191 learned_addr learned my addr 172.21.15.50:0/2100072191 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.351+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.351+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4052ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.351+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40477e70 con 0x562b4052b500 2023-10-26T06:48:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.351+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40414710 con 0x562b4052abe0 2023-10-26T06:48:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.351+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b404143b0 con 0x562b405255d0 2023-10-26T06:48:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe63affd700 1 -- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 msgr2=0x562b4052e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe63affd700 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe63affd700 1 -- 172.21.15.50:0/2100072191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 msgr2=0x562b4052ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe63affd700 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4052ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe63affd700 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c003680 con 0x562b405255d0 2023-10-26T06:48:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe655370b80 10 client.0 _ll_register_callbacks cb 0x562b4035ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b4047cef0 con 0x562b405255d0 2023-10-26T06:48:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe61affd700 10 client.26425 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.352+0000 7fe63affd700 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b40531510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe63400a690 tx=0x7fe63409a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2be8f888e9e46c server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.353+0000 7fe61affd700 1 -- 172.21.15.50:0/2100072191 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340b8250 con 0x562b405255d0 2023-10-26T06:48:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.353+0000 7fe61affd700 1 -- 172.21.15.50:0/2100072191 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe634078e40 con 0x562b405255d0 2023-10-26T06:48:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.353+0000 7fe61affd700 1 -- 172.21.15.50:0/2100072191 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6340b8250 con 0x562b405255d0 2023-10-26T06:48:42.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.353+0000 7fe655370b80 10 client.26425 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:42.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.353+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x562b402a2de0 con 0x562b405255d0 2023-10-26T06:48:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe61affd700 1 -- 172.21.15.50:0/2100072191 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe63409c030 con 0x562b405255d0 2023-10-26T06:48:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe655370b80 10 client.26425 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe655370b80 10 client.26425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe655370b80 20 client.26425 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b4054fcb0 0x562b40552170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe655370b80 4 client.26425 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.355+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b404f48b0 con 0x562b4054fcb0 2023-10-26T06:48:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.358+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b4054fcb0 0x562b40552170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.358+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b4054fcb0 0x562b40552170 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b1eda5a80d1877 server_cookie=a982cd9b6f08bc84 in_seq=0 out_seq=0 2023-10-26T06:48:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.358+0000 7fe61affd700 10 client.26425 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:42.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.359+0000 7fe61affd700 1 -- 172.21.15.50:0/2100072191 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b404f48b0 con 0x562b4054fcb0 2023-10-26T06:48:42.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.359+0000 7fe61affd700 10 client.26425 handle_command_reply: tid=0 2023-10-26T06:48:42.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.359+0000 7fe655370b80 1 client.26425 shutdown 2023-10-26T06:48:42.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 msgr2=0x562b40531510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b40531510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe63400a690 tx=0x7fe63409a680 comp rx=0 tx=0).stop 2023-10-26T06:48:42.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 shutdown_connections 2023-10-26T06:48:42.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b4054fcb0 0x562b40552170 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4052ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe61affd700 0 client.26425 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:42.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b40531510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 --2- 172.21.15.50:0/2100072191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b4052e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 >> 172.21.15.50:0/2100072191 conn(0x562b40499720 msgr2=0x562b40524080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 shutdown_connections 2023-10-26T06:48:42.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.360+0000 7fe655370b80 1 -- 172.21.15.50:0/2100072191 wait complete. 2023-10-26T06:48:42.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.361+0000 7fe655370b80 20 client.26425 trim_cache size 0 max 16384 2023-10-26T06:48:42.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.416+0000 7fe655370b80 1 Processor -- start 2023-10-26T06:48:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.417+0000 7fe655370b80 1 -- start start 2023-10-26T06:48:42.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.417+0000 7fe655370b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b4051a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.417+0000 7fe655370b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b40535f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.417+0000 7fe655370b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4051f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.418+0000 7fe63affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b4051a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.418+0000 7fe63affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b4051a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:49312/0 (socket says 172.21.15.50:49312) 2023-10-26T06:48:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe655370b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b402f8920 con 0x562b4052b500 2023-10-26T06:48:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63affd700 1 -- 172.21.15.50:0/2055852976 learned_addr learned my addr 172.21.15.50:0/2055852976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:42.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b4052f760 con 0x562b4052abe0 2023-10-26T06:48:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b405364c0 con 0x562b405255d0 2023-10-26T06:48:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63b7fe700 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4051f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b40535f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63affd700 1 -- 172.21.15.50:0/2055852976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 msgr2=0x562b40535f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63affd700 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b40535f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63affd700 1 -- 172.21.15.50:0/2055852976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 msgr2=0x562b4051f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63affd700 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4051f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.419+0000 7fe63affd700 1 -- 172.21.15.50:0/2055852976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b4028bc60 con 0x562b405255d0 2023-10-26T06:48:42.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.420+0000 7fe63affd700 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b4051a5d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe634007780 tx=0x7fe6340cc000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f0d51282a634bd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:42.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.420+0000 7fe6227fc700 1 -- 172.21.15.50:0/2055852976 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340b8250 con 0x562b405255d0 2023-10-26T06:48:42.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.420+0000 7fe6227fc700 1 -- 172.21.15.50:0/2055852976 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe63407c030 con 0x562b405255d0 2023-10-26T06:48:42.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.420+0000 7fe6227fc700 1 -- 172.21.15.50:0/2055852976 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634099470 con 0x562b405255d0 2023-10-26T06:48:42.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.421+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 msgr2=0x562b4051a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.421+0000 7fe655370b80 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b4051a5d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe634007780 tx=0x7fe6340cc000 comp rx=0 tx=0).stop 2023-10-26T06:48:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.424+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 shutdown_connections 2023-10-26T06:48:42.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.424+0000 7fe655370b80 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b4051f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.424+0000 7fe655370b80 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b405255d0 0x562b4051a5d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.424+0000 7fe655370b80 1 --2- 172.21.15.50:0/2055852976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b4052abe0 0x562b40535f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.424+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 >> 172.21.15.50:0/2055852976 conn(0x562b40499720 msgr2=0x562b405249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.425+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 shutdown_connections 2023-10-26T06:48:42.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.425+0000 7fe655370b80 1 -- 172.21.15.50:0/2055852976 wait complete. 2023-10-26T06:48:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.426+0000 7fe655370b80 1 -- start start 2023-10-26T06:48:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.426+0000 7fe655370b80 1 Processor -- start 2023-10-26T06:48:42.429 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-stat.o 2023-10-26T06:48:42.431 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/madvise.o 2023-10-26T06:48:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.428+0000 7fe655370b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b405255d0 0x562b405347f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.428+0000 7fe655370b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052abe0 0x562b40534d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.428+0000 7fe655370b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b40535270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.429+0000 7fe63b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b40535270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe63b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b40535270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56526/0 (socket says 172.21.15.50:56526) 2023-10-26T06:48:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe63a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052abe0 0x562b40534d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe655370b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b405a3bd0 con 0x562b4052b500 2023-10-26T06:48:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b405a3d10 con 0x562b405255d0 2023-10-26T06:48:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe63affd700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b405255d0 0x562b405347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe63b7fe700 1 -- 172.21.15.50:0/2108867782 learned_addr learned my addr 172.21.15.50:0/2108867782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b405a3e50 con 0x562b4052abe0 2023-10-26T06:48:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.430+0000 7fe655370b80 10 client.0 _ll_register_callbacks cb 0x562b4035ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.431+0000 7fe63affd700 1 -- 172.21.15.50:0/2108867782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052abe0 msgr2=0x562b40534d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.431+0000 7fe63affd700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052abe0 0x562b40534d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.431+0000 7fe63affd700 1 -- 172.21.15.50:0/2108867782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 msgr2=0x562b40535270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.431+0000 7fe63affd700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b40535270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.431+0000 7fe63affd700 1 -- 172.21.15.50:0/2108867782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b402a2de0 con 0x562b405255d0 2023-10-26T06:48:42.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.432+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052abe0 0x562b40534d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:42.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.433+0000 7fe63affd700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b405255d0 0x562b405347f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe63400a690 tx=0x7fe6340076f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61de07dce835c7de server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:42.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.433+0000 7fe61affd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:42.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.434+0000 7fe61affd700 1 -- 172.21.15.50:0/2108867782 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340a2080 con 0x562b405255d0 2023-10-26T06:48:42.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.435+0000 7fe61affd700 1 -- 172.21.15.50:0/2108867782 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe634078e40 con 0x562b405255d0 2023-10-26T06:48:42.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.435+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe62c015070 con 0x562b405255d0 2023-10-26T06:48:42.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.438+0000 7fe61affd700 1 -- 172.21.15.50:0/2108867782 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6340b8250 con 0x562b405255d0 2023-10-26T06:48:42.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.439+0000 7fe655370b80 10 client.26429 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:42.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.439+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562b402c9250 con 0x562b405255d0 2023-10-26T06:48:42.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.439+0000 7fe61affd700 1 -- 172.21.15.50:0/2108867782 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe62c015070 con 0x562b405255d0 2023-10-26T06:48:42.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe61affd700 1 -- 172.21.15.50:0/2108867782 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe63409c040 con 0x562b405255d0 2023-10-26T06:48:42.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe655370b80 10 client.26429 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:42.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe655370b80 10 client.26429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:42.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe655370b80 20 client.26429 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:42.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe655370b80 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b405a5200 0x562b405a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe655370b80 4 client.26429 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:48:42.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.440+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b40470e50 con 0x562b405a5200 2023-10-26T06:48:42.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.441+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b405a5200 0x562b405a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.442+0000 7fe63a7fc700 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b405a5200 0x562b405a75f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635282876ea67e25 server_cookie=df214e4e0ab6438f in_seq=0 out_seq=0 2023-10-26T06:48:42.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.442+0000 7fe61affd700 10 client.26429 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:42.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.443+0000 7fe61affd700 1 -- 172.21.15.50:0/2108867782 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562b40470e50 con 0x562b405a5200 2023-10-26T06:48:42.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.443+0000 7fe61affd700 10 client.26429 handle_command_reply: tid=0 2023-10-26T06:48:42.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.443+0000 7fe655370b80 1 client.26429 shutdown 2023-10-26T06:48:42.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b405255d0 msgr2=0x562b405347f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b405255d0 0x562b405347f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe63400a690 tx=0x7fe6340076f0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 shutdown_connections 2023-10-26T06:48:42.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x562b405a5200 0x562b405a75f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562b4052b500 0x562b40535270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x562b405255d0 0x562b405347f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 --2- 172.21.15.50:0/2108867782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562b4052abe0 0x562b40534d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 >> 172.21.15.50:0/2108867782 conn(0x562b40499720 msgr2=0x562b4051f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.444+0000 7fe61affd700 0 client.26429 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:42.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.445+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 shutdown_connections 2023-10-26T06:48:42.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.445+0000 7fe655370b80 1 -- 172.21.15.50:0/2108867782 wait complete. 2023-10-26T06:48:42.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.447+0000 7fe655370b80 20 client.26429 trim_cache size 0 max 16384 2023-10-26T06:48:42.449 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:48:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:48:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:48:42.449 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:48:42.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.450+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6240a16b0 msgr2=0x7fe6240a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.450+0000 7fe6419ff700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6240a16b0 0x7fe6240a3b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005950 tx=0x7fe62c00b390 comp rx=0 tx=0).stop 2023-10-26T06:48:42.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.450+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 msgr2=0x7fe63c1ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.450+0000 7fe6419ff700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 0x7fe63c1ab840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe634007d60 tx=0x7fe63400a340 comp rx=0 tx=0).stop 2023-10-26T06:48:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 shutdown_connections 2023-10-26T06:48:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6240a16b0 0x7fe6240a3b70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe63c119fd0 0x7fe63c1a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe63c10ef10 0x7fe63c1ab840 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 --2- 172.21.15.50:0/3951793363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe63c10f380 0x7fe63c1abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 >> 172.21.15.50:0/3951793363 conn(0x7fe63c06b840 msgr2=0x7fe63c117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.451+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 shutdown_connections 2023-10-26T06:48:42.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.452+0000 7fe6419ff700 1 -- 172.21.15.50:0/3951793363 wait complete. 2023-10-26T06:48:42.498 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:48:42.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:48:42.525 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/rcu/rcu_segcblist.o 2023-10-26T06:48:42.553 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dswscope.o 2023-10-26T06:48:42.761 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ext4/xattr_security.o 2023-10-26T06:48:42.829 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/crc32c_generic.o 2023-10-26T06:48:42.961 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/hygon.o 2023-10-26T06:48:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.984+0000 7f17ca7ff700 1 -- 172.21.15.50:0/778270885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0b7ab0 msgr2=0x7f17bc0b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.984+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/778270885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc0b9ea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17c4066760 tx=0x7f17c4068f80 comp rx=0 tx=0).stop 2023-10-26T06:48:42.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.985+0000 7f17ca7ff700 1 -- 172.21.15.50:0/778270885 shutdown_connections 2023-10-26T06:48:42.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.985+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/778270885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc0b9ea0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.985+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/778270885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a4e20 0x7f17bc0a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.985+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/778270885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0a5740 0x7f17bc0b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.985+0000 7f17ca7ff700 1 -- 172.21.15.50:0/778270885 >> 172.21.15.50:0/778270885 conn(0x7f17bc01a680 msgr2=0x7f17bc01aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.986+0000 7f17ca7ff700 1 -- 172.21.15.50:0/778270885 shutdown_connections 2023-10-26T06:48:42.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.986+0000 7f17ca7ff700 1 -- 172.21.15.50:0/778270885 wait complete. 2023-10-26T06:48:42.993 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/rcu/built-in.a 2023-10-26T06:48:42.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.987+0000 7f17ca7ff700 1 Processor -- start 2023-10-26T06:48:42.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.991+0000 7f17ca7ff700 1 -- start start 2023-10-26T06:48:42.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.992+0000 7f17ca7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0a4e20 0x7f17bc143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.992+0000 7f17ca7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a5740 0x7f17bc1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.992+0000 7f17ca7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.992+0000 7f17ca7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc1483b0 con 0x7f17bc0a5740 2023-10-26T06:48:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.992+0000 7f17ca7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc148520 con 0x7f17bc0b7ab0 2023-10-26T06:48:42.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.992+0000 7f17ca7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc1486e0 con 0x7f17bc0a4e20 2023-10-26T06:48:42.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.993+0000 7f17c8d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.995+0000 7f17c8d9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47700/0 (socket says 172.21.15.50:47700) 2023-10-26T06:48:42.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.995+0000 7f17c8d9c700 1 -- 172.21.15.50:0/2752658978 learned_addr learned my addr 172.21.15.50:0/2752658978 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:42.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.995+0000 7f17c37fe700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a5740 0x7f17bc1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:42.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.996+0000 7f17c37fe700 1 -- 172.21.15.50:0/2752658978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0a4e20 msgr2=0x7f17bc143490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-26T06:48:42.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.996+0000 7f17c37fe700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0a4e20 0x7f17bc143490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.996+0000 7f17c37fe700 1 -- 172.21.15.50:0/2752658978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0b7ab0 msgr2=0x7f17bc147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:42.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.996+0000 7f17c37fe700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:42.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.997+0000 7f17c37fe700 1 -- 172.21.15.50:0/2752658978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009520 con 0x7f17bc0a5740 2023-10-26T06:48:42.999 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/dswstate.o 2023-10-26T06:48:43.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.997+0000 7f17c37fe700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a5740 0x7f17bc1439d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f17b000edf0 tx=0x7f17b000c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:43.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.999+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0009970 con 0x7f17bc0a5740 2023-10-26T06:48:43.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:42.999+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17b00044e0 con 0x7f17bc0a5740 2023-10-26T06:48:43.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.000+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0009970 con 0x7f17bc0a5740 2023-10-26T06:48:43.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.001+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00095f0 con 0x7f17bc0a5740 2023-10-26T06:48:43.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.005+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c404ed30 con 0x7f17bc0a5740 2023-10-26T06:48:43.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.008+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17bc0a6270 con 0x7f17bc0a5740 2023-10-26T06:48:43.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.015+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f17b0003680 con 0x7f17bc0a5740 2023-10-26T06:48:43.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.025+0000 7f17c17fa700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f17b40a1780 0x7f17b40a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:43.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.025+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f17b0014070 con 0x7f17bc0a5740 2023-10-26T06:48:43.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.026+0000 7f17c3fff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f17b40a1780 0x7f17b40a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.028+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17b00967e0 con 0x7f17bc0a5740 2023-10-26T06:48:43.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.028+0000 7f17c3fff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f17b40a1780 0x7f17b40a3c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17bc018960 tx=0x7f17b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:43.077 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/core.o 2023-10-26T06:48:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:42 smithi125 ceph-mon[130643]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2023-10-26T06:48:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:42 smithi153 ceph-mon[131657]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2023-10-26T06:48:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:42 smithi050 ceph-mon[94997]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2023-10-26T06:48:43.289 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq-sysfs.o 2023-10-26T06:48:43.470 INFO:tasks.workunit.client.0.smithi050.stdout: AR security/selinux/built-in.a 2023-10-26T06:48:43.490 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/ext4/built-in.a 2023-10-26T06:48:43.518 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evevent.o 2023-10-26T06:48:43.520 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/centaur.o 2023-10-26T06:48:43.529 INFO:tasks.workunit.client.0.smithi050.stdout: CC security/lsm_audit.o 2023-10-26T06:48:43.596 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/hugetlbfs/inode.o 2023-10-26T06:48:43.610 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/page_io.o 2023-10-26T06:48:43.618 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/authenc.o 2023-10-26T06:48:43.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.619+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17bc0050d0 con 0x7f17bc0a5740 2023-10-26T06:48:43.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.622+0000 7f17c17fa700 1 -- 172.21.15.50:0/2752658978 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11327 (secure 0 0 0) 0x7f17b0099e00 con 0x7f17bc0a5740 2023-10-26T06:48:43.624 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:48:43.624 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:48:16.039416+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:48:43.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f17b40a1780 msgr2=0x7f17b40a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:43.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f17b40a1780 0x7f17b40a3c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f17bc018960 tx=0x7f17b8009260 comp rx=0 tx=0).stop 2023-10-26T06:48:43.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a5740 msgr2=0x7f17bc1439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:43.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a5740 0x7f17bc1439d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f17b000edf0 tx=0x7f17b000c5b0 comp rx=0 tx=0).stop 2023-10-26T06:48:43.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 shutdown_connections 2023-10-26T06:48:43.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f17b40a1780 0x7f17b40a3c40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:43.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17bc0b7ab0 0x7f17bc147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:43.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17bc0a4e20 0x7f17bc143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:43.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 --2- 172.21.15.50:0/2752658978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17bc0a5740 0x7f17bc1439d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:43.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.627+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 >> 172.21.15.50:0/2752658978 conn(0x7f17bc01a680 msgr2=0x7f17bc0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:43.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.628+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 shutdown_connections 2023-10-26T06:48:43.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:43.628+0000 7f17ca7ff700 1 -- 172.21.15.50:0/2752658978 wait complete. 2023-10-26T06:48:43.641 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2023-10-26T06:48:43.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:48:44.028 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evgpe.o 2023-10-26T06:48:44.169 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq-cpumap.o 2023-10-26T06:48:44.171 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/zhaoxin.o 2023-10-26T06:48:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:43 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2752658978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:48:44.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:43 smithi050 ceph-mon[94997]: pgmap v471: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2023-10-26T06:48:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.321+0000 7fd58a1ff700 1 -- 172.21.15.50:0/2988867345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58410f380 msgr2=0x7fd584107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.321+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/2988867345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58410f380 0x7fd584107d30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009f90 tx=0x7fd57c00b330 comp rx=0 tx=0).stop 2023-10-26T06:48:44.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 -- 172.21.15.50:0/2988867345 shutdown_connections 2023-10-26T06:48:44.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/2988867345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd584119fd0 0x7fd58411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/2988867345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 0x7fd5841077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/2988867345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd58410f380 0x7fd584107d30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 -- 172.21.15.50:0/2988867345 >> 172.21.15.50:0/2988867345 conn(0x7fd58406b840 msgr2=0x7fd58406bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:44.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 -- 172.21.15.50:0/2988867345 shutdown_connections 2023-10-26T06:48:44.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.322+0000 7fd58a1ff700 1 -- 172.21.15.50:0/2988867345 wait complete. 2023-10-26T06:48:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.326+0000 7fd58a1ff700 1 Processor -- start 2023-10-26T06:48:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.326+0000 7fd58a1ff700 1 -- start start 2023-10-26T06:48:44.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.327+0000 7fd58a1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 0x7fd584117890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.327+0000 7fd58a1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 0x7fd58410f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.327+0000 7fd58a1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd584119fd0 0x7fd58410fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.327+0000 7fd582ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 0x7fd58410f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.327+0000 7fd582ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 0x7fd58410f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37562/0 (socket says 172.21.15.50:37562) 2023-10-26T06:48:44.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.327+0000 7fd5837fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 0x7fd584117890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.328+0000 7fd5837fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 0x7fd584117890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48500/0 (socket says 172.21.15.50:48500) 2023-10-26T06:48:44.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.329+0000 7fd582ffd700 1 -- 172.21.15.50:0/3566724053 learned_addr learned my addr 172.21.15.50:0/3566724053 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:44.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.329+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd584110570 con 0x7fd58410f380 2023-10-26T06:48:44.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.329+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841106e0 con 0x7fd58410ef10 2023-10-26T06:48:44.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.329+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841ba920 con 0x7fd584119fd0 2023-10-26T06:48:44.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.329+0000 7fd583fff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd584119fd0 0x7fd58410fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd582ffd700 1 -- 172.21.15.50:0/3566724053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd584119fd0 msgr2=0x7fd58410fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd582ffd700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd584119fd0 0x7fd58410fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd582ffd700 1 -- 172.21.15.50:0/3566724053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 msgr2=0x7fd584117890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd582ffd700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 0x7fd584117890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd582ffd700 1 -- 172.21.15.50:0/3566724053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009c40 con 0x7fd58410f380 2023-10-26T06:48:44.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd583fff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd584119fd0 0x7fd58410fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:44.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.330+0000 7fd582ffd700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 0x7fd58410f8a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd57c000f80 tx=0x7fd57c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:44.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.331+0000 7fd580ff9700 1 -- 172.21.15.50:0/3566724053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00e040 con 0x7fd58410f380 2023-10-26T06:48:44.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.331+0000 7fd580ff9700 1 -- 172.21.15.50:0/3566724053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd57c007700 con 0x7fd58410f380 2023-10-26T06:48:44.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.331+0000 7fd580ff9700 1 -- 172.21.15.50:0/3566724053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0052a0 con 0x7fd58410f380 2023-10-26T06:48:44.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.331+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5841baba0 con 0x7fd58410f380 2023-10-26T06:48:44.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.331+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5841bafd0 con 0x7fd58410f380 2023-10-26T06:48:44.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.338+0000 7fd580ff9700 1 -- 172.21.15.50:0/3566724053 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd57c01d470 con 0x7fd58410f380 2023-10-26T06:48:44.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.343+0000 7fd59dbf3b80 1 Processor -- start 2023-10-26T06:48:44.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.346+0000 7fd59dbf3b80 1 -- start start 2023-10-26T06:48:44.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450126090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584501265d0 0x558450126a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd583fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd583fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43796/0 (socket says 172.21.15.50:43796) 2023-10-26T06:48:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd583fff700 1 -- 172.21.15.50:0/462307301 learned_addr learned my addr 172.21.15.50:0/462307301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584500996e0 con 0x5584501265d0 2023-10-26T06:48:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55845007fc60 con 0x55845012c500 2023-10-26T06:48:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.347+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55845007d580 con 0x55845012bbe0 2023-10-26T06:48:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd582ffd700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584501265d0 0x558450126a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd5837fe700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450126090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd583fff700 1 -- 172.21.15.50:0/462307301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 msgr2=0x558450126090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd583fff700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450126090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd583fff700 1 -- 172.21.15.50:0/462307301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584501265d0 msgr2=0x558450126a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd583fff700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584501265d0 0x558450126a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd583fff700 1 -- 172.21.15.50:0/462307301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584500363f0 con 0x55845012bbe0 2023-10-26T06:48:44.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd580ff9700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd56c0a15f0 0x7fd56c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd5837fe700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450126090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:44.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd582ffd700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584501265d0 0x558450126a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:44.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd580ff9700 1 -- 172.21.15.50:0/3566724053 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd57c0d1170 con 0x7fd58410f380 2023-10-26T06:48:44.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.348+0000 7fd583fff700 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012bfc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd57800f3c0 tx=0x7fd57800f6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb6459c784f5d793 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:44.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.349+0000 7fd5837fe700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd56c0a15f0 0x7fd56c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.350+0000 7fd5837fe700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd56c0a15f0 0x7fd56c0a3ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd574005950 tx=0x7fd5740058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:44.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.350+0000 7fd569ffb700 1 -- 172.21.15.50:0/462307301 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578004a30 con 0x55845012bbe0 2023-10-26T06:48:44.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.350+0000 7fd569ffb700 1 -- 172.21.15.50:0/462307301 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5780054e0 con 0x55845012bbe0 2023-10-26T06:48:44.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.350+0000 7fd569ffb700 1 -- 172.21.15.50:0/462307301 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578018860 con 0x55845012bbe0 2023-10-26T06:48:44.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 msgr2=0x55845012bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012bfc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd57800f3c0 tx=0x7fd57800f6d0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 shutdown_connections 2023-10-26T06:48:44.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584501265d0 0x558450126a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012bfc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/462307301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450126090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.351+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 >> 172.21.15.50:0/462307301 conn(0x55845009a720 msgr2=0x558450120b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:44.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.352+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 shutdown_connections 2023-10-26T06:48:44.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.352+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/462307301 wait complete. 2023-10-26T06:48:44.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.352+0000 7fd59dbf3b80 1 -- start start 2023-10-26T06:48:44.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.353+0000 7fd59dbf3b80 1 Processor -- start 2023-10-26T06:48:44.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.354+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5584501265d0 0x558450132550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.354+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.354+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 0x55845012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.354+0000 7fd582ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.354+0000 7fd583fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 0x55845012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd582ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43806/0 (socket says 172.21.15.50:43806) 2023-10-26T06:48:44.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd583fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 0x55845012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37580/0 (socket says 172.21.15.50:37580) 2023-10-26T06:48:44.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd582ffd700 1 -- 172.21.15.50:0/1222278943 learned_addr learned my addr 172.21.15.50:0/1222278943 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558450078e70 con 0x55845012c500 2023-10-26T06:48:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x558450015710 con 0x5584501265d0 2023-10-26T06:48:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584500153b0 con 0x55845012bbe0 2023-10-26T06:48:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.355+0000 7fd582ffd700 1 -- 172.21.15.50:0/1222278943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5584501265d0 msgr2=0x558450132550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:44.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd582ffd700 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5584501265d0 0x558450132550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd582ffd700 1 -- 172.21.15.50:0/1222278943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 msgr2=0x55845012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd582ffd700 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 0x55845012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd582ffd700 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57800ac10 con 0x55845012bbe0 2023-10-26T06:48:44.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd583fff700 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 0x55845012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd59dbf3b80 10 client.0 _ll_register_callbacks cb 0x55844ff5fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55845007def0 con 0x55845012bbe0 2023-10-26T06:48:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd562ffd700 10 client.26446 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:44.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.356+0000 7fd582ffd700 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012f820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd57c09a9b0 tx=0x7fd57c009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782c138d4ac0d2ea server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:44.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.357+0000 7fd562ffd700 1 -- 172.21.15.50:0/1222278943 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c09a380 con 0x55845012bbe0 2023-10-26T06:48:44.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.357+0000 7fd562ffd700 1 -- 172.21.15.50:0/1222278943 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd57c0704e0 con 0x55845012bbe0 2023-10-26T06:48:44.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.357+0000 7fd562ffd700 1 -- 172.21.15.50:0/1222278943 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd57c09a380 con 0x55845012bbe0 2023-10-26T06:48:44.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.357+0000 7fd59dbf3b80 10 client.26446 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:44.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.357+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x55844fea3de0 con 0x55845012bbe0 2023-10-26T06:48:44.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.357+0000 7fd562ffd700 1 -- 172.21.15.50:0/1222278943 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd57c097130 con 0x55845012bbe0 2023-10-26T06:48:44.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd59dbf3b80 10 client.26446 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:44.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd59dbf3b80 10 client.26446 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:48:44.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd59dbf3b80 20 client.26446 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:44.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55845013f8e0 0x558450141da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd59dbf3b80 4 client.26446 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:44.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584500f58b0 con 0x55845013f8e0 2023-10-26T06:48:44.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.358+0000 7fd5837fe700 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55845013f8e0 0x558450141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.359+0000 7fd5837fe700 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55845013f8e0 0x558450141da0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36493c8c2b282119 server_cookie=2e2a215c6740ace4 in_seq=0 out_seq=0 2023-10-26T06:48:44.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.359+0000 7fd562ffd700 10 client.26446 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:44.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.360+0000 7fd562ffd700 1 -- 172.21.15.50:0/1222278943 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5584500f58b0 con 0x55845013f8e0 2023-10-26T06:48:44.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.360+0000 7fd562ffd700 10 client.26446 handle_command_reply: tid=0 2023-10-26T06:48:44.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.360+0000 7fd59dbf3b80 1 client.26446 shutdown 2023-10-26T06:48:44.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.360+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 msgr2=0x55845012f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.360+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012f820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd57c09a9b0 tx=0x7fd57c009570 comp rx=0 tx=0).stop 2023-10-26T06:48:44.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.360+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 shutdown_connections 2023-10-26T06:48:44.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.361+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55845013f8e0 0x558450141da0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.361+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012c500 0x55845012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.361+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5584501265d0 0x558450132550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.361+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/1222278943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55845012bbe0 0x55845012f820 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.361+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 >> 172.21.15.50:0/1222278943 conn(0x55845009a720 msgr2=0x558450125080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:44.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.361+0000 7fd562ffd700 0 client.26446 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:44.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.362+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 shutdown_connections 2023-10-26T06:48:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.362+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/1222278943 wait complete. 2023-10-26T06:48:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.362+0000 7fd59dbf3b80 20 client.26446 trim_cache size 0 max 16384 2023-10-26T06:48:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.409+0000 7fd59dbf3b80 1 Processor -- start 2023-10-26T06:48:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.409+0000 7fd59dbf3b80 1 -- start start 2023-10-26T06:48:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.409+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.409+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.409+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x55845012f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.410+0000 7fd59dbf3b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55845011baf0 con 0x55845012bbe0 2023-10-26T06:48:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.410+0000 7fd59dbf3b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55844fef9920 con 0x55845012c500 2023-10-26T06:48:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.410+0000 7fd59dbf3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558450130e10 con 0x5584501265d0 2023-10-26T06:48:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.412+0000 7fd582ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.412+0000 7fd582ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37586/0 (socket says 172.21.15.50:37586) 2023-10-26T06:48:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.412+0000 7fd582ffd700 1 -- 172.21.15.50:0/581761245 learned_addr learned my addr 172.21.15.50:0/581761245 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.412+0000 7fd583fff700 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x55845012f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.412+0000 7fd583fff700 1 -- 172.21.15.50:0/581761245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 msgr2=0x558450136eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.413+0000 7fd583fff700 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.413+0000 7fd583fff700 1 -- 172.21.15.50:0/581761245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 msgr2=0x558450132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.413+0000 7fd583fff700 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450132080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.413+0000 7fd583fff700 1 -- 172.21.15.50:0/581761245 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55844fe8cc60 con 0x55845012c500 2023-10-26T06:48:44.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.413+0000 7fd583fff700 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x55845012f100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd578005400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9035cec7385ff9fd server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:44.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.415+0000 7fd56a7fc700 1 -- 172.21.15.50:0/581761245 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578003940 con 0x55845012c500 2023-10-26T06:48:44.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.416+0000 7fd56a7fc700 1 -- 172.21.15.50:0/581761245 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd578018440 con 0x55845012c500 2023-10-26T06:48:44.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.416+0000 7fd56a7fc700 1 -- 172.21.15.50:0/581761245 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578010690 con 0x55845012c500 2023-10-26T06:48:44.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/581761245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 msgr2=0x55845012f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x55845012f100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd578005400 comp rx=0 tx=0).stop 2023-10-26T06:48:44.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/581761245 shutdown_connections 2023-10-26T06:48:44.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x55845012f100 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/581761245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450132080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.418+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/581761245 >> 172.21.15.50:0/581761245 conn(0x55845009a720 msgr2=0x558450120810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:44.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.419+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/581761245 shutdown_connections 2023-10-26T06:48:44.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.419+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/581761245 wait complete. 2023-10-26T06:48:44.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:43 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2752658978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:48:44.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:43 smithi125 ceph-mon[130643]: pgmap v471: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2023-10-26T06:48:44.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.419+0000 7fd59dbf3b80 1 -- start start 2023-10-26T06:48:44.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.420+0000 7fd59dbf3b80 1 Processor -- start 2023-10-26T06:48:44.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.422+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd59dbf3b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450136b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd5837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd5837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43820/0 (socket says 172.21.15.50:43820) 2023-10-26T06:48:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd5837fe700 1 -- 172.21.15.50:0/163391491 learned_addr learned my addr 172.21.15.50:0/163391491 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450134e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558450135460 con 0x55845012bbe0 2023-10-26T06:48:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584501355d0 con 0x55845012c500 2023-10-26T06:48:44.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558450135790 con 0x5584501265d0 2023-10-26T06:48:44.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd582ffd700 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.423+0000 7fd5837fe700 1 -- 172.21.15.50:0/163391491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 msgr2=0x558450134e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd5837fe700 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450134e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd5837fe700 1 -- 172.21.15.50:0/163391491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 msgr2=0x558450136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd5837fe700 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450136b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd5837fe700 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584500363f0 con 0x5584501265d0 2023-10-26T06:48:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd59dbf3b80 10 client.0 _ll_register_callbacks cb 0x55844ff5fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5780054e0 con 0x5584501265d0 2023-10-26T06:48:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd5837fe700 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136620 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5584501227d0 tx=0x7fd5740047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c838e5d0fe0fbf48 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.424+0000 7fd562ffd700 10 client.26449 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.425+0000 7fd562ffd700 1 -- 172.21.15.50:0/163391491 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574025070 con 0x5584501265d0 2023-10-26T06:48:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.425+0000 7fd562ffd700 1 -- 172.21.15.50:0/163391491 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd574018070 con 0x5584501265d0 2023-10-26T06:48:44.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.425+0000 7fd562ffd700 1 -- 172.21.15.50:0/163391491 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5740129c0 con 0x5584501265d0 2023-10-26T06:48:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.426+0000 7fd59dbf3b80 10 client.26449 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.426+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x55844feca250 con 0x5584501265d0 2023-10-26T06:48:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd562ffd700 1 -- 172.21.15.50:0/163391491 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd574012b20 con 0x5584501265d0 2023-10-26T06:48:44.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd59dbf3b80 10 client.26449 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd59dbf3b80 10 client.26449 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:48:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd59dbf3b80 20 client.26449 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x558450194770 0x558450196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:44.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd59dbf3b80 4 client.26449 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:48:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.429+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558450071e50 con 0x558450194770 2023-10-26T06:48:44.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.430+0000 7fd582ffd700 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x558450194770 0x558450196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.434+0000 7fd582ffd700 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x558450194770 0x558450196bf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=113ed507232c7c5d server_cookie=3cd971d8dc1db571 in_seq=0 out_seq=0 2023-10-26T06:48:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.435+0000 7fd562ffd700 10 client.26449 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:44.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.435+0000 7fd562ffd700 1 -- 172.21.15.50:0/163391491 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558450071e50 con 0x558450194770 2023-10-26T06:48:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.435+0000 7fd562ffd700 10 client.26449 handle_command_reply: tid=0 2023-10-26T06:48:44.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.435+0000 7fd59dbf3b80 1 client.26449 shutdown 2023-10-26T06:48:44.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 msgr2=0x558450136620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136620 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5584501227d0 tx=0x7fd5740047c0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 shutdown_connections 2023-10-26T06:48:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x558450194770 0x558450196bf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55845012c500 0x558450134e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584501265d0 0x558450136620 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 --2- 172.21.15.50:0/163391491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55845012bbe0 0x558450136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 >> 172.21.15.50:0/163391491 conn(0x55845009a720 msgr2=0x5584501296b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd562ffd700 0 client.26449 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:48:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 shutdown_connections 2023-10-26T06:48:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.439+0000 7fd59dbf3b80 1 -- 172.21.15.50:0/163391491 wait complete. 2023-10-26T06:48:44.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.440+0000 7fd59dbf3b80 20 client.26449 trim_cache size 0 max 16384 2023-10-26T06:48:44.444 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:48:44.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd56c0a15f0 msgr2=0x7fd56c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd56c0a15f0 0x7fd56c0a3ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd574005950 tx=0x7fd5740058e0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 msgr2=0x7fd58410f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 0x7fd58410f8a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd57c000f80 tx=0x7fd57c004a50 comp rx=0 tx=0).stop 2023-10-26T06:48:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 shutdown_connections 2023-10-26T06:48:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd56c0a15f0 0x7fd56c0a3ab0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd584119fd0 0x7fd58410fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd58410ef10 0x7fd584117890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 --2- 172.21.15.50:0/3566724053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd58410f380 0x7fd58410f8a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.444+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 >> 172.21.15.50:0/3566724053 conn(0x7fd58406b840 msgr2=0x7fd584117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:44.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.448+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 shutdown_connections 2023-10-26T06:48:44.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:44.448+0000 7fd58a1ff700 1 -- 172.21.15.50:0/3566724053 wait complete. 2023-10-26T06:48:44.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:43 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2752658978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:48:44.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:43 smithi153 ceph-mon[131657]: pgmap v471: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2023-10-26T06:48:44.521 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/swap_state.o 2023-10-26T06:48:44.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:48:44.612 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/authencesn.o 2023-10-26T06:48:44.663 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/perfctr-watchdog.o 2023-10-26T06:48:44.664 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evgpeblk.o 2023-10-26T06:48:44.848 INFO:tasks.workunit.client.0.smithi050.stdout: AR security/built-in.a 2023-10-26T06:48:44.857 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/hugetlbfs/built-in.a 2023-10-26T06:48:44.927 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/iomap/apply.o 2023-10-26T06:48:44.949 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/swapfile.o 2023-10-26T06:48:45.025 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq-sched.o 2023-10-26T06:48:45.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.059+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/1903333263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98113940 msgr2=0x7f3f98115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.059+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/1903333263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98113940 0x7f3f98115d30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009920 tx=0x7f3f90009c30 comp rx=0 tx=0).stop 2023-10-26T06:48:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/1903333263 shutdown_connections 2023-10-26T06:48:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/1903333263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98113940 0x7f3f98115d30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/1903333263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f981077f0 0x7f3f98107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/1903333263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98108110 0x7f3f98113400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/1903333263 >> 172.21.15.50:0/1903333263 conn(0x7f3f9806b840 msgr2=0x7f3f9806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/1903333263 shutdown_connections 2023-10-26T06:48:45.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.060+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/1903333263 wait complete. 2023-10-26T06:48:45.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.064+0000 7f3f9d7ff700 1 Processor -- start 2023-10-26T06:48:45.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.068+0000 7f3f9d7ff700 1 -- start start 2023-10-26T06:48:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f9d7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f981077f0 0x7f3f981a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f9d7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 0x7f3f981a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f9d7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98113940 0x7f3f981a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f9d7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981a6590 con 0x7f3f98113940 2023-10-26T06:48:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f9d7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981a6700 con 0x7f3f98108110 2023-10-26T06:48:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f9d7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981a68c0 con 0x7f3f981077f0 2023-10-26T06:48:45.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f8e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 0x7f3f981a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f8e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 0x7f3f981a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48564/0 (socket says 172.21.15.50:48564) 2023-10-26T06:48:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/3983935234 learned_addr learned my addr 172.21.15.50:0/3983935234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.069+0000 7f3f977fe700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98113940 0x7f3f981a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f981077f0 0x7f3f981a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/3983935234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f981077f0 msgr2=0x7f3f981a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f981077f0 0x7f3f981a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98113940 msgr2=0x7f3f981a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98113940 0x7f3f981a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/3983935234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80009c40 con 0x7f3f98108110 2023-10-26T06:48:45.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.070+0000 7f3f977fe700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98113940 0x7f3f981a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.071+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 0x7f3f981a1bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d980 tx=0x7f3f8800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.074+0000 7f3f94ff9700 1 -- 172.21.15.50:0/3983935234 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88009930 con 0x7f3f98108110 2023-10-26T06:48:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.074+0000 7f3f94ff9700 1 -- 172.21.15.50:0/3983935234 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f88010460 con 0x7f3f98108110 2023-10-26T06:48:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.074+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90009520 con 0x7f3f98108110 2023-10-26T06:48:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.074+0000 7f3f94ff9700 1 -- 172.21.15.50:0/3983935234 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800f620 con 0x7f3f98108110 2023-10-26T06:48:45.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.074+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f981ae200 con 0x7f3f98108110 2023-10-26T06:48:45.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.085+0000 7f3f94ff9700 1 -- 172.21.15.50:0/3983935234 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3f8800f780 con 0x7f3f98108110 2023-10-26T06:48:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.088+0000 7f3f94ff9700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3f840a1740 0x7f3f840a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.088+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3f840a1740 0x7f3f840a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.089+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3f840a1740 0x7f3f840a3c00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009480 tx=0x7f3f8000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.091+0000 7f3f94ff9700 1 -- 172.21.15.50:0/3983935234 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3f8809a4b0 con 0x7f3f98108110 2023-10-26T06:48:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.091+0000 7f3fb10d6b80 1 Processor -- start 2023-10-26T06:48:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 -- start start 2023-10-26T06:48:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81ef6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81ef1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef15d0 0x556f81ef1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81e646e0 con 0x556f81ef6be0 2023-10-26T06:48:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81e4ac60 con 0x556f81ef15d0 2023-10-26T06:48:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.094+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81e48580 con 0x556f81ef7500 2023-10-26T06:48:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81ef1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81ef1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43844/0 (socket says 172.21.15.50:43844) 2023-10-26T06:48:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/633457160 learned_addr learned my addr 172.21.15.50:0/633457160 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81ef6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/633457160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef15d0 msgr2=0x556f81ef1a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef15d0 0x556f81ef1a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/633457160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 msgr2=0x556f81ef6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81ef6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.095+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/633457160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f81e013f0 con 0x556f81ef7500 2023-10-26T06:48:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.096+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81ef6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.096+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81ef1090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3f880972a0 tx=0x7f3f8809ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f8fe299408d757e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.098+0000 7f3f8d7fa700 1 -- 172.21.15.50:0/633457160 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88099710 con 0x556f81ef7500 2023-10-26T06:48:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.098+0000 7f3f8d7fa700 1 -- 172.21.15.50:0/633457160 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f8809d070 con 0x556f81ef7500 2023-10-26T06:48:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.098+0000 7f3f8d7fa700 1 -- 172.21.15.50:0/633457160 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88098100 con 0x556f81ef7500 2023-10-26T06:48:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/633457160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 msgr2=0x556f81ef1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81ef1090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3f880972a0 tx=0x7f3f8809ebd0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/633457160 shutdown_connections 2023-10-26T06:48:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef15d0 0x556f81ef1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81ef6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/633457160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81ef1090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.099+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/633457160 >> 172.21.15.50:0/633457160 conn(0x556f81e65720 msgr2=0x556f81eebb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.101+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/633457160 shutdown_connections 2023-10-26T06:48:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.101+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/633457160 wait complete. 2023-10-26T06:48:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.102+0000 7f3fb10d6b80 1 -- start start 2023-10-26T06:48:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.102+0000 7f3fb10d6b80 1 Processor -- start 2023-10-26T06:48:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81efa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81efad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef7500 0x556f81efb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81e43e70 con 0x556f81ef6be0 2023-10-26T06:48:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81de0710 con 0x556f81ef7500 2023-10-26T06:48:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81de03b0 con 0x556f81ef15d0 2023-10-26T06:48:45.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3fb10d6b80 10 client.0 _ll_register_callbacks cb 0x556f81d2aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:45.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.103+0000 7f3f96ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81efa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81efa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43852/0 (socket says 172.21.15.50:43852) 2023-10-26T06:48:45.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 -- 172.21.15.50:0/2602180570 learned_addr learned my addr 172.21.15.50:0/2602180570 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f977fe700 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef7500 0x556f81efb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 -- 172.21.15.50:0/2602180570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef7500 msgr2=0x556f81efb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef7500 0x556f81efb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 -- 172.21.15.50:0/2602180570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 msgr2=0x556f81efad20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81efad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.104+0000 7f3f96ffd700 1 -- 172.21.15.50:0/2602180570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f981ae200 con 0x556f81ef15d0 2023-10-26T06:48:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.106+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81efa7e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009fa0 tx=0x7f3f80004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f417dc10c49c6be server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.106+0000 7f3f7e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:48:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.107+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2602180570 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80026070 con 0x556f81ef15d0 2023-10-26T06:48:45.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.107+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2602180570 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3f80004bb0 con 0x556f81ef15d0 2023-10-26T06:48:45.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.111+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f81e48ef0 con 0x556f81ef15d0 2023-10-26T06:48:45.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.111+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2602180570 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f80004d70 con 0x556f81ef15d0 2023-10-26T06:48:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 10 client.26458 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:45.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556f81c6ede0 con 0x556f81ef15d0 2023-10-26T06:48:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2602180570 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556f81e48ef0 con 0x556f81ef15d0 2023-10-26T06:48:45.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2602180570 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f3f80029020 con 0x556f81ef15d0 2023-10-26T06:48:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 10 client.26458 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 10 client.26458 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:48:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 20 client.26458 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:45.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f0aeb0 0x556f81f0d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 4 client.26458 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:45.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.113+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f81ec08b0 con 0x556f81f0aeb0 2023-10-26T06:48:45.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.114+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f0aeb0 0x556f81f0d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.117+0000 7f3f7e7fc700 10 client.26458 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:45.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.117+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f0aeb0 0x556f81f0d2d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2951a858bac3f64 server_cookie=aa2fc90825b1f012 in_seq=0 out_seq=0 2023-10-26T06:48:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.118+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2602180570 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556f81ec08b0 con 0x556f81f0aeb0 2023-10-26T06:48:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.118+0000 7f3f7e7fc700 10 client.26458 handle_command_reply: tid=0 2023-10-26T06:48:45.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.118+0000 7f3fb10d6b80 1 client.26458 shutdown 2023-10-26T06:48:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 msgr2=0x556f81efa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81efa7e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009fa0 tx=0x7f3f80004b40 comp rx=0 tx=0).stop 2023-10-26T06:48:45.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 shutdown_connections 2023-10-26T06:48:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f0aeb0 0x556f81f0d2d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef7500 0x556f81efb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81efa7e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2602180570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef6be0 0x556f81efad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 >> 172.21.15.50:0/2602180570 conn(0x556f81e65720 msgr2=0x556f81ef0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3f7e7fc700 0 client.26458 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 shutdown_connections 2023-10-26T06:48:45.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.122+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2602180570 wait complete. 2023-10-26T06:48:45.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.126+0000 7f3fb10d6b80 20 client.26458 trim_cache size 0 max 16384 2023-10-26T06:48:45.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.161+0000 7f3fb10d6b80 1 Processor -- start 2023-10-26T06:48:45.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.161+0000 7f3fb10d6b80 1 -- start start 2023-10-26T06:48:45.163 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evgpeinit.o 2023-10-26T06:48:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81f01d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81efb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef7500 0x556f81f064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81eec130 con 0x556f81ef7500 2023-10-26T06:48:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81ee6af0 con 0x556f81ef6be0 2023-10-26T06:48:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81cc4920 con 0x556f81ef15d0 2023-10-26T06:48:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3f8e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81efb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3f8e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81efb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48588/0 (socket says 172.21.15.50:48588) 2023-10-26T06:48:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.162+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/1439727546 learned_addr learned my addr 172.21.15.50:0/1439727546 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/1439727546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 msgr2=0x556f81f01d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81f01d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/1439727546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef7500 msgr2=0x556f81f064b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef7500 0x556f81f064b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/1439727546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f81c57c60 con 0x556f81ef6be0 2023-10-26T06:48:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81efb080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d950 tx=0x7f3f88000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c795e20365467a server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8dffb700 1 -- 172.21.15.50:0/1439727546 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8809df00 con 0x556f81ef6be0 2023-10-26T06:48:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8dffb700 1 -- 172.21.15.50:0/1439727546 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f880a2140 con 0x556f81ef6be0 2023-10-26T06:48:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.163+0000 7f3f8dffb700 1 -- 172.21.15.50:0/1439727546 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f880964c0 con 0x556f81ef6be0 2023-10-26T06:48:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.165+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/1439727546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 msgr2=0x556f81efb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.165+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81efb080 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d950 tx=0x7f3f88000bc0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/1439727546 shutdown_connections 2023-10-26T06:48:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef7500 0x556f81f064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef15d0 0x556f81f01d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/1439727546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81efb080 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/1439727546 >> 172.21.15.50:0/1439727546 conn(0x556f81e65720 msgr2=0x556f81ef09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/1439727546 shutdown_connections 2023-10-26T06:48:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.168+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/1439727546 wait complete. 2023-10-26T06:48:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.169+0000 7f3fb10d6b80 1 -- start start 2023-10-26T06:48:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.171+0000 7f3fb10d6b80 1 Processor -- start 2023-10-26T06:48:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.172+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef15d0 0x556f81efff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81f00470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3fb10d6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81f5dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81f5e220 con 0x556f81ef15d0 2023-10-26T06:48:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81f5e360 con 0x556f81ef6be0 2023-10-26T06:48:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3fb10d6b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f81f5e4f0 con 0x556f81ef7500 2023-10-26T06:48:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3f977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81f5dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3f977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81f5dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43876/0 (socket says 172.21.15.50:43876) 2023-10-26T06:48:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.175+0000 7f3f977fe700 1 -- 172.21.15.50:0/2150873571 learned_addr learned my addr 172.21.15.50:0/2150873571 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.176+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81f00470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.176+0000 7f3fb10d6b80 10 client.0 _ll_register_callbacks cb 0x556f81d2aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.176+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 msgr2=0x556f81f5dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.176+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81f5dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.176+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/2150873571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef15d0 msgr2=0x556f81efff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.177+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef15d0 0x556f81efff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.178+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef15d0 0x556f81efff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.178+0000 7f3f8e7fc700 1 -- 172.21.15.50:0/2150873571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f81e013f0 con 0x556f81ef6be0 2023-10-26T06:48:45.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.178+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef15d0 0x556f81efff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:45.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.179+0000 7f3f8e7fc700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81f00470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d950 tx=0x7f3f88010a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1df0e75d6e0819e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.179+0000 7f3f7e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.179+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2150873571 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88096130 con 0x556f81ef6be0 2023-10-26T06:48:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.179+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2150873571 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3f880964c0 con 0x556f81ef6be0 2023-10-26T06:48:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.179+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f8809d070 con 0x556f81ef6be0 2023-10-26T06:48:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2150873571 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f880ca9a0 con 0x556f81ef6be0 2023-10-26T06:48:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 10 client.26462 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556f81c95250 con 0x556f81ef6be0 2023-10-26T06:48:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2150873571 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f8809d070 con 0x556f81ef6be0 2023-10-26T06:48:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2150873571 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f3f880b9050 con 0x556f81ef6be0 2023-10-26T06:48:45.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 10 client.26462 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 10 client.26462 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:48:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 20 client.26462 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f5f7a0 0x556f81f61b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 4 client.26462 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:48:45.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.180+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556f81e3ce50 con 0x556f81f5f7a0 2023-10-26T06:48:45.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.184+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f5f7a0 0x556f81f61b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.184+0000 7f3f7e7fc700 10 client.26462 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:45.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.184+0000 7f3f96ffd700 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f5f7a0 0x556f81f61b90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdbd434632265c4a server_cookie=d5c188115295b54f in_seq=0 out_seq=0 2023-10-26T06:48:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3f7e7fc700 1 -- 172.21.15.50:0/2150873571 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556f81e3ce50 con 0x556f81f5f7a0 2023-10-26T06:48:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3f7e7fc700 10 client.26462 handle_command_reply: tid=0 2023-10-26T06:48:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 client.26462 shutdown 2023-10-26T06:48:45.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 msgr2=0x556f81f00470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81f00470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d950 tx=0x7f3f88010a30 comp rx=0 tx=0).stop 2023-10-26T06:48:45.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 shutdown_connections 2023-10-26T06:48:45.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f81ef7500 0x556f81f5dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f81ef15d0 0x556f81efff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x556f81f5f7a0 0x556f81f61b90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 --2- 172.21.15.50:0/2150873571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x556f81ef6be0 0x556f81f00470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3f7e7fc700 0 client.26462 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:48:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 >> 172.21.15.50:0/2150873571 conn(0x556f81e65720 msgr2=0x556f81f064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.186+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 shutdown_connections 2023-10-26T06:48:45.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.187+0000 7f3fb10d6b80 1 -- 172.21.15.50:0/2150873571 wait complete. 2023-10-26T06:48:45.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.187+0000 7f3fb10d6b80 20 client.26462 trim_cache size 0 max 16384 2023-10-26T06:48:45.192 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:48:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3f840a1740 msgr2=0x7f3f840a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3f840a1740 0x7f3f840a3c00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009480 tx=0x7f3f8000b040 comp rx=0 tx=0).stop 2023-10-26T06:48:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 msgr2=0x7f3f981a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 0x7f3f981a1bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d980 tx=0x7f3f8800dc90 comp rx=0 tx=0).stop 2023-10-26T06:48:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 shutdown_connections 2023-10-26T06:48:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f3f840a1740 0x7f3f840a3c00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f98113940 0x7f3f981a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f981077f0 0x7f3f981a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 --2- 172.21.15.50:0/3983935234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3f98108110 0x7f3f981a1bb0 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800d980 tx=0x7f3f8800dc90 comp rx=0 tx=0).stop 2023-10-26T06:48:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 >> 172.21.15.50:0/3983935234 conn(0x7f3f9806b840 msgr2=0x7f3f98070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 shutdown_connections 2023-10-26T06:48:45.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.190+0000 7f3f9d7ff700 1 -- 172.21.15.50:0/3983935234 wait complete. 2023-10-26T06:48:45.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:48:45.353 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpu/capflags.o 2023-10-26T06:48:45.553 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/cpu/built-in.a 2023-10-26T06:48:45.643 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/rng.o 2023-10-26T06:48:45.644 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/iomap/buffered-io.o 2023-10-26T06:48:45.664 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/signal.o 2023-10-26T06:48:45.713 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/loadavg.o 2023-10-26T06:48:45.723 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evgpeutil.o 2023-10-26T06:48:45.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.845+0000 7f699d5ff700 1 -- 172.21.15.50:0/199366922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998067d40 msgr2=0x7f6998068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.845+0000 7f699d5ff700 1 --2- 172.21.15.50:0/199366922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998067d40 0x7f6998068120 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6988009970 tx=0x7f6988009c80 comp rx=0 tx=0).stop 2023-10-26T06:48:45.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 -- 172.21.15.50:0/199366922 shutdown_connections 2023-10-26T06:48:45.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 --2- 172.21.15.50:0/199366922 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105b30 0x7f699810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 --2- 172.21.15.50:0/199366922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998067d40 0x7f6998068120 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 --2- 172.21.15.50:0/199366922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998105170 0x7f69981055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 -- 172.21.15.50:0/199366922 >> 172.21.15.50:0/199366922 conn(0x7f69980767f0 msgr2=0x7f6998076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 -- 172.21.15.50:0/199366922 shutdown_connections 2023-10-26T06:48:45.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.852+0000 7f699d5ff700 1 -- 172.21.15.50:0/199366922 wait complete. 2023-10-26T06:48:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.856+0000 7f699d5ff700 1 Processor -- start 2023-10-26T06:48:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.856+0000 7f699d5ff700 1 -- start start 2023-10-26T06:48:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f699d5ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998067d40 0x7f6998198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f699d5ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 0x7f6998199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f699d5ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998105b30 0x7f699819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f699d5ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699819dde0 con 0x7f6998105b30 2023-10-26T06:48:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f699d5ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699819df50 con 0x7f6998105170 2023-10-26T06:48:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f699d5ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699819e110 con 0x7f6998067d40 2023-10-26T06:48:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f69967fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 0x7f6998199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f69967fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 0x7f6998199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2023-10-26T06:48:45.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f69967fc700 1 -- 172.21.15.50:0/3387090109 learned_addr learned my addr 172.21.15.50:0/3387090109 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f69977fe700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998105b30 0x7f699819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.861+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998067d40 0x7f6998198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69967fc700 1 -- 172.21.15.50:0/3387090109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998067d40 msgr2=0x7f6998198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69967fc700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998067d40 0x7f6998198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69967fc700 1 -- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998105b30 msgr2=0x7f699819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69967fc700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998105b30 0x7f699819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69967fc700 1 -- 172.21.15.50:0/3387090109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6988009520 con 0x7f6998105170 2023-10-26T06:48:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69977fe700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998105b30 0x7f699819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f69967fc700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 0x7f6998199400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f698c00d980 tx=0x7f698c00dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.862+0000 7f697ffff700 1 -- 172.21.15.50:0/3387090109 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c009b40 con 0x7f6998105170 2023-10-26T06:48:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.863+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699819e3f0 con 0x7f6998105170 2023-10-26T06:48:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.863+0000 7f697ffff700 1 -- 172.21.15.50:0/3387090109 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f698c00de60 con 0x7f6998105170 2023-10-26T06:48:45.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.863+0000 7f697ffff700 1 -- 172.21.15.50:0/3387090109 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c00f620 con 0x7f6998105170 2023-10-26T06:48:45.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.863+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69981a5c30 con 0x7f6998105170 2023-10-26T06:48:45.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.879+0000 7f697ffff700 1 -- 172.21.15.50:0/3387090109 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f698c00f780 con 0x7f6998105170 2023-10-26T06:48:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.881+0000 7f69b0f25b80 1 Processor -- start 2023-10-26T06:48:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.881+0000 7f697ffff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69800a1670 0x7f69800a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.881+0000 7f697ffff700 1 -- 172.21.15.50:0/3387090109 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f698c010920 con 0x7f6998105170 2023-10-26T06:48:45.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.882+0000 7f69977fe700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69800a1670 0x7f69800a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 -- start start 2023-10-26T06:48:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69977fe700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69800a1670 0x7f69800a3b30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f699000c450 tx=0x7f6990009570 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5560534343f0 0x5560534347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605342e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 0x55605342f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560533996e0 con 0x55605342ede0 2023-10-26T06:48:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55605337fc60 con 0x5560534343f0 2023-10-26T06:48:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.883+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55605337d580 con 0x556053434d10 2023-10-26T06:48:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.884+0000 7f69977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 0x55605342f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.884+0000 7f69977fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 0x55605342f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37650/0 (socket says 172.21.15.50:37650) 2023-10-26T06:48:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.884+0000 7f69977fe700 1 -- 172.21.15.50:0/18980377 learned_addr learned my addr 172.21.15.50:0/18980377 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.884+0000 7f6996ffd700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5560534343f0 0x5560534347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.884+0000 7f69967fc700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605342e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69977fe700 1 -- 172.21.15.50:0/18980377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 msgr2=0x55605342e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69977fe700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605342e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69977fe700 1 -- 172.21.15.50:0/18980377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5560534343f0 msgr2=0x5560534347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69977fe700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5560534343f0 0x5560534347d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69977fe700 1 -- 172.21.15.50:0/18980377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560533363f0 con 0x55605342ede0 2023-10-26T06:48:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69967fc700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605342e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.885+0000 7f69977fe700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 0x55605342f260 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6990018560 tx=0x7f6990011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee89ffdd9209e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.886+0000 7f6996ffd700 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5560534343f0 0x5560534347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.886+0000 7f697d7fa700 1 -- 172.21.15.50:0/18980377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699001d070 con 0x55605342ede0 2023-10-26T06:48:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.886+0000 7f697d7fa700 1 -- 172.21.15.50:0/18980377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6990018c80 con 0x55605342ede0 2023-10-26T06:48:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.886+0000 7f697d7fa700 1 -- 172.21.15.50:0/18980377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011070 con 0x55605342ede0 2023-10-26T06:48:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 -- 172.21.15.50:0/18980377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 msgr2=0x55605342f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 0x55605342f260 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6990018560 tx=0x7f6990011000 comp rx=0 tx=0).stop 2023-10-26T06:48:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 -- 172.21.15.50:0/18980377 shutdown_connections 2023-10-26T06:48:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55605342ede0 0x55605342f260 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5560534343f0 0x5560534347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/18980377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605342e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 -- 172.21.15.50:0/18980377 >> 172.21.15.50:0/18980377 conn(0x55605339a720 msgr2=0x556053420b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 -- 172.21.15.50:0/18980377 shutdown_connections 2023-10-26T06:48:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.891+0000 7f69b0f25b80 1 -- 172.21.15.50:0/18980377 wait complete. 2023-10-26T06:48:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.892+0000 7f69b0f25b80 1 -- start start 2023-10-26T06:48:45.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.893+0000 7f69b0f25b80 1 Processor -- start 2023-10-26T06:48:45.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x55605343acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053437fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x5560534385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556053378e70 con 0x5560534343f0 2023-10-26T06:48:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x556053315710 con 0x55605342ede0 2023-10-26T06:48:45.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560533153b0 con 0x556053434d10 2023-10-26T06:48:45.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69b0f25b80 10 client.0 _ll_register_callbacks cb 0x55605325fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x55605343acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x55605343acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48632/0 (socket says 172.21.15.50:48632) 2023-10-26T06:48:45.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f6996ffd700 1 -- 172.21.15.50:0/3632810273 learned_addr learned my addr 172.21.15.50:0/3632810273 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69967fc700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053437fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.894+0000 7f69977fe700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x5560534385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.895+0000 7f6996ffd700 1 -- 172.21.15.50:0/3632810273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 msgr2=0x5560534385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.895+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x5560534385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.895+0000 7f6996ffd700 1 -- 172.21.15.50:0/3632810273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 msgr2=0x556053437fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.895+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053437fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.895+0000 7f6996ffd700 1 -- 172.21.15.50:0/3632810273 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69981a5c30 con 0x55605342ede0 2023-10-26T06:48:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.895+0000 7f69967fc700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053437fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.899+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x55605343acb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6988016000 tx=0x7f69880057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6b3c8db6ffae0b server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.899+0000 7f697aff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.899+0000 7f697aff5700 1 -- 172.21.15.50:0/3632810273 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698801c040 con 0x55605342ede0 2023-10-26T06:48:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.899+0000 7f697aff5700 1 -- 172.21.15.50:0/3632810273 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f698800f9e0 con 0x55605342ede0 2023-10-26T06:48:45.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.900+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55605337def0 con 0x55605342ede0 2023-10-26T06:48:45.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.900+0000 7f697aff5700 1 -- 172.21.15.50:0/3632810273 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f698800fba0 con 0x55605342ede0 2023-10-26T06:48:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f69b0f25b80 10 client.26471 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:45.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f699000ce20 con 0x55605342ede0 2023-10-26T06:48:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f697aff5700 1 -- 172.21.15.50:0/3632810273 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6988030020 con 0x55605342ede0 2023-10-26T06:48:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f697aff5700 1 -- 172.21.15.50:0/3632810273 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f698802a020 con 0x55605342ede0 2023-10-26T06:48:45.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f69b0f25b80 10 client.26471 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:45.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f69b0f25b80 10 client.26471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:45.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f69b0f25b80 20 client.26471 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:45.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.903+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556053459690 0x55605345baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.904+0000 7f69b0f25b80 4 client.26471 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:45.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.904+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55605337def0 con 0x556053459690 2023-10-26T06:48:45.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.904+0000 7f69967fc700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556053459690 0x55605345baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.905+0000 7f69967fc700 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556053459690 0x55605345baf0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203a9b654e763e8d server_cookie=fa25286cd271493b in_seq=0 out_seq=0 2023-10-26T06:48:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.906+0000 7f697aff5700 10 client.26471 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.906+0000 7f697aff5700 1 -- 172.21.15.50:0/3632810273 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55605337def0 con 0x556053459690 2023-10-26T06:48:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.906+0000 7f697aff5700 10 client.26471 handle_command_reply: tid=0 2023-10-26T06:48:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.906+0000 7f69b0f25b80 1 client.26471 shutdown 2023-10-26T06:48:45.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.908+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 msgr2=0x55605343acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.908+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x55605343acb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6988016000 tx=0x7f69880057d0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.908+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 shutdown_connections 2023-10-26T06:48:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.908+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x556053459690 0x55605345baf0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.909+0000 7f697aff5700 0 client.26471 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.909+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x5560534385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.909+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x55605343acb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.909+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3632810273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053437fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.909+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 >> 172.21.15.50:0/3632810273 conn(0x55605339a720 msgr2=0x55605342d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.909+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 shutdown_connections 2023-10-26T06:48:45.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.910+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3632810273 wait complete. 2023-10-26T06:48:45.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.910+0000 7f69b0f25b80 20 client.26471 trim_cache size 0 max 16384 2023-10-26T06:48:45.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.955+0000 7f69b0f25b80 1 Processor -- start 2023-10-26T06:48:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.955+0000 7f69b0f25b80 1 -- start start 2023-10-26T06:48:45.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.955+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x5560534325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053450700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605343a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560531f9920 con 0x5560534343f0 2023-10-26T06:48:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55605342ec40 con 0x55605342ede0 2023-10-26T06:48:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556053421d20 con 0x556053434d10 2023-10-26T06:48:45.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605343a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x5560534325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x5560534325d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48640/0 (socket says 172.21.15.50:48640) 2023-10-26T06:48:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605343a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43912/0 (socket says 172.21.15.50:43912) 2023-10-26T06:48:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f6996ffd700 1 -- 172.21.15.50:0/3155752528 learned_addr learned my addr 172.21.15.50:0/3155752528 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.956+0000 7f69967fc700 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053450700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f6996ffd700 1 -- 172.21.15.50:0/3155752528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 msgr2=0x55605343a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605343a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f6996ffd700 1 -- 172.21.15.50:0/3155752528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 msgr2=0x556053450700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f69977fe700 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605343a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-26T06:48:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053450700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f6996ffd700 1 -- 172.21.15.50:0/3155752528 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560531a3de0 con 0x55605342ede0 2023-10-26T06:48:45.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f69967fc700 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053450700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.957+0000 7f6996ffd700 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x5560534325d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f698800b580 tx=0x7f6988004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78929f33e1db64f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.958+0000 7f697dffb700 1 -- 172.21.15.50:0/3155752528 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698801c040 con 0x55605342ede0 2023-10-26T06:48:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.959+0000 7f697dffb700 1 -- 172.21.15.50:0/3155752528 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6988030070 con 0x55605342ede0 2023-10-26T06:48:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.959+0000 7f697dffb700 1 -- 172.21.15.50:0/3155752528 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800b9d0 con 0x55605342ede0 2023-10-26T06:48:45.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.960+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3155752528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 msgr2=0x5560534325d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.960+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x5560534325d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f698800b580 tx=0x7f6988004d30 comp rx=0 tx=0).stop 2023-10-26T06:48:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3155752528 shutdown_connections 2023-10-26T06:48:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556053434d10 0x55605343a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x5560534325d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/3155752528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5560534343f0 0x556053450700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3155752528 >> 172.21.15.50:0/3155752528 conn(0x55605339a720 msgr2=0x556053431ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3155752528 shutdown_connections 2023-10-26T06:48:45.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.961+0000 7f69b0f25b80 1 -- 172.21.15.50:0/3155752528 wait complete. 2023-10-26T06:48:45.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.962+0000 7f69b0f25b80 1 -- start start 2023-10-26T06:48:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.962+0000 7f69b0f25b80 1 Processor -- start 2023-10-26T06:48:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x556053450210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560534343f0 0x55605344e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556053434d10 0x55605344ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x556053450b20 con 0x556053434d10 2023-10-26T06:48:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55605344f160 con 0x55605342ede0 2023-10-26T06:48:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55605344f2d0 con 0x5560534343f0 2023-10-26T06:48:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.963+0000 7f69b0f25b80 10 client.0 _ll_register_callbacks cb 0x55605325fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.964+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x556053450210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.964+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x556053450210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48656/0 (socket says 172.21.15.50:48656) 2023-10-26T06:48:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.964+0000 7f6996ffd700 1 -- 172.21.15.50:0/501426104 learned_addr learned my addr 172.21.15.50:0/501426104 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.964+0000 7f69977fe700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556053434d10 0x55605344ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.965+0000 7f69967fc700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560534343f0 0x55605344e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.967+0000 7f6996ffd700 1 -- 172.21.15.50:0/501426104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560534343f0 msgr2=0x55605344e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.967+0000 7f6996ffd700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560534343f0 0x55605344e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.967+0000 7f6996ffd700 1 -- 172.21.15.50:0/501426104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556053434d10 msgr2=0x55605344ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:45.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.968+0000 7f6996ffd700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556053434d10 0x55605344ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.971+0000 7f6996ffd700 1 -- 172.21.15.50:0/501426104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699000ce20 con 0x55605342ede0 2023-10-26T06:48:45.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.971+0000 7f69977fe700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556053434d10 0x55605344ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:45.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.976+0000 7f6996ffd700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x556053450210 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6988004b40 tx=0x7f6988005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d006440956a3ed1e server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:45.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.977+0000 7f697aff5700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:45.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.977+0000 7f697aff5700 1 -- 172.21.15.50:0/501426104 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698801c070 con 0x55605342ede0 2023-10-26T06:48:45.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.977+0000 7f697aff5700 1 -- 172.21.15.50:0/501426104 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6988000e40 con 0x55605342ede0 2023-10-26T06:48:45.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.977+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6990018c80 con 0x55605342ede0 2023-10-26T06:48:45.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.978+0000 7f697aff5700 1 -- 172.21.15.50:0/501426104 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f698800b6b0 con 0x55605342ede0 2023-10-26T06:48:45.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.978+0000 7f69b0f25b80 10 client.26477 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:45.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.978+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55605318cc60 con 0x55605342ede0 2023-10-26T06:48:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.978+0000 7f697aff5700 1 -- 172.21.15.50:0/501426104 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f698804b020 con 0x55605342ede0 2023-10-26T06:48:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f697aff5700 1 -- 172.21.15.50:0/501426104 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6988045020 con 0x55605342ede0 2023-10-26T06:48:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f69b0f25b80 10 client.26477 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f69b0f25b80 10 client.26477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:45.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f69b0f25b80 20 client.26477 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:45.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5560534ae4a0 0x5560534b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:45.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f69b0f25b80 4 client.26477 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:48:45.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.979+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f6990018c80 con 0x5560534ae4a0 2023-10-26T06:48:45.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.980+0000 7f69967fc700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5560534ae4a0 0x5560534b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:45.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f697aff5700 10 client.26477 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f69967fc700 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5560534ae4a0 0x5560534b08c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e990cf7c9e0c7134 server_cookie=1788884eab382da1 in_seq=0 out_seq=0 2023-10-26T06:48:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f697aff5700 1 -- 172.21.15.50:0/501426104 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f6990018c80 con 0x5560534ae4a0 2023-10-26T06:48:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f697aff5700 10 client.26477 handle_command_reply: tid=0 2023-10-26T06:48:45.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f69b0f25b80 1 client.26477 shutdown 2023-10-26T06:48:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 msgr2=0x556053450210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.984+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x556053450210 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6988004b40 tx=0x7f6988005730 comp rx=0 tx=0).stop 2023-10-26T06:48:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 shutdown_connections 2023-10-26T06:48:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5560534ae4a0 0x5560534b08c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556053434d10 0x55605344ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55605342ede0 0x556053450210 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 --2- 172.21.15.50:0/501426104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560534343f0 0x55605344e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 >> 172.21.15.50:0/501426104 conn(0x55605339a720 msgr2=0x55605341a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f697aff5700 0 client.26477 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:45.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 shutdown_connections 2023-10-26T06:48:45.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 1 -- 172.21.15.50:0/501426104 wait complete. 2023-10-26T06:48:45.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.985+0000 7f69b0f25b80 20 client.26477 trim_cache size 0 max 16384 2023-10-26T06:48:45.990 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:48:45.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69800a1670 msgr2=0x7f69800a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69800a1670 0x7f69800a3b30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f699000c450 tx=0x7f6990009570 comp rx=0 tx=0).stop 2023-10-26T06:48:45.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 msgr2=0x7f6998199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:45.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 0x7f6998199400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f698c00d980 tx=0x7f698c00dd40 comp rx=0 tx=0).stop 2023-10-26T06:48:45.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 shutdown_connections 2023-10-26T06:48:45.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f69800a1670 0x7f69800a3b30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6998105b30 0x7f699819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6998067d40 0x7f6998198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 --2- 172.21.15.50:0/3387090109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6998105170 0x7f6998199400 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:45.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.995+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 >> 172.21.15.50:0/3387090109 conn(0x7f69980767f0 msgr2=0x7f699810bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:45.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.998+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 shutdown_connections 2023-10-26T06:48:45.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:45.998+0000 7f699d5ff700 1 -- 172.21.15.50:0/3387090109 wait complete. 2023-10-26T06:48:46.122 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/ioctl.o 2023-10-26T06:48:46.249 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evglock.o 2023-10-26T06:48:46.442 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/drbg.o 2023-10-26T06:48:46.623 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/signal_compat.o 2023-10-26T06:48:46.697 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evhandler.o 2023-10-26T06:48:46.710 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/time.o 2023-10-26T06:48:46.726 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/clock.o 2023-10-26T06:48:46.857 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/iomap/direct-io.o 2023-10-26T06:48:46.925 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/swap_slots.o 2023-10-26T06:48:46.999 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/genhd.o 2023-10-26T06:48:47.048 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-26T06:48:47.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-26T06:48:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:46 smithi125 ceph-mon[130643]: pgmap v472: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.0 MiB/s wr, 76 op/s 2023-10-26T06:48:47.191 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/traps.o 2023-10-26T06:48:47.204 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evmisc.o 2023-10-26T06:48:47.213 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:46 smithi050 ceph-mon[94997]: pgmap v472: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.0 MiB/s wr, 76 op/s 2023-10-26T06:48:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:46 smithi153 ceph-mon[131657]: pgmap v472: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.0 MiB/s wr, 76 op/s 2023-10-26T06:48:47.432 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/jitterentropy.o 2023-10-26T06:48:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 -- 172.21.15.50:0/4013744234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f270010f380 msgr2=0x7f2700107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 --2- 172.21.15.50:0/4013744234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f270010f380 0x7f2700107d30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f26f40098f0 tx=0x7f26f4009c00 comp rx=0 tx=0).stop 2023-10-26T06:48:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 -- 172.21.15.50:0/4013744234 shutdown_connections 2023-10-26T06:48:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 --2- 172.21.15.50:0/4013744234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2700119fd0 0x7f270011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 --2- 172.21.15.50:0/4013744234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 --2- 172.21.15.50:0/4013744234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f270010f380 0x7f2700107d30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.549+0000 7f27069ff700 1 -- 172.21.15.50:0/4013744234 >> 172.21.15.50:0/4013744234 conn(0x7f270006b840 msgr2=0x7f270006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.550+0000 7f27069ff700 1 -- 172.21.15.50:0/4013744234 shutdown_connections 2023-10-26T06:48:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.550+0000 7f27069ff700 1 -- 172.21.15.50:0/4013744234 wait complete. 2023-10-26T06:48:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.551+0000 7f27069ff700 1 Processor -- start 2023-10-26T06:48:47.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.554+0000 7f27069ff700 1 -- start start 2023-10-26T06:48:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.554+0000 7f27069ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.554+0000 7f27069ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f270010f380 0x7f27001abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.554+0000 7f27069ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700119fd0 0x7f27001a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.554+0000 7f27069ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001a5e40 con 0x7f270010f380 2023-10-26T06:48:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f27069ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001a5fb0 con 0x7f2700119fd0 2023-10-26T06:48:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f27069ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001a6170 con 0x7f270010ef10 2023-10-26T06:48:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f2704f9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700119fd0 0x7f27001a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43942/0 (socket says 172.21.15.50:43942) 2023-10-26T06:48:47.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 -- 172.21.15.50:0/2935102653 learned_addr learned my addr 172.21.15.50:0/2935102653 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:47.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f270010f380 0x7f27001abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 -- 172.21.15.50:0/2935102653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700119fd0 msgr2=0x7f27001a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700119fd0 0x7f27001a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 -- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f270010f380 msgr2=0x7f27001abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.555+0000 7f26fffff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f270010f380 0x7f27001abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.556+0000 7f26fffff700 1 -- 172.21.15.50:0/2935102653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0009520 con 0x7f270010ef10 2023-10-26T06:48:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.556+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f270010f380 0x7f27001abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.556+0000 7f26fffff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001ab6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26f000eb30 tx=0x7f26f000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.556+0000 7f26fd7fa700 1 -- 172.21.15.50:0/2935102653 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000cc90 con 0x7f270010ef10 2023-10-26T06:48:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.556+0000 7f26fd7fa700 1 -- 172.21.15.50:0/2935102653 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f00044e0 con 0x7f270010ef10 2023-10-26T06:48:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.556+0000 7f26fd7fa700 1 -- 172.21.15.50:0/2935102653 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0003e30 con 0x7f270010ef10 2023-10-26T06:48:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.558+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f4009520 con 0x7f270010ef10 2023-10-26T06:48:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.559+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27001b24b0 con 0x7f270010ef10 2023-10-26T06:48:47.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.566+0000 7f271a3cdb80 1 Processor -- start 2023-10-26T06:48:47.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.567+0000 7f26fd7fa700 1 -- 172.21.15.50:0/2935102653 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f26f0004020 con 0x7f270010ef10 2023-10-26T06:48:47.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.569+0000 7f271a3cdb80 1 -- start start 2023-10-26T06:48:47.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.571+0000 7f26fd7fa700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1780 0x7f26e80a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.572+0000 7f26fd7fa700 1 -- 172.21.15.50:0/2935102653 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f26f0014070 con 0x7f270010ef10 2023-10-26T06:48:47.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.573+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1780 0x7f26e80a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.574+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cf0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.574+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.574+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57ceaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.574+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57c5d760 con 0x559a57cea650 2023-10-26T06:48:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.574+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57c43ce0 con 0x559a57cf0580 2023-10-26T06:48:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.574+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57c41600 con 0x559a57cefc60 2023-10-26T06:48:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.575+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.575+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1780 0x7f26e80a3c40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27001ac3a0 tx=0x7f26f8009150 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.575+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cea110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48676/0 (socket says 172.21.15.50:48676) 2023-10-26T06:48:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.575+0000 7f26ff7fe700 1 -- 172.21.15.50:0/2695216475 learned_addr learned my addr 172.21.15.50:0/2695216475 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.576+0000 7f26ff7fe700 1 -- 172.21.15.50:0/2695216475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 msgr2=0x559a57cf0040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.576+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cf0040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.576+0000 7f26ff7fe700 1 -- 172.21.15.50:0/2695216475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 msgr2=0x559a57ceaad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.576+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57ceaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.577+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57ceaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.577+0000 7f26ff7fe700 1 -- 172.21.15.50:0/2695216475 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a57bfa470 con 0x559a57cf0580 2023-10-26T06:48:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.577+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57ceaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.577+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cea110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f26f4016000 tx=0x7f26f400bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc66f45ca4d20eec server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.578+0000 7f26e67fc700 1 -- 172.21.15.50:0/2695216475 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f401c070 con 0x559a57cf0580 2023-10-26T06:48:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.578+0000 7f26e67fc700 1 -- 172.21.15.50:0/2695216475 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f400f460 con 0x559a57cf0580 2023-10-26T06:48:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.578+0000 7f26e67fc700 1 -- 172.21.15.50:0/2695216475 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400ba20 con 0x559a57cf0580 2023-10-26T06:48:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.579+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2695216475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 msgr2=0x559a57cea110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.579+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cea110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f26f4016000 tx=0x7f26f400bef0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.580+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2695216475 shutdown_connections 2023-10-26T06:48:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.580+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57ceaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.580+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cf0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.580+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2695216475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cea110 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.580+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2695216475 >> 172.21.15.50:0/2695216475 conn(0x559a57c5e7a0 msgr2=0x559a57ce4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.581+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2695216475 shutdown_connections 2023-10-26T06:48:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.581+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2695216475 wait complete. 2023-10-26T06:48:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.582+0000 7f271a3cdb80 1 -- start start 2023-10-26T06:48:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.582+0000 7f271a3cdb80 1 Processor -- start 2023-10-26T06:48:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cf6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cefc60 0x559a57cf38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cf0580 0x559a57cf3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57c3cef0 con 0x559a57cefc60 2023-10-26T06:48:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57bd9790 con 0x559a57cea650 2023-10-26T06:48:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57bd9430 con 0x559a57cf0580 2023-10-26T06:48:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f271a3cdb80 10 client.0 _ll_register_callbacks cb 0x559a57b23b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.586+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cf6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cefc60 0x559a57cf38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cf6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48688/0 (socket says 172.21.15.50:48688) 2023-10-26T06:48:47.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 -- 172.21.15.50:0/1526690696 learned_addr learned my addr 172.21.15.50:0/1526690696 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 -- 172.21.15.50:0/1526690696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cf0580 msgr2=0x559a57cf3f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cf0580 0x559a57cf3f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 -- 172.21.15.50:0/1526690696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cefc60 msgr2=0x559a57cf38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cefc60 0x559a57cf38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26fffff700 1 -- 172.21.15.50:0/1526690696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270011cd40 con 0x559a57cea650 2023-10-26T06:48:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.587+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cefc60 0x559a57cf38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.588+0000 7f26fffff700 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cf6560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26f000eb00 tx=0x7f26f0099690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3373561064620a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.588+0000 7f26df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.588+0000 7f26df7fe700 1 -- 172.21.15.50:0/1526690696 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000ce80 con 0x559a57cea650 2023-10-26T06:48:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.588+0000 7f26df7fe700 1 -- 172.21.15.50:0/1526690696 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f26f00152d0 con 0x559a57cea650 2023-10-26T06:48:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.589+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a57c41f70 con 0x559a57cea650 2023-10-26T06:48:47.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.592+0000 7f26df7fe700 1 -- 172.21.15.50:0/1526690696 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26f0099f40 con 0x559a57cea650 2023-10-26T06:48:47.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.592+0000 7f271a3cdb80 10 client.26489 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:47.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.592+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559a57a67e60 con 0x559a57cea650 2023-10-26T06:48:47.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.593+0000 7f26df7fe700 1 -- 172.21.15.50:0/1526690696 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a57c41f70 con 0x559a57cea650 2023-10-26T06:48:47.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.594+0000 7f26df7fe700 1 -- 172.21.15.50:0/1526690696 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f26f00a1740 con 0x559a57cea650 2023-10-26T06:48:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.594+0000 7f271a3cdb80 10 client.26489 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:47.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.594+0000 7f271a3cdb80 10 client.26489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.595+0000 7f271a3cdb80 20 client.26489 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.595+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d03f20 0x559a57d06340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.595+0000 7f271a3cdb80 4 client.26489 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:47.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.595+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a57cb9930 con 0x559a57d03f20 2023-10-26T06:48:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.596+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d03f20 0x559a57d06340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.597+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d03f20 0x559a57d06340 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb4e2f33c6c4606a server_cookie=eda0995ddef9d4 in_seq=0 out_seq=0 2023-10-26T06:48:47.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.597+0000 7f26df7fe700 10 client.26489 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:47.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.599+0000 7f26df7fe700 1 -- 172.21.15.50:0/1526690696 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a57cb9930 con 0x559a57d03f20 2023-10-26T06:48:47.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.599+0000 7f26df7fe700 10 client.26489 handle_command_reply: tid=0 2023-10-26T06:48:47.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.599+0000 7f271a3cdb80 1 client.26489 shutdown 2023-10-26T06:48:47.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.601+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 msgr2=0x559a57cf6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.601+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cf6560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26f000eb00 tx=0x7f26f0099690 comp rx=0 tx=0).stop 2023-10-26T06:48:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 shutdown_connections 2023-10-26T06:48:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d03f20 0x559a57d06340 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cf0580 0x559a57cf3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cf6560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1526690696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cefc60 0x559a57cf38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 >> 172.21.15.50:0/1526690696 conn(0x559a57c5e7a0 msgr2=0x559a57ce9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:47.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f26df7fe700 0 client.26489 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:47.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 shutdown_connections 2023-10-26T06:48:47.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.602+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1526690696 wait complete. 2023-10-26T06:48:47.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.603+0000 7f271a3cdb80 20 client.26489 trim_cache size 0 max 16384 2023-10-26T06:48:47.624 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/jitterentropy-kcapi.o 2023-10-26T06:48:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.639+0000 7f271a3cdb80 1 Processor -- start 2023-10-26T06:48:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 -- start start 2023-10-26T06:48:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cedeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cf0580 0x559a57cee970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57abd9a0 con 0x559a57cf0580 2023-10-26T06:48:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57cb9930 con 0x559a57cea650 2023-10-26T06:48:47.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.640+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57c41f70 con 0x559a57cefc60 2023-10-26T06:48:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.642+0000 7f2704f9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cf0580 0x559a57cee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.642+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cedeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.642+0000 7f26fffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cedeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48694/0 (socket says 172.21.15.50:48694) 2023-10-26T06:48:47.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.642+0000 7f26fffff700 1 -- 172.21.15.50:0/1475721358 learned_addr learned my addr 172.21.15.50:0/1475721358 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.642+0000 7f26ff7fe700 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.643+0000 7f26fffff700 1 -- 172.21.15.50:0/1475721358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 msgr2=0x559a57cfaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.643+0000 7f26fffff700 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.643+0000 7f26fffff700 1 -- 172.21.15.50:0/1475721358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cf0580 msgr2=0x559a57cee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.643+0000 7f26fffff700 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cf0580 0x559a57cee970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.643+0000 7f26fffff700 1 -- 172.21.15.50:0/1475721358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a57a50ce0 con 0x559a57cea650 2023-10-26T06:48:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.643+0000 7f26fffff700 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cedeb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f26f0003fb0 tx=0x7f26f0099400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631320d5ed566c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.644+0000 7f26e6ffd700 1 -- 172.21.15.50:0/1475721358 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00152d0 con 0x559a57cea650 2023-10-26T06:48:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.644+0000 7f26e6ffd700 1 -- 172.21.15.50:0/1475721358 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f0099f40 con 0x559a57cea650 2023-10-26T06:48:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.644+0000 7f26e6ffd700 1 -- 172.21.15.50:0/1475721358 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0098d30 con 0x559a57cea650 2023-10-26T06:48:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.644+0000 7f2704f9c700 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cf0580 0x559a57cee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.648+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1475721358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 msgr2=0x559a57cedeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.648+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cedeb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f26f0003fb0 tx=0x7f26f0099400 comp rx=0 tx=0).stop 2023-10-26T06:48:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1475721358 shutdown_connections 2023-10-26T06:48:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cf0580 0x559a57cee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cea650 0x559a57cedeb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/1475721358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1475721358 >> 172.21.15.50:0/1475721358 conn(0x559a57c5e7a0 msgr2=0x559a57ced7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1475721358 shutdown_connections 2023-10-26T06:48:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.649+0000 7f271a3cdb80 1 -- 172.21.15.50:0/1475721358 wait complete. 2023-10-26T06:48:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.650+0000 7f271a3cdb80 1 -- start start 2023-10-26T06:48:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.650+0000 7f271a3cdb80 1 Processor -- start 2023-10-26T06:48:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.653+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57cfa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.653+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.653+0000 7f271a3cdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cfac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f2704f9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cfac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57d51d70 con 0x559a57cea650 2023-10-26T06:48:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57d51ee0 con 0x559a57cf0580 2023-10-26T06:48:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f271a3cdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a57d520a0 con 0x559a57cefc60 2023-10-26T06:48:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f271a3cdb80 10 client.0 _ll_register_callbacks cb 0x559a57b23b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f2704f9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cfac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48704/0 (socket says 172.21.15.50:48704) 2023-10-26T06:48:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.654+0000 7f2704f9c700 1 -- 172.21.15.50:0/2966177592 learned_addr learned my addr 172.21.15.50:0/2966177592 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f2704f9c700 1 -- 172.21.15.50:0/2966177592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 msgr2=0x559a57cfa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:47.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f2704f9c700 1 -- 172.21.15.50:0/2966177592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 msgr2=0x559a57cfa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f26fffff700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57cfa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57cfa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f2704f9c700 1 -- 172.21.15.50:0/2966177592 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a57a67e60 con 0x559a57cf0580 2023-10-26T06:48:47.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.655+0000 7f26fffff700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57cfa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.656+0000 7f2704f9c700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cfac90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f26f8003b50 tx=0x7f26f8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75cecb4c5fd0aab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.656+0000 7f26df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:48:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.656+0000 7f26df7fe700 1 -- 172.21.15.50:0/2966177592 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8004930 con 0x559a57cf0580 2023-10-26T06:48:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.657+0000 7f26df7fe700 1 -- 172.21.15.50:0/2966177592 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f26f8015850 con 0x559a57cf0580 2023-10-26T06:48:47.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.657+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26f400f460 con 0x559a57cf0580 2023-10-26T06:48:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.657+0000 7f26df7fe700 1 -- 172.21.15.50:0/2966177592 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26f8015a10 con 0x559a57cf0580 2023-10-26T06:48:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.657+0000 7f271a3cdb80 10 client.26495 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.657+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559a57a8e2d0 con 0x559a57cf0580 2023-10-26T06:48:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.658+0000 7f26df7fe700 1 -- 172.21.15.50:0/2966177592 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f801c040 con 0x559a57cf0580 2023-10-26T06:48:47.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f26df7fe700 1 -- 172.21.15.50:0/2966177592 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f26f802c400 con 0x559a57cf0580 2023-10-26T06:48:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f271a3cdb80 10 client.26495 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f271a3cdb80 10 client.26495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f271a3cdb80 20 client.26495 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d6ada0 0x559a57d6d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:47.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f271a3cdb80 4 client.26495 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-26T06:48:47.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.659+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f26f400f460 con 0x559a57d6ada0 2023-10-26T06:48:47.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.660+0000 7f26fffff700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d6ada0 0x559a57d6d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.660+0000 7f26df7fe700 10 client.26495 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.661+0000 7f26fffff700 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d6ada0 0x559a57d6d190 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8c7ad88f7ab627 server_cookie=4fc2518a7de6c9f2 in_seq=0 out_seq=0 2023-10-26T06:48:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.663+0000 7f26df7fe700 1 -- 172.21.15.50:0/2966177592 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f26f400f460 con 0x559a57d6ada0 2023-10-26T06:48:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.663+0000 7f26df7fe700 10 client.26495 handle_command_reply: tid=0 2023-10-26T06:48:47.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.663+0000 7f271a3cdb80 1 client.26495 shutdown 2023-10-26T06:48:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.663+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 msgr2=0x559a57cfac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.663+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cfac90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f26f8003b50 tx=0x7f26f8004b40 comp rx=0 tx=0).stop 2023-10-26T06:48:47.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 shutdown_connections 2023-10-26T06:48:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x559a57d6ada0 0x559a57d6d190 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559a57cf0580 0x559a57cfac90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a57cea650 0x559a57cfa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f271a3cdb80 1 --2- 172.21.15.50:0/2966177592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559a57cefc60 0x559a57cfa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f26df7fe700 0 client.26495 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:47.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.664+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 >> 172.21.15.50:0/2966177592 conn(0x559a57c5e7a0 msgr2=0x559a57cde530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:47.668 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/dmapool.o 2023-10-26T06:48:47.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.666+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 shutdown_connections 2023-10-26T06:48:47.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.666+0000 7f271a3cdb80 1 -- 172.21.15.50:0/2966177592 wait complete. 2023-10-26T06:48:47.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.666+0000 7f271a3cdb80 20 client.26495 trim_cache size 0 max 16384 2023-10-26T06:48:47.670 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:48:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-10-26T06:48:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "d3d25360-c249-4964-8c3c-489ae63c57dd", 2023-10-26T06:48:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-10-26T06:48:47.670 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:48:47.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.669+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1780 msgr2=0x7f26e80a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.669+0000 7f27069ff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1780 0x7f26e80a3c40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27001ac3a0 tx=0x7f26f8009150 comp rx=0 tx=0).stop 2023-10-26T06:48:47.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.669+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 msgr2=0x7f27001ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:47.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.669+0000 7f27069ff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001ab6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26f000eb30 tx=0x7f26f000ee40 comp rx=0 tx=0).stop 2023-10-26T06:48:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.673+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 shutdown_connections 2023-10-26T06:48:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.673+0000 7f27069ff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f26e80a1780 0x7f26e80a3c40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.673+0000 7f27069ff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2700119fd0 0x7f27001a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.673+0000 7f27069ff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f270010ef10 0x7f27001ab6a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.673+0000 7f27069ff700 1 --2- 172.21.15.50:0/2935102653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f270010f380 0x7f27001abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:47.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.673+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 >> 172.21.15.50:0/2935102653 conn(0x7f270006b840 msgr2=0x7f2700117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.674+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 shutdown_connections 2023-10-26T06:48:47.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:47.674+0000 7f27069ff700 1 -- 172.21.15.50:0/2935102653 wait complete. 2023-10-26T06:48:47.683 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evregion.o 2023-10-26T06:48:47.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:48:47.813 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/timer.o 2023-10-26T06:48:47.814 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/iomap/fiemap.o 2023-10-26T06:48:47.840 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/cputime.o 2023-10-26T06:48:48.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:47 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:48:48.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:47 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:48:48.100 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.096+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003711 [...7,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ auth{0=1,2=1} v20289 ap=1 f(v0 m2023-10-26T06:47:45.451151+0000 89=81+8) n(v4 rc2023-10-26T06:48:47.538637+0000 b4336769 376=367+9) old_inodes=3 (isnap sync r=2) (inest mix dirty) (ipolicy sync r=1) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | dirtyscattered=1 lock=2 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55e12f316000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003711:[<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(2)0x10000003711:[<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:47:45.451151+0000 89=81+8)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:48:47.538637+0000 b4336769 376=367+9)","memory_value.dirstat":"f(v0 m2023-10-26T06:47:45.451151+0000 89=81+8)","memory_value.rstat":"n(v4 rc2023-10-26T06:48:47.538637+0000 b4336769 376=367+9)","error_str":""},"return_code":0} 2023-10-26T06:48:48.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:47 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:48:48.424 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/idt.o 2023-10-26T06:48:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.455+0000 7fa9c97ff700 1 -- 172.21.15.50:0/3652159843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c4108110 msgr2=0x7fa9c410bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.455+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/3652159843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c4108110 0x7fa9c410bdd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80098f0 tx=0x7fa9b8009c00 comp rx=0 tx=0).stop 2023-10-26T06:48:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.456+0000 7fa9c97ff700 1 -- 172.21.15.50:0/3652159843 shutdown_connections 2023-10-26T06:48:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.456+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/3652159843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c410c310 0x7fa9c410c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.456+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/3652159843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c4107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.456+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/3652159843 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c4108110 0x7fa9c410bdd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.456+0000 7fa9c97ff700 1 -- 172.21.15.50:0/3652159843 >> 172.21.15.50:0/3652159843 conn(0x7fa9c406bc20 msgr2=0x7fa9c406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.458+0000 7fa9c97ff700 1 -- 172.21.15.50:0/3652159843 shutdown_connections 2023-10-26T06:48:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.458+0000 7fa9c97ff700 1 -- 172.21.15.50:0/3652159843 wait complete. 2023-10-26T06:48:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.460+0000 7fa9c97ff700 1 Processor -- start 2023-10-26T06:48:48.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.462+0000 7fa9c97ff700 1 -- start start 2023-10-26T06:48:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c97ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c419d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c97ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c4108110 0x7fa9c419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c97ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 0x7fa9c41a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c97ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c41a21f0 con 0x7fa9c4108110 2023-10-26T06:48:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c97ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c41a2360 con 0x7fa9c410c310 2023-10-26T06:48:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c97ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c41a2520 con 0x7fa9c41077f0 2023-10-26T06:48:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.463+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 0x7fa9c41a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.464+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c419d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.464+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c419d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:43996/0 (socket says 172.21.15.50:43996) 2023-10-26T06:48:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.464+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1328209778 learned_addr learned my addr 172.21.15.50:0/1328209778 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.464+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c4108110 0x7fa9c419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.465+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1328209778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 msgr2=0x7fa9c41a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.464+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 0x7fa9c41a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48718/0 (socket says 172.21.15.50:48718) 2023-10-26T06:48:48.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.467+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 0x7fa9c41a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.467+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c4108110 msgr2=0x7fa9c419d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.467+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c4108110 0x7fa9c419d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.467+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/1328209778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8009520 con 0x7fa9c41077f0 2023-10-26T06:48:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.468+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c4108110 0x7fa9c419d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:48:48.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.468+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 0x7fa9c41a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:48.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.469+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c419d2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400ffc0 tx=0x7fa9b4015f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.472+0000 7fa9abfff700 1 -- 172.21.15.50:0/1328209778 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4013e00 con 0x7fa9c41077f0 2023-10-26T06:48:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.472+0000 7fa9abfff700 1 -- 172.21.15.50:0/1328209778 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9b4017040 con 0x7fa9c41077f0 2023-10-26T06:48:48.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.472+0000 7fa9abfff700 1 -- 172.21.15.50:0/1328209778 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b401c7c0 con 0x7fa9c41077f0 2023-10-26T06:48:48.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.474+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c41a2800 con 0x7fa9c41077f0 2023-10-26T06:48:48.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.476+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c41aa040 con 0x7fa9c41077f0 2023-10-26T06:48:48.480 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evrgnini.o 2023-10-26T06:48:48.485 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.121+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003604 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig auth v507 ap=1 s=6312 n(v0 rc2023-10-26T06:45:46.966040+0000 b6312 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003604:[<0x10000003603/Kconfig v507>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003604:[<0x10000003603/Kconfig v507>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.485 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.122+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000345c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partition-generic.c auth v573 ap=1 s=17848 n(v0 rc2019-11-25T00:32:01.000000+0000 b17848 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000345c:[<0x10000003603/partition-generic.c v573>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000345c:[<0x10000003603/partition-generic.c v573>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.485 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.122+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000345a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/mq-deadline.c auth v493 ap=1 s=21123 n(v0 rc2019-11-25T00:32:01.000000+0000 b21123 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000345a:[<0x10000003603/mq-deadline.c v493>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000345a:[<0x10000003603/mq-deadline.c v493>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.485 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.123+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003435 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.c auth v435 ap=1 s=25013 n(v0 rc2019-11-25T00:32:01.000000+0000 b25013 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003435:[<0x10000003603/blk-mq-debugfs.c v435>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003435:[<0x10000003603/blk-mq-debugfs.c v435>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.485 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.123+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003444 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.h auth v487 ap=1 s=5075 n(v0 rc2019-11-25T00:32:01.000000+0000 b5075 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003444:[<0x10000003603/blk-rq-qos.h v487>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003444:[<0x10000003603/blk-rq-qos.h v487>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.486 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.123+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003432 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-merge.c auth v501 ap=1 s=24473 n(v0 rc2023-10-26T06:45:46.972040+0000 b24473 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003432:[<0x10000003603/blk-merge.c v501>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003432:[<0x10000003603/blk-merge.c v501>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.486 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.124+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003441 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.c auth v529 ap=1 s=6785 n(v0 rc2023-10-26T06:45:46.974040+0000 b6785 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003441:[<0x10000003603/blk-pm.c v529>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003441:[<0x10000003603/blk-pm.c v529>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.487 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.124+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000342b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-flush.c auth v563 ap=1 s=14893 n(v0 rc2019-11-25T00:32:01.000000+0000 b14893 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000342b:[<0x10000003603/blk-flush.c v563>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000342b:[<0x10000003603/blk-flush.c v563>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.487 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.124+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003455 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/elevator.c auth v421 ap=1 s=19064 n(v0 rc2019-11-25T00:32:01.000000+0000 b19064 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133512000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003455:[<0x10000003603/elevator.c v421>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003455:[<0x10000003603/elevator.c v421>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.488 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.124+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003445 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-settings.c auth v457 ap=1 s=28711 n(v0 rc2019-11-25T00:32:01.000000+0000 b28711 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133512580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003445:[<0x10000003603/blk-settings.c v457>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003445:[<0x10000003603/blk-settings.c v457>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.489 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.125+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000344d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.h auth v419 ap=1 s=2940 n(v0 rc2023-10-26T06:45:46.977039+0000 b2940 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133513b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000344d:[<0x10000003603/blk-wbt.h v419>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000344d:[<0x10000003603/blk-wbt.h v419>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.489 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.125+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000343d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.h auth v467 ap=1 s=2359 n(v0 rc2019-11-25T00:32:01.000000+0000 b2359 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133513080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000343d:[<0x10000003603/blk-mq-tag.h v467>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000343d:[<0x10000003603/blk-mq-tag.h v467>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.490 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.125+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003442 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.h auth v585 ap=1 s=1440 n(v0 rc2019-11-25T00:32:01.000000+0000 b1440 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003442:[<0x10000003603/blk-pm.h v585>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003442:[<0x10000003603/blk-pm.h v585>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.490 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.126+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003428 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-cgroup.c auth v439 ap=1 s=49003 n(v0 rc2019-11-25T00:32:01.000000+0000 b49003 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133514680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003428:[<0x10000003603/blk-cgroup.c v439>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003428:[<0x10000003603/blk-cgroup.c v439>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.490 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.126+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003422 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-cgroup.c auth v497 ap=1 s=37779 n(v0 rc2019-11-25T00:32:01.000000+0000 b37779 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133515180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003422:[<0x10000003603/bfq-cgroup.c v497>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003422:[<0x10000003603/bfq-cgroup.c v497>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.490 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.126+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003436 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.h auth v591 ap=1 s=2737 n(v0 rc2019-11-25T00:32:01.000000+0000 b2737 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133513600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003436:[<0x10000003603/blk-mq-debugfs.h v591>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003436:[<0x10000003603/blk-mq-debugfs.h v591>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.491 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.126+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000343b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sysfs.c auth v523 ap=1 s=8589 n(v0 rc2023-10-26T06:45:46.973040+0000 b8589 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13354a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000343b:[<0x10000003603/blk-mq-sysfs.c v523>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000343b:[<0x10000003603/blk-mq-sysfs.c v523>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.491 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.127+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003434 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs-zoned.c auth v499 ap=1 s=435 n(v0 rc2019-11-25T00:32:01.000000+0000 b435 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133515700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003434:[<0x10000003603/blk-mq-debugfs-zoned.c v499>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003434:[<0x10000003603/blk-mq-debugfs-zoned.c v499>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.491 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.127+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003438 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-rdma.c auth v411 ap=1 s=1332 n(v0 rc2019-11-25T00:32:01.000000+0000 b1332 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13354ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003438:[<0x10000003603/blk-mq-rdma.c v411>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003438:[<0x10000003603/blk-mq-rdma.c v411>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.491 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.128+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003457 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioctl.c auth v553 ap=1 s=15728 n(v0 rc2019-11-25T00:32:01.000000+0000 b15728 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13354cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003457:[<0x10000003603/ioctl.c v553>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003457:[<0x10000003603/ioctl.c v553>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.491 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.129+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000344f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk.h auth v491 ap=1 s=10954 n(v0 rc2019-11-25T00:32:01.000000+0000 b10954 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133ccc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000344f:[<0x10000003603/blk.h v491>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000344f:[<0x10000003603/blk.h v491>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.492 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.130+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003605 [...7,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ auth{2=1} v674 ap=1 f(v0 m2023-10-26T06:48:27.761119+0000 46=46+0) n(v0 rc2023-10-26T06:48:27.761119+0000 b168048 47=46+1) old_inodes=2 (inest mix) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=0 authpin=1 discoverbase=0 scrubqueue=0 0x55e12f30a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003605:[<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(2)0x10000003605:[<0x10000003603/partitions v674>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:48:27.761119+0000 46=46+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:48:27.761119+0000 b168048 47=46+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:48:27.761119+0000 46=46+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:48:27.761119+0000 b168048 47=46+1)","error_str":""},"return_code":0} 2023-10-26T06:48:48.492 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.130+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003452 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg.c auth v597 ap=1 s=11335 n(v0 rc2019-11-25T00:32:01.000000+0000 b11335 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13354c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003452:[<0x10000003603/bsg.c v597>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003452:[<0x10000003603/bsg.c v597>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.492 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.131+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000341f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig.iosched auth v609 ap=1 s=1373 n(v0 rc2019-11-25T00:32:01.000000+0000 b1373 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13354d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000341f:[<0x10000003603/Kconfig.iosched v609>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000341f:[<0x10000003603/Kconfig.iosched v609>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.492 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.131+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003459 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/kyber-iosched.c auth v603 ap=1 s=28463 n(v0 rc2019-11-25T00:32:01.000000+0000 b28463 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13354c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003459:[<0x10000003603/kyber-iosched.c v603>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003459:[<0x10000003603/kyber-iosched.c v603>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.493 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.131+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003431 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-map.c auth v559 ap=1 s=6148 n(v0 rc2019-11-25T00:32:01.000000+0000 b6148 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003431:[<0x10000003603/blk-map.c v559>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003431:[<0x10000003603/blk-map.c v559>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.493 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.131+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000344a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-throttle.c auth v537 ap=1 s=69554 n(v0 rc2023-10-26T06:45:46.975040+0000 b69554 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133ccd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000344a:[<0x10000003603/blk-throttle.c v537>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000344a:[<0x10000003603/blk-throttle.c v537>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.493 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.131+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003456 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/genhd.c auth v547 ap=1 s=51748 n(v0 rc2019-11-25T00:32:01.000000+0000 b51748 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133ccdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003456:[<0x10000003603/genhd.c v547>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003456:[<0x10000003603/genhd.c v547>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.493 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.132+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003426 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio-integrity.c auth v449 ap=1 s=12637 n(v0 rc2019-11-25T00:32:01.000000+0000 b12637 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003426:[<0x10000003603/bio-integrity.c v449>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003426:[<0x10000003603/bio-integrity.c v449>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.493 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.132+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000344e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-zoned.c auth v561 ap=1 s=13394 n(v0 rc2019-11-25T00:32:01.000000+0000 b13394 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133ccec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000344e:[<0x10000003603/blk-zoned.c v561>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000344e:[<0x10000003603/blk-zoned.c v561>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.494 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.132+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000342e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iocost.c auth v471 ap=1 s=68575 n(v0 rc2019-11-25T00:32:01.000000+0000 b68575 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133ccf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000342e:[<0x10000003603/blk-iocost.c v471>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000342e:[<0x10000003603/blk-iocost.c v471>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.494 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.132+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000342d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-ioc.c auth v409 ap=1 s=10460 n(v0 rc2023-10-26T06:45:46.971040+0000 b10460 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133ccf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000342d:[<0x10000003603/blk-ioc.c v409>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000342d:[<0x10000003603/blk-ioc.c v409>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.494 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.132+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003439 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.c auth v485 ap=1 s=14415 n(v0 rc2019-11-25T00:32:01.000000+0000 b14415 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003439:[<0x10000003603/blk-mq-sched.c v485>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003439:[<0x10000003603/blk-mq-sched.c v485>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.494 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.132+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003480 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/scsi_ioctl.c auth v557 ap=1 s=18960 n(v0 rc2019-11-25T00:32:01.000000+0000 b18960 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003480:[<0x10000003603/scsi_ioctl.c v557>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003480:[<0x10000003603/scsi_ioctl.c v557>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.494 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.133+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000342f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iolatency.c auth v575 ap=1 s=28682 n(v0 rc2019-11-25T00:32:01.000000+0000 b28682 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000342f:[<0x10000003603/blk-iolatency.c v575>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000342f:[<0x10000003603/blk-iolatency.c v575>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.495 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.133+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003420 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Makefile auth v417 ap=1 s=1544 n(v0 rc2019-11-25T00:32:01.000000+0000 b1544 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003420:[<0x10000003603/Makefile v417>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003420:[<0x10000003603/Makefile v417>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.495 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.133+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003482 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/t10-pi.c auth v545 ap=1 s=7906 n(v0 rc2019-11-25T00:32:01.000000+0000 b7906 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003482:[<0x10000003603/t10-pi.c v545>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003482:[<0x10000003603/t10-pi.c v545>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.495 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.134+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000344c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.c auth v517 ap=1 s=20426 n(v0 rc2019-11-25T00:32:01.000000+0000 b20426 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000344c:[<0x10000003603/blk-wbt.c v517>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000344c:[<0x10000003603/blk-wbt.c v517>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.495 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.134+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003446 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-softirq.c auth v515 ap=1 s=3825 n(v0 rc2019-11-25T00:32:01.000000+0000 b3825 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003446:[<0x10000003603/blk-softirq.c v515>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003446:[<0x10000003603/blk-softirq.c v515>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.495 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.135+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003447 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.c auth v459 ap=1 s=4737 n(v0 rc2019-11-25T00:32:01.000000+0000 b4737 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003447:[<0x10000003603/blk-stat.c v459>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003447:[<0x10000003603/blk-stat.c v459>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.496 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.135+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003443 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.c auth v531 ap=1 s=7246 n(v0 rc2019-11-25T00:32:01.000000+0000 b7246 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003443:[<0x10000003603/blk-rq-qos.c v531>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003443:[<0x10000003603/blk-rq-qos.c v531>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.496 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.135+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003423 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.c auth v579 ap=1 s=241601 n(v0 rc2023-10-26T06:45:46.968040+0000 b241601 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133cd4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003423:[<0x10000003603/bfq-iosched.c v579>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003423:[<0x10000003603/bfq-iosched.c v579>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.496 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.136+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003437 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-pci.c auth v511 ap=1 s=1310 n(v0 rc2019-11-25T00:32:01.000000+0000 b1310 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003437:[<0x10000003603/blk-mq-pci.c v511>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003437:[<0x10000003603/blk-mq-pci.c v511>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.496 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.136+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000345b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/opal_proto.h auth v413 ap=1 s=9514 n(v0 rc2019-11-25T00:32:01.000000+0000 b9514 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000345b:[<0x10000003603/opal_proto.h v413>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000345b:[<0x10000003603/opal_proto.h v413>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.496 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.136+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003424 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.h auth v521 ap=1 s=37108 n(v0 rc2023-10-26T06:45:46.969040+0000 b37108 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003424:[<0x10000003603/bfq-iosched.h v521>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003424:[<0x10000003603/bfq-iosched.h v521>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.497 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.136+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003481 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/sed-opal.c auth v541 ap=1 s=59636 n(v0 rc2019-11-25T00:32:01.000000+0000 b59636 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003481:[<0x10000003603/sed-opal.c v541>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003481:[<0x10000003603/sed-opal.c v541>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.497 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.137+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000343e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-virtio.c auth v525 ap=1 s=1366 n(v0 rc2019-11-25T00:32:01.000000+0000 b1366 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000343e:[<0x10000003603/blk-mq-virtio.c v525>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000343e:[<0x10000003603/blk-mq-virtio.c v525>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.497 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.137+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003448 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.h auth v489 ap=1 s=4756 n(v0 rc2019-11-25T00:32:01.000000+0000 b4756 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003448:[<0x10000003603/blk-stat.h v489>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003448:[<0x10000003603/blk-stat.h v489>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.497 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.137+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003430 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-lib.c auth v577 ap=1 s=10395 n(v0 rc2019-11-25T00:32:01.000000+0000 b10395 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1334e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003430:[<0x10000003603/blk-lib.c v577>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003430:[<0x10000003603/blk-lib.c v577>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.497 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.137+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003450 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bounce.c auth v551 ap=1 s=9569 n(v0 rc2019-11-25T00:32:01.000000+0000 b9569 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f582000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003450:[<0x10000003603/bounce.c v551>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003450:[<0x10000003603/bounce.c v551>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.498 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.137+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003421 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/badblocks.c auth v465 ap=1 s=14483 n(v0 rc2019-11-25T00:32:01.000000+0000 b14483 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f582580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003421:[<0x10000003603/badblocks.c v465>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003421:[<0x10000003603/badblocks.c v465>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.498 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.137+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000344b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-timeout.c auth v549 ap=1 s=3860 n(v0 rc2023-10-26T06:45:46.976040+0000 b3860 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f582b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000344b:[<0x10000003603/blk-timeout.c v549>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000344b:[<0x10000003603/blk-timeout.c v549>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.498 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.138+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003451 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg-lib.c auth v595 ap=1 s=10050 n(v0 rc2019-11-25T00:32:01.000000+0000 b10050 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f584100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003451:[<0x10000003603/bsg-lib.c v595>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003451:[<0x10000003603/bsg-lib.c v595>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.498 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.138+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003453 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/cmdline-parser.c auth v463 ap=1 s=5048 n(v0 rc2019-11-25T00:32:01.000000+0000 b5048 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f584c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003453:[<0x10000003603/cmdline-parser.c v463>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003453:[<0x10000003603/cmdline-parser.c v463>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.498 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.139+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003449 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-sysfs.c auth v453 ap=1 s=27066 n(v0 rc2019-11-25T00:32:01.000000+0000 b27066 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f585700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003449:[<0x10000003603/blk-sysfs.c v453>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003449:[<0x10000003603/blk-sysfs.c v453>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.499 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.139+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003425 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-wf2q.c auth v567 ap=1 s=53658 n(v0 rc2019-11-25T00:32:01.000000+0000 b53658 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f583600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003425:[<0x10000003603/bfq-wf2q.c v567>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003425:[<0x10000003603/bfq-wf2q.c v567>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.499 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.139+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000343a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.h auth v473 ap=1 s=2570 n(v0 rc2019-11-25T00:32:01.000000+0000 b2570 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000343a:[<0x10000003603/blk-mq-sched.h v473>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000343a:[<0x10000003603/blk-mq-sched.h v473>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.499 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.139+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003440 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.h auth v427 ap=1 s=8009 n(v0 rc2019-11-25T00:32:01.000000+0000 b8009 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003440:[<0x10000003603/blk-mq.h v427>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003440:[<0x10000003603/blk-mq.h v427>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.499 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.140+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000342a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-exec.c auth v539 ap=1 s=2621 n(v0 rc2019-11-25T00:32:01.000000+0000 b2621 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000342a:[<0x10000003603/blk-exec.c v539>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000342a:[<0x10000003603/blk-exec.c v539>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.499 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.140+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003433 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-cpumap.c auth v451 ap=1 s=2245 n(v0 rc2019-11-25T00:32:01.000000+0000 b2245 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003433:[<0x10000003603/blk-mq-cpumap.c v451>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003433:[<0x10000003603/blk-mq-cpumap.c v451>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.500 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.140+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003454 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/compat_ioctl.c auth v455 ap=1 s=11124 n(v0 rc2019-11-25T00:32:01.000000+0000 b11124 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003454:[<0x10000003603/compat_ioctl.c v455>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003454:[<0x10000003603/compat_ioctl.c v455>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.500 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.141+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000343f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.c auth v429 ap=1 s=88293 n(v0 rc2019-11-25T00:32:01.000000+0000 b88293 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000343f:[<0x10000003603/blk-mq.c v429>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000343f:[<0x10000003603/blk-mq.c v429>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.500 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.141+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003429 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-core.c auth v509 ap=1 s=49738 n(v0 rc2019-11-25T00:32:01.000000+0000 b49738 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003429:[<0x10000003603/blk-core.c v509>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003429:[<0x10000003603/blk-core.c v509>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.500 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.141+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003458 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioprio.c auth v477 ap=1 s=5227 n(v0 rc2019-11-25T00:32:01.000000+0000 b5227 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f68e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003458:[<0x10000003603/ioprio.c v477>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003458:[<0x10000003603/ioprio.c v477>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.500 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.142+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003427 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio.c auth v481 ap=1 s=55319 n(v0 rc2023-10-26T06:45:46.970040+0000 b55319 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f68f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003427:[<0x10000003603/bio.c v481>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003427:[<0x10000003603/bio.c v481>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.501 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.142+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000343c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.c auth v571 ap=1 s=15469 n(v0 rc2019-11-25T00:32:01.000000+0000 b15469 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f68e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000343c:[<0x10000003603/blk-mq-tag.c v571>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000343c:[<0x10000003603/blk-mq-tag.c v571>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.501 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:48.146+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000342c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-integrity.c auth v583 ap=1 s=11900 n(v0 rc2019-11-25T00:32:01.000000+0000 b11900 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f68f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000342c:[<0x10000003603/blk-integrity.c v583>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000342c:[<0x10000003603/blk-integrity.c v583>,<0x10000000202/block v11949>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.489+0000 7fa9abfff700 1 -- 172.21.15.50:0/1328209778 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa9b401dae0 con 0x7fa9c41077f0 2023-10-26T06:48:48.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.497+0000 7fa9dd1bdb80 1 Processor -- start 2023-10-26T06:48:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.497+0000 7fa9abfff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9ac0a1740 0x7fa9ac0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 -- start start 2023-10-26T06:48:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9ac0a1740 0x7fa9ac0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f89be0 0x555734f89fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f8a500 0x555734f84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f84a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734ef76e0 con 0x555734f89be0 2023-10-26T06:48:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734eddc60 con 0x555734f845d0 2023-10-26T06:48:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.498+0000 7fa9dd1bdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734edb580 con 0x555734f8a500 2023-10-26T06:48:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.499+0000 7fa9abfff700 1 -- 172.21.15.50:0/1328209778 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa9b40d4b20 con 0x7fa9c41077f0 2023-10-26T06:48:48.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.499+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f84a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.499+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f84a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48720/0 (socket says 172.21.15.50:48720) 2023-10-26T06:48:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.499+0000 7fa9c37fe700 1 -- 172.21.15.50:0/2048631060 learned_addr learned my addr 172.21.15.50:0/2048631060 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.499+0000 7fa9c27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f8a500 0x555734f84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.499+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f89be0 0x555734f89fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.500+0000 7fa9c27fc700 1 -- 172.21.15.50:0/2048631060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 msgr2=0x555734f84a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.500+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f84a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.500+0000 7fa9c27fc700 1 -- 172.21.15.50:0/2048631060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f89be0 msgr2=0x555734f89fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.500+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f89be0 0x555734f89fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.500+0000 7fa9c27fc700 1 -- 172.21.15.50:0/2048631060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555734e943f0 con 0x555734f8a500 2023-10-26T06:48:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.501+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f8a500 0x555734f84090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005950 tx=0x7fa9b800fbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73da47282f83c8a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.504+0000 7fa9a97fa700 1 -- 172.21.15.50:0/2048631060 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b802d030 con 0x555734f8a500 2023-10-26T06:48:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.504+0000 7fa9a97fa700 1 -- 172.21.15.50:0/2048631060 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9b800bc40 con 0x555734f8a500 2023-10-26T06:48:48.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.504+0000 7fa9a97fa700 1 -- 172.21.15.50:0/2048631060 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b801c070 con 0x555734f8a500 2023-10-26T06:48:48.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.505+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9ac0a1740 0x7fa9ac0a3c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80098c0 tx=0x7fa9b802a000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.509+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/2048631060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f8a500 msgr2=0x555734f84090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.509+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f8a500 0x555734f84090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005950 tx=0x7fa9b800fbe0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.510+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/2048631060 shutdown_connections 2023-10-26T06:48:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.510+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f84a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.510+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f89be0 0x555734f89fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.510+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/2048631060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f8a500 0x555734f84090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.510+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/2048631060 >> 172.21.15.50:0/2048631060 conn(0x555734ef8720 msgr2=0x555734f7eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:48.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.511+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/2048631060 shutdown_connections 2023-10-26T06:48:48.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.511+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/2048631060 wait complete. 2023-10-26T06:48:48.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.513+0000 7fa9dd1bdb80 1 -- start start 2023-10-26T06:48:48.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.514+0000 7fa9dd1bdb80 1 Processor -- start 2023-10-26T06:48:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.517+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 0x555734f904f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.517+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 0x555734f904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.518+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 0x555734f904f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:44028/0 (socket says 172.21.15.50:44028) 2023-10-26T06:48:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.518+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/3519385986 learned_addr learned my addr 172.21.15.50:0/3519385986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.518+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f89be0 0x555734f8d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.518+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.519+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f89be0 0x555734f8d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.519+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.520+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734ed6e70 con 0x555734f8a500 2023-10-26T06:48:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.520+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734e73710 con 0x555734f89be0 2023-10-26T06:48:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.520+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734e733b0 con 0x555734f845d0 2023-10-26T06:48:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.521+0000 7fa9c37fe700 1 -- 172.21.15.50:0/3519385986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 msgr2=0x555734f904f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.521+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 0x555734f904f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.521+0000 7fa9c37fe700 1 -- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f89be0 msgr2=0x555734f8d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.521+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f89be0 0x555734f8d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.521+0000 7fa9c37fe700 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b801f040 con 0x555734f8a500 2023-10-26T06:48:48.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.521+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8df20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00fad0 tx=0x7fa9bc00fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd93259e38cc1d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:48.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.522+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 0x555734f904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:48.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.522+0000 7fa9dd1bdb80 10 client.0 _ll_register_callbacks cb 0x555734dbda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:48.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.522+0000 7fa9a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:48.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.522+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/3519385986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00dcd0 con 0x555734f8a500 2023-10-26T06:48:48.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.523+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/3519385986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa9bc008040 con 0x555734f8a500 2023-10-26T06:48:48.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.523+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555734edbef0 con 0x555734f8a500 2023-10-26T06:48:48.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.523+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/3519385986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9bc00de30 con 0x555734f8a500 2023-10-26T06:48:48.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.523+0000 7fa9dd1bdb80 10 client.16449 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:48.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.523+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x555734d01de0 con 0x555734f8a500 2023-10-26T06:48:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/3519385986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa9bc010400 con 0x555734f8a500 2023-10-26T06:48:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9dd1bdb80 10 client.16449 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9dd1bdb80 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:48.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9dd1bdb80 20 client.16449 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734fa00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9dd1bdb80 4 client.16449 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:48:48.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.527+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555734f538b0 con 0x555734f9dc10 2023-10-26T06:48:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.528+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734fa00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.530+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734fa00d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3260d4d29ce5f352 server_cookie=a23536c21e69cda7 in_seq=0 out_seq=0 2023-10-26T06:48:48.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.530+0000 7fa9a6ff5700 10 client.16449 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:48.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.531+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/3519385986 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555734f538b0 con 0x555734f9dc10 2023-10-26T06:48:48.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.531+0000 7fa9a6ff5700 10 client.16449 handle_command_reply: tid=0 2023-10-26T06:48:48.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.532+0000 7fa9dd1bdb80 1 client.16449 shutdown 2023-10-26T06:48:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.535+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 msgr2=0x555734f8df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.535+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8df20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00fad0 tx=0x7fa9bc00fe90 comp rx=0 tx=0).stop 2023-10-26T06:48:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.535+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 shutdown_connections 2023-10-26T06:48:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.536+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734fa00d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.536+0000 7fa9a6ff5700 0 client.16449 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:48.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.536+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8df20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.536+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f845d0 0x555734f904f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.536+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/3519385986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f89be0 0x555734f8d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.536+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 >> 172.21.15.50:0/3519385986 conn(0x555734ef8720 msgr2=0x555734f83080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:48.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.539+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 shutdown_connections 2023-10-26T06:48:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.539+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/3519385986 wait complete. 2023-10-26T06:48:48.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.539+0000 7fa9dd1bdb80 20 client.16449 trim_cache size 0 max 16384 2023-10-26T06:48:48.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.608+0000 7fa9dd1bdb80 1 Processor -- start 2023-10-26T06:48:48.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.609+0000 7fa9dd1bdb80 1 -- start start 2023-10-26T06:48:48.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.611+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.611+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.611+0000 7fa9c2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:48736/0 (socket says 172.21.15.50:48736) 2023-10-26T06:48:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.611+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.611+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/336757012 learned_addr learned my addr 172.21.15.50:0/336757012 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.611+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.612+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.612+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734f79af0 con 0x555734f8a500 2023-10-26T06:48:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.612+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734d57920 con 0x555734f845d0 2023-10-26T06:48:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.612+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734f9a5d0 con 0x555734f89be0 2023-10-26T06:48:48.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/336757012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 msgr2=0x555734f839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f839d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/336757012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 msgr2=0x555734f8c0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c2ffd700 1 -- 172.21.15.50:0/336757012 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555734f7ed70 con 0x555734f845d0 2023-10-26T06:48:48.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c27fc700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:48:48.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.613+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:48:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.614+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94ee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40d23d0 tx=0x7fa9b4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7adf416c43053525 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.614+0000 7fa9a9ffb700 1 -- 172.21.15.50:0/336757012 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40a1bb0 con 0x555734f845d0 2023-10-26T06:48:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.614+0000 7fa9a9ffb700 1 -- 172.21.15.50:0/336757012 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9b40a5d00 con 0x555734f845d0 2023-10-26T06:48:48.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.614+0000 7fa9a9ffb700 1 -- 172.21.15.50:0/336757012 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b409e2c0 con 0x555734f845d0 2023-10-26T06:48:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 msgr2=0x555734f94ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94ee0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40d23d0 tx=0x7fa9b4000bc0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 shutdown_connections 2023-10-26T06:48:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734f8c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94ee0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/336757012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.616+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 >> 172.21.15.50:0/336757012 conn(0x555734ef8720 msgr2=0x555734f849b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:48.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.617+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 shutdown_connections 2023-10-26T06:48:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.617+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/336757012 wait complete. 2023-10-26T06:48:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.618+0000 7fa9dd1bdb80 1 -- start start 2023-10-26T06:48:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.618+0000 7fa9dd1bdb80 1 Processor -- start 2023-10-26T06:48:48.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.619+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.620+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.620+0000 7fa9dd1bdb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734febb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9dd1bdb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734fec040 con 0x555734f8a500 2023-10-26T06:48:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9dd1bdb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734fec1b0 con 0x555734f845d0 2023-10-26T06:48:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9dd1bdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x555734fec370 con 0x555734f89be0 2023-10-26T06:48:48.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734febb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9dd1bdb80 10 client.0 _ll_register_callbacks cb 0x555734dbda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:48:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9c37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734febb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37762/0 (socket says 172.21.15.50:37762) 2023-10-26T06:48:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.621+0000 7fa9c37fe700 1 -- 172.21.15.50:0/1617589420 learned_addr learned my addr 172.21.15.50:0/1617589420 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:48:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9c37fe700 1 -- 172.21.15.50:0/1617589420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 msgr2=0x555734f94660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f94660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9c37fe700 1 -- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 msgr2=0x555734f94120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:48:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9c37fe700 1 -- 172.21.15.50:0/1617589420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c41aa040 con 0x555734f8a500 2023-10-26T06:48:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:48:48.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.622+0000 7fa9c37fe700 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734febb00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00fed0 tx=0x7fa9bc004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd767d926685d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:48:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.623+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/1617589420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc02f070 con 0x555734f8a500 2023-10-26T06:48:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.623+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9b800bc40 con 0x555734f8a500 2023-10-26T06:48:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.624+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/1617589420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa9bc007190 con 0x555734f8a500 2023-10-26T06:48:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.624+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/1617589420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9bc02f070 con 0x555734f8a500 2023-10-26T06:48:48.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.624+0000 7fa9dd1bdb80 10 client.16452 fetch_fsmap learned FSMap version 27 2023-10-26T06:48:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.625+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555734ceac60 con 0x555734f8a500 2023-10-26T06:48:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.626+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/1617589420 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9bc039020 con 0x555734f8a500 2023-10-26T06:48:48.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.626+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/1617589420 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa9bc032020 con 0x555734f8a500 2023-10-26T06:48:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9dd1bdb80 10 client.16452 fetch_fsmap finished waiting for FSMap version 27 2023-10-26T06:48:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9dd1bdb80 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:48:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9dd1bdb80 20 client.16452 populate_metadata read hostname 'smithi050' 2023-10-26T06:48:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734ff5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:48:48.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9dd1bdb80 4 client.16452 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:48:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555734ecfe50 con 0x555734f9dc10 2023-10-26T06:48:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.627+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734ff5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:48:48.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.628+0000 7fa9c2ffd700 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734ff5ca0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae7c043de8007 server_cookie=220322096f5317c9 in_seq=0 out_seq=0 2023-10-26T06:48:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.629+0000 7fa9a6ff5700 10 client.16452 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.630+0000 7fa9a6ff5700 1 -- 172.21.15.50:0/1617589420 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x555734ecfe50 con 0x555734f9dc10 2023-10-26T06:48:48.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.630+0000 7fa9a6ff5700 10 client.16452 handle_command_reply: tid=0 2023-10-26T06:48:48.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.631+0000 7fa9dd1bdb80 1 client.16452 shutdown 2023-10-26T06:48:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 msgr2=0x555734febb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734febb00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00fed0 tx=0x7fa9bc004b80 comp rx=0 tx=0).stop 2023-10-26T06:48:48.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 shutdown_connections 2023-10-26T06:48:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x555734f9dc10 0x555734ff5ca0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555734f8a500 0x555734febb00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x555734f845d0 0x555734f94120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 --2- 172.21.15.50:0/1617589420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555734f89be0 0x555734f94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.632+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 >> 172.21.15.50:0/1617589420 conn(0x555734ef8720 msgr2=0x555734f83930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.633+0000 7fa9a6ff5700 0 client.16452 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:48:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.634+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 shutdown_connections 2023-10-26T06:48:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.635+0000 7fa9dd1bdb80 1 -- 172.21.15.50:0/1617589420 wait complete. 2023-10-26T06:48:48.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.640+0000 7fa9dd1bdb80 20 client.16452 trim_cache size 0 max 16384 2023-10-26T06:48:48.642 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:48:48.642 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "scrub active (4960 inodes in the stack)", 2023-10-26T06:48:48.642 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-10-26T06:48:48.642 INFO:teuthology.orchestra.run.smithi050.stdout: "d3d25360-c249-4964-8c3c-489ae63c57dd": { 2023-10-26T06:48:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-10-26T06:48:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "d3d25360-c249-4964-8c3c-489ae63c57dd", 2023-10-26T06:48:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2023-10-26T06:48:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:48:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:48:48.644 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:48:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.640+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9ac0a1740 msgr2=0x7fa9ac0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9ac0a1740 0x7fa9ac0a3c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80098c0 tx=0x7fa9b802a000 comp rx=0 tx=0).stop 2023-10-26T06:48:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 msgr2=0x7fa9c419d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:48:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c419d2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400ffc0 tx=0x7fa9b4015f90 comp rx=0 tx=0).stop 2023-10-26T06:48:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 shutdown_connections 2023-10-26T06:48:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa9ac0a1740 0x7fa9ac0a3c00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9c410c310 0x7fa9c41a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9c41077f0 0x7fa9c419d2d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 --2- 172.21.15.50:0/1328209778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9c4108110 0x7fa9c419d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:48:48.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.641+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 >> 172.21.15.50:0/1328209778 conn(0x7fa9c406bc20 msgr2=0x7fa9c41093a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:48:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.643+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 shutdown_connections 2023-10-26T06:48:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:48:48.643+0000 7fa9c97ff700 1 -- 172.21.15.50:0/1328209778 wait complete. 2023-10-26T06:48:48.659 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/ghash-generic.o 2023-10-26T06:48:48.715 INFO:tasks.cephfs.filesystem:scrub status for tag:d3d25360-c249-4964-8c3c-489ae63c57dd - {'path': '/', 'tag': 'd3d25360-c249-4964-8c3c-489ae63c57dd', 'options': 'recursive,force'} 2023-10-26T06:48:48.735 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/partition-generic.o 2023-10-26T06:48:48.757 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/hugetlb.o 2023-10-26T06:48:48.785 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/iomap/seek.o 2023-10-26T06:48:49.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: scrub queued for path: / 2023-10-26T06:48:49.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:48:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: scrub summary: active paths [/] 2023-10-26T06:48:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: pgmap v473: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 94 op/s 2023-10-26T06:48:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003711 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.019 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003604 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000345c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partition-generic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000345a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/mq-deadline.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003435 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003444 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.020 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003432 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-merge.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003441 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000342b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-flush.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003455 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/elevator.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003445 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-settings.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.021 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000344d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000343d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003442 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003428 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-cgroup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003422 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-cgroup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.022 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003436 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.023 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000343b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.023 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003434 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs-zoned.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.023 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003438 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-rdma.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.023 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003457 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.023 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000344f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003605 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003452 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000341f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig.iosched) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003459 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/kyber-iosched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003431 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-map.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000344a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-throttle.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003456 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/genhd.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003426 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio-integrity.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000344e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-zoned.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000342e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iocost.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000342d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-ioc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003439 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003480 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/scsi_ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000342f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iolatency.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003420 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.026 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003482 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/t10-pi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000344c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003446 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-softirq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003447 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003443 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003423 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.028 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003437 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-pci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.028 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000345b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/opal_proto.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.028 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003424 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.028 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003481 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/sed-opal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.028 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000343e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-virtio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.029 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003448 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.029 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003430 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-lib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.029 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003450 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bounce.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.029 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003421 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/badblocks.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000344b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-timeout.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003451 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg-lib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003453 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/cmdline-parser.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003449 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003425 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-wf2q.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000343a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003440 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000342a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-exec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003433 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-cpumap.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.032 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003454 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/compat_ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.032 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000343f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.032 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003429 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.032 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003458 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioprio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.032 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003427 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.032 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000343c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.033 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:48 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000342c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-integrity.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: scrub queued for path: / 2023-10-26T06:48:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:48:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: scrub summary: active paths [/] 2023-10-26T06:48:49.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: pgmap v473: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 94 op/s 2023-10-26T06:48:49.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003711 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003604 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000345c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partition-generic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000345a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/mq-deadline.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003435 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003444 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003432 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-merge.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003441 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000342b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-flush.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003455 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/elevator.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003445 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-settings.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000344d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000343d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003442 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003428 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-cgroup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003422 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-cgroup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003436 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000343b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003434 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs-zoned.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003438 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-rdma.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003457 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000344f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003605 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003452 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000341f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig.iosched) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003459 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/kyber-iosched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003431 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-map.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000344a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-throttle.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003456 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/genhd.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003426 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio-integrity.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000344e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-zoned.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000342e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iocost.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000342d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-ioc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003439 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003480 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/scsi_ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000342f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iolatency.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003420 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003482 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/t10-pi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000344c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003446 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-softirq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003447 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003443 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003423 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003437 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-pci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000345b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/opal_proto.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003424 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003481 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/sed-opal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000343e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-virtio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003448 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003430 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-lib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003450 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bounce.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003421 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/badblocks.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000344b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-timeout.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003451 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg-lib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003453 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/cmdline-parser.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003449 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003425 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-wf2q.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000343a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003440 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000342a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-exec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003433 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-cpumap.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003454 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/compat_ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000343f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003429 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003458 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioprio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003427 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000343c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:48 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000342c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-integrity.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: scrub queued for path: / 2023-10-26T06:48:49.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:49.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:48:49.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: scrub summary: active paths [/] 2023-10-26T06:48:49.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: pgmap v473: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 94 op/s 2023-10-26T06:48:49.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003711 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003604 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000345c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partition-generic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000345a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/mq-deadline.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003435 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003444 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003432 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-merge.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003441 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000342b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-flush.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003455 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/elevator.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003445 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-settings.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000344d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000343d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003442 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003428 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-cgroup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003422 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-cgroup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003436 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000343b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003434 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs-zoned.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003438 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-rdma.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003457 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000344f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003605 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003452 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000341f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig.iosched) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003459 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/kyber-iosched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003431 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-map.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000344a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-throttle.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003456 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/genhd.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003426 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio-integrity.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000344e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-zoned.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000342e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iocost.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000342d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-ioc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003439 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003480 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/scsi_ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000342f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iolatency.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003420 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003482 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/t10-pi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000344c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003446 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-softirq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003447 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003443 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003423 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003437 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-pci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000345b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/opal_proto.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003424 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003481 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/sed-opal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000343e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-virtio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003448 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003430 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-lib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003450 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bounce.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003421 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/badblocks.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000344b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-timeout.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003451 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg-lib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003453 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/cmdline-parser.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003449 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003425 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-wf2q.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000343a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003440 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000342a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-exec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003433 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-cpumap.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003454 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/compat_ioctl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000343f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003429 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003458 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioprio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003427 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000343c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:48 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000342c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-integrity.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.324 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evsci.o 2023-10-26T06:48:49.443 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/irq.o 2023-10-26T06:48:49.453 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/idle.o 2023-10-26T06:48:49.795 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/hash_info.o 2023-10-26T06:48:49.847 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/iomap/swapfile.o 2023-10-26T06:48:49.862 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003712 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_perflib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000367b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/blacklist.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.863 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000369b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/numa.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.864 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003684 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.864 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003683 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_pm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.864 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000367a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bgrt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.864 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003682 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/debugfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.865 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000368c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/evged.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.865 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036bf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.865 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000368f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hed.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.865 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003578 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_ipmi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.866 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036bd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.866 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003577 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_extlog.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.866 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003576 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_dbg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.867 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003816 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.867 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_throttling.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.867 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000369e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.868 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036ac (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pptt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.868 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036bb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/scan.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.868 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.868 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036ae (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.868 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000367f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/container.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.869 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003693 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ioapic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.869 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000367e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cm_sbs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.869 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003694 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/irq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.869 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003692 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/internal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.870 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036af (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_driver.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.870 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_slot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.870 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000381c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.870 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036c0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/tables.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.870 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.871 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000368a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec_sys.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.871 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_root.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.871 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036be (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/spcr.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.871 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036ab (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/power.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.872 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036bc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.872 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003574 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_cmos_rtc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.872 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000369d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.872 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/resource.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.872 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000357f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pnp.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.873 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036c1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.873 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000357a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.873 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000368e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/glue.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.873 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000356f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.873 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003579 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.874 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003572 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_amba.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.874 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003812 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.874 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003713 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.874 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003575 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_configfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.875 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000381a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.875 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/reboot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003582 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_video.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003583 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_watchdog.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036c3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/video_detect.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_pdc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036c2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/utils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.877 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003810 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.877 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.877 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_mcfg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.877 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000368b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/event.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.877 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036c4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/wakeup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.878 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003580 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_processor.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.878 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000369f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_irq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.878 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_idle.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.878 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000357d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pad.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000357c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_memhotplug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003679 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/battery.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036ba (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003685 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.879 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003570 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ac.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.880 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003571 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_adxl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.880 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003814 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.880 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003581 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_tad.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.880 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000369c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nvs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.880 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036b5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/property.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.881 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000367c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bus.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.881 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003689 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.881 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000357e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_platform.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.881 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003680 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cppc_acpi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.882 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003573 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_apd.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.882 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003818 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.882 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036ad (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/proc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.882 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003681 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/custom_method.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000357b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpss.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_link.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000367d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/button.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000368d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/fan.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:49.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.597+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003712 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Kconfig auth v1753 ap=1 s=19410 n(v0 rc2023-10-26T06:45:47.244033+0000 b19410 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132c17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003712:[<0x10000003711/Kconfig v1753>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003712:[<0x10000003711/Kconfig v1753>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.597+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_perflib.c auth v1741 ap=1 s=19733 n(v0 rc2019-11-25T00:32:01.000000+0000 b19733 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132c17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b2:[<0x10000003711/processor_perflib.c v1741>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b2:[<0x10000003711/processor_perflib.c v1741>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.598+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000367b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/blacklist.c auth v1449 ap=1 s=3798 n(v0 rc2023-10-26T06:45:47.434028+0000 b3798 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000367b:[<0x10000003711/blacklist.c v1449>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000367b:[<0x10000003711/blacklist.c v1449>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.598+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000369b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/numa.c auth v1635 ap=1 s=12472 n(v0 rc2019-11-25T00:32:01.000000+0000 b12472 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000369b:[<0x10000003711/numa.c v1635>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000369b:[<0x10000003711/numa.c v1635>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.598+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003684 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_sysfs.c auth v1801 ap=1 s=16727 n(v0 rc2019-11-25T00:32:01.000000+0000 b16727 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003684:[<0x10000003711/device_sysfs.c v1801>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003684:[<0x10000003711/device_sysfs.c v1801>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.598+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003683 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_pm.c auth v1397 ap=1 s=38052 n(v0 rc2019-11-25T00:32:01.000000+0000 b38052 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003683:[<0x10000003711/device_pm.c v1397>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003683:[<0x10000003711/device_pm.c v1397>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.599+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000367a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bgrt.c auth v1525 ap=1 s=2972 n(v0 rc2019-11-25T00:32:01.000000+0000 b2972 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000367a:[<0x10000003711/bgrt.c v1525>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000367a:[<0x10000003711/bgrt.c v1525>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.599+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003682 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/debugfs.c auth v1813 ap=1 s=463 n(v0 rc2019-11-25T00:32:01.000000+0000 b463 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003682:[<0x10000003711/debugfs.c v1813>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003682:[<0x10000003711/debugfs.c v1813>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.599+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000368c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/evged.c auth v1301 ap=1 s=4337 n(v0 rc2019-11-25T00:32:01.000000+0000 b4337 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000368c:[<0x10000003711/evged.c v1301>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000368c:[<0x10000003711/evged.c v1301>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.599+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036bf [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sysfs.c auth v1649 ap=1 s=28012 n(v0 rc2019-11-25T00:32:01.000000+0000 b28012 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036bf:[<0x10000003711/sysfs.c v1649>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036bf:[<0x10000003711/sysfs.c v1649>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.600+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000368f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hed.c auth v1519 ap=1 s=1945 n(v0 rc2019-11-25T00:32:01.000000+0000 b1945 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000368f:[<0x10000003711/hed.c v1519>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000368f:[<0x10000003711/hed.c v1519>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.600+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003578 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_ipmi.c auth v1705 ap=1 s=16823 n(v0 rc2019-11-25T00:32:01.000000+0000 b16823 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003578:[<0x10000003711/acpi_ipmi.c v1705>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003578:[<0x10000003711/acpi_ipmi.c v1705>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.600+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036bd [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.h auth v1905 ap=1 s=507 n(v0 rc2019-11-25T00:32:01.000000+0000 b507 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ff3db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036bd:[<0x10000003711/sleep.h v1905>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036bd:[<0x10000003711/sleep.h v1905>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.600+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003577 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_extlog.c auth v1789 ap=1 s=8933 n(v0 rc2023-10-26T06:45:47.245033+0000 b8933 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd62000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003577:[<0x10000003711/acpi_extlog.c v1789>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003577:[<0x10000003711/acpi_extlog.c v1789>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.601+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003576 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_dbg.c auth v1365 ap=1 s=18282 n(v0 rc2019-11-25T00:32:01.000000+0000 b18282 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd62b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003576:[<0x10000003711/acpi_dbg.c v1365>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003576:[<0x10000003711/acpi_dbg.c v1365>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.601+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003816 [...4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/ auth v1913 ap=1 f(v0 m2023-10-26T06:45:47.459028+0000 3=3+0) n(v0 rc2023-10-26T06:45:47.459028+0000 b19053 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003816:[<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x10000003816:[<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:45:47.459028+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:45:47.459028+0000 b19053 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:45:47.459028+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:45:47.459028+0000 b19053 4=3+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.601+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_throttling.c auth v1683 ap=1 s=31758 n(v0 rc2019-11-25T00:32:01.000000+0000 b31758 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b4:[<0x10000003711/processor_throttling.c v1683>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b4:[<0x10000003711/processor_throttling.c v1683>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.601+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000369e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osl.c auth v1347 ap=1 s=43444 n(v0 rc2019-11-25T00:32:01.000000+0000 b43444 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd63600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000369e:[<0x10000003711/osl.c v1347>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000369e:[<0x10000003711/osl.c v1347>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.601+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036ac [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pptt.c auth v1349 ap=1 s=23987 n(v0 rc2019-11-25T00:32:01.000000+0000 b23987 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd64100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036ac:[<0x10000003711/pptt.c v1349>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036ac:[<0x10000003711/pptt.c v1349>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.602+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036bb [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/scan.c auth v1401 ap=1 s=59691 n(v0 rc2019-11-25T00:32:01.000000+0000 b59691 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd65180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036bb:[<0x10000003711/scan.c v1401>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036bb:[<0x10000003711/scan.c v1401>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.602+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_thermal.c auth v1377 ap=1 s=6187 n(v0 rc2019-11-25T00:32:01.000000+0000 b6187 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd65700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b3:[<0x10000003711/processor_thermal.c v1377>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b3:[<0x10000003711/processor_thermal.c v1377>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.602+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036ae [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_core.c auth v1483 ap=1 s=9389 n(v0 rc2023-10-26T06:45:47.482027+0000 b9389 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036ae:[<0x10000003711/processor_core.c v1483>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036ae:[<0x10000003711/processor_core.c v1483>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.602+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000367f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/container.c auth v1633 ap=1 s=2746 n(v0 rc2019-11-25T00:32:01.000000+0000 b2746 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000367f:[<0x10000003711/container.c v1633>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000367f:[<0x10000003711/container.c v1633>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.602+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003693 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ioapic.c auth v1803 ap=1 s=6070 n(v0 rc2023-10-26T06:45:47.460028+0000 b6070 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003693:[<0x10000003711/ioapic.c v1803>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003693:[<0x10000003711/ioapic.c v1803>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.603+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000367e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cm_sbs.c auth v1543 ap=1 s=2185 n(v0 rc2019-11-25T00:32:01.000000+0000 b2185 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000367e:[<0x10000003711/cm_sbs.c v1543>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000367e:[<0x10000003711/cm_sbs.c v1543>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.603+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003694 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/irq.c auth v1893 ap=1 s=9162 n(v0 rc2019-11-25T00:32:01.000000+0000 b9162 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003694:[<0x10000003711/irq.c v1893>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003694:[<0x10000003711/irq.c v1893>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.603+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003692 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/internal.h auth v1415 ap=1 s=9320 n(v0 rc2019-11-25T00:32:01.000000+0000 b9320 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003692:[<0x10000003711/internal.h v1415>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003692:[<0x10000003711/internal.h v1415>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.603+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036af [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_driver.c auth v1399 ap=1 s=9151 n(v0 rc2019-11-25T00:32:01.000000+0000 b9151 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036af:[<0x10000003711/processor_driver.c v1399>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036af:[<0x10000003711/processor_driver.c v1399>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.604+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_slot.c auth v1739 ap=1 s=4834 n(v0 rc2019-11-25T00:32:01.000000+0000 b4834 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a3:[<0x10000003711/pci_slot.c v1739>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a3:[<0x10000003711/pci_slot.c v1739>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.604+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000381c [...4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/ auth{2=1} v1919 ap=1 f(v0 m2023-10-26T06:45:47.507027+0000 2=2+0) n(v0 rc2023-10-26T06:45:47.507027+0000 b8925 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x55e132341b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000381c:[<0x10000003711/x86 v1919>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x1000000381c:[<0x10000003711/x86 v1919>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:45:47.507027+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:45:47.507027+0000 b8925 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:45:47.507027+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:45:47.507027+0000 b8925 3=2+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.604+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036c0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/tables.c auth v1345 ap=1 s=22851 n(v0 rc2019-11-25T00:32:01.000000+0000 b22851 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036c0:[<0x10000003711/tables.c v1345>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036c0:[<0x10000003711/tables.c v1345>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.604+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.c auth v1445 ap=1 s=7271 n(v0 rc2019-11-25T00:32:01.000000+0000 b7271 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b9:[<0x10000003711/sbshc.c v1445>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b9:[<0x10000003711/sbshc.c v1445>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.604+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000368a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec_sys.c auth v1647 ap=1 s=3217 n(v0 rc2019-11-25T00:32:01.000000+0000 b3217 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000368a:[<0x10000003711/ec_sys.c v1647>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000368a:[<0x10000003711/ec_sys.c v1647>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.605+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_root.c auth v1481 ap=1 s=26108 n(v0 rc2019-11-25T00:32:01.000000+0000 b26108 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a2:[<0x10000003711/pci_root.c v1481>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a2:[<0x10000003711/pci_root.c v1481>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.605+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036be [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/spcr.c auth v1403 ap=1 s=5982 n(v0 rc2019-11-25T00:32:01.000000+0000 b5982 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c7eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036be:[<0x10000003711/spcr.c v1403>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036be:[<0x10000003711/spcr.c v1403>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.605+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036ab [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/power.c auth v1561 ap=1 s=26609 n(v0 rc2019-11-25T00:32:01.000000+0000 b26609 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036ab:[<0x10000003711/power.c v1561>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036ab:[<0x10000003711/power.c v1561>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.605+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036bc [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.c auth v1837 ap=1 s=32680 n(v0 rc2019-11-25T00:32:01.000000+0000 b32680 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036bc:[<0x10000003711/sleep.c v1837>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036bc:[<0x10000003711/sleep.c v1837>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.605+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003574 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_cmos_rtc.c auth v1627 ap=1 s=2032 n(v0 rc2019-11-25T00:32:01.000000+0000 b2032 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003574:[<0x10000003711/acpi_cmos_rtc.c v1627>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003574:[<0x10000003711/acpi_cmos_rtc.c v1627>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.606+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000369d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osi.c auth v1895 ap=1 s=13378 n(v0 rc2023-10-26T06:45:47.467028+0000 b13378 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fd6cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000369d:[<0x10000003711/osi.c v1895>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000369d:[<0x10000003711/osi.c v1895>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.606+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/resource.c auth v1451 ap=1 s=23398 n(v0 rc2019-11-25T00:32:01.000000+0000 b23398 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c80c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b7:[<0x10000003711/resource.c v1451>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b7:[<0x10000003711/resource.c v1451>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.606+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pnp.c auth v1779 ap=1 s=13871 n(v0 rc2019-11-25T00:32:01.000000+0000 b13871 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357f:[<0x10000003711/acpi_pnp.c v1779>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000357f:[<0x10000003711/acpi_pnp.c v1779>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.607+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036c1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/thermal.c auth v1651 ap=1 s=31926 n(v0 rc2019-11-25T00:32:01.000000+0000 b31926 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c81180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036c1:[<0x10000003711/thermal.c v1651>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036c1:[<0x10000003711/thermal.c v1651>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.607+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpit.c auth v1273 ap=1 s=4305 n(v0 rc2019-11-25T00:32:01.000000+0000 b4305 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c81700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357a:[<0x10000003711/acpi_lpit.c v1273>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000357a:[<0x10000003711/acpi_lpit.c v1273>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.607+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000368e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/glue.c auth v1877 ap=1 s=9144 n(v0 rc2019-11-25T00:32:01.000000+0000 b9144 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c7f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000368e:[<0x10000003711/glue.c v1877>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000368e:[<0x10000003711/glue.c v1877>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.607+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000356f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Makefile auth v1571 ap=1 s=3832 n(v0 rc2019-11-25T00:32:01.000000+0000 b3832 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000356f:[<0x10000003711/Makefile v1571>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000356f:[<0x10000003711/Makefile v1571>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.608+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003579 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpat.c auth v1807 ap=1 s=4139 n(v0 rc2019-11-25T00:32:01.000000+0000 b4139 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e133c80100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003579:[<0x10000003711/acpi_lpat.c v1807>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003579:[<0x10000003711/acpi_lpat.c v1807>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.609+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003572 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_amba.c auth v1763 ap=1 s=3115 n(v0 rc2019-11-25T00:32:01.000000+0000 b3115 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003572:[<0x10000003711/acpi_amba.c v1763>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003572:[<0x10000003711/acpi_amba.c v1763>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.613+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003812 [...4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/ auth v1909 ap=1 f(v0 m2023-10-26T06:45:47.433028+0000 4=4+0) n(v0 rc2023-10-26T06:45:47.433028+0000 b53267 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003812:[<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x10000003812:[<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:45:47.433028+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:45:47.433028+0000 b53267 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:45:47.433028+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:45:47.433028+0000 b53267 5=4+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.613+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003713 [...7,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/ auth{0=1,2=1} fragtree_t(*^3) v2186 pv2196 ap=8 f(v0 m2023-10-26T06:48:48.362617+0000 250=250+0)->f(v0 m2023-10-26T06:48:49.189597+0000 252=252+0) n(v0 rc2023-10-26T06:48:48.362617+0000 b2683191 251=250+1)->n(v0 rc2023-10-26T06:48:49.189597+0000 b2683191 253=252+1) old_inodes=2 (iauth sync r=1) (isnap sync r=2) (inest mix w=3) (ipolicy sync r=1) (ifile excl w=2) (iversion lock w=5 last_client=15375) caps={15375=pAsLsXsFsxcr/pAsLsXsFsxcral@73},l=15375 | lock=6 importingcaps=0 dirfrag=8 caps=1 dirwaiter=0 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55e12f316580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003713:[<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(2)0x10000003713:[<0x10000003711/acpica v2186>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:48:48.362617+0000 250=250+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:48:48.362617+0000 b2683191 251=250+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:48:48.362617+0000 250=250+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:48:48.362617+0000 b2683191 251=250+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.613+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003575 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_configfs.c auth v1897 ap=1 s=6382 n(v0 rc2019-11-25T00:32:01.000000+0000 b6382 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003575:[<0x10000003711/acpi_configfs.c v1897>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003575:[<0x10000003711/acpi_configfs.c v1897>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.613+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000381a [...4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/ auth v1917 ap=1 f(v0 m2023-10-26T06:45:47.479027+0000 8=8+0) n(v0 rc2023-10-26T06:45:47.480027+0000 b50974 9=8+1) (inest lock) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000381a:[<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x1000000381a:[<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:45:47.479027+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:45:47.480027+0000 b50974 9=8+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:45:47.479027+0000 8=8+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:45:47.480027+0000 b50974 9=8+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.614+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/reboot.c auth v1623 ap=1 s=1707 n(v0 rc2019-11-25T00:32:01.000000+0000 b1707 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b6:[<0x10000003711/reboot.c v1623>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b6:[<0x10000003711/reboot.c v1623>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.614+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003582 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_video.c auth v1549 ap=1 s=59877 n(v0 rc2019-11-25T00:32:01.000000+0000 b59877 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003582:[<0x10000003711/acpi_video.c v1549>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003582:[<0x10000003711/acpi_video.c v1549>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.614+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003583 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_watchdog.c auth v1325 ap=1 s=4428 n(v0 rc2019-11-25T00:32:01.000000+0000 b4428 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003583:[<0x10000003711/acpi_watchdog.c v1325>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003583:[<0x10000003711/acpi_watchdog.c v1325>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.614+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036c3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/video_detect.c auth v1305 ap=1 s=12988 n(v0 rc2019-11-25T00:32:01.000000+0000 b12988 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036c3:[<0x10000003711/video_detect.c v1305>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036c3:[<0x10000003711/video_detect.c v1305>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.614+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_pdc.c auth v1751 ap=1 s=4802 n(v0 rc2019-11-25T00:32:01.000000+0000 b4802 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b1:[<0x10000003711/processor_pdc.c v1751>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b1:[<0x10000003711/processor_pdc.c v1751>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.615+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036c2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/utils.c auth v1405 ap=1 s=22685 n(v0 rc2019-11-25T00:32:01.000000+0000 b22685 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036c2:[<0x10000003711/utils.c v1405>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036c2:[<0x10000003711/utils.c v1405>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.615+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003810 [...4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ auth v1907 ap=1 f(v0 m2023-10-26T06:45:47.423029+0000 10=10+0) n(v0 rc2023-10-26T06:45:47.423029+0000 b127147 11=10+1) (inest lock) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003810:[<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x10000003810:[<0x10000003711/apei v1907>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:45:47.423029+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:45:47.423029+0000 b127147 11=10+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:45:47.423029+0000 10=10+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:45:47.423029+0000 b127147 11=10+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.615+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbs.c auth v1777 ap=1 s=19962 n(v0 rc2019-11-25T00:32:01.000000+0000 b19962 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b8:[<0x10000003711/sbs.c v1777>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b8:[<0x10000003711/sbs.c v1777>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.615+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_mcfg.c auth v1711 ap=1 s=8368 n(v0 rc2019-11-25T00:32:01.000000+0000 b8368 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a1:[<0x10000003711/pci_mcfg.c v1711>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a1:[<0x10000003711/pci_mcfg.c v1711>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.615+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000368b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/event.c auth v1339 ap=1 s=4415 n(v0 rc2019-11-25T00:32:01.000000+0000 b4415 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000368b:[<0x10000003711/event.c v1339>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000368b:[<0x10000003711/event.c v1339>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.616+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036c4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/wakeup.c auth v1407 ap=1 s=2750 n(v0 rc2019-11-25T00:32:01.000000+0000 b2750 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132aca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036c4:[<0x10000003711/wakeup.c v1407>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036c4:[<0x10000003711/wakeup.c v1407>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.617+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003580 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_processor.c auth v1485 ap=1 s=18210 n(v0 rc2019-11-25T00:32:01.000000+0000 b18210 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132acb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003580:[<0x10000003711/acpi_processor.c v1485>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003580:[<0x10000003711/acpi_processor.c v1485>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.617+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000369f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_irq.c auth v1669 ap=1 s=13784 n(v0 rc2019-11-25T00:32:01.000000+0000 b13784 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000369f:[<0x10000003711/pci_irq.c v1669>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000369f:[<0x10000003711/pci_irq.c v1669>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.617+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_idle.c auth v1861 ap=1 s=38889 n(v0 rc2019-11-25T00:32:01.000000+0000 b38889 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132ac5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b0:[<0x10000003711/processor_idle.c v1861>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b0:[<0x10000003711/processor_idle.c v1861>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.617+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pad.c auth v1573 ap=1 s=12371 n(v0 rc2019-11-25T00:32:01.000000+0000 b12371 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132acb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357d:[<0x10000003711/acpi_pad.c v1573>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000357d:[<0x10000003711/acpi_pad.c v1573>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.618+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_memhotplug.c auth v1465 ap=1 s=9709 n(v0 rc2019-11-25T00:32:01.000000+0000 b9709 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132208000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357c:[<0x10000003711/acpi_memhotplug.c v1465>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000357c:[<0x10000003711/acpi_memhotplug.c v1465>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.619+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003679 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/battery.c auth v1847 ap=1 s=45162 n(v0 rc2019-11-25T00:32:01.000000+0000 b45162 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132208580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003679:[<0x10000003711/battery.c v1847>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003679:[<0x10000003711/battery.c v1847>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.619+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036ba [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.h auth v1827 ap=1 s=964 n(v0 rc2019-11-25T00:32:01.000000+0000 b964 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132aca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036ba:[<0x10000003711/sbshc.h v1827>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036ba:[<0x10000003711/sbshc.h v1827>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.619+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003685 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dock.c auth v1875 ap=1 s=16870 n(v0 rc2019-11-25T00:32:01.000000+0000 b16870 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132acac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003685:[<0x10000003711/dock.c v1875>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003685:[<0x10000003711/dock.c v1875>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.619+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003570 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ac.c auth v1821 ap=1 s=11385 n(v0 rc2019-11-25T00:32:01.000000+0000 b11385 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132208b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003570:[<0x10000003711/ac.c v1821>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003570:[<0x10000003711/ac.c v1821>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.619+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003571 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_adxl.c auth v1433 ap=1 s=4827 n(v0 rc2019-11-25T00:32:01.000000+0000 b4827 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132209080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003571:[<0x10000003711/acpi_adxl.c v1433>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003571:[<0x10000003711/acpi_adxl.c v1433>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.620+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003814 [...6,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/ auth v1924 ap=1 f(v0 m2023-10-26T06:47:45.439151+0000 5=5+0) n(v0 rc2023-10-26T06:47:45.439151+0000 b4783 6=5+1) old_inodes=1 (inest mix) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=0 authpin=1 discoverbase=0 scrubqueue=0 0x55e12f317080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003814:[<0x10000003711/dptf v1924>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x10000003814:[<0x10000003711/dptf v1924>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:47:45.439151+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:47:45.439151+0000 b4783 6=5+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:47:45.439151+0000 5=5+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:47:45.439151+0000 b4783 6=5+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.620+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003581 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_tad.c auth v1487 ap=1 s=15976 n(v0 rc2023-10-26T06:45:47.246033+0000 b15976 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132209600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003581:[<0x10000003711/acpi_tad.c v1487>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003581:[<0x10000003711/acpi_tad.c v1487>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.620+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000369c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nvs.c auth v1709 ap=1 s=4661 n(v0 rc2019-11-25T00:32:01.000000+0000 b4661 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13220a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000369c:[<0x10000003711/nvs.c v1709>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000369c:[<0x10000003711/nvs.c v1709>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.620+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036b5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/property.c auth v1691 ap=1 s=37006 n(v0 rc2019-11-25T00:32:01.000000+0000 b37006 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132209b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036b5:[<0x10000003711/property.c v1691>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036b5:[<0x10000003711/property.c v1691>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.621+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000367c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bus.c auth v1849 ap=1 s=33862 n(v0 rc2019-11-25T00:32:01.000000+0000 b33862 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13220ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000367c:[<0x10000003711/bus.c v1849>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000367c:[<0x10000003711/bus.c v1849>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.621+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003689 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec.c auth v1471 ap=1 s=58026 n(v0 rc2019-11-25T00:32:01.000000+0000 b58026 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13220b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003689:[<0x10000003711/ec.c v1471>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003689:[<0x10000003711/ec.c v1471>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.621+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_platform.c auth v1817 ap=1 s=3919 n(v0 rc2019-11-25T00:32:01.000000+0000 b3919 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13220a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357e:[<0x10000003711/acpi_platform.c v1817>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000357e:[<0x10000003711/acpi_platform.c v1817>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.621+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003680 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cppc_acpi.c auth v1545 ap=1 s=41983 n(v0 rc2019-11-25T00:32:01.000000+0000 b41983 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13220b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003680:[<0x10000003711/cppc_acpi.c v1545>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003680:[<0x10000003711/cppc_acpi.c v1545>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.622+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003573 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_apd.c auth v1547 ap=1 s=6351 n(v0 rc2019-11-25T00:32:01.000000+0000 b6351 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132214b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003573:[<0x10000003711/acpi_apd.c v1547>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003573:[<0x10000003711/acpi_apd.c v1547>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.622+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003818 [...4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/ auth v1915 ap=1 f(v0 m2023-10-26T06:45:47.466028+0000 7=7+0) n(v0 rc2023-10-26T06:45:47.466028+0000 b129354 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={15375=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15375 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132214580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000003818:[<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(2)0x10000003818:[<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-26T06:45:47.466028+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-26T06:45:47.466028+0000 b129354 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-26T06:45:47.466028+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-26T06:45:47.466028+0000 b129354 8=7+1)","error_str":""},"return_code":0} 2023-10-26T06:48:49.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.622+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036ad [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/proc.c auth v1361 ap=1 s=3689 n(v0 rc2019-11-25T00:32:01.000000+0000 b3689 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132215080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036ad:[<0x10000003711/proc.c v1361>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036ad:[<0x10000003711/proc.c v1361>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.622+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003681 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/custom_method.c auth v1857 ap=1 s=2190 n(v0 rc2019-11-25T00:32:01.000000+0000 b2190 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132214000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003681:[<0x10000003711/custom_method.c v1857>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003681:[<0x10000003711/custom_method.c v1857>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.623+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000357b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpss.c auth v1419 ap=1 s=35323 n(v0 rc2019-11-25T00:32:01.000000+0000 b35323 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132216680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000357b:[<0x10000003711/acpi_lpss.c v1419>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000357b:[<0x10000003711/acpi_lpss.c v1419>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.623+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_link.c auth v1759 ap=1 s=24172 n(v0 rc2019-11-25T00:32:01.000000+0000 b24172 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132216100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a0:[<0x10000003711/pci_link.c v1759>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a0:[<0x10000003711/pci_link.c v1759>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.623+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000367d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/button.c auth v1835 ap=1 s=17717 n(v0 rc2019-11-25T00:32:01.000000+0000 b17717 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132215600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000367d:[<0x10000003711/button.c v1835>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000367d:[<0x10000003711/button.c v1835>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.625+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000368d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/fan.c auth v1531 ap=1 s=10259 n(v0 rc2019-11-25T00:32:01.000000+0000 b10259 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132215b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000368d:[<0x10000003711/fan.c v1531>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000368d:[<0x10000003711/fan.c v1531>,<0x1000000370b/acpi v20289>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.860+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000346d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.h auth v158 ap=1 s=86 n(v0 rc2019-11-25T00:32:01.000000+0000 b86 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f68fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000346d:[<0x10000003605/ibm.h v158>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000346d:[<0x10000003605/ibm.h v158>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:49.989 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evxface.o 2023-10-26T06:48:50.006 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/ioprio.o 2023-10-26T06:48:50.037 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/rsapubkey.asn1.o 2023-10-26T06:48:50.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003712 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_perflib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000367b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/blacklist.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000369b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/numa.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003684 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003683 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_pm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000367a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bgrt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003682 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/debugfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000368c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/evged.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036bf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000368f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hed.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003578 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_ipmi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036bd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003577 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_extlog.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003576 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_dbg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003816 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_throttling.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000369e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036ac (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pptt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036bb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/scan.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036ae (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000367f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/container.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003693 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ioapic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000367e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cm_sbs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003694 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/irq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003692 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/internal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036af (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_driver.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_slot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000381c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036c0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/tables.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000368a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec_sys.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_root.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036be (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/spcr.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036ab (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/power.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036bc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003574 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_cmos_rtc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000369d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/resource.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000357f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pnp.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036c1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000357a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000368e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/glue.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000356f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003579 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003572 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_amba.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003812 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003713 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003575 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_configfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000381a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/reboot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003582 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_video.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003583 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_watchdog.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036c3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/video_detect.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_pdc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036c2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/utils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003810 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_mcfg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000368b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/event.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036c4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/wakeup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003580 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_processor.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000369f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_irq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_idle.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000357d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pad.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000357c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_memhotplug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003679 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/battery.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036ba (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003685 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003570 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ac.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003571 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_adxl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003814 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003581 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_tad.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000369c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nvs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036b5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/property.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000367c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bus.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003689 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000357e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_platform.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003680 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cppc_acpi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003573 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_apd.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003818 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036ad (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/proc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003681 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/custom_method.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000357b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpss.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_link.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000367d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/button.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:49 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000368d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/fan.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.237 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.863+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003462 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.c auth v198 ap=1 s=3789 n(v0 rc2019-11-25T00:32:01.000000+0000 b3789 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f690c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003462:[<0x10000003605/amiga.c v198>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003462:[<0x10000003605/amiga.c v198>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.237 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.863+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003606 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Kconfig auth v200 ap=1 s=9850 n(v0 rc2023-10-26T06:45:47.028038+0000 b9850 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f690100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003606:[<0x10000003605/Kconfig v200>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003606:[<0x10000003605/Kconfig v200>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.237 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.867+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000346c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.c auth v186 ap=1 s=9594 n(v0 rc2019-11-25T00:32:01.000000+0000 b9594 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f691180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000346c:[<0x10000003605/ibm.c v186>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000346c:[<0x10000003605/ibm.c v186>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.238 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.868+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003470 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.c auth v182 ap=1 s=43074 n(v0 rc2023-10-26T06:45:47.030038+0000 b43074 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f691700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003470:[<0x10000003605/ldm.c v182>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003470:[<0x10000003605/ldm.c v182>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.238 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.868+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003468 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.c auth v190 ap=1 s=3687 n(v0 rc2019-11-25T00:32:01.000000+0000 b3687 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f695080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003468:[<0x10000003605/cmdline.c v190>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003468:[<0x10000003605/cmdline.c v190>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.238 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.868+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003461 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.h auth v160 ap=1 s=98 n(v0 rc2019-11-25T00:32:01.000000+0000 b98 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f695b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003461:[<0x10000003605/aix.h v160>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003461:[<0x10000003605/aix.h v160>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.238 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.868+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003474 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.c auth v168 ap=1 s=16422 n(v0 rc2019-11-25T00:32:01.000000+0000 b16422 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f696100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003474:[<0x10000003605/msdos.c v168>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003474:[<0x10000003605/msdos.c v168>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.238 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.869+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003460 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.c auth v176 ap=1 s=6584 n(v0 rc2019-11-25T00:32:01.000000+0000 b6584 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f695600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003460:[<0x10000003605/aix.c v176>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003460:[<0x10000003605/aix.c v176>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.239 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.869+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003476 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.c auth v144 ap=1 s=1961 n(v0 rc2019-11-25T00:32:01.000000+0000 b1961 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f697700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003476:[<0x10000003605/osf.c v144>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003476:[<0x10000003605/osf.c v144>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.239 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.870+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003469 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.h auth v214 ap=1 s=96 n(v0 rc2019-11-25T00:32:01.000000+0000 b96 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f694000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003469:[<0x10000003605/cmdline.h v214>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003469:[<0x10000003605/cmdline.h v214>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.239 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.870+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003464 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.c auth v202 ap=1 s=4244 n(v0 rc2023-10-26T06:45:47.029038+0000 b4244 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f696c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003464:[<0x10000003605/atari.c v202>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003464:[<0x10000003605/atari.c v202>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.239 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.870+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003478 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.c auth v206 ap=1 s=2310 n(v0 rc2019-11-25T00:32:01.000000+0000 b2310 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12f697180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003478:[<0x10000003605/sgi.c v206>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003478:[<0x10000003605/sgi.c v206>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.240 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.870+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003467 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.h auth v162 ap=1 s=1213 n(v0 rc2019-11-25T00:32:01.000000+0000 b1213 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003467:[<0x10000003605/check.h v162>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003467:[<0x10000003605/check.h v162>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.240 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.871+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003472 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.c auth v188 ap=1 s=3640 n(v0 rc2019-11-25T00:32:01.000000+0000 b3640 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003472:[<0x10000003605/mac.c v188>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003472:[<0x10000003605/mac.c v188>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.240 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.871+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003471 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.h auth v172 ap=1 s=4800 n(v0 rc2019-11-25T00:32:01.000000+0000 b4800 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003471:[<0x10000003605/ldm.h v172>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003471:[<0x10000003605/ldm.h v172>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.240 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.871+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000347d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.h auth v208 ap=1 s=101 n(v0 rc2019-11-25T00:32:01.000000+0000 b101 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000347d:[<0x10000003605/sysv68.h v208>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000347d:[<0x10000003605/sysv68.h v208>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.240 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.871+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003475 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.h auth v166 ap=1 s=163 n(v0 rc2019-11-25T00:32:01.000000+0000 b163 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003475:[<0x10000003605/msdos.h v166>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003475:[<0x10000003605/msdos.h v166>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.241 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.872+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000345d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Makefile auth v146 ap=1 s=737 n(v0 rc2019-11-25T00:32:01.000000+0000 b737 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000345d:[<0x10000003605/Makefile v146>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000345d:[<0x10000003605/Makefile v146>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.241 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.872+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000347e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.c auth v170 ap=1 s=1225 n(v0 rc2019-11-25T00:32:01.000000+0000 b1225 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000347e:[<0x10000003605/ultrix.c v170>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000347e:[<0x10000003605/ultrix.c v170>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.241 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.872+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003477 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.h auth v156 ap=1 s=162 n(v0 rc2019-11-25T00:32:01.000000+0000 b162 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129892000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003477:[<0x10000003605/osf.h v156>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003477:[<0x10000003605/osf.h v156>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.241 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.873+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000347f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.h auth v212 ap=1 s=129 n(v0 rc2019-11-25T00:32:01.000000+0000 b129 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000347f:[<0x10000003605/ultrix.h v212>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000347f:[<0x10000003605/ultrix.h v212>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.242 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.873+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000347c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.c auth v192 ap=1 s=1975 n(v0 rc2019-11-25T00:32:01.000000+0000 b1975 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129893080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000347c:[<0x10000003605/sysv68.c v192>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000347c:[<0x10000003605/sysv68.c v192>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.242 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.873+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000346b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.h auth v150 ap=1 s=3800 n(v0 rc2019-11-25T00:32:01.000000+0000 b3800 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129893600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000346b:[<0x10000003605/efi.h v150>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000346b:[<0x10000003605/efi.h v150>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.242 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.874+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003465 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.h auth v178 ap=1 s=1099 n(v0 rc2019-11-25T00:32:01.000000+0000 b1099 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe16100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003465:[<0x10000003605/atari.h v178>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003465:[<0x10000003605/atari.h v178>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.242 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.874+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000346a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.c auth v174 ap=1 s=22811 n(v0 rc2019-11-25T00:32:01.000000+0000 b22811 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129894100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000346a:[<0x10000003605/efi.c v174>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000346a:[<0x10000003605/efi.c v174>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.242 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.875+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003463 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.h auth v194 ap=1 s=128 n(v0 rc2019-11-25T00:32:01.000000+0000 b128 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129893b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003463:[<0x10000003605/amiga.h v194>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003463:[<0x10000003605/amiga.h v194>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.243 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.876+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000346e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.c auth v180 ap=1 s=1151 n(v0 rc2019-11-25T00:32:01.000000+0000 b1151 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12fe16c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000346e:[<0x10000003605/karma.c v180>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000346e:[<0x10000003605/karma.c v180>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.243 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.876+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000345e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.c auth v148 ap=1 s=12374 n(v0 rc2019-11-25T00:32:01.000000+0000 b12374 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129894c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000345e:[<0x10000003605/acorn.c v148>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000345e:[<0x10000003605/acorn.c v148>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.243 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.876+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000345f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.h auth v164 ap=1 s=527 n(v0 rc2019-11-25T00:32:01.000000+0000 b527 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129895180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000345f:[<0x10000003605/acorn.h v164>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000345f:[<0x10000003605/acorn.h v164>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.243 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.876+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000347b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.h auth v210 ap=1 s=208 n(v0 rc2019-11-25T00:32:01.000000+0000 b208 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e129894680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000347b:[<0x10000003605/sun.h v210>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000347b:[<0x10000003605/sun.h v210>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.244 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.877+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000346f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.h auth v204 ap=1 s=163 n(v0 rc2019-11-25T00:32:01.000000+0000 b163 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000346f:[<0x10000003605/karma.h v204>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000346f:[<0x10000003605/karma.h v204>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.244 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.877+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003466 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.c auth v184 ap=1 s=4333 n(v0 rc2019-11-25T00:32:01.000000+0000 b4333 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003466:[<0x10000003605/check.c v184>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003466:[<0x10000003605/check.c v184>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.244 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.877+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003479 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.h auth v196 ap=1 s=167 n(v0 rc2019-11-25T00:32:01.000000+0000 b167 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003479:[<0x10000003605/sgi.h v196>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003479:[<0x10000003605/sgi.h v196>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.244 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.878+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003473 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.h auth v152 ap=1 s=1303 n(v0 rc2019-11-25T00:32:01.000000+0000 b1303 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffedb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003473:[<0x10000003605/mac.h v152>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003473:[<0x10000003605/mac.h v152>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.244 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:49.878+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000347a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.c auth v154 ap=1 s=3863 n(v0 rc2019-11-25T00:32:01.000000+0000 b3863 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000347a:[<0x10000003605/sun.c v154>,<0x10000003603/partitions v616>,<0x10000000202/block v10669>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000347a:[<0x10000003605/sun.c v154>,<0x10000003603/partitions v674>,<0x10000000202/block v11975>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:50.248 INFO:tasks.workunit.client.0.smithi050.stdout: CC crypto/rsaprivkey.asn1.o 2023-10-26T06:48:50.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003712 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_perflib.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000367b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/blacklist.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000369b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/numa.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003684 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003683 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_pm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000367a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bgrt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003682 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/debugfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000368c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/evged.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036bf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sysfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000368f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hed.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003578 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_ipmi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036bd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003577 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_extlog.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003576 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_dbg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003816 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_throttling.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000369e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036ac (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pptt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036bb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/scan.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036ae (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000367f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/container.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003693 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ioapic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000367e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cm_sbs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003694 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/irq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003692 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/internal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036af (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_driver.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_slot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000381c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036c0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/tables.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000368a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec_sys.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_root.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036be (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/spcr.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036ab (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/power.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.279 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036bc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003574 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_cmos_rtc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000369d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/resource.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000357f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pnp.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.280 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036c1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000357a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000368e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/glue.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000356f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003579 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003572 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_amba.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003812 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003713 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003575 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_configfs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000381a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.282 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/reboot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003582 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_video.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003583 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_watchdog.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036c3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/video_detect.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_pdc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036c2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/utils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.284 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003810 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.284 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.284 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_mcfg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.284 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000368b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/event.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.284 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036c4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/wakeup.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003580 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_processor.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000369f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_irq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_idle.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000357d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pad.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000357c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_memhotplug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.286 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003679 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/battery.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.286 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036ba (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.286 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003685 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.286 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003570 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ac.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.286 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003571 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_adxl.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.286 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003814 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003581 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_tad.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000369c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nvs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036b5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/property.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000367c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bus.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003689 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000357e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_platform.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003680 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cppc_acpi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003573 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_apd.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003818 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036ad (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/proc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003681 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/custom_method.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000357b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpss.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_link.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000367d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/button.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:49 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000368d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/fan.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:50.420 INFO:tasks.workunit.client.0.smithi050.stdout: AR crypto/built-in.a 2023-10-26T06:48:50.507 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/hrtimer.o 2023-10-26T06:48:50.555 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/dptf/int340x_thermal.o 2023-10-26T06:48:50.860 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/iomap/built-in.a 2023-10-26T06:48:50.960 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evxfevnt.o 2023-10-26T06:48:50.972 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/namei.o 2023-10-26T06:48:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: pgmap v474: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2023-10-26T06:48:51.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000346d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003462 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003606 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000346c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003470 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003468 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003461 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003474 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003460 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003476 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003469 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003464 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003478 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003467 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003472 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003471 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000347d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003475 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000345d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000347e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003477 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000347f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000347c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000346b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003465 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000346a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003463 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000346e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000345e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000345f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000347b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000346f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003466 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003479 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003473 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:50 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000347a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.184 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/badblocks.o 2023-10-26T06:48:51.207 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/irq_64.o 2023-10-26T06:48:51.219 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/fair.o 2023-10-26T06:48:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: pgmap v474: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2023-10-26T06:48:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000346d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003462 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003606 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000346c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003470 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003468 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003461 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003474 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003460 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003476 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003469 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003464 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003478 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003467 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003472 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003471 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000347d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003475 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000345d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000347e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003477 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000347f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000347c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000346b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003465 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000346a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003463 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000346e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000345e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000345f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000347b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000346f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003466 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003479 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003473 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:50 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000347a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: pgmap v474: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2023-10-26T06:48:51.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000346d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003462 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003606 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000346c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003470 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003468 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003461 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003474 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003460 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003476 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003469 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003464 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003478 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003467 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003472 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003471 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000347d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003475 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000345d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000347e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003477 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000347f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000347c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000346b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003465 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000346a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003463 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000346e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000345e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000345f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000347b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000346f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.274 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003466 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003479 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003473 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.275 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:50 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000347a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:51.469 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/acpi/dptf/built-in.a 2023-10-26T06:48:51.535 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/rt.o 2023-10-26T06:48:51.635 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evxfgpe.o 2023-10-26T06:48:51.862 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/inode.o 2023-10-26T06:48:52.102 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-rq-qos.o 2023-10-26T06:48:52.154 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/dumpstack_64.o 2023-10-26T06:48:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:51 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:48:52.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:51 smithi125 ceph-mon[130643]: pgmap v475: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2023-10-26T06:48:52.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:51 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:48:52.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:51 smithi153 ceph-mon[131657]: pgmap v475: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2023-10-26T06:48:52.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:51 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:48:52.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:51 smithi050 ceph-mon[94997]: pgmap v475: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2023-10-26T06:48:52.353 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mempolicy.o 2023-10-26T06:48:52.364 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/timekeeping.o 2023-10-26T06:48:52.435 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/evxfregn.o 2023-10-26T06:48:52.879 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.506+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003690 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Makefile auth v12 ap=1 s=74 n(v0 rc2019-11-25T00:32:01.000000+0000 b74 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132217180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003690:[<0x10000003816/Makefile v12>,<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003690:[<0x10000003816/Makefile v12>,<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.879 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.507+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003817 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Kconfig auth v16 ap=1 s=415 n(v0 rc2023-10-26T06:45:47.459028+0000 b415 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132216c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003817:[<0x10000003816/Kconfig v16>,<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003817:[<0x10000003816/Kconfig v16>,<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.880 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.507+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000381d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/apple.c auth v8 ap=1 s=4202 n(v0 rc2023-10-26T06:45:47.507027+0000 b4202 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000381d:[<0x1000000381c/apple.c v8>,<0x10000003711/x86 v1919>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000381d:[<0x1000000381c/apple.c v8>,<0x10000003711/x86 v1919>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.880 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.507+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_bxtwc.c auth v38 ap=1 s=7845 n(v0 rc2019-11-25T00:32:01.000000+0000 b7845 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a5:[<0x1000000381a/intel_pmic_bxtwc.c v38>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a5:[<0x1000000381a/intel_pmic_bxtwc.c v38>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.880 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.507+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtwc.c auth v32 ap=1 s=6751 n(v0 rc2019-11-25T00:32:01.000000+0000 b6751 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a7:[<0x1000000381a/intel_pmic_chtwc.c v32>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a7:[<0x1000000381a/intel_pmic_chtwc.c v32>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.880 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.508+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036c5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/utils.c auth v10 ap=1 s=4723 n(v0 rc2019-11-25T00:32:01.000000+0000 b4723 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036c5:[<0x1000000381c/utils.c v10>,<0x10000003711/x86 v1919>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036c5:[<0x1000000381c/utils.c v10>,<0x10000003711/x86 v1919>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.880 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.508+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036aa [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/tps68470_pmic.c auth v34 ap=1 s=10285 n(v0 rc2023-10-26T06:45:47.480027+0000 b10285 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036aa:[<0x1000000381a/tps68470_pmic.c v34>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036aa:[<0x1000000381a/tps68470_pmic.c v34>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.881 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.508+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtdc_ti.c auth v40 ap=1 s=3280 n(v0 rc2019-11-25T00:32:01.000000+0000 b3280 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a6:[<0x1000000381a/intel_pmic_chtdc_ti.c v40>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a6:[<0x1000000381a/intel_pmic_chtdc_ti.c v40>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.881 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.508+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.h auth v42 ap=1 s=1121 n(v0 rc2019-11-25T00:32:01.000000+0000 b1121 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a4:[<0x1000000381a/intel_pmic.h v42>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a4:[<0x1000000381a/intel_pmic.h v42>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.881 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.508+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_crc.c auth v36 ap=1 s=5664 n(v0 rc2019-11-25T00:32:01.000000+0000 b5664 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a8:[<0x1000000381a/intel_pmic_crc.c v36>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a8:[<0x1000000381a/intel_pmic_crc.c v36>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.881 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.508+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000036a9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_xpower.c auth v44 ap=1 s=6635 n(v0 rc2019-11-25T00:32:01.000000+0000 b6635 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000036a9:[<0x1000000381a/intel_pmic_xpower.c v44>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x100000036a9:[<0x1000000381a/intel_pmic_xpower.c v44>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.881 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.509+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003677 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/gtdt.c auth v16 ap=1 s=11354 n(v0 rc2019-11-25T00:32:01.000000+0000 b11354 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13300e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003677:[<0x10000003812/gtdt.c v16>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003677:[<0x10000003812/gtdt.c v16>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.882 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.509+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003691 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/hmat.c auth v14 ap=1 s=18564 n(v0 rc2019-11-25T00:32:01.000000+0000 b18564 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e132217700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003691:[<0x10000003816/hmat.c v14>,<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003691:[<0x10000003816/hmat.c v14>,<0x10000003711/hmat v1913>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.882 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.509+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000381b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.c auth v46 ap=1 s=9393 n(v0 rc2023-10-26T06:45:47.479027+0000 b9393 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000381b:[<0x1000000381a/intel_pmic.c v46>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000381b:[<0x1000000381a/intel_pmic.c v46>,<0x10000003711/pmic v1917>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.882 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.509+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003678 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/iort.c auth v18 ap=1 s=41680 n(v0 rc2019-11-25T00:32:01.000000+0000 b41680 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13300e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003678:[<0x10000003812/iort.c v18>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003678:[<0x10000003812/iort.c v18>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.882 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.509+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresnte.c auth v816 ap=1 s=6834 n(v0 rc2019-11-25T00:32:01.000000+0000 b6834 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13300f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d8:[<0x10000003713/exresnte.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d8:[<0x10000003713/exresnte.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.883 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.510+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsutils.c auth v844 ap=1 s=23691 n(v0 rc2019-11-25T00:32:01.000000+0000 b23691 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13300fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b2:[<0x10000003713/dsutils.c v844>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b2:[<0x10000003713/dsutils.c v844>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.883 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.510+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000362d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pswalk.c auth v810 ap=1 s=2488 n(v0 rc2019-11-25T00:32:01.000000+0000 b2488 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133010100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000362d:[<0x10000003713/pswalk.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000362d:[<0x10000003713/pswalk.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.883 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.511+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exprep.c auth v796 ap=1 s=18293 n(v0 rc2019-11-25T00:32:01.000000+0000 b18293 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133010c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d6:[<0x10000003713/exprep.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d6:[<0x10000003713/exprep.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.883 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.512+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003634 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsinfo.c auth v812 ap=1 s=11247 n(v0 rc2019-11-25T00:32:01.000000+0000 b11247 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133011180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003634:[<0x10000003713/rsinfo.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003634:[<0x10000003713/rsinfo.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.883 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.512+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003813 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Kconfig auth v22 ap=1 s=123 n(v0 rc2023-10-26T06:45:47.433028+0000 b123 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1337d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003813:[<0x10000003812/Kconfig v22>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003813:[<0x10000003812/Kconfig v22>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.512+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003661 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresdecode.c auth v808 ap=1 s=4896 n(v0 rc2023-10-26T06:45:47.295032+0000 b4896 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133011700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003661:[<0x10000003713/utresdecode.c v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003661:[<0x10000003713/utresdecode.c v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003676 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Makefile auth v20 ap=1 s=110 n(v0 rc2019-11-25T00:32:01.000000+0000 b110 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e13300eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003676:[<0x10000003812/Makefile v20>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003676:[<0x10000003812/Makefile v20>,<0x10000003711/arm64 v1909>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ea [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxface.c auth v840 ap=1 s=13453 n(v0 rc2019-11-25T00:32:01.000000+0000 b13453 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133010680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ea:[<0x10000003713/hwxface.c v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ea:[<0x10000003713/hwxface.c v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035cf [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmisc.c auth v842 ap=1 s=11917 n(v0 rc2019-11-25T00:32:01.000000+0000 b11917 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13300f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035cf:[<0x10000003713/exmisc.c v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035cf:[<0x10000003713/exmisc.c v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035bc [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeinit.c auth v830 ap=1 s=12405 n(v0 rc2023-10-26T06:45:47.275032+0000 b12405 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133014000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035bc:[<0x10000003713/evgpeinit.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035bc:[<0x10000003713/evgpeinit.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.885 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003642 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbutils.c auth v836 ap=1 s=13128 n(v0 rc2019-11-25T00:32:01.000000+0000 b13128 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133014b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003642:[<0x10000003713/tbutils.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003642:[<0x10000003713/tbutils.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.885 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003659 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmisc.c auth v826 ap=1 s=10190 n(v0 rc2019-11-25T00:32:01.000000+0000 b10190 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133014580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003659:[<0x10000003713/utmisc.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003659:[<0x10000003713/utmisc.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.885 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.513+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000359d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbexec.c auth v798 ap=1 s=23859 n(v0 rc2019-11-25T00:32:01.000000+0000 b23859 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133015080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000359d:[<0x10000003713/dbexec.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000359d:[<0x10000003713/dbexec.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.885 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.514+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwtimer.c auth v820 ap=1 s=4911 n(v0 rc2019-11-25T00:32:01.000000+0000 b4911 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133015600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e8:[<0x10000003713/hwtimer.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e8:[<0x10000003713/hwtimer.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.885 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.514+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmutex.c auth v814 ap=1 s=14919 n(v0 rc2019-11-25T00:32:01.000000+0000 b14919 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133015b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d0:[<0x10000003713/exmutex.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d0:[<0x10000003713/exmutex.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.886 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.514+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003653 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uthex.c auth v800 ap=1 s=2994 n(v0 rc2019-11-25T00:32:01.000000+0000 b2994 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133016100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003653:[<0x10000003713/uthex.c v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003653:[<0x10000003713/uthex.c v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.886 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.514+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000361c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair.c auth v822 ap=1 s=17407 n(v0 rc2019-11-25T00:32:01.000000+0000 b17407 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133017180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000361c:[<0x10000003713/nsrepair.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000361c:[<0x10000003713/nsrepair.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.886 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.514+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003664 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstring.c auth v818 ap=1 s=5079 n(v0 rc2019-11-25T00:32:01.000000+0000 b5079 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133017700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003664:[<0x10000003713/utstring.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003664:[<0x10000003713/utstring.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.886 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.514+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000365b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utnonansi.c auth v838 ap=1 s=4474 n(v0 rc2019-11-25T00:32:01.000000+0000 b4474 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d80000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000365b:[<0x10000003713/utnonansi.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000365b:[<0x10000003713/utnonansi.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.886 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.515+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003598 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlcode.h auth v806 ap=1 s=18169 n(v0 rc2019-11-25T00:32:01.000000+0000 b18169 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d80580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003598:[<0x10000003713/amlcode.h v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003598:[<0x10000003713/amlcode.h v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.887 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.515+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003591 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acopcode.h auth v832 ap=1 s=21200 n(v0 rc2019-11-25T00:32:01.000000+0000 b21200 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133016c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003591:[<0x10000003713/acopcode.h v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003591:[<0x10000003713/acopcode.h v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.887 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.515+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035eb [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxfsleep.c auth v824 ap=1 s=9878 n(v0 rc2019-11-25T00:32:01.000000+0000 b9878 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133016680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035eb:[<0x10000003713/hwxfsleep.c v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035eb:[<0x10000003713/hwxfsleep.c v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.887 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.515+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000362e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psxface.c auth v834 ap=1 s=9478 n(v0 rc2019-11-25T00:32:01.000000+0000 b9478 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d81080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000362e:[<0x10000003713/psxface.c v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000362e:[<0x10000003713/psxface.c v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.887 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.515+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003651 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utexcep.c auth v804 ap=1 s=3060 n(v0 rc2019-11-25T00:32:01.000000+0000 b3060 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d81600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003651:[<0x10000003713/utexcep.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003651:[<0x10000003713/utexcep.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.887 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.516+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbxface.c auth v802 ap=1 s=13608 n(v0 rc2019-11-25T00:32:01.000000+0000 b13608 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d80b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a7:[<0x10000003713/dbxface.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a7:[<0x10000003713/dbxface.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.516+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000363e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfadt.c auth v798 ap=1 s=22374 n(v0 rc2019-11-25T00:32:01.000000+0000 b22374 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d82100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000363e:[<0x10000003713/tbfadt.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000363e:[<0x10000003713/tbfadt.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.516+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003617 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsnames.c auth v828 ap=1 s=13359 n(v0 rc2019-11-25T00:32:01.000000+0000 b13359 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d81b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003617:[<0x10000003713/nsnames.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003617:[<0x10000003713/nsnames.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.516+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfregn.c auth v822 ap=1 s=6405 n(v0 rc2019-11-25T00:32:01.000000+0000 b6405 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d82c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c6:[<0x10000003713/evxfregn.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c6:[<0x10000003713/evxfregn.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.516+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035cc [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdump.c auth v808 ap=1 s=33613 n(v0 rc2019-11-25T00:32:01.000000+0000 b33613 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d82680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035cc:[<0x10000003713/exdump.c v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035cc:[<0x10000003713/exdump.c v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.888 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.517+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003650 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uteval.c auth v818 ap=1 s=8585 n(v0 rc2019-11-25T00:32:01.000000+0000 b8585 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d83700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003650:[<0x10000003713/uteval.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003650:[<0x10000003713/uteval.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.517+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003589 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acevents.h auth v804 ap=1 s=6992 n(v0 rc2019-11-25T00:32:01.000000+0000 b6992 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003589:[<0x10000003713/acevents.h v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003589:[<0x10000003713/acevents.h v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.517+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ca [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/excreate.c auth v840 ap=1 s=13007 n(v0 rc2019-11-25T00:32:01.000000+0000 b13007 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ca:[<0x10000003713/excreate.c v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ca:[<0x10000003713/excreate.c v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.517+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000365c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utobject.c auth v826 ap=1 s=18863 n(v0 rc2019-11-25T00:32:01.000000+0000 b18863 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000365c:[<0x10000003713/utobject.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000365c:[<0x10000003713/utobject.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.889 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.517+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003665 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrsuppt.c auth v810 ap=1 s=12748 n(v0 rc2019-11-25T00:32:01.000000+0000 b12748 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003665:[<0x10000003713/utstrsuppt.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003665:[<0x10000003713/utstrsuppt.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.517+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003610 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsarguments.c auth v830 ap=1 s=8898 n(v0 rc2019-11-25T00:32:01.000000+0000 b8898 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003610:[<0x10000003713/nsarguments.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003610:[<0x10000003713/nsarguments.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.518+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dspkginit.c auth v816 ap=1 s=16258 n(v0 rc2019-11-25T00:32:01.000000+0000 b16258 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b1:[<0x10000003713/dspkginit.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b1:[<0x10000003713/dspkginit.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.518+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ec [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsaccess.c auth v806 ap=1 s=20571 n(v0 rc2019-11-25T00:32:01.000000+0000 b20571 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ec:[<0x10000003713/nsaccess.c v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ec:[<0x10000003713/nsaccess.c v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.890 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.518+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003593 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acpredef.h auth v832 ap=1 s=37198 n(v0 rc2019-11-25T00:32:01.000000+0000 b37198 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003593:[<0x10000003713/acpredef.h v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003593:[<0x10000003713/acpredef.h v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.518+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003586 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acconvert.h auth v800 ap=1 s=2912 n(v0 rc2019-11-25T00:32:01.000000+0000 b2912 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003586:[<0x10000003713/acconvert.h v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003586:[<0x10000003713/acconvert.h v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.518+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exregion.c auth v820 ap=1 s=13755 n(v0 rc2019-11-25T00:32:01.000000+0000 b13755 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d7:[<0x10000003713/exregion.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d7:[<0x10000003713/exregion.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.518+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exnames.c auth v838 ap=1 s=9761 n(v0 rc2019-11-25T00:32:01.000000+0000 b9761 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132d8f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d1:[<0x10000003713/exnames.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d1:[<0x10000003713/exnames.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.519+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000361a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nspredef.c auth v796 ap=1 s=11788 n(v0 rc2019-11-25T00:32:01.000000+0000 b11788 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000361a:[<0x10000003713/nspredef.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000361a:[<0x10000003713/nspredef.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.519+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003623 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfobj.c auth v802 ap=1 s=5308 n(v0 rc2019-11-25T00:32:01.000000+0000 b5308 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f6e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003623:[<0x10000003713/nsxfobj.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003623:[<0x10000003713/nsxfobj.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.519+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003641 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbprint.c auth v824 ap=1 s=6116 n(v0 rc2023-10-26T06:45:47.291032+0000 b6116 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f6f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003641:[<0x10000003713/tbprint.c v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003641:[<0x10000003713/tbprint.c v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.519+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003658 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmath.c auth v834 ap=1 s=12991 n(v0 rc2019-11-25T00:32:01.000000+0000 b12991 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003658:[<0x10000003713/utmath.c v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003658:[<0x10000003713/utmath.c v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.520+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/extrace.c auth v814 ap=1 s=8503 n(v0 rc2019-11-25T00:32:01.000000+0000 b8503 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f6fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e0:[<0x10000003713/extrace.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e0:[<0x10000003713/extrace.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.892 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.520+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000358d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/aclocal.h auth v812 ap=1 s=41786 n(v0 rc2019-11-25T00:32:01.000000+0000 b41786 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000358d:[<0x10000003713/aclocal.h v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000358d:[<0x10000003713/aclocal.h v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.520+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000364d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdecode.c auth v828 ap=1 s=15532 n(v0 rc2019-11-25T00:32:01.000000+0000 b15532 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f70680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000364d:[<0x10000003713/utdecode.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000364d:[<0x10000003713/utdecode.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.520+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003619 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsparse.c auth v806 ap=1 s=7705 n(v0 rc2019-11-25T00:32:01.000000+0000 b7705 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003619:[<0x10000003713/nsparse.c v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003619:[<0x10000003713/nsparse.c v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.521+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbmethod.c auth v838 ap=1 s=11817 n(v0 rc2019-11-25T00:32:01.000000+0000 b11817 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a1:[<0x10000003713/dbmethod.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a1:[<0x10000003713/dbmethod.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.522+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003588 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdispat.h auth v824 ap=1 s=9989 n(v0 rc2019-11-25T00:32:01.000000+0000 b9989 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003588:[<0x10000003713/acdispat.h v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003588:[<0x10000003713/acdispat.h v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.522+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003587 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdebug.h auth v834 ap=1 s=7391 n(v0 rc2019-11-25T00:32:01.000000+0000 b7391 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003587:[<0x10000003713/acdebug.h v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003587:[<0x10000003713/acdebug.h v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.522+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000364a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcache.c auth v852 ap=1 s=6719 n(v0 rc2019-11-25T00:32:01.000000+0000 b6719 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000364a:[<0x10000003713/utcache.c v852>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000364a:[<0x10000003713/utcache.c v852>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.522+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003663 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstate.c auth v814 ap=1 s=7318 n(v0 rc2019-11-25T00:32:01.000000+0000 b7318 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003663:[<0x10000003713/utstate.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003663:[<0x10000003713/utstate.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.523+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003629 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psparse.c auth v812 ap=1 s=17995 n(v0 rc2019-11-25T00:32:01.000000+0000 b17995 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003629:[<0x10000003713/psparse.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003629:[<0x10000003713/psparse.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.894 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.523+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evsci.c auth v816 ap=1 s=6068 n(v0 rc2019-11-25T00:32:01.000000+0000 b6068 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c2:[<0x10000003713/evsci.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c2:[<0x10000003713/evsci.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.523+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000364e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdelete.c auth v818 ap=1 s=19003 n(v0 rc2019-11-25T00:32:01.000000+0000 b19003 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000364e:[<0x10000003713/utdelete.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000364e:[<0x10000003713/utdelete.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.524+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evregion.c auth v836 ap=1 s=24748 n(v0 rc2019-11-25T00:32:01.000000+0000 b24748 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c0:[<0x10000003713/evregion.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c0:[<0x10000003713/evregion.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.524+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000358e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acmacros.h auth v842 ap=1 s=22098 n(v0 rc2019-11-25T00:32:01.000000+0000 b22098 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000358e:[<0x10000003713/acmacros.h v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000358e:[<0x10000003713/acmacros.h v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.524+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfevnt.c auth v836 ap=1 s=8890 n(v0 rc2019-11-25T00:32:01.000000+0000 b8890 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132f71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c4:[<0x10000003713/evxfevnt.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c4:[<0x10000003713/evxfevnt.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.895 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.524+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000358b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/achware.h auth v840 ap=1 s=3444 n(v0 rc2019-11-25T00:32:01.000000+0000 b3444 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000358b:[<0x10000003713/achware.h v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000358b:[<0x10000003713/achware.h v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.524+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload2.c auth v846 ap=1 s=17135 n(v0 rc2023-10-26T06:45:47.273032+0000 b17135 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132ccab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b5:[<0x10000003713/dswload2.c v846>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b5:[<0x10000003713/dswload2.c v846>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.525+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbinput.c auth v802 ap=1 s=27813 n(v0 rc2019-11-25T00:32:01.000000+0000 b27813 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a0:[<0x10000003713/dbinput.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a0:[<0x10000003713/dbinput.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.525+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbtest.c auth v826 ap=1 s=29348 n(v0 rc2023-10-26T06:45:47.270032+0000 b29348 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a5:[<0x10000003713/dbtest.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a5:[<0x10000003713/dbtest.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.896 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.525+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000366a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxferror.c auth v820 ap=1 s=7514 n(v0 rc2019-11-25T00:32:01.000000+0000 b7514 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000366a:[<0x10000003713/utxferror.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000366a:[<0x10000003713/utxferror.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.525+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000362a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psscope.c auth v808 ap=1 s=6570 n(v0 rc2019-11-25T00:32:01.000000+0000 b6570 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000362a:[<0x10000003713/psscope.c v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000362a:[<0x10000003713/psscope.c v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.525+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconfig.c auth v810 ap=1 s=15270 n(v0 rc2019-11-25T00:32:01.000000+0000 b15270 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c8:[<0x10000003713/exconfig.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c8:[<0x10000003713/exconfig.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.526+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003635 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsio.c auth v796 ap=1 s=7383 n(v0 rc2019-11-25T00:32:01.000000+0000 b7383 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003635:[<0x10000003713/rsio.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003635:[<0x10000003713/rsio.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.526+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003656 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utlock.c auth v832 ap=1 s=4001 n(v0 rc2019-11-25T00:32:01.000000+0000 b4001 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003656:[<0x10000003713/utlock.c v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003656:[<0x10000003713/utlock.c v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.897 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.526+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000365a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmutex.c auth v798 ap=1 s=8580 n(v0 rc2019-11-25T00:32:01.000000+0000 b8580 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132cd5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000365a:[<0x10000003713/utmutex.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000365a:[<0x10000003713/utmutex.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.526+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswscope.c auth v828 ap=1 s=4974 n(v0 rc2019-11-25T00:32:01.000000+0000 b4974 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128618000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b6:[<0x10000003713/dswscope.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b6:[<0x10000003713/dswscope.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.526+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000364c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdebug.c auth v830 ap=1 s=18177 n(v0 rc2019-11-25T00:32:01.000000+0000 b18177 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128619080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000364c:[<0x10000003713/utdebug.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000364c:[<0x10000003713/utdebug.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.526+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035dc [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstore.c auth v848 ap=1 s=16958 n(v0 rc2023-10-26T06:45:47.281032+0000 b16958 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035dc:[<0x10000003713/exstore.c v848>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035dc:[<0x10000003713/exstore.c v848>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.898 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.527+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000362b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pstree.c auth v800 ap=1 s=6456 n(v0 rc2019-11-25T00:32:01.000000+0000 b6456 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128619b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000362b:[<0x10000003713/pstree.c v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000362b:[<0x10000003713/pstree.c v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.527+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbobject.c auth v822 ap=1 s=11919 n(v0 rc2019-11-25T00:32:01.000000+0000 b11919 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12861a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a3:[<0x10000003713/dbobject.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a3:[<0x10000003713/dbobject.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.527+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsargs.c auth v804 ap=1 s=10408 n(v0 rc2019-11-25T00:32:01.000000+0000 b10408 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12861ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a8:[<0x10000003713/dsargs.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a8:[<0x10000003713/dsargs.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.527+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003639 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmisc.c auth v842 ap=1 s=19041 n(v0 rc2019-11-25T00:32:01.000000+0000 b19041 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12861b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003639:[<0x10000003713/rsmisc.c v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003639:[<0x10000003713/rsmisc.c v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.528+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000358a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acglobal.h auth v826 ap=1 s=15051 n(v0 rc2019-11-25T00:32:01.000000+0000 b15051 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128622000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000358a:[<0x10000003713/acglobal.h v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000358a:[<0x10000003713/acglobal.h v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.899 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.529+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003632 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdump.c auth v830 ap=1 s=13901 n(v0 rc2019-11-25T00:32:01.000000+0000 b13901 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128622580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003632:[<0x10000003713/rsdump.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003632:[<0x10000003713/rsdump.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.529+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003584 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acapps.h auth v822 ap=1 s=4035 n(v0 rc2019-11-25T00:32:01.000000+0000 b4035 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128622b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003584:[<0x10000003713/acapps.h v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003584:[<0x10000003713/acapps.h v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.529+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b8 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evevent.c auth v850 ap=1 s=7245 n(v0 rc2023-10-26T06:45:47.274032+0000 b7245 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128619600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b8:[<0x10000003713/evevent.c v850>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b8:[<0x10000003713/evevent.c v850>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.530+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000359e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbfileio.c auth v824 ap=1 s=3159 n(v0 rc2023-10-26T06:45:47.267032+0000 b3159 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12861b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000359e:[<0x10000003713/dbfileio.c v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000359e:[<0x10000003713/dbfileio.c v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.900 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.530+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwacpi.c auth v804 ap=1 s=3871 n(v0 rc2019-11-25T00:32:01.000000+0000 b3871 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128623600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e2:[<0x10000003713/hwacpi.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e2:[<0x10000003713/hwacpi.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.530+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg2.c auth v844 ap=1 s=14360 n(v0 rc2023-10-26T06:45:47.280032+0000 b14360 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12861a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d3:[<0x10000003713/exoparg2.c v844>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d3:[<0x10000003713/exoparg2.c v844>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.530+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003621 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfeval.c auth v810 ap=1 s=28367 n(v0 rc2019-11-25T00:32:01.000000+0000 b28367 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128623b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003621:[<0x10000003713/nsxfeval.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003621:[<0x10000003713/nsxfeval.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.531+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003648 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utascii.c auth v814 ap=1 s=2878 n(v0 rc2019-11-25T00:32:01.000000+0000 b2878 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128624680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003648:[<0x10000003713/utascii.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003648:[<0x10000003713/utascii.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.531+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003662 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresrc.c auth v816 ap=1 s=16429 n(v0 rc2019-11-25T00:32:01.000000+0000 b16429 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128624100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003662:[<0x10000003713/utresrc.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003662:[<0x10000003713/utresrc.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.901 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.531+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003646 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utaddress.c auth v834 ap=1 s=7738 n(v0 rc2019-11-25T00:32:01.000000+0000 b7738 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e128624c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003646:[<0x10000003713/utaddress.c v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003646:[<0x10000003713/utaddress.c v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.531+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003611 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsconvert.c auth v802 ap=1 s=13160 n(v0 rc2019-11-25T00:32:01.000000+0000 b13160 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff88580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003611:[<0x10000003713/nsconvert.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003611:[<0x10000003713/nsconvert.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.532+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003599 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlresrc.h auth v828 ap=1 s=16616 n(v0 rc2019-11-25T00:32:01.000000+0000 b16616 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff88000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003599:[<0x10000003713/amlresrc.h v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003599:[<0x10000003713/amlresrc.h v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.532+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035db [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exserial.c auth v818 ap=1 s=10319 n(v0 rc2019-11-25T00:32:01.000000+0000 b10319 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff88b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035db:[<0x10000003713/exserial.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035db:[<0x10000003713/exserial.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.902 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.532+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003614 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nseval.c auth v820 ap=1 s=9279 n(v0 rc2019-11-25T00:32:01.000000+0000 b9279 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff89080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003614:[<0x10000003713/nseval.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003614:[<0x10000003713/nseval.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.533+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg1.c auth v812 ap=1 s=26978 n(v0 rc2019-11-25T00:32:01.000000+0000 b26978 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff8a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d2:[<0x10000003713/exoparg1.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d2:[<0x10000003713/exoparg1.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.533+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003714 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/Makefile auth v808 ap=1 s=2871 n(v0 rc2023-10-26T06:45:47.264032+0000 b2871 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff89b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003714:[<0x10000003713/Makefile v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003714:[<0x10000003713/Makefile v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.533+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000363b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsutils.c auth v806 ap=1 s=22024 n(v0 rc2019-11-25T00:32:01.000000+0000 b22024 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff8a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000363b:[<0x10000003713/rsutils.c v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000363b:[<0x10000003713/rsutils.c v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.533+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003652 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utglobal.c auth v798 ap=1 s=7836 n(v0 rc2019-11-25T00:32:01.000000+0000 b7836 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff8ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003652:[<0x10000003713/utglobal.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003652:[<0x10000003713/utglobal.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.903 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.533+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a2 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbnames.c auth v796 ap=1 s=24699 n(v0 rc2023-10-26T06:45:47.269032+0000 b24699 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff8b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a2:[<0x10000003713/dbnames.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a2:[<0x10000003713/dbnames.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.534+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003625 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psloop.c auth v832 ap=1 s=14907 n(v0 rc2019-11-25T00:32:01.000000+0000 b14907 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12ff8b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003625:[<0x10000003713/psloop.c v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003625:[<0x10000003713/psloop.c v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.534+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003631 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscreate.c auth v836 ap=1 s=13422 n(v0 rc2019-11-25T00:32:01.000000+0000 b13422 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003631:[<0x10000003713/rscreate.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003631:[<0x10000003713/rscreate.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.534+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000363c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsxface.c auth v800 ap=1 s=19649 n(v0 rc2023-10-26T06:45:47.290032+0000 b19649 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000363c:[<0x10000003713/rsxface.c v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000363c:[<0x10000003713/rsxface.c v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.534+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresolv.c auth v796 ap=1 s=13411 n(v0 rc2019-11-25T00:32:01.000000+0000 b13411 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d9:[<0x10000003713/exresolv.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d9:[<0x10000003713/exresolv.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.904 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.535+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035bf [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evmisc.c auth v826 ap=1 s=7031 n(v0 rc2019-11-25T00:32:01.000000+0000 b7031 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035bf:[<0x10000003713/evmisc.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035bf:[<0x10000003713/evmisc.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.535+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000365d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utosi.c auth v804 ap=1 s=15221 n(v0 rc2019-11-25T00:32:01.000000+0000 b15221 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000365d:[<0x10000003713/utosi.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000365d:[<0x10000003713/utosi.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.535+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003626 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psobject.c auth v818 ap=1 s=19950 n(v0 rc2019-11-25T00:32:01.000000+0000 b19950 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003626:[<0x10000003713/psobject.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003626:[<0x10000003713/psobject.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.535+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbutils.c auth v830 ap=1 s=10255 n(v0 rc2019-11-25T00:32:01.000000+0000 b10255 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a6:[<0x10000003713/dbutils.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a6:[<0x10000003713/dbutils.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.535+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035de [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstorob.c auth v816 ap=1 s=5392 n(v0 rc2019-11-25T00:32:01.000000+0000 b5392 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035de:[<0x10000003713/exstorob.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035de:[<0x10000003713/exstorob.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.905 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.536+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035aa [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsdebug.c auth v822 ap=1 s=5403 n(v0 rc2019-11-25T00:32:01.000000+0000 b5403 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035aa:[<0x10000003713/dsdebug.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035aa:[<0x10000003713/dsdebug.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.536+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswstate.c auth v808 ap=1 s=19638 n(v0 rc2019-11-25T00:32:01.000000+0000 b19638 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b7:[<0x10000003713/dswstate.c v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b7:[<0x10000003713/dswstate.c v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.536+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000363a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsserial.c auth v836 ap=1 s=23158 n(v0 rc2019-11-25T00:32:01.000000+0000 b23158 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000363a:[<0x10000003713/rsserial.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000363a:[<0x10000003713/rsserial.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.536+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000363d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbdata.c auth v812 ap=1 s=29626 n(v0 rc2019-11-25T00:32:01.000000+0000 b29626 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000363d:[<0x10000003713/tbdata.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000363d:[<0x10000003713/tbdata.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.906 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.536+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000360f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsalloc.c auth v810 ap=1 s=12716 n(v0 rc2019-11-25T00:32:01.000000+0000 b12716 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000360f:[<0x10000003713/nsalloc.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000360f:[<0x10000003713/nsalloc.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.536+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwpci.c auth v814 ap=1 s=11906 n(v0 rc2019-11-25T00:32:01.000000+0000 b11906 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e5:[<0x10000003713/hwpci.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e5:[<0x10000003713/hwpci.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.537+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003620 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nswalk.c auth v832 ap=1 s=9516 n(v0 rc2019-11-25T00:32:01.000000+0000 b9516 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003620:[<0x10000003713/nswalk.c v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003620:[<0x10000003713/nswalk.c v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.537+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconcat.c auth v838 ap=1 s=10765 n(v0 rc2019-11-25T00:32:01.000000+0000 b10765 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c7:[<0x10000003713/exconcat.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c7:[<0x10000003713/exconcat.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.907 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.537+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dscontrol.c auth v840 ap=1 s=9577 n(v0 rc2023-10-26T06:45:47.271032+0000 b9577 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a9:[<0x10000003713/dscontrol.c v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a9:[<0x10000003713/dscontrol.c v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.537+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwvalid.c auth v820 ap=1 s=8850 n(v0 rc2019-11-25T00:32:01.000000+0000 b8850 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e9:[<0x10000003713/hwvalid.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e9:[<0x10000003713/hwvalid.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.537+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exutils.c auth v806 ap=1 s=12456 n(v0 rc2019-11-25T00:32:01.000000+0000 b12456 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e12fdc9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e1:[<0x10000003713/exutils.c v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e1:[<0x10000003713/exutils.c v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.537+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003597 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acutils.h auth v800 ap=1 s=20692 n(v0 rc2019-11-25T00:32:01.000000+0000 b20692 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133148000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003597:[<0x10000003713/acutils.h v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003597:[<0x10000003713/acutils.h v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.538+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg3.c auth v842 ap=1 s=6763 n(v0 rc2019-11-25T00:32:01.000000+0000 b6763 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133148580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d4:[<0x10000003713/exoparg3.c v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d4:[<0x10000003713/exoparg3.c v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.908 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.538+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ac [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsinit.c auth v798 ap=1 s=6183 n(v0 rc2019-11-25T00:32:01.000000+0000 b6183 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133149080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ac:[<0x10000003713/dsinit.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ac:[<0x10000003713/dsinit.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.538+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035dd [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstoren.c auth v828 ap=1 s=7818 n(v0 rc2019-11-25T00:32:01.000000+0000 b7818 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133149600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035dd:[<0x10000003713/exstoren.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035dd:[<0x10000003713/exstoren.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.538+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035be [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evhandler.c auth v802 ap=1 s=14312 n(v0 rc2019-11-25T00:32:01.000000+0000 b14312 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133148b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035be:[<0x10000003713/evhandler.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035be:[<0x10000003713/evhandler.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.538+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003613 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdumpdv.c auth v834 ap=1 s=2940 n(v0 rc2019-11-25T00:32:01.000000+0000 b2940 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133149b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003613:[<0x10000003713/nsdumpdv.c v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003613:[<0x10000003713/nsdumpdv.c v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.538+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003585 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/accommon.h auth v824 ap=1 s=1172 n(v0 rc2019-11-25T00:32:01.000000+0000 b1172 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13314a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003585:[<0x10000003713/accommon.h v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003585:[<0x10000003713/accommon.h v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.909 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.539+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003638 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmemory.c auth v804 ap=1 s=5563 n(v0 rc2019-11-25T00:32:01.000000+0000 b5563 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13314a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003638:[<0x10000003713/rsmemory.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003638:[<0x10000003713/rsmemory.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.910 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.539+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003624 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psargs.c auth v834 ap=1 s=22686 n(v0 rc2019-11-25T00:32:01.000000+0000 b22686 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13314ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003624:[<0x10000003713/psargs.c v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003624:[<0x10000003713/psargs.c v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.910 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.539+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003622 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfname.c auth v802 ap=1 s=16403 n(v0 rc2019-11-25T00:32:01.000000+0000 b16403 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13314b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003622:[<0x10000003713/nsxfname.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003622:[<0x10000003713/nsxfname.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.910 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.539+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003590 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acobject.h auth v832 ap=1 s=16231 n(v0 rc2019-11-25T00:32:01.000000+0000 b16231 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13314b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003590:[<0x10000003713/acobject.h v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003590:[<0x10000003713/acobject.h v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.910 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.539+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ce [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfldio.c auth v820 ap=1 s=27805 n(v0 rc2019-11-25T00:32:01.000000+0000 b27805 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133152000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ce:[<0x10000003713/exfldio.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ce:[<0x10000003713/exfldio.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.911 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.540+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000358c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acinterp.h auth v818 ap=1 s=15903 n(v0 rc2019-11-25T00:32:01.000000+0000 b15903 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133153080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000358c:[<0x10000003713/acinterp.h v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000358c:[<0x10000003713/acinterp.h v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.911 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.540+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwgpe.c auth v810 ap=1 s=13338 n(v0 rc2019-11-25T00:32:01.000000+0000 b13338 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133152580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e4:[<0x10000003713/hwgpe.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e4:[<0x10000003713/hwgpe.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.911 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.540+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b0 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsopcode.c auth v842 ap=1 s=20009 n(v0 rc2019-11-25T00:32:01.000000+0000 b20009 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133152b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b0:[<0x10000003713/dsopcode.c v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b0:[<0x10000003713/dsopcode.c v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.911 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.540+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003627 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopcode.c auth v828 ap=1 s=25775 n(v0 rc2019-11-25T00:32:01.000000+0000 b25775 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133153600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003627:[<0x10000003713/psopcode.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003627:[<0x10000003713/psopcode.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.911 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.540+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035cb [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdebug.c auth v798 ap=1 s=7766 n(v0 rc2019-11-25T00:32:01.000000+0000 b7766 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133153b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035cb:[<0x10000003713/exdebug.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035cb:[<0x10000003713/exdebug.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.912 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.540+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000362c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psutils.c auth v826 ap=1 s=5466 n(v0 rc2019-11-25T00:32:01.000000+0000 b5466 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133154100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000362c:[<0x10000003713/psutils.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000362c:[<0x10000003713/psutils.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.912 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.541+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003649 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utbuffer.c auth v838 ap=1 s=7073 n(v0 rc2019-11-25T00:32:01.000000+0000 b7073 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133154680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003649:[<0x10000003713/utbuffer.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003649:[<0x10000003713/utbuffer.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.912 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.541+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003596 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/actables.h auth v808 ap=1 s=4068 n(v0 rc2019-11-25T00:32:01.000000+0000 b4068 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133154c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003596:[<0x10000003713/actables.h v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003596:[<0x10000003713/actables.h v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.912 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.541+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035d5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg6.c auth v812 ap=1 s=8158 n(v0 rc2019-11-25T00:32:01.000000+0000 b8158 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133155180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035d5:[<0x10000003713/exoparg6.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035d5:[<0x10000003713/exoparg6.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.913 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.541+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000366c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfmutex.c auth v836 ap=1 s=4544 n(v0 rc2019-11-25T00:32:01.000000+0000 b4544 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e133155700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000366c:[<0x10000003713/utxfmutex.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000366c:[<0x10000003713/utxfmutex.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.913 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.541+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ab [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsfield.c auth v830 ap=1 s=23227 n(v0 rc2019-11-25T00:32:01.000000+0000 b23227 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ab:[<0x10000003713/dsfield.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ab:[<0x10000003713/dsfield.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.913 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.541+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035a4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbstats.c auth v800 ap=1 s=14754 n(v0 rc2019-11-25T00:32:01.000000+0000 b14754 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035a4:[<0x10000003713/dbstats.c v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035a4:[<0x10000003713/dbstats.c v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.913 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ad [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmethod.c auth v806 ap=1 s=25579 n(v0 rc2019-11-25T00:32:01.000000+0000 b25579 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ad:[<0x10000003713/dsmethod.c v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ad:[<0x10000003713/dsmethod.c v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.913 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c1 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evrgnini.c auth v822 ap=1 s=16397 n(v0 rc2019-11-25T00:32:01.000000+0000 b16397 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c1:[<0x10000003713/evrgnini.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c1:[<0x10000003713/evrgnini.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.914 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035cd [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfield.c auth v824 ap=1 s=12308 n(v0 rc2019-11-25T00:32:01.000000+0000 b12308 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035cd:[<0x10000003713/exfield.c v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035cd:[<0x10000003713/exfield.c v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.914 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003668 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utuuid.c auth v840 ap=1 s=2103 n(v0 rc2019-11-25T00:32:01.000000+0000 b2103 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003668:[<0x10000003713/utuuid.c v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003668:[<0x10000003713/utuuid.c v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.914 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003618 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsobject.c auth v816 ap=1 s=11622 n(v0 rc2019-11-25T00:32:01.000000+0000 b11622 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003618:[<0x10000003713/nsobject.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003618:[<0x10000003713/nsobject.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.914 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000366b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfinit.c auth v814 ap=1 s=7123 n(v0 rc2019-11-25T00:32:01.000000+0000 b7123 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000366b:[<0x10000003713/utxfinit.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000366b:[<0x10000003713/utxfinit.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.914 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.542+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003666 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrtoul64.c auth v846 ap=1 s=11871 n(v0 rc2019-11-25T00:32:01.000000+0000 b11871 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003666:[<0x10000003713/utstrtoul64.c v846>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003666:[<0x10000003713/utstrtoul64.c v846>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.915 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003633 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdumpinfo.c auth v796 ap=1 s=22936 n(v0 rc2023-10-26T06:45:47.288032+0000 b22936 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003633:[<0x10000003713/rsdumpinfo.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003633:[<0x10000003713/rsdumpinfo.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.915 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e6 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwregs.c auth v844 ap=1 s=22497 n(v0 rc2019-11-25T00:32:01.000000+0000 b22497 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13259d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e6:[<0x10000003713/hwregs.c v844>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e6:[<0x10000003713/hwregs.c v844>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.915 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000361b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsprepkg.c auth v826 ap=1 s=19753 n(v0 rc2019-11-25T00:32:01.000000+0000 b19753 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000361b:[<0x10000003713/nsprepkg.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000361b:[<0x10000003713/nsprepkg.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.915 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003636 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsirq.c auth v802 ap=1 s=7634 n(v0 rc2019-11-25T00:32:01.000000+0000 b7634 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003636:[<0x10000003713/rsirq.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003636:[<0x10000003713/rsirq.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.916 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035bd [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeutil.c auth v812 ap=1 s=8970 n(v0 rc2019-11-25T00:32:01.000000+0000 b8970 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035bd:[<0x10000003713/evgpeutil.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035bd:[<0x10000003713/evgpeutil.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.916 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003595 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acstruct.h auth v834 ap=1 s=7094 n(v0 rc2023-10-26T06:45:47.266032+0000 b7094 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003595:[<0x10000003713/acstruct.h v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003595:[<0x10000003713/acstruct.h v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.916 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.543+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e7 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwsleep.c auth v800 ap=1 s=8488 n(v0 rc2019-11-25T00:32:01.000000+0000 b8488 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e7:[<0x10000003713/hwsleep.c v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e7:[<0x10000003713/hwsleep.c v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.916 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.544+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003637 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rslist.c auth v816 ap=1 s=6811 n(v0 rc2019-11-25T00:32:01.000000+0000 b6811 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003637:[<0x10000003713/rslist.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003637:[<0x10000003713/rslist.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.917 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.544+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003644 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfload.c auth v830 ap=1 s=11415 n(v0 rc2019-11-25T00:32:01.000000+0000 b11415 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003644:[<0x10000003713/tbxfload.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003644:[<0x10000003713/tbxfload.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.917 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.544+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003630 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscalc.c auth v822 ap=1 s=22772 n(v0 rc2019-11-25T00:32:01.000000+0000 b22772 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003630:[<0x10000003713/rscalc.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003630:[<0x10000003713/rscalc.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.917 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.544+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003654 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utids.c auth v836 ap=1 s=11274 n(v0 rc2019-11-25T00:32:01.000000+0000 b11274 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1325a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003654:[<0x10000003713/utids.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003654:[<0x10000003713/utids.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.917 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.544+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c5 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfgpe.c auth v810 ap=1 s=29214 n(v0 rc2023-10-26T06:45:47.277032+0000 b29214 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c5:[<0x10000003713/evxfgpe.c v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c5:[<0x10000003713/evxfgpe.c v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.918 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.545+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ba [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpe.c auth v842 ap=1 s=24405 n(v0 rc2019-11-25T00:32:01.000000+0000 b24405 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ba:[<0x10000003713/evgpe.c v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ba:[<0x10000003713/evgpe.c v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.918 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.545+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003594 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acresrc.h auth v832 ap=1 s=10956 n(v0 rc2019-11-25T00:32:01.000000+0000 b10956 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003594:[<0x10000003713/acresrc.h v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003594:[<0x10000003713/acresrc.h v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.545+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035ae [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmthdat.c auth v828 ap=1 s=19736 n(v0 rc2019-11-25T00:32:01.000000+0000 b19736 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035ae:[<0x10000003713/dsmthdat.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035ae:[<0x10000003713/dsmthdat.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.545+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003643 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxface.c auth v838 ap=1 s=15392 n(v0 rc2019-11-25T00:32:01.000000+0000 b15392 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003643:[<0x10000003713/tbxface.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003643:[<0x10000003713/tbxface.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000365e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utownerid.c auth v820 ap=1 s=5340 n(v0 rc2019-11-25T00:32:01.000000+0000 b5340 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000365e:[<0x10000003713/utownerid.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000365e:[<0x10000003713/utownerid.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003616 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsload.c auth v808 ap=1 s=7669 n(v0 rc2019-11-25T00:32:01.000000+0000 b7669 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003616:[<0x10000003713/nsload.c v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003616:[<0x10000003713/nsload.c v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000359f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbhistry.c auth v840 ap=1 s=5202 n(v0 rc2019-11-25T00:32:01.000000+0000 b5202 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000359f:[<0x10000003713/dbhistry.c v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000359f:[<0x10000003713/dbhistry.c v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000361d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair2.c auth v796 ap=1 s=29320 n(v0 rc2019-11-25T00:32:01.000000+0000 b29320 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000361d:[<0x10000003713/nsrepair2.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000361d:[<0x10000003713/nsrepair2.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035da [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresop.c auth v798 ap=1 s=16570 n(v0 rc2019-11-25T00:32:01.000000+0000 b16570 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035da:[<0x10000003713/exresop.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035da:[<0x10000003713/exresop.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000358f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acnamesp.h auth v806 ap=1 s=11625 n(v0 rc2019-11-25T00:32:01.000000+0000 b11625 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e13253d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000358f:[<0x10000003713/acnamesp.h v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000358f:[<0x10000003713/acnamesp.h v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.546+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003615 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsinit.c auth v804 ap=1 s=19201 n(v0 rc2019-11-25T00:32:01.000000+0000 b19201 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132544000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003615:[<0x10000003713/nsinit.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003615:[<0x10000003713/nsinit.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.547+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003645 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfroot.c auth v818 ap=1 s=7143 n(v0 rc2019-11-25T00:32:01.000000+0000 b7143 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132544580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003645:[<0x10000003713/tbxfroot.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003645:[<0x10000003713/tbxfroot.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.547+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000365f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utpredef.c auth v824 ap=1 s=9659 n(v0 rc2019-11-25T00:32:01.000000+0000 b9659 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132544b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000365f:[<0x10000003713/utpredef.c v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000365f:[<0x10000003713/utpredef.c v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.547+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003655 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utinit.c auth v814 ap=1 s=6973 n(v0 rc2019-11-25T00:32:01.000000+0000 b6973 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132545080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003655:[<0x10000003713/utinit.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003655:[<0x10000003713/utinit.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.547+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000359b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbconvert.c auth v812 ap=1 s=12777 n(v0 rc2019-11-25T00:32:01.000000+0000 b12777 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132545600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000359b:[<0x10000003713/dbconvert.c v812>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000359b:[<0x10000003713/dbconvert.c v812>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.922 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.547+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswexec.c auth v824 ap=1 s=18477 n(v0 rc2019-11-25T00:32:01.000000+0000 b18477 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132545b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b3:[<0x10000003713/dswexec.c v824>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b3:[<0x10000003713/dswexec.c v824>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.922 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.547+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035e3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwesleep.c auth v798 ap=1 s=5938 n(v0 rc2019-11-25T00:32:01.000000+0000 b5938 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132546100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035e3:[<0x10000003713/hwesleep.c v798>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035e3:[<0x10000003713/hwesleep.c v798>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.922 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.548+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000363f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfind.c auth v832 ap=1 s=3484 n(v0 rc2019-11-25T00:32:01.000000+0000 b3484 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132546680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000363f:[<0x10000003713/tbfind.c v832>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000363f:[<0x10000003713/tbfind.c v832>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.922 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.548+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035bb [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeblk.c auth v814 ap=1 s=13709 n(v0 rc2019-11-25T00:32:01.000000+0000 b13709 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132546c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035bb:[<0x10000003713/evgpeblk.c v814>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035bb:[<0x10000003713/evgpeblk.c v814>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.548+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003647 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utalloc.c auth v822 ap=1 s=8905 n(v0 rc2019-11-25T00:32:01.000000+0000 b8905 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132547180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003647:[<0x10000003713/utalloc.c v822>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003647:[<0x10000003713/utalloc.c v822>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.548+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000359a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbcmds.c auth v808 ap=1 s=30880 n(v0 rc2019-11-25T00:32:01.000000+0000 b30880 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e132547700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000359a:[<0x10000003713/dbcmds.c v808>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000359a:[<0x10000003713/dbcmds.c v808>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.548+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000364f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uterror.c auth v836 ap=1 s=9894 n(v0 rc2019-11-25T00:32:01.000000+0000 b9894 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000364f:[<0x10000003713/uterror.c v836>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000364f:[<0x10000003713/uterror.c v836>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.549+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003669 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxface.c auth v844 ap=1 s=14740 n(v0 rc2019-11-25T00:32:01.000000+0000 b14740 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003669:[<0x10000003713/utxface.c v844>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003669:[<0x10000003713/utxface.c v844>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.549+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003660 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utprint.c auth v800 ap=1 s=16751 n(v0 rc2019-11-25T00:32:01.000000+0000 b16751 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003660:[<0x10000003713/utprint.c v800>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003660:[<0x10000003713/utprint.c v800>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.549+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003592 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acparser.h auth v810 ap=1 s=6473 n(v0 rc2019-11-25T00:32:01.000000+0000 b6473 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003592:[<0x10000003713/acparser.h v810>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003592:[<0x10000003713/acparser.h v810>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.549+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b4 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload.c auth v846 ap=1 s=15370 n(v0 rc2019-11-25T00:32:01.000000+0000 b15370 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b4:[<0x10000003713/dswload.c v846>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b4:[<0x10000003713/dswload.c v846>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.549+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000361f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsutils.c auth v838 ap=1 s=19888 n(v0 rc2019-11-25T00:32:01.000000+0000 b19888 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000361f:[<0x10000003713/nsutils.c v838>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000361f:[<0x10000003713/nsutils.c v838>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.549+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000362f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsaddr.c auth v840 ap=1 s=10633 n(v0 rc2019-11-25T00:32:01.000000+0000 b10633 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000362f:[<0x10000003713/rsaddr.c v840>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000362f:[<0x10000003713/rsaddr.c v840>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.550+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035b9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evglock.c auth v826 ap=1 s=8944 n(v0 rc2019-11-25T00:32:01.000000+0000 b8944 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035b9:[<0x10000003713/evglock.c v826>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035b9:[<0x10000003713/evglock.c v826>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.550+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035df [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exsystem.c auth v830 ap=1 s=7518 n(v0 rc2019-11-25T00:32:01.000000+0000 b7518 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035df:[<0x10000003713/exsystem.c v830>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035df:[<0x10000003713/exsystem.c v830>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.550+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003667 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uttrack.c auth v802 ap=1 s=19018 n(v0 rc2023-10-26T06:45:47.296032+0000 b19018 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003667:[<0x10000003713/uttrack.c v802>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003667:[<0x10000003713/uttrack.c v802>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.550+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c3 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxface.c auth v804 ap=1 s=30630 n(v0 rc2019-11-25T00:32:01.000000+0000 b30630 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c3:[<0x10000003713/evxface.c v804>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c3:[<0x10000003713/evxface.c v804>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.550+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003628 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopinfo.c auth v818 ap=1 s=7513 n(v0 rc2019-11-25T00:32:01.000000+0000 b7513 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003628:[<0x10000003713/psopinfo.c v818>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003628:[<0x10000003713/psopinfo.c v818>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.550+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035c9 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconvrt.c auth v796 ap=1 s=16956 n(v0 rc2019-11-25T00:32:01.000000+0000 b16956 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035c9:[<0x10000003713/exconvrt.c v796>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035c9:[<0x10000003713/exconvrt.c v796>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003640 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbinstal.c auth v842 ap=1 s=9144 n(v0 rc2019-11-25T00:32:01.000000+0000 b9144 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003640:[<0x10000003713/tbinstal.c v842>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003640:[<0x10000003713/tbinstal.c v842>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.927 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003612 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdump.c auth v834 ap=1 s=21641 n(v0 rc2019-11-25T00:32:01.000000+0000 b21641 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003612:[<0x10000003713/nsdump.c v834>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x10000003612:[<0x10000003713/nsdump.c v834>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.927 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000035af [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsobject.c auth v820 ap=1 s=14605 n(v0 rc2019-11-25T00:32:01.000000+0000 b14605 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000035af:[<0x10000003713/dsobject.c v820>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x100000035af:[<0x10000003713/dsobject.c v820>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.927 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000359c [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbdisply.c auth v828 ap=1 s=28198 n(v0 rc2019-11-25T00:32:01.000000+0000 b28198 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000359c:[<0x10000003713/dbdisply.c v828>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000359c:[<0x10000003713/dbdisply.c v828>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.927 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000364b [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcopy.c auth v816 ap=1 s=26888 n(v0 rc2023-10-26T06:45:47.292032+0000 b26888 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000364b:[<0x10000003713/utcopy.c v816>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000364b:[<0x10000003713/utcopy.c v816>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.927 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003675 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/hest.c auth v48 ap=1 s=6871 n(v0 rc2019-11-25T00:32:01.000000+0000 b6871 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003675:[<0x10000003810/hest.c v48>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003675:[<0x10000003810/hest.c v48>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003811 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Kconfig auth v56 ap=1 s=2230 n(v0 rc2023-10-26T06:45:47.422029+0000 b2230 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e1300eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003811:[<0x10000003810/Kconfig v56>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003811:[<0x10000003810/Kconfig v56>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.551+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000361e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nssearch.c auth v806 ap=1 s=12642 n(v0 rc2019-11-25T00:32:01.000000+0000 b12642 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e1300eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000361e:[<0x10000003713/nssearch.c v806>,<0x10000003711/acpica v1922>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10633>,<0x10000000201/linux-5.4 v1377>,<0x10000000006/t v362>,<0x10000000005/tmp v352>,<0x100000001fb/client.0 v320>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v336>,<0x10000000001/sv_1 v334>,<0x10000000000/_nogroup v325>,<0x1/volumes v311>]//[]","memoryvalue":"(3)0x1000000361e:[<0x10000003713/nssearch.c v806>,<0x10000003711/acpica v2256>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003672 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst-dbg.c auth v52 ap=1 s=4877 n(v0 rc2019-11-25T00:32:01.000000+0000 b4877 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003672:[<0x10000003810/erst-dbg.c v52>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003672:[<0x10000003810/erst-dbg.c v52>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000366f [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-internal.h auth v58 ap=1 s=4009 n(v0 rc2019-11-25T00:32:01.000000+0000 b4009 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000366f:[<0x10000003810/apei-internal.h v58>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000366f:[<0x10000003810/apei-internal.h v58>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003670 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/bert.c auth v46 ap=1 s=3757 n(v0 rc2023-10-26T06:45:47.423029+0000 b3757 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003670:[<0x10000003810/bert.c v46>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003670:[<0x10000003810/bert.c v46>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003673 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst.c auth v44 ap=1 s=28650 n(v0 rc2019-11-25T00:32:01.000000+0000 b28650 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003673:[<0x10000003810/erst.c v44>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003673:[<0x10000003810/erst.c v44>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003674 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ghes.c auth v54 ap=1 s=35700 n(v0 rc2019-11-25T00:32:01.000000+0000 b35700 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003674:[<0x10000003810/ghes.c v54>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003674:[<0x10000003810/ghes.c v54>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000366d [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Makefile auth v42 ap=1 s=241 n(v0 rc2019-11-25T00:32:01.000000+0000 b241 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000366d:[<0x10000003810/Makefile v42>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000366d:[<0x10000003810/Makefile v42>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.552+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003671 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/einj.c auth v50 ap=1 s=21284 n(v0 rc2019-11-25T00:32:01.000000+0000 b21284 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003671:[<0x10000003810/einj.c v50>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003671:[<0x10000003810/einj.c v50>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.553+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000366e [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-base.c auth v40 ap=1 s=19528 n(v0 rc2019-11-25T00:32:01.000000+0000 b19528 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000366e:[<0x10000003810/apei-base.c v40>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000366e:[<0x10000003810/apei-base.c v40>,<0x10000003711/apei v1907>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.553+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003815 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Kconfig auth v18 ap=1 s=517 n(v0 rc2023-10-26T06:45:47.448028+0000 b517 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@2},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffb9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003815:[<0x10000003814/Kconfig v18>,<0x10000003711/dptf v1924>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003815:[<0x10000003814/Kconfig v18>,<0x10000003711/dptf v2258>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.553+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003686 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Makefile auth v16 ap=1 s=133 n(v0 rc2019-11-25T00:32:01.000000+0000 b133 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@2},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003686:[<0x10000003814/Makefile v16>,<0x10000003711/dptf v1924>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003686:[<0x10000003814/Makefile v16>,<0x10000003711/dptf v2258>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.553+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003687 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/dptf_power.c auth v20 ap=1 s=2944 n(v0 rc2019-11-25T00:32:01.000000+0000 b2944 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003687:[<0x10000003814/dptf_power.c v20>,<0x10000003711/dptf v1924>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003687:[<0x10000003814/dptf_power.c v20>,<0x10000003711/dptf v2258>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.553+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003819 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Kconfig auth v28 ap=1 s=1010 n(v0 rc2023-10-26T06:45:47.465028+0000 b1010 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/pFscr@1},l=15375 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003819:[<0x10000003818/Kconfig v28>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003819:[<0x10000003818/Kconfig v28>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.553+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003688 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/int340x_thermal.c auth v22 ap=1 s=1189 n(v0 rc2023-10-26T06:45:47.449028+0000 b1189 1=1+0) (iversion lock) caps={15375=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003688:[<0x10000003814/int340x_thermal.c v22>,<0x10000003711/dptf v1924>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003688:[<0x10000003814/int340x_thermal.c v22>,<0x10000003711/dptf v2258>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.554+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003699 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/mce.c auth v34 ap=1 s=2630 n(v0 rc2019-11-25T00:32:01.000000+0000 b2630 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003699:[<0x10000003818/mce.c v34>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003699:[<0x10000003818/mce.c v34>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.554+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003697 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.c auth v32 ap=1 s=10080 n(v0 rc2019-11-25T00:32:01.000000+0000 b10080 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003697:[<0x10000003818/intel.c v32>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003697:[<0x10000003818/intel.c v32>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.554+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003698 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.h auth v40 ap=1 s=2614 n(v0 rc2019-11-25T00:32:01.000000+0000 b2614 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003698:[<0x10000003818/intel.h v40>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003698:[<0x10000003818/intel.h v40>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.554+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000369a [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/nfit.h auth v38 ap=1 s=9279 n(v0 rc2019-11-25T00:32:01.000000+0000 b9279 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000369a:[<0x10000003818/nfit.h v38>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x1000000369a:[<0x10000003818/nfit.h v38>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.554+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003695 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Makefile auth v36 ap=1 s=141 n(v0 rc2019-11-25T00:32:01.000000+0000 b141 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003695:[<0x10000003818/Makefile v36>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003695:[<0x10000003818/Makefile v36>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:48:52.554+0000 7f543a0e6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003696 [4,head] /volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/core.c auth v30 ap=1 s=103600 n(v0 rc2023-10-26T06:45:47.466028+0000 b103600 1=1+0) (iversion lock) caps={15375=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55e12ffc3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003696:[<0x10000003818/core.c v30>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20252>,<0x10000000202/drivers v10986>,<0x10000000201/linux-5.4 v1396>,<0x10000000006/t v375>,<0x10000000005/tmp v364>,<0x100000001fb/client.0 v332>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v347>,<0x10000000001/sv_1 v346>,<0x10000000000/_nogroup v337>,<0x1/volumes v322>]//[]","memoryvalue":"(3)0x10000003696:[<0x10000003818/core.c v30>,<0x10000003711/nfit v1915>,<0x1000000370b/acpi v20294>,<0x10000000202/drivers v11951>,<0x10000000201/linux-5.4 v1474>,<0x10000000006/t v403>,<0x10000000005/tmp v390>,<0x100000001fb/client.0 v318>,<0x100000001fa/e5637e95-292b-4ecb-84bd-f467baf5f25a v373>,<0x10000000001/sv_1 v342>,<0x10000000000/_nogroup v362>,<0x1/volumes v334>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-26T06:48:52.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exconcat.o 2023-10-26T06:48:53.052 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/time.o 2023-10-26T06:48:53.110 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/bounce.o 2023-10-26T06:48:53.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:53.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:53.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003690 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003817 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000381d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/apple.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_bxtwc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtwc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036c5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/utils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036aa (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/tps68470_pmic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.175 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtdc_ti.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_crc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000036a9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_xpower.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.176 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003677 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/gtdt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003691 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/hmat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000381b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003678 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/iort.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresnte.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.177 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000362d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pswalk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exprep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003634 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003813 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003661 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresdecode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.178 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003676 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ea (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035cf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035bc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003642 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.179 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003659 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000359d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbexec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwtimer.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003653 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uthex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.180 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000361c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003664 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstring.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000365b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utnonansi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003598 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlcode.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.181 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003591 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acopcode.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035eb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxfsleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000362e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003651 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utexcep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.182 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000363e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfadt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003617 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfregn.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035cc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.183 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003650 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uteval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003589 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acevents.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ca (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/excreate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000365c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003665 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrsuppt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.184 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003610 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsarguments.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dspkginit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ec (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsaccess.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003593 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acpredef.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003586 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acconvert.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.185 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exregion.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000361a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nspredef.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003623 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfobj.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003641 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbprint.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.186 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003658 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmath.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/extrace.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000358d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/aclocal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000364d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdecode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003619 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsparse.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbmethod.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.187 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003588 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdispat.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003587 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdebug.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000364a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcache.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003663 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.188 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003629 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psparse.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evsci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000364e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdelete.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evregion.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000358e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acmacros.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfevnt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000358b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/achware.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbinput.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbtest.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000366a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxferror.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.190 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000362a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psscope.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconfig.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003635 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003656 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utlock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000365a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.191 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswscope.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.192 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000364c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.192 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035dc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstore.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.192 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000362b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pstree.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.192 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.193 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsargs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.193 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003639 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.193 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000358a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acglobal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.193 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003632 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.193 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003584 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acapps.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.194 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evevent.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.194 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000359e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbfileio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.194 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwacpi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.194 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.195 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003621 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfeval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.195 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003648 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utascii.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.195 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003662 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresrc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.195 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003646 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utaddress.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.195 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003611 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsconvert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.196 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003599 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlresrc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.196 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035db (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exserial.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.196 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003614 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nseval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.196 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg1.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.196 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003714 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.197 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000363b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.197 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003652 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utglobal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.197 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.197 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003625 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psloop.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.197 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003631 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscreate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.198 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000363c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.198 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresolv.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.198 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035bf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.198 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000365d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utosi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.198 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003626 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.199 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.199 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035de (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstorob.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.199 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035aa (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.199 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswstate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.199 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000363a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsserial.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.199 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000363d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbdata.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.200 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000360f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsalloc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.200 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwpci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.200 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003620 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nswalk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.200 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconcat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.200 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dscontrol.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.201 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwvalid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.201 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.201 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003597 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acutils.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.201 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg3.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.201 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ac (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.202 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035dd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstoren.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.202 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035be (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evhandler.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.202 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003613 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdumpdv.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.202 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003585 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/accommon.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.202 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003638 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmemory.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.203 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003624 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psargs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.203 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003622 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfname.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.203 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003590 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acobject.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.203 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ce (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfldio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.203 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000358c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acinterp.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.204 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.204 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsopcode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.204 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003627 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopcode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.204 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035cb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.204 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000362c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.205 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003649 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utbuffer.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.205 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003596 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/actables.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.205 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035d5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg6.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.205 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000366c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.205 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ab (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsfield.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.205 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035a4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbstats.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.206 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ad (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmethod.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.206 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evrgnini.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.206 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035cd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfield.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.206 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003668 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utuuid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.207 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003618 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.207 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000366b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.207 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003666 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrtoul64.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.207 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003633 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdumpinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.207 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwregs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.208 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000361b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsprepkg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.208 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003636 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsirq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.208 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035bd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeutil.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.208 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003595 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acstruct.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.208 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwsleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.209 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003637 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rslist.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.209 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003644 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.209 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003630 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscalc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.209 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003654 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utids.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.209 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.210 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ba (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.210 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003594 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acresrc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.210 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035ae (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmthdat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.210 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003643 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.211 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000365e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utownerid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.211 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003616 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.213 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000359f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbhistry.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.213 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000361d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.213 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035da (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresop.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.214 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000358f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acnamesp.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.214 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003615 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.214 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003645 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfroot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.214 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000365f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utpredef.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.215 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003655 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.215 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000359b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbconvert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.215 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswexec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.215 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035e3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwesleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.215 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000363f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfind.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.216 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035bb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeblk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.216 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003647 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utalloc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.216 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000359a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbcmds.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.216 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000364f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uterror.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.216 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003669 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.217 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003660 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utprint.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.217 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003592 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acparser.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.217 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.217 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000361f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.217 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000362f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsaddr.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.218 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035b9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evglock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.218 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035df (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exsystem.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.218 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003667 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uttrack.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.218 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.218 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003628 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.219 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035c9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconvrt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.219 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003640 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbinstal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.219 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003612 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.219 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x100000035af (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.219 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000359c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbdisply.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.219 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000364b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcopy.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.220 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003675 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/hest.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.220 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003811 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.220 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000361e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nssearch.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.220 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003672 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst-dbg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.220 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000366f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-internal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.221 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003670 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/bert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.221 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003673 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.221 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003674 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ghes.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.221 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000366d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.221 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003671 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/einj.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.222 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000366e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-base.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.222 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003815 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.222 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003686 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.222 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003687 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/dptf_power.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.222 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003819 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.223 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003688 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/int340x_thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.223 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003699 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/mce.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.223 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003697 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.223 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003698 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.223 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x1000000369a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/nfit.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.224 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003695 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.224 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:52 smithi125 ceph-mon[130643]: Scrub error on inode 0x10000003696 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:53.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:53.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003690 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003817 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000381d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/apple.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_bxtwc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtwc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036c5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/utils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036aa (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/tps68470_pmic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtdc_ti.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.237 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_crc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000036a9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_xpower.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003677 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/gtdt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003691 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/hmat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000381b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.238 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003678 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/iort.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresnte.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000362d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pswalk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exprep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.239 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003634 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003813 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003661 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresdecode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003676 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ea (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035cf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035bc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003642 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003659 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000359d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbexec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.241 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwtimer.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003653 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uthex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000361c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003664 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstring.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.242 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000365b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utnonansi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003598 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlcode.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.243 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003591 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acopcode.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035eb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxfsleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000362e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.244 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003651 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utexcep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000363e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfadt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003617 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfregn.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035cc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003650 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uteval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003589 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acevents.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ca (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/excreate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000365c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003665 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrsuppt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003610 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsarguments.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dspkginit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ec (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsaccess.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003593 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acpredef.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.247 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003586 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acconvert.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exregion.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000361a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nspredef.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003623 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfobj.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.248 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003641 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbprint.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003658 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmath.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/extrace.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000358d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/aclocal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000364d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdecode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.249 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003619 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsparse.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbmethod.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003588 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdispat.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003587 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdebug.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000364a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcache.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.250 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003663 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003629 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psparse.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evsci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000364e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdelete.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evregion.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000358e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acmacros.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfevnt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000358b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/achware.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbinput.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.252 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbtest.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000366a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxferror.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000362a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psscope.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconfig.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003635 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.253 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003656 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utlock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000365a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswscope.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000364c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035dc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstore.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.254 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000362b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pstree.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsargs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003639 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000358a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acglobal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.255 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003632 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.256 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003584 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acapps.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.256 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evevent.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.256 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000359e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbfileio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.256 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwacpi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.256 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.257 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003621 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfeval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.257 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003648 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utascii.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.257 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003662 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresrc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.257 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003646 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utaddress.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.257 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003611 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsconvert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.258 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003599 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlresrc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.258 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035db (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exserial.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.258 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003614 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nseval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.258 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg1.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.258 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003714 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.258 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000363b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.259 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003652 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utglobal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.259 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.259 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003625 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psloop.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.259 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003631 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscreate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.259 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000363c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.261 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresolv.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.261 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035bf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.261 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000365d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utosi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.262 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003626 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.262 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.262 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035de (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstorob.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.262 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035aa (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.262 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswstate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000363a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsserial.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000363d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbdata.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000360f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsalloc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwpci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.263 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003620 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nswalk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconcat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dscontrol.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwvalid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.264 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003597 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acutils.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg3.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ac (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035dd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstoren.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035be (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evhandler.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.265 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003613 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdumpdv.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003585 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/accommon.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003638 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmemory.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003624 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psargs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003622 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfname.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.266 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003590 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acobject.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ce (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfldio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000358c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acinterp.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsopcode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003627 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopcode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035cb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000362c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003649 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utbuffer.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003596 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/actables.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035d5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg6.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.268 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000366c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ab (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsfield.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035a4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbstats.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ad (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmethod.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evrgnini.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.269 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035cd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfield.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003668 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utuuid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003618 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000366b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.270 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003666 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrtoul64.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003633 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdumpinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwregs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000361b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsprepkg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003636 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsirq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.271 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035bd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeutil.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003595 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acstruct.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwsleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003637 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rslist.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003644 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003630 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscalc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003654 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utids.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ba (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003594 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acresrc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035ae (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmthdat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003643 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000365e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utownerid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003616 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000359f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbhistry.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000361d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.275 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035da (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresop.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.275 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000358f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acnamesp.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.275 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003615 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.275 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003645 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfroot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.275 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000365f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utpredef.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003655 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000359b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbconvert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswexec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035e3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwesleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.276 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000363f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfind.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035bb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeblk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003647 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utalloc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000359a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbcmds.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000364f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uterror.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003669 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.277 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003660 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utprint.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003592 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acparser.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000361f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000362f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsaddr.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.278 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035b9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evglock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035df (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exsystem.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003667 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uttrack.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003628 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.279 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035c9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconvrt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003640 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbinstal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003612 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x100000035af (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000359c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbdisply.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.280 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000364b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcopy.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003675 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/hest.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003811 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000361e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nssearch.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003672 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst-dbg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.281 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000366f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-internal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003670 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/bert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003673 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003674 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ghes.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000366d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.282 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003671 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/einj.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000366e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-base.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003815 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003686 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003687 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/dptf_power.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.283 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003819 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003688 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/int340x_thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003699 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/mce.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003697 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003698 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x1000000369a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/nfit.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003695 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:52 smithi153 ceph-mon[131657]: Scrub error on inode 0x10000003696 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:53.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:53.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003690 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003817 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000381d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/apple.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_bxtwc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtwc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036c5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/utils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036aa (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/tps68470_pmic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.288 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtdc_ti.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_crc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000036a9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_xpower.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003677 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/gtdt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003691 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/hmat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000381b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003678 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/iort.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresnte.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000362d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pswalk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.291 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exprep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.291 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003634 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.291 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003813 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.291 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003661 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresdecode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.291 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003676 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.292 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ea (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.292 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035cf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.292 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035bc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.292 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003642 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.292 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003659 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.293 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000359d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbexec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.293 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwtimer.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.293 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.293 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003653 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uthex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.293 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000361c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003664 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstring.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000365b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utnonansi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003598 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlcode.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003591 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acopcode.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.294 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035eb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxfsleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000362e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003651 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utexcep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000363e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfadt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003617 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfregn.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035cc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003650 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uteval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003589 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acevents.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ca (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/excreate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000365c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003665 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrsuppt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003610 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsarguments.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dspkginit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ec (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsaccess.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003593 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acpredef.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003586 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acconvert.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exregion.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.298 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000361a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nspredef.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.299 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003623 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfobj.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.299 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003641 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbprint.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.299 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003658 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmath.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.299 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/extrace.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.299 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000358d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/aclocal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.300 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000364d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdecode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.300 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003619 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsparse.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.300 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbmethod.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.300 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003588 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdispat.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.300 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003587 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdebug.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000364a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcache.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003663 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003629 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psparse.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evsci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000364e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdelete.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evregion.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000358e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acmacros.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfevnt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000358b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/achware.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.302 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbinput.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbtest.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000366a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxferror.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000362a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psscope.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconfig.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.303 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003635 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.304 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003656 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utlock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.304 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000365a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.304 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswscope.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.304 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000364c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.304 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035dc (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstore.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000362b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pstree.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsargs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003639 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000358a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acglobal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003632 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003584 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acapps.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b8 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evevent.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000359e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbfileio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwacpi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003621 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfeval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003648 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utascii.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003662 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresrc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003646 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utaddress.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003611 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsconvert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003599 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlresrc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035db (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exserial.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003614 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nseval.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg1.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003714 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000363b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003652 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utglobal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a2 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbnames.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003625 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psloop.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003631 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscreate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000363c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.310 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresolv.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.310 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035bf (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evmisc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.310 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000365d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utosi.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.310 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003626 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.310 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.311 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035de (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstorob.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.311 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035aa (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.311 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswstate.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.311 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000363a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsserial.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.311 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000363d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbdata.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.312 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000360f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsalloc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.312 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwpci.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.312 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003620 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nswalk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.312 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconcat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.312 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dscontrol.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.312 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwvalid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003597 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acutils.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg3.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ac (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035dd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstoren.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.314 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035be (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evhandler.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.314 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003613 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdumpdv.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.314 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003585 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/accommon.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.314 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003638 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmemory.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.314 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003624 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psargs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003622 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfname.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003590 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acobject.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ce (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfldio.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000358c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acinterp.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b0 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsopcode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.316 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003627 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopcode.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.316 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035cb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdebug.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.316 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000362c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.316 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003649 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utbuffer.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.316 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003596 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/actables.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.317 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035d5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg6.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.317 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000366c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfmutex.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.317 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ab (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsfield.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.317 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035a4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbstats.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.317 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ad (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmethod.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.318 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c1 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evrgnini.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.318 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035cd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfield.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.318 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003668 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utuuid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.318 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003618 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.318 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000366b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003666 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrtoul64.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003633 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdumpinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e6 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwregs.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000361b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsprepkg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003636 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsirq.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.320 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035bd (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeutil.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.320 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003595 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acstruct.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.320 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e7 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwsleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.320 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003637 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rslist.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.320 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003644 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.320 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003630 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscalc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.321 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003654 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utids.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.321 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c5 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.321 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ba (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpe.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.321 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003594 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acresrc.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.322 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035ae (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmthdat.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.322 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003643 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.322 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000365e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utownerid.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.322 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003616 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.322 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000359f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbhistry.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000361d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair2.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035da (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresop.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000358f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acnamesp.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003615 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003645 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfroot.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000365f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utpredef.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003655 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utinit.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000359b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbconvert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswexec.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035e3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwesleep.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000363f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfind.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035bb (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeblk.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003647 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utalloc.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000359a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbcmds.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000364f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uterror.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003669 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.326 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003660 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utprint.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.326 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003592 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acparser.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.326 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b4 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.326 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000361f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsutils.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.326 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000362f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsaddr.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035b9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evglock.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035df (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exsystem.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003667 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uttrack.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c3 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxface.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003628 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopinfo.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035c9 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconvrt.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003640 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbinstal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003612 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdump.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x100000035af (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsobject.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000359c (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbdisply.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000364b (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcopy.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003675 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/hest.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003811 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000361e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nssearch.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003672 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst-dbg.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000366f (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-internal.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.329 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003670 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/bert.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003673 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003674 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ghes.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000366d (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003671 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/einj.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000366e (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-base.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003815 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003686 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003687 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/dptf_power.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003819 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Kconfig) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003688 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/int340x_thermal.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003699 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/mce.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003697 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003698 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x1000000369a (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/nfit.h) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003695 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Makefile) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:52 smithi050 ceph-mon[94997]: Scrub error on inode 0x10000003696 (/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/core.c) see mds.i log and `damage ls` output for details 2023-10-26T06:48:53.441 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/dir.o 2023-10-26T06:48:53.589 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/ntp.o 2023-10-26T06:48:53.651 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exconfig.o 2023-10-26T06:48:53.661 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/ioport.o 2023-10-26T06:48:54.087 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/amba/built-in.a 2023-10-26T06:48:54.158 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/tables.o 2023-10-26T06:48:54.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:54 smithi050 ceph-mon[94997]: pgmap v476: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 1.0 MiB/s wr, 592 op/s 2023-10-26T06:48:54.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:48:54.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:48:54.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:54 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:48:54.318 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/util.o 2023-10-26T06:48:54.343 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exconvrt.o 2023-10-26T06:48:54.408 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/scsi_ioctl.o 2023-10-26T06:48:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:54 smithi125 ceph-mon[130643]: pgmap v476: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 1.0 MiB/s wr, 592 op/s 2023-10-26T06:48:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:48:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:48:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:54 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:48:54.458 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/sparse.o 2023-10-26T06:48:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:54 smithi153 ceph-mon[131657]: pgmap v476: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 1.0 MiB/s wr, 592 op/s 2023-10-26T06:48:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:48:54.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:48:54.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:54 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:48:54.661 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/dumpstack.o 2023-10-26T06:48:54.674 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/clocksource.o 2023-10-26T06:48:54.940 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/excreate.o 2023-10-26T06:48:55.035 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/rock.o 2023-10-26T06:48:55.122 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/jiffies.o 2023-10-26T06:48:55.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:55 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:48:55.005+0000 7f8f3a015700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-26T06:48:55.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:55 smithi050 ceph-mon[94997]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-26T06:48:55.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:55 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:active 2023-10-26T06:48:55.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:55 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:55 smithi125 ceph-mon[130643]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-26T06:48:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:55 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:active 2023-10-26T06:48:55.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:55 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:55.473 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/nmi.o 2023-10-26T06:48:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:55 smithi153 ceph-mon[131657]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-26T06:48:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:55 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] up:active 2023-10-26T06:48:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:55 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:48:55.502 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_clock.o 2023-10-26T06:48:55.514 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exdebug.o 2023-10-26T06:48:55.560 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/sparse-vmemmap.o 2023-10-26T06:48:55.622 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/timer_list.o 2023-10-26T06:48:55.647 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/deadline.o 2023-10-26T06:48:55.660 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/bsg.o 2023-10-26T06:48:56.094 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/ring_buffer.o 2023-10-26T06:48:56.175 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exdump.o 2023-10-26T06:48:56.188 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/export.o 2023-10-26T06:48:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:56 smithi125 ceph-mon[130643]: pgmap v477: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 837 KiB/s wr, 713 op/s 2023-10-26T06:48:56.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:56 smithi153 ceph-mon[131657]: pgmap v477: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 837 KiB/s wr, 713 op/s 2023-10-26T06:48:56.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:56 smithi050 ceph-mon[94997]: pgmap v477: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 837 KiB/s wr, 713 op/s 2023-10-26T06:48:56.574 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/mmu_notifier.o 2023-10-26T06:48:56.718 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/timeconv.o 2023-10-26T06:48:56.889 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exfield.o 2023-10-26T06:48:56.955 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/ldt.o 2023-10-26T06:48:57.011 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/joliet.o 2023-10-26T06:48:57.050 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/mq-deadline.o 2023-10-26T06:48:57.207 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/timecounter.o 2023-10-26T06:48:57.255 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/wait.o 2023-10-26T06:48:57.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:57 smithi125 ceph-mon[130643]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:57.481 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/alarmtimer.o 2023-10-26T06:48:57.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:57 smithi153 ceph-mon[131657]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:57.494 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exfldio.o 2023-10-26T06:48:57.494 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/isofs/compress.o 2023-10-26T06:48:57.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:57 smithi050 ceph-mon[94997]: scrub summary: idle+waiting paths [/] 2023-10-26T06:48:57.632 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace.o 2023-10-26T06:48:57.698 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/slub.o 2023-10-26T06:48:57.721 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/setup.o 2023-10-26T06:48:57.807 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/kyber-iosched.o 2023-10-26T06:48:58.023 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exmisc.o 2023-10-26T06:48:58.196 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/wait_bit.o 2023-10-26T06:48:58.269 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/isofs/built-in.a 2023-10-26T06:48:58.336 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/jbd2/transaction.o 2023-10-26T06:48:58.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:48:58 smithi125 ceph-mon[130643]: pgmap v478: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 900 KiB/s wr, 780 op/s 2023-10-26T06:48:58.453 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exmutex.o 2023-10-26T06:48:58.470 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/posix-timers.o 2023-10-26T06:48:58.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:48:58 smithi153 ceph-mon[131657]: pgmap v478: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 900 KiB/s wr, 780 op/s 2023-10-26T06:48:58.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:48:58 smithi050 ceph-mon[94997]: pgmap v478: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 900 KiB/s wr, 780 op/s 2023-10-26T06:48:58.769 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/x86_init.o 2023-10-26T06:48:58.898 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exnames.o 2023-10-26T06:48:59.009 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/compat_ioctl.o 2023-10-26T06:48:59.264 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/swait.o 2023-10-26T06:48:59.370 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exoparg1.o 2023-10-26T06:48:59.395 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/i8259.o 2023-10-26T06:48:59.609 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/posix-cpu-timers.o 2023-10-26T06:48:59.673 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/jbd2/commit.o 2023-10-26T06:48:59.846 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq-pci.o 2023-10-26T06:48:59.875 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exoparg2.o 2023-10-26T06:49:00.052 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/irqinit.o 2023-10-26T06:49:00.178 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/migrate.o 2023-10-26T06:49:00.225 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/completion.o 2023-10-26T06:49:00.266 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_output.o 2023-10-26T06:49:00.334 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exoparg3.o 2023-10-26T06:49:00.494 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/posix-clock.o 2023-10-26T06:49:00.533 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-mq-debugfs.o 2023-10-26T06:49:00.739 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/jump_label.o 2023-10-26T06:49:00.763 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/jbd2/recovery.o 2023-10-26T06:49:00.766 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exoparg6.o 2023-10-26T06:49:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:00 smithi125 ceph-mon[130643]: pgmap v479: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 989 KiB/s wr, 759 op/s 2023-10-26T06:49:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:00 smithi153 ceph-mon[131657]: pgmap v479: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 989 KiB/s wr, 759 op/s 2023-10-26T06:49:01.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:00 smithi050 ceph-mon[94997]: pgmap v479: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 989 KiB/s wr, 759 op/s 2023-10-26T06:49:01.294 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exprep.o 2023-10-26T06:49:01.304 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/itimer.o 2023-10-26T06:49:01.399 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/cpupri.o 2023-10-26T06:49:01.436 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_seq.o 2023-10-26T06:49:01.466 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/irq_work.o 2023-10-26T06:49:01.542 INFO:tasks.workunit.client.0.smithi050.stdout: CC block/blk-pm.o 2023-10-26T06:49:01.724 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/jbd2/checkpoint.o 2023-10-26T06:49:01.732 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/early_ioremap.o 2023-10-26T06:49:01.735 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exregion.o 2023-10-26T06:49:01.945 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/probe_roms.o 2023-10-26T06:49:01.952 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_stat.o 2023-10-26T06:49:02.141 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/clockevents.o 2023-10-26T06:49:02.167 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exresnte.o 2023-10-26T06:49:02.288 INFO:tasks.workunit.client.0.smithi050.stdout: AR block/built-in.a 2023-10-26T06:49:02.335 INFO:tasks.workunit.client.0.smithi050.stdout: CC mm/memfd.o 2023-10-26T06:49:02.339 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/cpudeadline.o 2023-10-26T06:49:02.371 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exresolv.o 2023-10-26T06:49:02.561 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/jbd2/revoke.o 2023-10-26T06:49:02.589 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/sys_x86_64.o 2023-10-26T06:49:02.603 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/tick-common.o 2023-10-26T06:49:02.661 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_printk.o 2023-10-26T06:49:02.792 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/blacklist.o 2023-10-26T06:49:02.836 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exresop.o 2023-10-26T06:49:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:02 smithi125 ceph-mon[130643]: pgmap v480: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 945 KiB/s wr, 700 op/s 2023-10-26T06:49:03.191 INFO:tasks.workunit.client.0.smithi050.stdout: AR mm/built-in.a 2023-10-26T06:49:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:02 smithi153 ceph-mon[131657]: pgmap v480: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 945 KiB/s wr, 700 op/s 2023-10-26T06:49:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:02 smithi050 ceph-mon[94997]: pgmap v480: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 945 KiB/s wr, 700 op/s 2023-10-26T06:49:03.297 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/fork.o 2023-10-26T06:49:03.298 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exserial.o 2023-10-26T06:49:03.301 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/jbd2/journal.o 2023-10-26T06:49:03.304 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/espfix_64.o 2023-10-26T06:49:03.320 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/topology.o 2023-10-26T06:49:03.340 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/kernfs/mount.o 2023-10-26T06:49:03.416 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_sched_switch.o 2023-10-26T06:49:03.456 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/tick-broadcast.o 2023-10-26T06:49:03.728 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exstore.o 2023-10-26T06:49:03.966 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/kernfs/inode.o 2023-10-26T06:49:04.100 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/ksysfs.o 2023-10-26T06:49:04.103 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/tick-broadcast-hrtimer.o 2023-10-26T06:49:04.174 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exstoren.o 2023-10-26T06:49:04.184 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_nop.o 2023-10-26T06:49:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:04 smithi050 ceph-mon[94997]: pgmap v481: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1019 KiB/s wr, 559 op/s 2023-10-26T06:49:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:04 smithi125 ceph-mon[130643]: pgmap v481: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1019 KiB/s wr, 559 op/s 2023-10-26T06:49:04.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:04 smithi153 ceph-mon[131657]: pgmap v481: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1019 KiB/s wr, 559 op/s 2023-10-26T06:49:04.543 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/tick-oneshot.o 2023-10-26T06:49:04.611 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exstorob.o 2023-10-26T06:49:04.676 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/kernfs/dir.o 2023-10-26T06:49:04.708 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/bootflag.o 2023-10-26T06:49:04.807 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/stop_task.o 2023-10-26T06:49:04.830 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/blktrace.o 2023-10-26T06:49:04.989 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/tick-sched.o 2023-10-26T06:49:05.039 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exsystem.o 2023-10-26T06:49:05.213 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/jbd2/built-in.a 2023-10-26T06:49:05.218 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/extrace.o 2023-10-26T06:49:05.260 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/e820.o 2023-10-26T06:49:05.267 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/osi.o 2023-10-26T06:49:05.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:05 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:49:05.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:05 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:49:05.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:05 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:49:05.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:05 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:49:05.470 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/kernfs/file.o 2023-10-26T06:49:05.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:05 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:49:05.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:05 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:49:05.640 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/exutils.o 2023-10-26T06:49:05.663 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/arm/built-in.a 2023-10-26T06:49:05.704 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/atmel/built-in.a 2023-10-26T06:49:05.759 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/pelt.o 2023-10-26T06:49:05.771 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq.o 2023-10-26T06:49:05.868 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwacpi.o 2023-10-26T06:49:05.982 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/vsyscall.o 2023-10-26T06:49:06.147 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/exec_domain.o 2023-10-26T06:49:06.167 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_events.o 2023-10-26T06:49:06.320 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/pci-dma.o 2023-10-26T06:49:06.331 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwesleep.o 2023-10-26T06:49:06.343 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/kernfs/symlink.o 2023-10-26T06:49:06.357 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_lock.o 2023-10-26T06:49:06.397 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/time/timekeeping_debug.o 2023-10-26T06:49:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:06 smithi125 ceph-mon[130643]: scrub summary: idle 2023-10-26T06:49:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:06 smithi125 ceph-mon[130643]: pgmap v482: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 966 KiB/s wr, 271 op/s 2023-10-26T06:49:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:06 smithi153 ceph-mon[131657]: scrub summary: idle 2023-10-26T06:49:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:06 smithi153 ceph-mon[131657]: pgmap v482: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 966 KiB/s wr, 271 op/s 2023-10-26T06:49:06.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:06 smithi050 ceph-mon[94997]: scrub summary: idle 2023-10-26T06:49:06.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:06 smithi050 ceph-mon[94997]: pgmap v482: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 966 KiB/s wr, 271 op/s 2023-10-26T06:49:06.770 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwgpe.o 2023-10-26T06:49:06.774 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_clientmgr.o 2023-10-26T06:49:06.825 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/clntlock.o 2023-10-26T06:49:06.912 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/kernfs/built-in.a 2023-10-26T06:49:06.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_memory.o 2023-10-26T06:49:07.031 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/quirks.o 2023-10-26T06:49:07.045 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/stats.o 2023-10-26T06:49:07.050 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/time/built-in.a 2023-10-26T06:49:07.130 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-core.o 2023-10-26T06:49:07.241 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwregs.o 2023-10-26T06:49:07.648 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_export.o 2023-10-26T06:49:07.716 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-scsi.o 2023-10-26T06:49:07.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwsleep.o 2023-10-26T06:49:07.756 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/topology.o 2023-10-26T06:49:07.921 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/clntproc.o 2023-10-26T06:49:07.961 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_queue.o 2023-10-26T06:49:08.007 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/cpuacct.o 2023-10-26T06:49:08.167 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwvalid.o 2023-10-26T06:49:08.214 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/kdebugfs.o 2023-10-26T06:49:08.379 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_event_perf.o 2023-10-26T06:49:08.592 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwxface.o 2023-10-26T06:49:08.651 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_fifo.o 2023-10-26T06:49:08.778 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/alternative.o 2023-10-26T06:49:08.997 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/cpufreq.o 2023-10-26T06:49:09.074 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwxfsleep.o 2023-10-26T06:49:09.095 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/clntxdr.o 2023-10-26T06:49:09.157 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_events_filter.o 2023-10-26T06:49:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:08 smithi125 ceph-mon[130643]: pgmap v483: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.0 MiB/s wr, 146 op/s 2023-10-26T06:49:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:08 smithi153 ceph-mon[131657]: pgmap v483: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.0 MiB/s wr, 146 op/s 2023-10-26T06:49:09.242 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_prioq.o 2023-10-26T06:49:09.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:08 smithi050 ceph-mon[94997]: pgmap v483: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.0 MiB/s wr, 146 op/s 2023-10-26T06:49:09.533 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/hwpci.o 2023-10-26T06:49:09.549 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/panic.o 2023-10-26T06:49:09.738 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/i8253.o 2023-10-26T06:49:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_timer.o 2023-10-26T06:49:09.913 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/membarrier.o 2023-10-26T06:49:09.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsaccess.o 2023-10-26T06:49:10.060 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-eh.o 2023-10-26T06:49:10.122 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/hw_breakpoint.o 2023-10-26T06:49:10.130 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/host.o 2023-10-26T06:49:10.343 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_events_trigger.o 2023-10-26T06:49:10.355 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/drivers/mpu401/built-in.a 2023-10-26T06:49:10.398 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/drivers/opl3/built-in.a 2023-10-26T06:49:10.445 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/drivers/opl4/built-in.a 2023-10-26T06:49:10.457 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_system.o 2023-10-26T06:49:10.471 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsalloc.o 2023-10-26T06:49:10.488 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/drivers/pcsp/built-in.a 2023-10-26T06:49:10.528 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/drivers/vx/built-in.a 2023-10-26T06:49:10.561 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/drivers/built-in.a 2023-10-26T06:49:10.625 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/sound.o 2023-10-26T06:49:10.841 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/tsc.o 2023-10-26T06:49:10.917 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sched/isolation.o 2023-10-26T06:49:10.931 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsarguments.o 2023-10-26T06:49:11.005 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_ports.o 2023-10-26T06:49:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:10 smithi125 ceph-mon[130643]: pgmap v484: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2023-10-26T06:49:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:10 smithi153 ceph-mon[131657]: pgmap v484: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2023-10-26T06:49:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:10 smithi050 ceph-mon[94997]: pgmap v484: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2023-10-26T06:49:11.270 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/osl.o 2023-10-26T06:49:11.331 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/svc.o 2023-10-26T06:49:11.420 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsconvert.o 2023-10-26T06:49:11.442 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_kprobe.o 2023-10-26T06:49:11.741 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_info.o 2023-10-26T06:49:11.793 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/tsc_msr.o 2023-10-26T06:49:11.886 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsdump.o 2023-10-26T06:49:11.925 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-transport.o 2023-10-26T06:49:11.982 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/sched/built-in.a 2023-10-26T06:49:12.064 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/power-traces.o 2023-10-26T06:49:12.104 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/io_delay.o 2023-10-26T06:49:12.227 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq/seq_dummy.o 2023-10-26T06:49:12.271 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nseval.o 2023-10-26T06:49:12.368 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/i386.o 2023-10-26T06:49:12.481 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/rtc.o 2023-10-26T06:49:12.500 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/svclock.o 2023-10-26T06:49:12.705 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsinit.o 2023-10-26T06:49:12.711 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/init.o 2023-10-26T06:49:12.768 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/core/seq/built-in.a 2023-10-26T06:49:12.834 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-trace.o 2023-10-26T06:49:12.857 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/init.o 2023-10-26T06:49:13.044 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/auxdisplay/built-in.a 2023-10-26T06:49:13.126 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/base/firmware_loader/builtin/built-in.a 2023-10-26T06:49:13.167 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/firmware_loader/main.o 2023-10-26T06:49:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:12 smithi125 ceph-mon[130643]: pgmap v485: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:49:13.183 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsload.o 2023-10-26T06:49:13.202 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/pci-iommu_table.o 2023-10-26T06:49:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:12 smithi153 ceph-mon[131657]: pgmap v485: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:49:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:12 smithi050 ceph-mon[94997]: pgmap v485: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:49:13.274 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/rpm-traces.o 2023-10-26T06:49:13.287 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/mmconfig_64.o 2023-10-26T06:49:13.597 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsnames.o 2023-10-26T06:49:13.598 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-sff.o 2023-10-26T06:49:13.659 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/memory.o 2023-10-26T06:49:13.674 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/svcshare.o 2023-10-26T06:49:13.752 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/resource.o 2023-10-26T06:49:13.898 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/kernel/irqflags.o 2023-10-26T06:49:13.951 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/direct.o 2023-10-26T06:49:14.007 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/process.o 2023-10-26T06:49:14.044 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_dynevent.o 2023-10-26T06:49:14.097 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsobject.o 2023-10-26T06:49:14.100 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/control.o 2023-10-26T06:49:14.110 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/base/firmware_loader/built-in.a 2023-10-26T06:49:14.174 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/sysfs.o 2023-10-26T06:49:14.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:14 smithi050 ceph-mon[94997]: pgmap v486: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2023-10-26T06:49:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:14 smithi125 ceph-mon[130643]: pgmap v486: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2023-10-26T06:49:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:14 smithi153 ceph-mon[131657]: pgmap v486: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2023-10-26T06:49:14.578 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsparse.o 2023-10-26T06:49:14.635 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/mmconfig-shared.o 2023-10-26T06:49:14.708 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/svcproc.o 2023-10-26T06:49:14.755 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/generic_ops.o 2023-10-26T06:49:14.791 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_probe.o 2023-10-26T06:49:15.030 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nspredef.o 2023-10-26T06:49:15.115 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-pmp.o 2023-10-26T06:49:15.280 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/ptrace.o 2023-10-26T06:49:15.280 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/common.o 2023-10-26T06:49:15.441 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/misc.o 2023-10-26T06:49:15.460 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsprepkg.o 2023-10-26T06:49:15.470 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/fixup.o 2023-10-26T06:49:15.811 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/svcsubs.o 2023-10-26T06:49:15.870 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/qos.o 2023-10-26T06:49:15.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/trace/trace_uprobe.o 2023-10-26T06:49:15.952 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsrepair.o 2023-10-26T06:49:16.049 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/device.o 2023-10-26T06:49:16.070 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libata-acpi.o 2023-10-26T06:49:16.289 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/acpi.o 2023-10-26T06:49:16.431 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/tls.o 2023-10-26T06:49:16.467 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsrepair2.o 2023-10-26T06:49:16.602 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/info.o 2023-10-26T06:49:16.850 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/runtime.o 2023-10-26T06:49:16.958 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nssearch.o 2023-10-26T06:49:16.967 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/mon.o 2023-10-26T06:49:16.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/legacy.o 2023-10-26T06:49:17.054 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/ahci.o 2023-10-26T06:49:17.159 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/trace/built-in.a 2023-10-26T06:49:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:16 smithi125 ceph-mon[130643]: pgmap v487: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.1 MiB/s wr, 74 op/s 2023-10-26T06:49:17.176 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/step.o 2023-10-26T06:49:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:16 smithi153 ceph-mon[131657]: pgmap v487: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.1 MiB/s wr, 74 op/s 2023-10-26T06:49:17.240 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cpu.o 2023-10-26T06:49:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:16 smithi050 ceph-mon[94997]: pgmap v487: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.1 MiB/s wr, 74 op/s 2023-10-26T06:49:17.380 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsutils.o 2023-10-26T06:49:17.421 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/isadma.o 2023-10-26T06:49:17.574 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/irq.o 2023-10-26T06:49:17.806 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/wakeirq.o 2023-10-26T06:49:17.819 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/i8237.o 2023-10-26T06:49:17.861 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/vmaster.o 2023-10-26T06:49:17.890 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nswalk.o 2023-10-26T06:49:18.031 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/libahci.o 2023-10-26T06:49:18.083 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/xdr.o 2023-10-26T06:49:18.203 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/stacktrace.o 2023-10-26T06:49:18.329 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsxfeval.o 2023-10-26T06:49:18.330 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/main.o 2023-10-26T06:49:18.451 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/ctljack.o 2023-10-26T06:49:18.497 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/common.o 2023-10-26T06:49:18.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-26T06:49:18.811 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/exit.o 2023-10-26T06:49:18.820 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/reboot.o 2023-10-26T06:49:18.869 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsxfname.o 2023-10-26T06:49:18.888 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/jack.o 2023-10-26T06:49:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:18 smithi125 ceph-mon[130643]: pgmap v488: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:49:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 -- 172.21.15.50:0/3239682677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 msgr2=0x7f05d810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3239682677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 0x7f05d810f800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f05d000b0a0 tx=0x7f05d000b3b0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 -- 172.21.15.50:0/3239682677 shutdown_connections 2023-10-26T06:49:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3239682677 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 0x7f05d810f800 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3239682677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 0x7f05d8108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3239682677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 -- 172.21.15.50:0/3239682677 >> 172.21.15.50:0/3239682677 conn(0x7f05d80fe3e0 msgr2=0x7f05d8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 -- 172.21.15.50:0/3239682677 shutdown_connections 2023-10-26T06:49:19.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.170+0000 7f05de1ff700 1 -- 172.21.15.50:0/3239682677 wait complete. 2023-10-26T06:49:19.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.172+0000 7f05de1ff700 1 Processor -- start 2023-10-26T06:49:19.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.174+0000 7f05de1ff700 1 -- start start 2023-10-26T06:49:19.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.175+0000 7f05de1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05de1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 0x7f05d8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05de1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 0x7f05d819c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05de1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d819cb60 con 0x7f05d8102930 2023-10-26T06:49:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05de1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d819ccd0 con 0x7f05d81032f0 2023-10-26T06:49:19.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05de1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d819ce90 con 0x7f05d8108940 2023-10-26T06:49:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34818/0 (socket says 172.21.15.50:34818) 2023-10-26T06:49:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05d77fe700 1 -- 172.21.15.50:0/3597068422 learned_addr learned my addr 172.21.15.50:0/3597068422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:19.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.177+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 0x7f05d819c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.178+0000 7f05d7fff700 1 -- 172.21.15.50:0/3597068422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 msgr2=0x7f05d8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.178+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 0x7f05d8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.178+0000 7f05d7fff700 1 -- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 msgr2=0x7f05d8198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.178+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.178+0000 7f05d7fff700 1 -- 172.21.15.50:0/3597068422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0009d00 con 0x7f05d8108940 2023-10-26T06:49:19.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.178+0000 7f05d77fe700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:49:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.179+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 0x7f05d819c560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05d000b070 tx=0x7f05d0009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.179+0000 7f05d4ff9700 1 -- 172.21.15.50:0/3597068422 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000e040 con 0x7f05d8108940 2023-10-26T06:49:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.179+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d819d110 con 0x7f05d8108940 2023-10-26T06:49:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.179+0000 7f05d4ff9700 1 -- 172.21.15.50:0/3597068422 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05d0004c50 con 0x7f05d8108940 2023-10-26T06:49:19.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.179+0000 7f05d4ff9700 1 -- 172.21.15.50:0/3597068422 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d001dea0 con 0x7f05d8108940 2023-10-26T06:49:19.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.179+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d81a5ad0 con 0x7f05d8108940 2023-10-26T06:49:19.186 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/clnt4xdr.o 2023-10-26T06:49:19.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.187+0000 7f05d4ff9700 1 -- 172.21.15.50:0/3597068422 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f05d001d470 con 0x7f05d8108940 2023-10-26T06:49:19.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.189+0000 7f05f1bc6b80 1 Processor -- start 2023-10-26T06:49:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 -- start start 2023-10-26T06:49:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271dbe0 0x55eda271dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 0x55eda2718090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda27185d0 0x55eda2718a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda268b6e0 con 0x55eda271e500 2023-10-26T06:49:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2671c60 con 0x55eda27185d0 2023-10-26T06:49:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05f1bc6b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda266f580 con 0x55eda271dbe0 2023-10-26T06:49:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.190+0000 7f05d6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271dbe0 0x55eda271dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.191+0000 7f05d6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271dbe0 0x55eda271dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53402/0 (socket says 172.21.15.50:53402) 2023-10-26T06:49:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.191+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 0x55eda2718090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.191+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 0x55eda2718090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34832/0 (socket says 172.21.15.50:34832) 2023-10-26T06:49:19.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.191+0000 7f05d77fe700 1 -- 172.21.15.50:0/1461614645 learned_addr learned my addr 172.21.15.50:0/1461614645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:19.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda27185d0 0x55eda2718a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d77fe700 1 -- 172.21.15.50:0/1461614645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271dbe0 msgr2=0x55eda271dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d77fe700 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271dbe0 0x55eda271dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d77fe700 1 -- 172.21.15.50:0/1461614645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda27185d0 msgr2=0x55eda2718a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d77fe700 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda27185d0 0x55eda2718a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d77fe700 1 -- 172.21.15.50:0/1461614645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eda26283f0 con 0x55eda271e500 2023-10-26T06:49:19.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.192+0000 7f05d77fe700 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 0x55eda2718090 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0105e0 tx=0x7f05cc0108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deb8a470ddaaaa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.193+0000 7f05d4ff9700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f05c00a15f0 0x7f05c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.193+0000 7f05d4ff9700 1 -- 172.21.15.50:0/3597068422 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f05d00ce630 con 0x7f05d8108940 2023-10-26T06:49:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.193+0000 7f05bdffb700 1 -- 172.21.15.50:0/1461614645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc022630 con 0x55eda271e500 2023-10-26T06:49:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.193+0000 7f05bdffb700 1 -- 172.21.15.50:0/1461614645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05cc01d070 con 0x55eda271e500 2023-10-26T06:49:19.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.193+0000 7f05bdffb700 1 -- 172.21.15.50:0/1461614645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc022630 con 0x55eda271e500 2023-10-26T06:49:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.195+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/1461614645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 msgr2=0x55eda2718090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.195+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 0x55eda2718090 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0105e0 tx=0x7f05cc0108f0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.196+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/1461614645 shutdown_connections 2023-10-26T06:49:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.196+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda27185d0 0x55eda2718a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.196+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271dbe0 0x55eda271dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.196+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/1461614645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda271e500 0x55eda2718090 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.196+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/1461614645 >> 172.21.15.50:0/1461614645 conn(0x55eda268c720 msgr2=0x55eda2712b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.198+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/1461614645 shutdown_connections 2023-10-26T06:49:19.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.201+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f05c00a15f0 0x7f05c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.202+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f05c00a15f0 0x7f05c00a3ab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55eda2718fb0 tx=0x7f05c8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.202+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/1461614645 wait complete. 2023-10-26T06:49:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.203+0000 7f05f1bc6b80 1 -- start start 2023-10-26T06:49:19.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.203+0000 7f05f1bc6b80 1 Processor -- start 2023-10-26T06:49:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.208+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27219e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.208+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda27223a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.208+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda273cf60 0x55eda273f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05d6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda27223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05d6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda27223a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34838/0 (socket says 172.21.15.50:34838) 2023-10-26T06:49:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05d6ffd700 1 -- 172.21.15.50:0/818653010 learned_addr learned my addr 172.21.15.50:0/818653010 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda266ae70 con 0x55eda2721f20 2023-10-26T06:49:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2607710 con 0x55eda271e500 2023-10-26T06:49:19.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05d77fe700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.209+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda26073b0 con 0x55eda273cf60 2023-10-26T06:49:19.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d7fff700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda273cf60 0x55eda273f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05f1bc6b80 10 client.0 _ll_register_callbacks cb 0x55eda2551a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:19.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d6ffd700 1 -- 172.21.15.50:0/818653010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda273cf60 msgr2=0x55eda273f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda273cf60 0x55eda273f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d6ffd700 1 -- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 msgr2=0x55eda27219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d6ffd700 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc00be40 con 0x55eda2721f20 2023-10-26T06:49:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.210+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda27223a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f05c8004040 tx=0x7f05c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb333809d28aaee server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.212+0000 7f05b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:49:19.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.212+0000 7f05b6ffd700 1 -- 172.21.15.50:0/818653010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8004570 con 0x55eda2721f20 2023-10-26T06:49:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.212+0000 7f05b6ffd700 1 -- 172.21.15.50:0/818653010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f05c8028470 con 0x55eda2721f20 2023-10-26T06:49:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.212+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eda266fef0 con 0x55eda2721f20 2023-10-26T06:49:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.213+0000 7f05b6ffd700 1 -- 172.21.15.50:0/818653010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c8028630 con 0x55eda2721f20 2023-10-26T06:49:19.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.213+0000 7f05f1bc6b80 10 client.16464 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:19.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.213+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55eda2495de0 con 0x55eda2721f20 2023-10-26T06:49:19.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05b6ffd700 1 -- 172.21.15.50:0/818653010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eda266fef0 con 0x55eda2721f20 2023-10-26T06:49:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05b6ffd700 1 -- 172.21.15.50:0/818653010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f05c801e880 con 0x55eda2721f20 2023-10-26T06:49:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05f1bc6b80 10 client.16464 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05f1bc6b80 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:49:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05f1bc6b80 20 client.16464 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2743660 0x55eda2745a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05f1bc6b80 4 client.16464 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:49:19.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eda26e78b0 con 0x55eda2743660 2023-10-26T06:49:19.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.218+0000 7f05d77fe700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2743660 0x55eda2745a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.219+0000 7f05b6ffd700 10 client.16464 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:19.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.219+0000 7f05d77fe700 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2743660 0x55eda2745a80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44101541e787f5d8 server_cookie=5e5fba6744103fd2 in_seq=0 out_seq=0 2023-10-26T06:49:19.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.220+0000 7f05b6ffd700 1 -- 172.21.15.50:0/818653010 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eda26e78b0 con 0x55eda2743660 2023-10-26T06:49:19.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.220+0000 7f05b6ffd700 10 client.16464 handle_command_reply: tid=0 2023-10-26T06:49:19.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.222+0000 7f05f1bc6b80 1 client.16464 shutdown 2023-10-26T06:49:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 msgr2=0x55eda27223a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda27223a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f05c8004040 tx=0x7f05c8004750 comp rx=0 tx=0).stop 2023-10-26T06:49:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 shutdown_connections 2023-10-26T06:49:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2743660 0x55eda2745a80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda273cf60 0x55eda273f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/818653010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda27223a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05b6ffd700 0 client.16464 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 >> 172.21.15.50:0/818653010 conn(0x55eda268c720 msgr2=0x55eda2717080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 shutdown_connections 2023-10-26T06:49:19.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.225+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/818653010 wait complete. 2023-10-26T06:49:19.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.229+0000 7f05f1bc6b80 20 client.16464 trim_cache size 0 max 16384 2023-10-26T06:49:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:18 smithi153 ceph-mon[131657]: pgmap v488: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:49:19.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:18 smithi050 ceph-mon[94997]: pgmap v488: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:49:19.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.272+0000 7f05f1bc6b80 1 Processor -- start 2023-10-26T06:49:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.272+0000 7f05f1bc6b80 1 -- start start 2023-10-26T06:49:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.273+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 0x55eda270d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.273+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda2739ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 0x55eda270d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda2739ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda2739ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34846/0 (socket says 172.21.15.50:34846) 2023-10-26T06:49:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 0x55eda270d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53422/0 (socket says 172.21.15.50:53422) 2023-10-26T06:49:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d6ffd700 1 -- 172.21.15.50:0/161759679 learned_addr learned my addr 172.21.15.50:0/161759679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda273cf60 0x55eda27202b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda24eb920 con 0x55eda2721f20 2023-10-26T06:49:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda266fef0 con 0x55eda273cf60 2023-10-26T06:49:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2740330 con 0x55eda271e500 2023-10-26T06:49:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d77fe700 1 -- 172.21.15.50:0/161759679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda273cf60 msgr2=0x55eda27202b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:49:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d77fe700 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda273cf60 0x55eda27202b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.274+0000 7f05d77fe700 1 -- 172.21.15.50:0/161759679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 msgr2=0x55eda2739ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05d77fe700 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda2739ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05d77fe700 1 -- 172.21.15.50:0/161759679 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eda2712d70 con 0x55eda271e500 2023-10-26T06:49:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda2739ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:49:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05d77fe700 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 0x55eda270d5d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f05cc010c40 tx=0x7f05cc021ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94a90d337ace2e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05be7fc700 1 -- 172.21.15.50:0/161759679 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc016040 con 0x55eda271e500 2023-10-26T06:49:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05be7fc700 1 -- 172.21.15.50:0/161759679 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05cc02a440 con 0x55eda271e500 2023-10-26T06:49:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.275+0000 7f05be7fc700 1 -- 172.21.15.50:0/161759679 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc022630 con 0x55eda271e500 2023-10-26T06:49:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.276+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 msgr2=0x55eda270d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.276+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 0x55eda270d5d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f05cc010c40 tx=0x7f05cc021ee0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.277+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 shutdown_connections 2023-10-26T06:49:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.277+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda273cf60 0x55eda27202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.277+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda271e500 0x55eda270d5d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.277+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/161759679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda2721f20 0x55eda2739ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.277+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 >> 172.21.15.50:0/161759679 conn(0x55eda268c720 msgr2=0x55eda273f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.277+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 shutdown_connections 2023-10-26T06:49:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.278+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/161759679 wait complete. 2023-10-26T06:49:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.278+0000 7f05f1bc6b80 1 -- start start 2023-10-26T06:49:19.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.278+0000 7f05f1bc6b80 1 Processor -- start 2023-10-26T06:49:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.280+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.280+0000 7f05f1bc6b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda2721f20 0x55eda2738df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.280+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.281+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47742/0 (socket says 172.21.15.50:47742) 2023-10-26T06:49:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.281+0000 7f05d77fe700 1 -- 172.21.15.50:0/3320205068 learned_addr learned my addr 172.21.15.50:0/3320205068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:19.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.281+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda273cf60 0x55eda27974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.281+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2739580 con 0x55eda273cf60 2023-10-26T06:49:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.281+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda27396f0 con 0x55eda271e500 2023-10-26T06:49:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.281+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda273cf60 0x55eda27974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda2721f20 0x55eda2738df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2797a00 con 0x55eda2721f20 2023-10-26T06:49:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d7fff700 1 -- 172.21.15.50:0/3320205068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda2721f20 msgr2=0x55eda2738df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda2721f20 0x55eda2738df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d7fff700 1 -- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 msgr2=0x55eda27388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d7fff700 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eda2495de0 con 0x55eda273cf60 2023-10-26T06:49:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.282+0000 7f05d6ffd700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda2721f20 0x55eda2738df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:49:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.283+0000 7f05d7fff700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda273cf60 0x55eda27974c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f05d00cbe00 tx=0x7f05d009b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6628b1705abb182 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.283+0000 7f05d77fe700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:49:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.283+0000 7f05b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:49:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.283+0000 7f05b6ffd700 1 -- 172.21.15.50:0/3320205068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d009be50 con 0x55eda273cf60 2023-10-26T06:49:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.283+0000 7f05b6ffd700 1 -- 172.21.15.50:0/3320205068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f05d009b750 con 0x55eda273cf60 2023-10-26T06:49:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.283+0000 7f05f1bc6b80 10 client.0 _ll_register_callbacks cb 0x55eda2551a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.284+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05cc01d070 con 0x55eda273cf60 2023-10-26T06:49:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.284+0000 7f05b6ffd700 1 -- 172.21.15.50:0/3320205068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05d009f8a0 con 0x55eda273cf60 2023-10-26T06:49:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.285+0000 7f05f1bc6b80 10 client.16470 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.285+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=28}) v3 -- 0x7f05cc02a730 con 0x55eda273cf60 2023-10-26T06:49:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.285+0000 7f05b6ffd700 1 -- 172.21.15.50:0/3320205068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f05d009b9b0 con 0x55eda273cf60 2023-10-26T06:49:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05f1bc6b80 10 client.16470 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05f1bc6b80 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:49:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05f1bc6b80 20 client.16470 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2798dd0 0x55eda279b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05f1bc6b80 4 client.16470 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-26T06:49:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f05cc01d070 con 0x55eda2798dd0 2023-10-26T06:49:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.286+0000 7f05d77fe700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2798dd0 0x55eda279b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.292 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/early.o 2023-10-26T06:49:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.289+0000 7f05b6ffd700 10 client.16470 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.289+0000 7f05d77fe700 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2798dd0 0x55eda279b290 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2ec94a6089bbcf server_cookie=291d9d890a2d5213 in_seq=0 out_seq=0 2023-10-26T06:49:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.290+0000 7f05b6ffd700 1 -- 172.21.15.50:0/3320205068 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f05cc01d070 con 0x55eda2798dd0 2023-10-26T06:49:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.290+0000 7f05b6ffd700 10 client.16470 handle_command_reply: tid=0 2023-10-26T06:49:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.290+0000 7f05f1bc6b80 1 client.16470 shutdown 2023-10-26T06:49:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda273cf60 msgr2=0x55eda27974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda273cf60 0x55eda27974c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f05d00cbe00 tx=0x7f05d009b5d0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 shutdown_connections 2023-10-26T06:49:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x55eda2798dd0 0x55eda279b290 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05b6ffd700 0 client.16470 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eda273cf60 0x55eda27974c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55eda271e500 0x55eda27388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 --2- 172.21.15.50:0/3320205068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eda2721f20 0x55eda2738df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.291+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 >> 172.21.15.50:0/3320205068 conn(0x55eda268c720 msgr2=0x55eda2721270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.292+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 shutdown_connections 2023-10-26T06:49:19.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.292+0000 7f05f1bc6b80 1 -- 172.21.15.50:0/3320205068 wait complete. 2023-10-26T06:49:19.299 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:49:19.300 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-10-26T06:49:19.300 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-10-26T06:49:19.300 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:49:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.294+0000 7f05f1bc6b80 20 client.16470 trim_cache size 0 max 16384 2023-10-26T06:49:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f05c00a15f0 msgr2=0x7f05c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f05c00a15f0 0x7f05c00a3ab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55eda2718fb0 tx=0x7f05c8009260 comp rx=0 tx=0).stop 2023-10-26T06:49:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 msgr2=0x7f05d819c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 0x7f05d819c560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05d000b070 tx=0x7f05d0009c60 comp rx=0 tx=0).stop 2023-10-26T06:49:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 shutdown_connections 2023-10-26T06:49:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f05c00a15f0 0x7f05c00a3ab0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05d8108940 0x7f05d819c560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05d8102930 0x7f05d8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 --2- 172.21.15.50:0/3597068422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05d81032f0 0x7f05d8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.301+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 >> 172.21.15.50:0/3597068422 conn(0x7f05d80fe3e0 msgr2=0x7f05d80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.302+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 shutdown_connections 2023-10-26T06:49:19.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.303+0000 7f05de1ff700 1 -- 172.21.15.50:0/3597068422 wait complete. 2023-10-26T06:49:19.358 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-26T06:49:19.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:49:19.438 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/nsxfobj.o 2023-10-26T06:49:19.471 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/ata_piix.o 2023-10-26T06:49:19.637 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/hwdep.o 2023-10-26T06:49:19.838 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/msr.o 2023-10-26T06:49:19.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.863+0000 7f1aa59ff700 1 -- 172.21.15.50:0/3800515880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa0113940 msgr2=0x7f1aa0115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.863+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/3800515880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa0113940 0x7f1aa0115d30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009990 tx=0x7f1a94009ca0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 -- 172.21.15.50:0/3800515880 shutdown_connections 2023-10-26T06:49:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/3800515880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa0113940 0x7f1aa0115d30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/3800515880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa01077f0 0x7f1aa0107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/3800515880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 0x7f1aa0113400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 -- 172.21.15.50:0/3800515880 >> 172.21.15.50:0/3800515880 conn(0x7f1aa006b7d0 msgr2=0x7f1aa006bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:19.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 -- 172.21.15.50:0/3800515880 shutdown_connections 2023-10-26T06:49:19.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.864+0000 7f1aa59ff700 1 -- 172.21.15.50:0/3800515880 wait complete. 2023-10-26T06:49:19.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.866+0000 7f1aa59ff700 1 Processor -- start 2023-10-26T06:49:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 -- start start 2023-10-26T06:49:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa01077f0 0x7f1aa010ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 0x7f1aa010efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 0x7f1aa0109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa010a3b0 con 0x7f1aa0108110 2023-10-26T06:49:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa010a520 con 0x7f1aa0113940 2023-10-26T06:49:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.869+0000 7f1aa59ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa010a6e0 con 0x7f1aa01077f0 2023-10-26T06:49:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 0x7f1aa0109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 0x7f1aa0109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47758/0 (socket says 172.21.15.50:47758) 2023-10-26T06:49:19.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 -- 172.21.15.50:0/1509856447 learned_addr learned my addr 172.21.15.50:0/1509856447 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:19.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9effd700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa01077f0 0x7f1aa010ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9e7fc700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 0x7f1aa010efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 -- 172.21.15.50:0/1509856447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa01077f0 msgr2=0x7f1aa010ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa01077f0 0x7f1aa010ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 -- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 msgr2=0x7f1aa010efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:19.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 0x7f1aa010efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:19.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.870+0000 7f1a9f7fe700 1 -- 172.21.15.50:0/1509856447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940095f0 con 0x7f1aa0113940 2023-10-26T06:49:19.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.871+0000 7f1a9e7fc700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 0x7f1aa010efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:49:19.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.871+0000 7f1a9f7fe700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 0x7f1aa0109be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400b5c0 tx=0x7f1a9400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.871+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9401d070 con 0x7f1aa0113940 2023-10-26T06:49:19.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.871+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a94022470 con 0x7f1aa0113940 2023-10-26T06:49:19.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.871+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94017650 con 0x7f1aa0113940 2023-10-26T06:49:19.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.871+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa010a960 con 0x7f1aa0113940 2023-10-26T06:49:19.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.872+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa0112a10 con 0x7f1aa0113940 2023-10-26T06:49:19.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.874+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0108ee0 con 0x7f1aa0113940 2023-10-26T06:49:19.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.883+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1a940225e0 con 0x7f1aa0113940 2023-10-26T06:49:19.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.886+0000 7f1aa49fd700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1a880a1670 0x7f1a880a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:19.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.886+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1a940cdfb0 con 0x7f1aa0113940 2023-10-26T06:49:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.887+0000 7f1a9effd700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1a880a1670 0x7f1a880a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:19.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.888+0000 7f1a9effd700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1a880a1670 0x7f1a880a3b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1a980060b0 tx=0x7f1a9800c040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:19.890 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/bus_numa.o 2023-10-26T06:49:19.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:19.890+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1a94097410 con 0x7f1aa0113940 2023-10-26T06:49:19.955 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psargs.o 2023-10-26T06:49:19.971 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/wakeup.o 2023-10-26T06:49:20.364 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/xdr4.o 2023-10-26T06:49:20.467 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psloop.o 2023-10-26T06:49:20.474 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/pata_amd.o 2023-10-26T06:49:20.480 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/cpuid.o 2023-10-26T06:49:20.538 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/timer.o 2023-10-26T06:49:20.550 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/pci/amd_bus.o 2023-10-26T06:49:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.557+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aa0118e70 con 0x7f1aa0113940 2023-10-26T06:49:20.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.558+0000 7f1aa49fd700 1 -- 172.21.15.50:0/1509856447 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+11329 (secure 0 0 0) 0x7f1a9409aa30 con 0x7f1aa0113940 2023-10-26T06:49:20.560 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:49:20.560 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:48:54.018233+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":116,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:49:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1a880a1670 msgr2=0x7f1a880a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1a880a1670 0x7f1a880a3b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1a980060b0 tx=0x7f1a9800c040 comp rx=0 tx=0).stop 2023-10-26T06:49:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 msgr2=0x7f1aa0109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:20.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 0x7f1aa0109be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400b5c0 tx=0x7f1a9400f690 comp rx=0 tx=0).stop 2023-10-26T06:49:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 shutdown_connections 2023-10-26T06:49:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f1a880a1670 0x7f1a880a3b30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1aa0113940 0x7f1aa0109be0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.563+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1aa01077f0 0x7f1aa010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:20.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.564+0000 7f1aa59ff700 1 --2- 172.21.15.50:0/1509856447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aa0108110 0x7f1aa010efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.564+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 >> 172.21.15.50:0/1509856447 conn(0x7f1aa006b7d0 msgr2=0x7f1aa0070650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.564+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 shutdown_connections 2023-10-26T06:49:20.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:20.564+0000 7f1aa59ff700 1 -- 172.21.15.50:0/1509856447 wait complete. 2023-10-26T06:49:20.569 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2023-10-26T06:49:20.578 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/softirq.o 2023-10-26T06:49:20.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-26T06:49:21.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:20 smithi050 ceph-mon[94997]: pgmap v489: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.2 MiB/s wr, 93 op/s 2023-10-26T06:49:21.018 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:20 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1509856447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:49:21.024 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psobject.o 2023-10-26T06:49:21.094 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/early-quirks.o 2023-10-26T06:49:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:20 smithi125 ceph-mon[130643]: pgmap v489: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.2 MiB/s wr, 93 op/s 2023-10-26T06:49:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:20 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1509856447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:49:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 -- 172.21.15.50:0/2437030545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac10ef10 msgr2=0x7f8dac1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 --2- 172.21.15.50:0/2437030545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac10ef10 0x7f8dac1077f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009940 tx=0x7f8d98009c50 comp rx=0 tx=0).stop 2023-10-26T06:49:21.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 -- 172.21.15.50:0/2437030545 shutdown_connections 2023-10-26T06:49:21.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 --2- 172.21.15.50:0/2437030545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac119fd0 0x7f8dac11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 --2- 172.21.15.50:0/2437030545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac10ef10 0x7f8dac1077f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 --2- 172.21.15.50:0/2437030545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.178+0000 7f8db33ff700 1 -- 172.21.15.50:0/2437030545 >> 172.21.15.50:0/2437030545 conn(0x7f8dac06b840 msgr2=0x7f8dac06bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.179+0000 7f8db33ff700 1 -- 172.21.15.50:0/2437030545 shutdown_connections 2023-10-26T06:49:21.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.179+0000 7f8db33ff700 1 -- 172.21.15.50:0/2437030545 wait complete. 2023-10-26T06:49:21.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.180+0000 7f8db33ff700 1 Processor -- start 2023-10-26T06:49:21.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.184+0000 7f8db33ff700 1 -- start start 2023-10-26T06:49:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.184+0000 7f8db33ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac119600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.184+0000 7f8db33ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac119fd0 0x7f8dac1156c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.184+0000 7f8db33ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac115c00 0x7f8dac1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db33ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac119df0 con 0x7f8dac119fd0 2023-10-26T06:49:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db33ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1a9cf0 con 0x7f8dac10f380 2023-10-26T06:49:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db33ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1a9e60 con 0x7f8dac115c00 2023-10-26T06:49:21.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db119b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac119600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db199c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac115c00 0x7f8dac1160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db119b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac119600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47762/0 (socket says 172.21.15.50:47762) 2023-10-26T06:49:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db119b700 1 -- 172.21.15.50:0/3762648463 learned_addr learned my addr 172.21.15.50:0/3762648463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db099a700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac119fd0 0x7f8dac1156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db199c700 1 -- 172.21.15.50:0/3762648463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 msgr2=0x7f8dac119600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db199c700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac119600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.185+0000 7f8db199c700 1 -- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac119fd0 msgr2=0x7f8dac1156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.186+0000 7f8db199c700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac119fd0 0x7f8dac1156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.186+0000 7f8db199c700 1 -- 172.21.15.50:0/3762648463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98009520 con 0x7f8dac115c00 2023-10-26T06:49:21.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.186+0000 7f8db119b700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac119600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:49:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.186+0000 7f8db099a700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac119fd0 0x7f8dac1156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:49:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.186+0000 7f8db199c700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac115c00 0x7f8dac1160b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8dac069b80 tx=0x7f8da401ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.189+0000 7f8daa7fc700 1 -- 172.21.15.50:0/3762648463 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4004830 con 0x7f8dac115c00 2023-10-26T06:49:21.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.189+0000 7f8daa7fc700 1 -- 172.21.15.50:0/3762648463 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8da4004e50 con 0x7f8dac115c00 2023-10-26T06:49:21.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.189+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac1aa140 con 0x7f8dac115c00 2023-10-26T06:49:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.189+0000 7f8daa7fc700 1 -- 172.21.15.50:0/3762648463 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da401aa50 con 0x7f8dac115c00 2023-10-26T06:49:21.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.189+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac1aa650 con 0x7f8dac115c00 2023-10-26T06:49:21.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.196+0000 7f8dc6c30b80 1 Processor -- start 2023-10-26T06:49:21.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.199+0000 7f8daa7fc700 1 -- 172.21.15.50:0/3762648463 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8da4005220 con 0x7f8dac115c00 2023-10-26T06:49:21.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.200+0000 7f8dc6c30b80 1 -- start start 2023-10-26T06:49:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.204+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed74fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.204+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.204+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed6fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.204+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ece26e0 con 0x55693ed74be0 2023-10-26T06:49:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.204+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ecc8c60 con 0x55693ed75500 2023-10-26T06:49:21.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.204+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ecc6580 con 0x55693ed6f5d0 2023-10-26T06:49:21.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed6f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47764/0 (socket says 172.21.15.50:47764) 2023-10-26T06:49:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 -- 172.21.15.50:0/845829021 learned_addr learned my addr 172.21.15.50:0/845829021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db099a700 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed74fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db099a700 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed6fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 -- 172.21.15.50:0/845829021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 msgr2=0x55693ed6fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed6fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 -- 172.21.15.50:0/845829021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 msgr2=0x55693ed74fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed74fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.205+0000 7f8db119b700 1 -- 172.21.15.50:0/845829021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55693ec7f3f0 con 0x55693ed75500 2023-10-26T06:49:21.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.206+0000 7f8db119b700 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed6f090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009860 tx=0x7f8d98005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d18f5357eb1786e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.207+0000 7f8daa7fc700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8d9c0a1740 0x7f8d9c0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.207+0000 7f8daa7fc700 1 -- 172.21.15.50:0/3762648463 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8da40dd760 con 0x7f8dac115c00 2023-10-26T06:49:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.208+0000 7f8d977fe700 1 -- 172.21.15.50:0/845829021 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800fa90 con 0x55693ed75500 2023-10-26T06:49:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.208+0000 7f8d977fe700 1 -- 172.21.15.50:0/845829021 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d9801d040 con 0x55693ed75500 2023-10-26T06:49:21.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.208+0000 7f8db099a700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8d9c0a1740 0x7f8d9c0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/845829021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 msgr2=0x55693ed6f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed6f090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009860 tx=0x7f8d98005d40 comp rx=0 tx=0).stop 2023-10-26T06:49:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/845829021 shutdown_connections 2023-10-26T06:49:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed6fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed74fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/845829021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed6f090 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/845829021 >> 172.21.15.50:0/845829021 conn(0x55693ece3720 msgr2=0x55693ed69b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.209+0000 7f8db099a700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8d9c0a1740 0x7f8d9c0a3c00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8dac116df0 tx=0x7f8da000f040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.210+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/845829021 shutdown_connections 2023-10-26T06:49:21.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.210+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/845829021 wait complete. 2023-10-26T06:49:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.211+0000 7f8dc6c30b80 1 -- start start 2023-10-26T06:49:21.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.212+0000 7f8dc6c30b80 1 Processor -- start 2023-10-26T06:49:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.215+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed7b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.215+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed74be0 0x55693ed786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.215+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed75500 0x55693ed78c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.215+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ecc1e70 con 0x55693ed75500 2023-10-26T06:49:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.215+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ec5e710 con 0x55693ed74be0 2023-10-26T06:49:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.215+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ec5e3b0 con 0x55693ed6f5d0 2023-10-26T06:49:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.216+0000 7f8dc6c30b80 10 client.0 _ll_register_callbacks cb 0x55693eba8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:21.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.216+0000 7f8db099a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed74be0 0x55693ed786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.216+0000 7f8db119b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed7b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.216+0000 7f8db099a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed74be0 0x55693ed786f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47766/0 (socket says 172.21.15.50:47766) 2023-10-26T06:49:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.216+0000 7f8db099a700 1 -- 172.21.15.50:0/1384281368 learned_addr learned my addr 172.21.15.50:0/1384281368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.217+0000 7f8db119b700 1 -- 172.21.15.50:0/1384281368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed74be0 msgr2=0x55693ed786f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.217+0000 7f8db119b700 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed74be0 0x55693ed786f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.217+0000 7f8db119b700 1 -- 172.21.15.50:0/1384281368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed75500 msgr2=0x55693ed78c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.217+0000 7f8db119b700 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed75500 0x55693ed78c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.217+0000 7f8db119b700 1 -- 172.21.15.50:0/1384281368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac11cd40 con 0x55693ed6f5d0 2023-10-26T06:49:21.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.218+0000 7f8db119b700 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed7b400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800b5c0 tx=0x7f8d9800b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4974209da879f72 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.222+0000 7f8d94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:49:21.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.222+0000 7f8d94ff9700 1 -- 172.21.15.50:0/1384281368 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98003880 con 0x55693ed6f5d0 2023-10-26T06:49:21.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.222+0000 7f8d94ff9700 1 -- 172.21.15.50:0/1384281368 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8d980056b0 con 0x55693ed6f5d0 2023-10-26T06:49:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.226+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55693ecc6ef0 con 0x55693ed6f5d0 2023-10-26T06:49:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.226+0000 7f8d94ff9700 1 -- 172.21.15.50:0/1384281368 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d9800b870 con 0x55693ed6f5d0 2023-10-26T06:49:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.226+0000 7f8dc6c30b80 10 client.26527 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.226+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55693eaecde0 con 0x55693ed6f5d0 2023-10-26T06:49:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8d94ff9700 1 -- 172.21.15.50:0/1384281368 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55693ecc6ef0 con 0x55693ed6f5d0 2023-10-26T06:49:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8d94ff9700 1 -- 172.21.15.50:0/1384281368 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8d98020070 con 0x55693ed6f5d0 2023-10-26T06:49:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8dc6c30b80 10 client.26527 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8dc6c30b80 10 client.26527 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:49:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8dc6c30b80 20 client.26527 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693ed888d0 0x55693ed8acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8dc6c30b80 4 client.26527 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:49:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.227+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55693ed3e8b0 con 0x55693ed888d0 2023-10-26T06:49:21.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.228+0000 7f8db099a700 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693ed888d0 0x55693ed8acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.229+0000 7f8db099a700 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693ed888d0 0x55693ed8acf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f60d2319d8ec77b server_cookie=bda0603461997c60 in_seq=0 out_seq=0 2023-10-26T06:49:21.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.229+0000 7f8d94ff9700 10 client.26527 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:49:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8d94ff9700 1 -- 172.21.15.50:0/1384281368 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55693ed3e8b0 con 0x55693ed888d0 2023-10-26T06:49:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8d94ff9700 10 client.26527 handle_command_reply: tid=0 2023-10-26T06:49:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 client.26527 shutdown 2023-10-26T06:49:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 msgr2=0x55693ed7b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed7b400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800b5c0 tx=0x7f8d9800b7d0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 shutdown_connections 2023-10-26T06:49:21.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:20 smithi153 ceph-mon[131657]: pgmap v489: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.2 MiB/s wr, 93 op/s 2023-10-26T06:49:21.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:20 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1509856447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:49:21.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693ed888d0 0x55693ed8acf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed75500 0x55693ed78c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed6f5d0 0x55693ed7b400 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8d94ff9700 0 client.26527 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:49:21.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1384281368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed74be0 0x55693ed786f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.233+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 >> 172.21.15.50:0/1384281368 conn(0x55693ece3720 msgr2=0x55693ed6e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.235+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 shutdown_connections 2023-10-26T06:49:21.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.235+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1384281368 wait complete. 2023-10-26T06:49:21.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.236+0000 7f8dc6c30b80 20 client.26527 trim_cache size 0 max 16384 2023-10-26T06:49:21.253 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/wakeup_stats.o 2023-10-26T06:49:21.269 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/pci/built-in.a 2023-10-26T06:49:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.284+0000 7f8dc6c30b80 1 Processor -- start 2023-10-26T06:49:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.287+0000 7f8dc6c30b80 1 -- start start 2023-10-26T06:49:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.290+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 0x55693ed7ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.291+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed74be0 0x55693ed6e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.291+0000 7f8db119b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 0x55693ed7ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.292+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed7af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.292+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693eb42920 con 0x55693ed6f5d0 2023-10-26T06:49:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.292+0000 7f8db119b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 0x55693ed7ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34916/0 (socket says 172.21.15.50:34916) 2023-10-26T06:49:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.292+0000 7f8db119b700 1 -- 172.21.15.50:0/1690035495 learned_addr learned my addr 172.21.15.50:0/1690035495 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.292+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ed62000 con 0x55693ed75500 2023-10-26T06:49:21.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.292+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ed70030 con 0x55693ed74be0 2023-10-26T06:49:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.295+0000 7f8db099a700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed74be0 0x55693ed6e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.296+0000 7f8db199c700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed7af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.309+0000 7f8db199c700 1 -- 172.21.15.50:0/1690035495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed74be0 msgr2=0x55693ed6e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.309+0000 7f8db199c700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed74be0 0x55693ed6e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.309+0000 7f8db199c700 1 -- 172.21.15.50:0/1690035495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 msgr2=0x55693ed7ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.309+0000 7f8db199c700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 0x55693ed7ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.309+0000 7f8db199c700 1 -- 172.21.15.50:0/1690035495 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55693ead5c60 con 0x55693ed75500 2023-10-26T06:49:21.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.309+0000 7f8db119b700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 0x55693ed7ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:49:21.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.311+0000 7f8db099a700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed74be0 0x55693ed6e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:49:21.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.311+0000 7f8db199c700 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed7af30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8da40daf60 tx=0x7f8da40a6b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb4fc3073618de5 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.312+0000 7f8d97fff700 1 -- 172.21.15.50:0/1690035495 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40aaef0 con 0x55693ed75500 2023-10-26T06:49:21.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.313+0000 7f8d97fff700 1 -- 172.21.15.50:0/1690035495 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8da40aa7f0 con 0x55693ed75500 2023-10-26T06:49:21.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.313+0000 7f8d97fff700 1 -- 172.21.15.50:0/1690035495 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40a9ce0 con 0x55693ed75500 2023-10-26T06:49:21.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.314+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 msgr2=0x55693ed7af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.314+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed7af30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8da40daf60 tx=0x7f8da40a6b30 comp rx=0 tx=0).stop 2023-10-26T06:49:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.317+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 shutdown_connections 2023-10-26T06:49:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.317+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed75500 0x55693ed7af30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.317+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed6f5d0 0x55693ed7ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.317+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/1690035495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed74be0 0x55693ed6e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.317+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 >> 172.21.15.50:0/1690035495 conn(0x55693ece3720 msgr2=0x55693ed69a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.318+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 shutdown_connections 2023-10-26T06:49:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.318+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/1690035495 wait complete. 2023-10-26T06:49:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.318+0000 7f8dc6c30b80 1 -- start start 2023-10-26T06:49:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.321+0000 7f8dc6c30b80 1 Processor -- start 2023-10-26T06:49:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.324+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed6f5d0 0x55693ed7e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.324+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed7eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.324+0000 7f8dc6c30b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 0x55693ed7f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.324+0000 7f8db119b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed6f5d0 0x55693ed7e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.325+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693ed804b0 con 0x55693ed74be0 2023-10-26T06:49:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.325+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693eddc750 con 0x55693ed6f5d0 2023-10-26T06:49:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.325+0000 7f8dc6c30b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55693eddc910 con 0x55693ed75500 2023-10-26T06:49:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.325+0000 7f8dc6c30b80 10 client.0 _ll_register_callbacks cb 0x55693eba8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.327+0000 7f8db199c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 0x55693ed7f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.327+0000 7f8db199c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 0x55693ed7f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53488/0 (socket says 172.21.15.50:53488) 2023-10-26T06:49:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.327+0000 7f8db199c700 1 -- 172.21.15.50:0/974316557 learned_addr learned my addr 172.21.15.50:0/974316557 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.329+0000 7f8db199c700 1 -- 172.21.15.50:0/974316557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed6f5d0 msgr2=0x55693ed7e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.329+0000 7f8db199c700 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed6f5d0 0x55693ed7e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.329+0000 7f8db199c700 1 -- 172.21.15.50:0/974316557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 msgr2=0x55693ed7eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.329+0000 7f8db199c700 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed7eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.329+0000 7f8db199c700 1 -- 172.21.15.50:0/974316557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0029ae0 con 0x55693ed75500 2023-10-26T06:49:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.330+0000 7f8db199c700 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 0x55693ed7f020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8da40db560 tx=0x7f8da401a350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cfc3377ef3fb542 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.332+0000 7f8d94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-10-26T06:49:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.332+0000 7f8d94ff9700 1 -- 172.21.15.50:0/974316557 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40a9ee0 con 0x55693ed75500 2023-10-26T06:49:21.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.332+0000 7f8d94ff9700 1 -- 172.21.15.50:0/974316557 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8da40aaef0 con 0x55693ed75500 2023-10-26T06:49:21.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.336+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d9800bed0 con 0x55693ed75500 2023-10-26T06:49:21.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.343+0000 7f8d94ff9700 1 -- 172.21.15.50:0/974316557 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8da40c30d0 con 0x55693ed75500 2023-10-26T06:49:21.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.343+0000 7f8dc6c30b80 10 client.26533 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:21.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.343+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f8dac1aa650 con 0x55693ed75500 2023-10-26T06:49:21.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8d94ff9700 1 -- 172.21.15.50:0/974316557 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d9800bed0 con 0x55693ed75500 2023-10-26T06:49:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8d94ff9700 1 -- 172.21.15.50:0/974316557 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8da40c4020 con 0x55693ed75500 2023-10-26T06:49:21.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8dc6c30b80 10 client.26533 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:21.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8dc6c30b80 10 client.26533 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-26T06:49:21.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8dc6c30b80 20 client.26533 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:21.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693edddc50 0x55693ede0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8dc6c30b80 4 client.26533 mds_command: new command op to 24694 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:49:21.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.344+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 --> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55693ecbae50 con 0x55693edddc50 2023-10-26T06:49:21.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.345+0000 7f8db119b700 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693edddc50 0x55693ede0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.345+0000 7f8d94ff9700 10 client.26533 ms_handle_connect on v2:172.21.15.153:6836/3558298736 2023-10-26T06:49:21.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.345+0000 7f8db119b700 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693edddc50 0x55693ede0070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdf4939130393ea9 server_cookie=c5436964046dfdbd in_seq=0 out_seq=0 2023-10-26T06:49:21.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.346+0000 7f8d94ff9700 1 -- 172.21.15.50:0/974316557 <== mds.2 v2:172.21.15.153:6836/3558298736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55693ecbae50 con 0x55693edddc50 2023-10-26T06:49:21.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.346+0000 7f8d94ff9700 10 client.26533 handle_command_reply: tid=0 2023-10-26T06:49:21.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.346+0000 7f8dc6c30b80 1 client.26533 shutdown 2023-10-26T06:49:21.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 msgr2=0x55693ed7f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 0x55693ed7f020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8da40db560 tx=0x7f8da401a350 comp rx=0 tx=0).stop 2023-10-26T06:49:21.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 shutdown_connections 2023-10-26T06:49:21.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:6836/3558298736,v1:172.21.15.153:6837/3558298736] conn(0x55693edddc50 0x55693ede0070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55693ed75500 0x55693ed7f020 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55693ed6f5d0 0x55693ed7e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 --2- 172.21.15.50:0/974316557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55693ed74be0 0x55693ed7eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 >> 172.21.15.50:0/974316557 conn(0x55693ece3720 msgr2=0x55693ed84650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8d94ff9700 0 client.26533 ms_handle_reset on v2:172.21.15.153:6836/3558298736 2023-10-26T06:49:21.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 shutdown_connections 2023-10-26T06:49:21.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.349+0000 7f8dc6c30b80 1 -- 172.21.15.50:0/974316557 wait complete. 2023-10-26T06:49:21.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.350+0000 7f8dc6c30b80 20 client.26533 trim_cache size 0 max 16384 2023-10-26T06:49:21.353 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:49:21.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.350+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8d9c0a1740 msgr2=0x7f8d9c0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.351+0000 7f8db33ff700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8d9c0a1740 0x7f8d9c0a3c00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8dac116df0 tx=0x7f8da000f040 comp rx=0 tx=0).stop 2023-10-26T06:49:21.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.351+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac115c00 msgr2=0x7f8dac1160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.351+0000 7f8db33ff700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac115c00 0x7f8dac1160b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8dac069b80 tx=0x7f8da401ebd0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.352+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 shutdown_connections 2023-10-26T06:49:21.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.352+0000 7f8db33ff700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8d9c0a1740 0x7f8d9c0a3c00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.352+0000 7f8db33ff700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac115c00 0x7f8dac1160b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.352+0000 7f8db33ff700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8dac10f380 0x7f8dac119600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.352+0000 7f8db33ff700 1 --2- 172.21.15.50:0/3762648463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8dac119fd0 0x7f8dac1156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.352+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 >> 172.21.15.50:0/3762648463 conn(0x7f8dac06b840 msgr2=0x7f8dac10ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.353+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 shutdown_connections 2023-10-26T06:49:21.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.353+0000 7f8db33ff700 1 -- 172.21.15.50:0/3762648463 wait complete. 2023-10-26T06:49:21.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-26T06:49:21.402 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/utils.o 2023-10-26T06:49:21.431 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/pata_oldpiix.o 2023-10-26T06:49:21.545 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/svc4proc.o 2023-10-26T06:49:21.678 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psopcode.o 2023-10-26T06:49:21.861 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/resource.o 2023-10-26T06:49:21.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 -- 172.21.15.50:0/3772792607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac10f2f0 msgr2=0x7fe6ac115cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 --2- 172.21.15.50:0/3772792607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac115cb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009990 tx=0x7fe69c009ca0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 -- 172.21.15.50:0/3772792607 shutdown_connections 2023-10-26T06:49:21.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 --2- 172.21.15.50:0/3772792607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac115cb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 --2- 172.21.15.50:0/3772792607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac107a60 0x7fe6ac107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 --2- 172.21.15.50:0/3772792607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac108410 0x7fe6ac10ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.898+0000 7fe6b239d700 1 -- 172.21.15.50:0/3772792607 >> 172.21.15.50:0/3772792607 conn(0x7fe6ac06b650 msgr2=0x7fe6ac06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.901+0000 7fe6b239d700 1 -- 172.21.15.50:0/3772792607 shutdown_connections 2023-10-26T06:49:21.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.901+0000 7fe6b239d700 1 -- 172.21.15.50:0/3772792607 wait complete. 2023-10-26T06:49:21.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.903+0000 7fe6b239d700 1 Processor -- start 2023-10-26T06:49:21.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.904+0000 7fe6b239d700 1 -- start start 2023-10-26T06:49:21.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.904+0000 7fe6b239d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 0x7fe6ac114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.905+0000 7fe6b139b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 0x7fe6ac114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.905+0000 7fe6b139b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 0x7fe6ac114d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47782/0 (socket says 172.21.15.50:47782) 2023-10-26T06:49:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.905+0000 7fe6b139b700 1 -- 172.21.15.50:0/2358016754 learned_addr learned my addr 172.21.15.50:0/2358016754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.905+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac1152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.905+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac1a29e0 0x7fe6ac1a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.908 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/trace.o 2023-10-26T06:49:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.906+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac1a33a0 con 0x7fe6ac1a29e0 2023-10-26T06:49:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.906+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac1a3510 con 0x7fe6ac107a60 2023-10-26T06:49:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.906+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac1a36d0 con 0x7fe6ac10f2f0 2023-10-26T06:49:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.906+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac1152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.907+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac1a29e0 0x7fe6ac1a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b139b700 1 -- 172.21.15.50:0/2358016754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac10f2f0 msgr2=0x7fe6ac1152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b139b700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac1152d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b139b700 1 -- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac1a29e0 msgr2=0x7fe6ac1a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b139b700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac1a29e0 0x7fe6ac1a2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b139b700 1 -- 172.21.15.50:0/2358016754 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0095f0 con 0x7fe6ac107a60 2023-10-26T06:49:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac1a29e0 0x7fe6ac1a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:49:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.908+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac1152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:49:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.909+0000 7fe6b139b700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 0x7fe6ac114d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800c920 tx=0x7fe6a800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.909+0000 7fe6a27fc700 1 -- 172.21.15.50:0/2358016754 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8007b00 con 0x7fe6ac107a60 2023-10-26T06:49:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.909+0000 7fe6a27fc700 1 -- 172.21.15.50:0/2358016754 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6a800ce70 con 0x7fe6ac107a60 2023-10-26T06:49:21.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.909+0000 7fe6a27fc700 1 -- 172.21.15.50:0/2358016754 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80054e0 con 0x7fe6ac107a60 2023-10-26T06:49:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.911+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac1a5ad0 con 0x7fe6ac107a60 2023-10-26T06:49:21.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.911+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac1a5f60 con 0x7fe6ac107a60 2023-10-26T06:49:21.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.917+0000 7fe6a27fc700 1 -- 172.21.15.50:0/2358016754 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe6a8004750 con 0x7fe6ac107a60 2023-10-26T06:49:21.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.918+0000 7fe6c6f0bb80 1 Processor -- start 2023-10-26T06:49:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.918+0000 7fe6c6f0bb80 1 -- start start 2023-10-26T06:49:21.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.919+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.920+0000 7fe6b1b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.920+0000 7fe6b1b9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34942/0 (socket says 172.21.15.50:34942) 2023-10-26T06:49:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.920+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/549868824 learned_addr learned my addr 172.21.15.50:0/549868824 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.920+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.920+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.921+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa5213b6e0 con 0x55aa521cdd60 2023-10-26T06:49:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.921+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa52121c60 con 0x55aa521ce680 2023-10-26T06:49:21.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.921+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa5211f580 con 0x55aa521c8820 2023-10-26T06:49:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.921+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.922+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/549868824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 msgr2=0x55aa521c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.922+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.922+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/549868824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 msgr2=0x55aa521c82e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:49:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.922+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521c82e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.922+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/549868824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa520d83f0 con 0x55aa521cdd60 2023-10-26T06:49:21.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.923+0000 7fe6a27fc700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6980a16f0 0x7fe6980a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.923+0000 7fe6a27fc700 1 -- 172.21.15.50:0/2358016754 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe6a80cce80 con 0x7fe6ac107a60 2023-10-26T06:49:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.923+0000 7fe6b139b700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6980a16f0 0x7fe6980a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.923+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521ce140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe69c003760 tx=0x7fe69c003790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7edc2237515a654 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.924+0000 7fe6b139b700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6980a16f0 0x7fe6980a3bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55aa521ceae0 tx=0x7fe6a80962c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.924+0000 7fe6977fe700 1 -- 172.21.15.50:0/549868824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00b9d0 con 0x55aa521cdd60 2023-10-26T06:49:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.924+0000 7fe6977fe700 1 -- 172.21.15.50:0/549868824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe69c01e040 con 0x55aa521cdd60 2023-10-26T06:49:21.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.924+0000 7fe6977fe700 1 -- 172.21.15.50:0/549868824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0056a0 con 0x55aa521cdd60 2023-10-26T06:49:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.925+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 msgr2=0x55aa521ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.925+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521ce140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe69c003760 tx=0x7fe69c003790 comp rx=0 tx=0).stop 2023-10-26T06:49:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.926+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 shutdown_connections 2023-10-26T06:49:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.926+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.926+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521ce140 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.926+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/549868824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.926+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 >> 172.21.15.50:0/549868824 conn(0x55aa5213c720 msgr2=0x55aa521c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.927+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 shutdown_connections 2023-10-26T06:49:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.927+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/549868824 wait complete. 2023-10-26T06:49:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.928+0000 7fe6c6f0bb80 1 -- start start 2023-10-26T06:49:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.928+0000 7fe6c6f0bb80 1 Processor -- start 2023-10-26T06:49:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.929+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 0x55aa521d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.930+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.930+0000 7fe6b1b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 0x55aa521d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.930+0000 7fe6b1b9c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 0x55aa521d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47784/0 (socket says 172.21.15.50:47784) 2023-10-26T06:49:21.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.930+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/2091404086 learned_addr learned my addr 172.21.15.50:0/2091404086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.931+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521ce680 0x55aa521d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.931+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa5211ae70 con 0x55aa521cdd60 2023-10-26T06:49:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.931+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa520b7710 con 0x55aa521c8820 2023-10-26T06:49:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.931+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa520b73b0 con 0x55aa521ce680 2023-10-26T06:49:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.932+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521ce680 0x55aa521d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.932+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521ce680 msgr2=0x55aa521d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.932+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521ce680 0x55aa521d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.932+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/2091404086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 msgr2=0x55aa521d1f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:49:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.933+0000 7fe6c6f0bb80 10 client.0 _ll_register_callbacks cb 0x55aa52001a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.933+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.933+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.933+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac1164f0 con 0x55aa521c8820 2023-10-26T06:49:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.934+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:49:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.934+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa5211fef0 con 0x55aa521c8820 2023-10-26T06:49:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.934+0000 7fe694ff9700 10 client.26537 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:49:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.934+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 0x55aa521d19f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe69c006010 tx=0x7fe69c00be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fcfe3f8f3c1a971 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.935+0000 7fe694ff9700 1 -- 172.21.15.50:0/2091404086 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c004d00 con 0x55aa521c8820 2023-10-26T06:49:21.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.936+0000 7fe694ff9700 1 -- 172.21.15.50:0/2091404086 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe69c004e60 con 0x55aa521c8820 2023-10-26T06:49:21.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.936+0000 7fe694ff9700 1 -- 172.21.15.50:0/2091404086 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe69c005020 con 0x55aa521c8820 2023-10-26T06:49:21.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.936+0000 7fe6c6f0bb80 10 client.26537 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:21.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.936+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({fsmap=28}) v3 -- 0x55aa51f45de0 con 0x55aa521c8820 2023-10-26T06:49:21.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe694ff9700 1 -- 172.21.15.50:0/2091404086 <== mon.2 v2:172.21.15.125:3300/0 4 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe69c031460 con 0x55aa521c8820 2023-10-26T06:49:21.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe6c6f0bb80 10 client.26537 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:21.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe6c6f0bb80 10 client.26537 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:49:21.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe6c6f0bb80 20 client.26537 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa521e18f0 0x55aa521e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe6c6f0bb80 4 client.26537 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:49:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.937+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa521978b0 con 0x55aa521e18f0 2023-10-26T06:49:21.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.939+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa521e18f0 0x55aa521e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.939+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa521e18f0 0x55aa521e3ce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4314841ce3c75b2 server_cookie=9214da76e5d46cc9 in_seq=0 out_seq=0 2023-10-26T06:49:21.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.939+0000 7fe694ff9700 10 client.26537 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:49:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.940+0000 7fe694ff9700 1 -- 172.21.15.50:0/2091404086 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aa521978b0 con 0x55aa521e18f0 2023-10-26T06:49:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.940+0000 7fe694ff9700 10 client.26537 handle_command_reply: tid=0 2023-10-26T06:49:21.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.940+0000 7fe6c6f0bb80 1 client.26537 shutdown 2023-10-26T06:49:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 msgr2=0x55aa521d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 0x55aa521d19f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe69c006010 tx=0x7fe69c00be80 comp rx=0 tx=0).stop 2023-10-26T06:49:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 shutdown_connections 2023-10-26T06:49:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521ce680 0x55aa521d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa521e18f0 0x55aa521e3ce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521c8820 0x55aa521d19f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2091404086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 >> 172.21.15.50:0/2091404086 conn(0x55aa5213c720 msgr2=0x55aa521c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.941+0000 7fe694ff9700 0 client.26537 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:49:21.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.942+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 shutdown_connections 2023-10-26T06:49:21.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.942+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2091404086 wait complete. 2023-10-26T06:49:21.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.942+0000 7fe6c6f0bb80 20 client.26537 trim_cache size 0 max 16384 2023-10-26T06:49:21.971 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/hrtimer.o 2023-10-26T06:49:21.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.971+0000 7fe6c6f0bb80 1 Processor -- start 2023-10-26T06:49:21.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.971+0000 7fe6c6f0bb80 1 -- start start 2023-10-26T06:49:21.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.972+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.972+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521cdd60 0x55aa521d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.972+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521ce680 0x55aa521d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6c6f0bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa51f9b920 con 0x55aa521ce680 2023-10-26T06:49:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6b1b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6b1b9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53528/0 (socket says 172.21.15.50:53528) 2023-10-26T06:49:21.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6b1b9c700 1 -- 172.21.15.50:0/3716925557 learned_addr learned my addr 172.21.15.50:0/3716925557 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa521978b0 con 0x55aa521cdd60 2023-10-26T06:49:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa521d2e80 con 0x55aa521c8820 2023-10-26T06:49:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.973+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521cdd60 0x55aa521d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.974+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/3716925557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 msgr2=0x55aa521d8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.974+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.974+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/3716925557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521ce680 msgr2=0x55aa521d02c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:49:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.975+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521ce680 0x55aa521d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.975+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521ce680 0x55aa521d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.975+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/3716925557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa51f2ec60 con 0x55aa521cdd60 2023-10-26T06:49:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.975+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521ce680 0x55aa521d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:49:21.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.976+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521cdd60 0x55aa521d2260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55aa521e44c0 tx=0x7fe6a4009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77323659265544e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.977+0000 7fe697fff700 1 -- 172.21.15.50:0/3716925557 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a401a070 con 0x55aa521cdd60 2023-10-26T06:49:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.977+0000 7fe697fff700 1 -- 172.21.15.50:0/3716925557 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6a401f070 con 0x55aa521cdd60 2023-10-26T06:49:21.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.977+0000 7fe697fff700 1 -- 172.21.15.50:0/3716925557 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4005020 con 0x55aa521cdd60 2023-10-26T06:49:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.979+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521cdd60 msgr2=0x55aa521d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:21.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.979+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521cdd60 0x55aa521d2260 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55aa521e44c0 tx=0x7fe6a4009040 comp rx=0 tx=0).stop 2023-10-26T06:49:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.982+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 shutdown_connections 2023-10-26T06:49:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.982+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521ce680 0x55aa521d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.982+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.982+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/3716925557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521cdd60 0x55aa521d2260 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.982+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 >> 172.21.15.50:0/3716925557 conn(0x55aa5213c720 msgr2=0x55aa521c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:21.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.985+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 shutdown_connections 2023-10-26T06:49:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.985+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/3716925557 wait complete. 2023-10-26T06:49:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.986+0000 7fe6c6f0bb80 1 -- start start 2023-10-26T06:49:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.986+0000 7fe6c6f0bb80 1 Processor -- start 2023-10-26T06:49:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521d7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa521d7e60 con 0x55aa521cdd60 2023-10-26T06:49:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa521d7fd0 con 0x55aa521ce680 2023-10-26T06:49:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa521d8140 con 0x55aa521c8820 2023-10-26T06:49:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.987+0000 7fe6c6f0bb80 10 client.0 _ll_register_callbacks cb 0x55aa52001a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:21.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.988+0000 7fe6b0b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.988+0000 7fe6b0b9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34982/0 (socket says 172.21.15.50:34982) 2023-10-26T06:49:21.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.988+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/2881721086 learned_addr learned my addr 172.21.15.50:0/2881721086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:21.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.988+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.988+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521d7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:21.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.990+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 msgr2=0x55aa521d8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.990+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.990+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/2881721086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 msgr2=0x55aa521d7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.990+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521d7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:21.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.990+0000 7fe6b0b9a700 1 -- 172.21.15.50:0/2881721086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a400c810 con 0x55aa521cdd60 2023-10-26T06:49:21.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.993+0000 7fe6b0b9a700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d73e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4007a20 tx=0x7fe6a4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c62dda0cc022e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.993+0000 7fe694ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-10-26T06:49:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.993+0000 7fe694ff9700 1 -- 172.21.15.50:0/2881721086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a401a070 con 0x55aa521cdd60 2023-10-26T06:49:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.993+0000 7fe694ff9700 1 -- 172.21.15.50:0/2881721086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe6a401bda0 con 0x55aa521cdd60 2023-10-26T06:49:21.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.994+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe69c01e040 con 0x55aa521cdd60 2023-10-26T06:49:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.998+0000 7fe694ff9700 1 -- 172.21.15.50:0/2881721086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6a401b050 con 0x55aa521cdd60 2023-10-26T06:49:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.998+0000 7fe6c6f0bb80 10 client.16488 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:21.998+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55aa51f6c250 con 0x55aa521cdd60 2023-10-26T06:49:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe694ff9700 1 -- 172.21.15.50:0/2881721086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6a4024440 con 0x55aa521cdd60 2023-10-26T06:49:22.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe694ff9700 1 -- 172.21.15.50:0/2881721086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe6a402a020 con 0x55aa521cdd60 2023-10-26T06:49:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe6c6f0bb80 10 client.16488 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe6c6f0bb80 10 client.16488 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-26T06:49:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe6c6f0bb80 20 client.16488 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa52236990 0x55aa52238d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:22.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe6c6f0bb80 4 client.16488 mds_command: new command op to 24709 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:49:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.002+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 --> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fe69c01e040 con 0x55aa52236990 2023-10-26T06:49:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.004+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa52236990 0x55aa52238d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.004+0000 7fe694ff9700 10 client.16488 ms_handle_connect on v2:172.21.15.153:6838/1756575060 2023-10-26T06:49:22.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.005+0000 7fe6b1b9c700 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa52236990 0x55aa52238d80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13fa112e3d141916 server_cookie=a26a42c252e345dd in_seq=0 out_seq=0 2023-10-26T06:49:22.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.008+0000 7fe694ff9700 1 -- 172.21.15.50:0/2881721086 <== mds.1 v2:172.21.15.153:6838/1756575060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+100412 (crc 0 0 0) 0x7fe69c01e040 con 0x55aa52236990 2023-10-26T06:49:22.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.008+0000 7fe694ff9700 10 client.16488 handle_command_reply: tid=0 2023-10-26T06:49:22.014 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/smp.o 2023-10-26T06:49:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.009+0000 7fe6c6f0bb80 1 client.16488 shutdown 2023-10-26T06:49:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 msgr2=0x55aa521d73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d73e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4007a20 tx=0x7fe6a4004bb0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 shutdown_connections 2023-10-26T06:49:22.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:6838/1756575060,v1:172.21.15.153:6839/1756575060] conn(0x55aa52236990 0x55aa52238d80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55aa521ce680 0x55aa521d7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa521c8820 0x55aa521d8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 --2- 172.21.15.50:0/2881721086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa521cdd60 0x55aa521d73e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.013+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 >> 172.21.15.50:0/2881721086 conn(0x55aa5213c720 msgr2=0x55aa521d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.014+0000 7fe694ff9700 0 client.16488 ms_handle_reset on v2:172.21.15.153:6838/1756575060 2023-10-26T06:49:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.015+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 shutdown_connections 2023-10-26T06:49:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.015+0000 7fe6c6f0bb80 1 -- 172.21.15.50:0/2881721086 wait complete. 2023-10-26T06:49:22.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.015+0000 7fe6c6f0bb80 20 client.16488 trim_cache size 0 max 16384 2023-10-26T06:49:22.019 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-10-26T06:49:22.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.019 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.019 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6396365, 2023-10-26T06:49:22.020 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641155, 2023-10-26T06:49:22.020 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.c" 2023-10-26T06:49:22.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.020 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 8724614, 2023-10-26T06:49:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642131, 2023-10-26T06:49:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Kconfig" 2023-10-26T06:49:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.022 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.022 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 15235323, 2023-10-26T06:49:22.022 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641632, 2023-10-26T06:49:22.022 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nswalk.c" 2023-10-26T06:49:22.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.023 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.023 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 23742792, 2023-10-26T06:49:22.023 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641481, 2023-10-26T06:49:22.023 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acevents.h" 2023-10-26T06:49:22.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.024 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.024 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 36944612, 2023-10-26T06:49:22.024 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641171, 2023-10-26T06:49:22.024 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/cmdline-parser.c" 2023-10-26T06:49:22.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.025 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.025 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 45192167, 2023-10-26T06:49:22.025 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641709, 2023-10-26T06:49:22.025 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Makefile" 2023-10-26T06:49:22.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.026 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.026 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 48314283, 2023-10-26T06:49:22.026 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641733, 2023-10-26T06:49:22.027 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dock.c" 2023-10-26T06:49:22.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.027 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.027 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 58692571, 2023-10-26T06:49:22.027 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641671, 2023-10-26T06:49:22.028 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utalloc.c" 2023-10-26T06:49:22.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.028 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.028 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 68020737, 2023-10-26T06:49:22.028 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641471, 2023-10-26T06:49:22.029 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pnp.c" 2023-10-26T06:49:22.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.029 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.029 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 81746971, 2023-10-26T06:49:22.030 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641669, 2023-10-26T06:49:22.030 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfroot.c" 2023-10-26T06:49:22.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.030 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.031 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 100552245, 2023-10-26T06:49:22.031 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641661, 2023-10-26T06:49:22.031 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbdata.c" 2023-10-26T06:49:22.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.031 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.032 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 111184379, 2023-10-26T06:49:22.032 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641211, 2023-10-26T06:49:22.032 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.h" 2023-10-26T06:49:22.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.033 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.033 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 113990077, 2023-10-26T06:49:22.033 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641456, 2023-10-26T06:49:22.033 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ac.c" 2023-10-26T06:49:22.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.034 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.034 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 115701723, 2023-10-26T06:49:22.034 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641637, 2023-10-26T06:49:22.034 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psloop.c" 2023-10-26T06:49:22.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.035 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.035 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 123851159, 2023-10-26T06:49:22.035 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641485, 2023-10-26T06:49:22.035 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/aclocal.h" 2023-10-26T06:49:22.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.036 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.036 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 131020073, 2023-10-26T06:49:22.036 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641203, 2023-10-26T06:49:22.036 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.h" 2023-10-26T06:49:22.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.037 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.037 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 146724333, 2023-10-26T06:49:22.037 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641495, 2023-10-26T06:49:22.037 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acutils.h" 2023-10-26T06:49:22.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.038 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.038 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 165828755, 2023-10-26T06:49:22.038 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641778, 2023-10-26T06:49:22.038 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_perflib.c" 2023-10-26T06:49:22.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.039 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.039 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 176509780, 2023-10-26T06:49:22.039 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641538, 2023-10-26T06:49:22.039 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evsci.c" 2023-10-26T06:49:22.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.040 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.040 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 176723801, 2023-10-26T06:49:22.040 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641531, 2023-10-26T06:49:22.041 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeblk.c" 2023-10-26T06:49:22.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.041 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.041 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 187550821, 2023-10-26T06:49:22.041 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641126, 2023-10-26T06:49:22.042 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio-integrity.c" 2023-10-26T06:49:22.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.042 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.042 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 193622644, 2023-10-26T06:49:22.043 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641148, 2023-10-26T06:49:22.043 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.c" 2023-10-26T06:49:22.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.043 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.043 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 199491637, 2023-10-26T06:49:22.044 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641696, 2023-10-26T06:49:22.044 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utprint.c" 2023-10-26T06:49:22.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.044 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.045 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 203617230, 2023-10-26T06:49:22.045 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641179, 2023-10-26T06:49:22.045 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/opal_proto.h" 2023-10-26T06:49:22.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.045 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.046 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 224275425, 2023-10-26T06:49:22.046 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641561, 2023-10-26T06:49:22.046 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresolv.c" 2023-10-26T06:49:22.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.047 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.047 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 235644809, 2023-10-26T06:49:22.047 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641143, 2023-10-26T06:49:22.047 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-pci.c" 2023-10-26T06:49:22.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 245545049, 2023-10-26T06:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641756, 2023-10-26T06:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nvs.c" 2023-10-26T06:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.049 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.049 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 246301521, 2023-10-26T06:49:22.049 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641657, 2023-10-26T06:49:22.049 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmisc.c" 2023-10-26T06:49:22.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.050 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.050 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 265872550, 2023-10-26T06:49:22.050 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641665, 2023-10-26T06:49:22.050 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbprint.c" 2023-10-26T06:49:22.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.051 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.051 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 272376403, 2023-10-26T06:49:22.051 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641736, 2023-10-26T06:49:22.051 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/int340x_thermal.c" 2023-10-26T06:49:22.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.052 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.052 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 287942716, 2023-10-26T06:49:22.052 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641684, 2023-10-26T06:49:22.052 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utids.c" 2023-10-26T06:49:22.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.053 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.053 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 316796750, 2023-10-26T06:49:22.053 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641119, 2023-10-26T06:49:22.053 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig.iosched" 2023-10-26T06:49:22.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.054 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.054 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 321432901, 2023-10-26T06:49:22.054 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641714, 2023-10-26T06:49:22.054 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst-dbg.c" 2023-10-26T06:49:22.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.055 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.055 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 324261249, 2023-10-26T06:49:22.055 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641127, 2023-10-26T06:49:22.056 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio.c" 2023-10-26T06:49:22.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.056 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.056 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 328628672, 2023-10-26T06:49:22.056 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641639, 2023-10-26T06:49:22.057 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopcode.c" 2023-10-26T06:49:22.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.057 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.057 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 331437290, 2023-10-26T06:49:22.058 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641624, 2023-10-26T06:49:22.058 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsobject.c" 2023-10-26T06:49:22.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.058 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.058 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 339845913, 2023-10-26T06:49:22.059 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641785, 2023-10-26T06:49:22.059 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.c" 2023-10-26T06:49:22.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.059 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.059 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 351574134, 2023-10-26T06:49:22.060 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641747, 2023-10-26T06:49:22.060 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ioapic.c" 2023-10-26T06:49:22.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.060 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.060 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 362749787, 2023-10-26T06:49:22.061 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641741, 2023-10-26T06:49:22.061 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/fan.c" 2023-10-26T06:49:22.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.061 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.062 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 380868601, 2023-10-26T06:49:22.062 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641564, 2023-10-26T06:49:22.062 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstore.c" 2023-10-26T06:49:22.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.063 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.063 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 402131392, 2023-10-26T06:49:22.063 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641552, 2023-10-26T06:49:22.063 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmutex.c" 2023-10-26T06:49:22.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.064 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.064 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 437244359, 2023-10-26T06:49:22.064 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641479, 2023-10-26T06:49:22.064 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdebug.h" 2023-10-26T06:49:22.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 444959933, 2023-10-26T06:49:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641873, 2023-10-26T06:49:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi" 2023-10-26T06:49:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.066 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.066 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 447741010, 2023-10-26T06:49:22.066 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642139, 2023-10-26T06:49:22.066 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.c" 2023-10-26T06:49:22.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.067 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.067 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 450929988, 2023-10-26T06:49:22.067 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641184, 2023-10-26T06:49:22.067 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.c" 2023-10-26T06:49:22.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.068 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.068 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 466751840, 2023-10-26T06:49:22.068 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641567, 2023-10-26T06:49:22.069 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exsystem.c" 2023-10-26T06:49:22.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.069 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.069 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 469860688, 2023-10-26T06:49:22.069 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641151, 2023-10-26T06:49:22.070 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.c" 2023-10-26T06:49:22.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.070 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.070 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 475429065, 2023-10-26T06:49:22.071 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641653, 2023-10-26T06:49:22.071 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsio.c" 2023-10-26T06:49:22.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.071 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.071 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 482582713, 2023-10-26T06:49:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641744, 2023-10-26T06:49:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Makefile" 2023-10-26T06:49:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.072 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 483051065, 2023-10-26T06:49:22.073 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641484, 2023-10-26T06:49:22.073 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acinterp.h" 2023-10-26T06:49:22.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.073 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.073 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 506694709, 2023-10-26T06:49:22.074 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641545, 2023-10-26T06:49:22.074 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconvrt.c" 2023-10-26T06:49:22.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.074 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.075 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 515282732, 2023-10-26T06:49:22.075 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641670, 2023-10-26T06:49:22.075 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utaddress.c" 2023-10-26T06:49:22.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.075 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.076 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 518618698, 2023-10-26T06:49:22.076 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641707, 2023-10-26T06:49:22.076 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfinit.c" 2023-10-26T06:49:22.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.076 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.077 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 524051054, 2023-10-26T06:49:22.077 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641130, 2023-10-26T06:49:22.077 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-exec.c" 2023-10-26T06:49:22.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.077 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.078 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 524103295, 2023-10-26T06:49:22.078 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641152, 2023-10-26T06:49:22.078 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.h" 2023-10-26T06:49:22.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.079 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.079 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 532415024, 2023-10-26T06:49:22.079 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641720, 2023-10-26T06:49:22.079 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/iort.c" 2023-10-26T06:49:22.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.080 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.080 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 539460608, 2023-10-26T06:49:22.080 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641782, 2023-10-26T06:49:22.080 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/reboot.c" 2023-10-26T06:49:22.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.081 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.081 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 541756134, 2023-10-26T06:49:22.081 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641666, 2023-10-26T06:49:22.081 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbutils.c" 2023-10-26T06:49:22.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.082 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.082 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 542564652, 2023-10-26T06:49:22.082 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641166, 2023-10-26T06:49:22.082 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-zoned.c" 2023-10-26T06:49:22.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.083 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.083 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 542900395, 2023-10-26T06:49:22.083 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641700, 2023-10-26T06:49:22.083 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstring.c" 2023-10-26T06:49:22.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.084 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.084 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 550315803, 2023-10-26T06:49:22.084 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641472, 2023-10-26T06:49:22.084 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_processor.c" 2023-10-26T06:49:22.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.085 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.085 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 603749015, 2023-10-26T06:49:22.085 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641792, 2023-10-26T06:49:22.086 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/tables.c" 2023-10-26T06:49:22.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.086 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.086 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 603996647, 2023-10-26T06:49:22.086 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641635, 2023-10-26T06:49:22.087 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfobj.c" 2023-10-26T06:49:22.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.087 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.087 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 612640870, 2023-10-26T06:49:22.087 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641157, 2023-10-26T06:49:22.088 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-settings.c" 2023-10-26T06:49:22.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.088 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.088 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 618119290, 2023-10-26T06:49:22.088 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641542, 2023-10-26T06:49:22.089 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfregn.c" 2023-10-26T06:49:22.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.089 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.089 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 624100791, 2023-10-26T06:49:22.090 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641749, 2023-10-26T06:49:22.090 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Makefile" 2023-10-26T06:49:22.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.090 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.090 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 626550018, 2023-10-26T06:49:22.091 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641551, 2023-10-26T06:49:22.091 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmisc.c" 2023-10-26T06:49:22.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.091 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.091 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 640434255, 2023-10-26T06:49:22.092 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641474, 2023-10-26T06:49:22.092 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_video.c" 2023-10-26T06:49:22.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.092 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.093 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 651332900, 2023-10-26T06:49:22.093 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641460, 2023-10-26T06:49:22.093 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_cmos_rtc.c" 2023-10-26T06:49:22.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.093 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.094 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 655518708, 2023-10-26T06:49:22.094 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641569, 2023-10-26T06:49:22.094 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exutils.c" 2023-10-26T06:49:22.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.094 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.095 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 658939165, 2023-10-26T06:49:22.095 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641136, 2023-10-26T06:49:22.095 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-lib.c" 2023-10-26T06:49:22.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.095 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 665546368, 2023-10-26T06:49:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641208, 2023-10-26T06:49:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.c" 2023-10-26T06:49:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.097 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 681554914, 2023-10-26T06:49:22.097 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641169, 2023-10-26T06:49:22.097 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg-lib.c" 2023-10-26T06:49:22.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 714715726, 2023-10-26T06:49:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641181, 2023-10-26T06:49:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Makefile" 2023-10-26T06:49:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.099 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.099 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 717228407, 2023-10-26T06:49:22.099 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642133, 2023-10-26T06:49:22.099 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Kconfig" 2023-10-26T06:49:22.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.100 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.100 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 746516422, 2023-10-26T06:49:22.100 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641491, 2023-10-26T06:49:22.100 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acpredef.h" 2023-10-26T06:49:22.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.101 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.101 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 746749984, 2023-10-26T06:49:22.101 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641668, 2023-10-26T06:49:22.101 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfload.c" 2023-10-26T06:49:22.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.102 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.102 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 751019542, 2023-10-26T06:49:22.102 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641183, 2023-10-26T06:49:22.102 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.h" 2023-10-26T06:49:22.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 751544179, 2023-10-26T06:49:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641788, 2023-10-26T06:49:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.c" 2023-10-26T06:49:22.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.104 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.104 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 773171897, 2023-10-26T06:49:22.104 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641163, 2023-10-26T06:49:22.104 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-timeout.c" 2023-10-26T06:49:22.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.105 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.105 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 774129809, 2023-10-26T06:49:22.105 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641206, 2023-10-26T06:49:22.105 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.c" 2023-10-26T06:49:22.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.106 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.106 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 775540447, 2023-10-26T06:49:22.106 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641556, 2023-10-26T06:49:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg3.c" 2023-10-26T06:49:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 776484859, 2023-10-26T06:49:22.107 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641680, 2023-10-26T06:49:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uteval.c" 2023-10-26T06:49:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 787599185, 2023-10-26T06:49:22.108 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641218, 2023-10-26T06:49:22.109 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/t10-pi.c" 2023-10-26T06:49:22.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.109 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.109 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 796546875, 2023-10-26T06:49:22.109 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641544, 2023-10-26T06:49:22.110 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconfig.c" 2023-10-26T06:49:22.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.110 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.110 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 816654758, 2023-10-26T06:49:22.110 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641134, 2023-10-26T06:49:22.111 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iocost.c" 2023-10-26T06:49:22.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.111 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.111 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 818280352, 2023-10-26T06:49:22.112 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641763, 2023-10-26T06:49:22.112 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_slot.c" 2023-10-26T06:49:22.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.112 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.112 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 819832805, 2023-10-26T06:49:22.113 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641734, 2023-10-26T06:49:22.113 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Makefile" 2023-10-26T06:49:22.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.113 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.113 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 833721065, 2023-10-26T06:49:22.114 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641539, 2023-10-26T06:49:22.114 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxface.c" 2023-10-26T06:49:22.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.114 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.115 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 840825491, 2023-10-26T06:49:22.115 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641766, 2023-10-26T06:49:22.115 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtdc_ti.c" 2023-10-26T06:49:22.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.115 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 849910116, 2023-10-26T06:49:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641789, 2023-10-26T06:49:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.h" 2023-10-26T06:49:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.117 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.117 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 854405434, 2023-10-26T06:49:22.117 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641575, 2023-10-26T06:49:22.117 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwsleep.c" 2023-10-26T06:49:22.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.118 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.118 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 859743700, 2023-10-26T06:49:22.118 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641794, 2023-10-26T06:49:22.118 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/utils.c" 2023-10-26T06:49:22.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.119 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.119 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 870460073, 2023-10-26T06:49:22.119 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641469, 2023-10-26T06:49:22.119 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pad.c" 2023-10-26T06:49:22.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.120 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.120 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 894518533, 2023-10-26T06:49:22.120 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641168, 2023-10-26T06:49:22.120 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bounce.c" 2023-10-26T06:49:22.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.121 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.121 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 904668910, 2023-10-26T06:49:22.121 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641199, 2023-10-26T06:49:22.121 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.h" 2023-10-26T06:49:22.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.122 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.122 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 918113137, 2023-10-26T06:49:22.122 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641518, 2023-10-26T06:49:22.122 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmthdat.c" 2023-10-26T06:49:22.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.123 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.123 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 921227924, 2023-10-26T06:49:22.123 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641205, 2023-10-26T06:49:22.124 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.h" 2023-10-26T06:49:22.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.124 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.124 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 922879567, 2023-10-26T06:49:22.124 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641180, 2023-10-26T06:49:22.125 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partition-generic.c" 2023-10-26T06:49:22.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.125 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.125 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 942976263, 2023-10-26T06:49:22.125 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641621, 2023-10-26T06:49:22.126 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsinit.c" 2023-10-26T06:49:22.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.126 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.126 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 945056436, 2023-10-26T06:49:22.127 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642135, 2023-10-26T06:49:22.127 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Kconfig" 2023-10-26T06:49:22.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.127 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.127 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 952043643, 2023-10-26T06:49:22.128 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641170, 2023-10-26T06:49:22.128 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg.c" 2023-10-26T06:49:22.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.128 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.128 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 962252984, 2023-10-26T06:49:22.129 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641690, 2023-10-26T06:49:22.129 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmutex.c" 2023-10-26T06:49:22.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.129 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.129 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 966717306, 2023-10-26T06:49:22.130 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641703, 2023-10-26T06:49:22.130 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uttrack.c" 2023-10-26T06:49:22.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.130 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.131 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 996060119, 2023-10-26T06:49:22.131 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641616, 2023-10-26T06:49:22.131 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsarguments.c" 2023-10-26T06:49:22.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.132 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.132 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1002480666, 2023-10-26T06:49:22.132 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641467, 2023-10-26T06:49:22.132 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpss.c" 2023-10-26T06:49:22.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.133 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.133 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1011263702, 2023-10-26T06:49:22.133 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641535, 2023-10-26T06:49:22.133 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evmisc.c" 2023-10-26T06:49:22.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.134 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.134 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1014246855, 2023-10-26T06:49:22.134 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641465, 2023-10-26T06:49:22.134 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpat.c" 2023-10-26T06:49:22.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.135 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.135 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1022876451, 2023-10-26T06:49:22.135 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641207, 2023-10-26T06:49:22.135 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.h" 2023-10-26T06:49:22.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.136 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.136 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1030028027, 2023-10-26T06:49:22.136 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641767, 2023-10-26T06:49:22.136 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtwc.c" 2023-10-26T06:49:22.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.137 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.137 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1033914258, 2023-10-26T06:49:22.137 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641503, 2023-10-26T06:49:22.137 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbhistry.c" 2023-10-26T06:49:22.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.138 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.138 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1038435968, 2023-10-26T06:49:22.138 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641755, 2023-10-26T06:49:22.139 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/numa.c" 2023-10-26T06:49:22.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.139 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.139 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1042290408, 2023-10-26T06:49:22.139 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641475, 2023-10-26T06:49:22.140 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_watchdog.c" 2023-10-26T06:49:22.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.140 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.140 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1042460940, 2023-10-26T06:49:22.140 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641512, 2023-10-26T06:49:22.141 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsargs.c" 2023-10-26T06:49:22.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.141 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.141 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1050771726, 2023-10-26T06:49:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641204, 2023-10-26T06:49:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.c" 2023-10-26T06:49:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.142 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1053481490, 2023-10-26T06:49:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641732, 2023-10-26T06:49:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_sysfs.c" 2023-10-26T06:49:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.143 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.144 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1056868002, 2023-10-26T06:49:22.144 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641695, 2023-10-26T06:49:22.144 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utpredef.c" 2023-10-26T06:49:22.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.144 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.145 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1085590677, 2023-10-26T06:49:22.145 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641122, 2023-10-26T06:49:22.145 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-cgroup.c" 2023-10-26T06:49:22.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.146 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.146 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1096017194, 2023-10-26T06:49:22.146 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641172, 2023-10-26T06:49:22.146 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/compat_ioctl.c" 2023-10-26T06:49:22.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.147 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.147 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1111432432, 2023-10-26T06:49:22.147 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641144, 2023-10-26T06:49:22.147 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-rdma.c" 2023-10-26T06:49:22.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.148 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.148 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1111967084, 2023-10-26T06:49:22.148 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641675, 2023-10-26T06:49:22.148 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcopy.c" 2023-10-26T06:49:22.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.149 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.149 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1112666052, 2023-10-26T06:49:22.149 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641470, 2023-10-26T06:49:22.149 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_platform.c" 2023-10-26T06:49:22.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.150 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.150 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1188861939, 2023-10-26T06:49:22.150 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641728, 2023-10-26T06:49:22.150 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cppc_acpi.c" 2023-10-26T06:49:22.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1191481729, 2023-10-26T06:49:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641190, 2023-10-26T06:49:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.c" 2023-10-26T06:49:22.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.152 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.152 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1201518582, 2023-10-26T06:49:22.152 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641697, 2023-10-26T06:49:22.152 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresdecode.c" 2023-10-26T06:49:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1267865570, 2023-10-26T06:49:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641777, 2023-10-26T06:49:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_pdc.c" 2023-10-26T06:49:22.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.154 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.154 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1277007388, 2023-10-26T06:49:22.154 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641770, 2023-10-26T06:49:22.154 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/tps68470_pmic.c" 2023-10-26T06:49:22.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.155 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.155 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1291552181, 2023-10-26T06:49:22.155 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641578, 2023-10-26T06:49:22.156 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxface.c" 2023-10-26T06:49:22.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.156 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.156 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1306231681, 2023-10-26T06:49:22.156 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641628, 2023-10-26T06:49:22.157 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair.c" 2023-10-26T06:49:22.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.157 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.157 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1315668498, 2023-10-26T06:49:22.157 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641178, 2023-10-26T06:49:22.158 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/mq-deadline.c" 2023-10-26T06:49:22.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.158 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.158 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1316322009, 2023-10-26T06:49:22.158 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641142, 2023-10-26T06:49:22.159 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.h" 2023-10-26T06:49:22.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.159 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.159 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1320700604, 2023-10-26T06:49:22.160 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641775, 2023-10-26T06:49:22.160 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_driver.c" 2023-10-26T06:49:22.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.160 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.160 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1330941324, 2023-10-26T06:49:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642136, 2023-10-26T06:49:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit" 2023-10-26T06:49:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.161 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1339123381, 2023-10-26T06:49:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641557, 2023-10-26T06:49:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg6.c" 2023-10-26T06:49:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.162 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1344992156, 2023-10-26T06:49:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641125, 2023-10-26T06:49:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-wf2q.c" 2023-10-26T06:49:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.163 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1346623550, 2023-10-26T06:49:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641121, 2023-10-26T06:49:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/badblocks.c" 2023-10-26T06:49:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.164 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1361239431, 2023-10-26T06:49:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641141, 2023-10-26T06:49:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.c" 2023-10-26T06:49:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1366736501, 2023-10-26T06:49:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641546, 2023-10-26T06:49:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/excreate.c" 2023-10-26T06:49:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1372392620, 2023-10-26T06:49:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641137, 2023-10-26T06:49:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-map.c" 2023-10-26T06:49:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1385911610, 2023-10-26T06:49:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641677, 2023-10-26T06:49:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdecode.c" 2023-10-26T06:49:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1398419322, 2023-10-26T06:49:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641212, 2023-10-26T06:49:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.c" 2023-10-26T06:49:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1403616200, 2023-10-26T06:49:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641622, 2023-10-26T06:49:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsload.c" 2023-10-26T06:49:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1403744183, 2023-10-26T06:49:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641641, 2023-10-26T06:49:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psparse.c" 2023-10-26T06:49:22.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1405689145, 2023-10-26T06:49:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641739, 2023-10-26T06:49:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/event.c" 2023-10-26T06:49:22.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1411700779, 2023-10-26T06:49:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641627, 2023-10-26T06:49:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsprepkg.c" 2023-10-26T06:49:22.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1412850996, 2023-10-26T06:49:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641486, 2023-10-26T06:49:22.174 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acmacros.h" 2023-10-26T06:49:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1418976570, 2023-10-26T06:49:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641643, 2023-10-26T06:49:22.175 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pstree.c" 2023-10-26T06:49:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1423459279, 2023-10-26T06:49:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641522, 2023-10-26T06:49:22.176 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsutils.c" 2023-10-26T06:49:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1432828725, 2023-10-26T06:49:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641480, 2023-10-26T06:49:22.177 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdispat.h" 2023-10-26T06:49:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1439527154, 2023-10-26T06:49:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641463, 2023-10-26T06:49:22.178 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_extlog.c" 2023-10-26T06:49:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1444434412, 2023-10-26T06:49:22.179 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641874, 2023-10-26T06:49:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Kconfig" 2023-10-26T06:49:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1455618672, 2023-10-26T06:49:22.180 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641161, 2023-10-26T06:49:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-sysfs.c" 2023-10-26T06:49:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1459358494, 2023-10-26T06:49:22.181 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641147, 2023-10-26T06:49:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sysfs.c" 2023-10-26T06:49:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1462429501, 2023-10-26T06:49:22.182 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641715, 2023-10-26T06:49:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst.c" 2023-10-26T06:49:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1462835714, 2023-10-26T06:49:22.183 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641721, 2023-10-26T06:49:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/battery.c" 2023-10-26T06:49:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.184 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1476819184, 2023-10-26T06:49:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641663, 2023-10-26T06:49:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfind.c" 2023-10-26T06:49:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.185 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1529004252, 2023-10-26T06:49:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641790, 2023-10-26T06:49:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/spcr.c" 2023-10-26T06:49:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.186 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1530685082, 2023-10-26T06:49:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642138, 2023-10-26T06:49:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic" 2023-10-26T06:49:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.187 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1533985443, 2023-10-26T06:49:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641702, 2023-10-26T06:49:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrtoul64.c" 2023-10-26T06:49:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.188 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1534654707, 2023-10-26T06:49:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642140, 2023-10-26T06:49:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86" 2023-10-26T06:49:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1546122364, 2023-10-26T06:49:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641558, 2023-10-26T06:49:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exprep.c" 2023-10-26T06:49:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1568494127, 2023-10-26T06:49:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641457, 2023-10-26T06:49:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_adxl.c" 2023-10-26T06:49:22.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1574154179, 2023-10-26T06:49:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641875, 2023-10-26T06:49:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica" 2023-10-26T06:49:22.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1623364898, 2023-10-26T06:49:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641727, 2023-10-26T06:49:22.193 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/container.c" 2023-10-26T06:49:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1638363523, 2023-10-26T06:49:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641197, 2023-10-26T06:49:22.194 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.h" 2023-10-26T06:49:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1641856920, 2023-10-26T06:49:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641185, 2023-10-26T06:49:22.195 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.h" 2023-10-26T06:49:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1646012115, 2023-10-26T06:49:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641129, 2023-10-26T06:49:22.196 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-core.c" 2023-10-26T06:49:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1681438253, 2023-10-26T06:49:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641619, 2023-10-26T06:49:22.197 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdumpdv.c" 2023-10-26T06:49:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1690436767, 2023-10-26T06:49:22.198 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641565, 2023-10-26T06:49:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstoren.c" 2023-10-26T06:49:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1697254763, 2023-10-26T06:49:22.199 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641638, 2023-10-26T06:49:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psobject.c" 2023-10-26T06:49:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.200 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1706844082, 2023-10-26T06:49:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641751, 2023-10-26T06:49:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.c" 2023-10-26T06:49:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.201 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1729688523, 2023-10-26T06:49:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641494, 2023-10-26T06:49:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/actables.h" 2023-10-26T06:49:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1751438725, 2023-10-26T06:49:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641490, 2023-10-26T06:49:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acparser.h" 2023-10-26T06:49:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1762234735, 2023-10-26T06:49:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641543, 2023-10-26T06:49:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconcat.c" 2023-10-26T06:49:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1765542504, 2023-10-26T06:49:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641555, 2023-10-26T06:49:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg2.c" 2023-10-26T06:49:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1782002653, 2023-10-26T06:49:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641537, 2023-10-26T06:49:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evrgnini.c" 2023-10-26T06:49:22.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1794854272, 2023-10-26T06:49:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641123, 2023-10-26T06:49:22.207 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.c" 2023-10-26T06:49:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1801853836, 2023-10-26T06:49:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641658, 2023-10-26T06:49:22.208 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsserial.c" 2023-10-26T06:49:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1805408452, 2023-10-26T06:49:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641754, 2023-10-26T06:49:22.209 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/nfit.h" 2023-10-26T06:49:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.210 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1807962373, 2023-10-26T06:49:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641655, 2023-10-26T06:49:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rslist.c" 2023-10-26T06:49:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.211 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1809952859, 2023-10-26T06:49:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641519, 2023-10-26T06:49:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsobject.c" 2023-10-26T06:49:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.212 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1812819953, 2023-10-26T06:49:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641644, 2023-10-26T06:49:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psutils.c" 2023-10-26T06:49:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.213 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1820295788, 2023-10-26T06:49:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641200, 2023-10-26T06:49:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.c" 2023-10-26T06:49:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1828323853, 2023-10-26T06:49:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641192, 2023-10-26T06:49:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.c" 2023-10-26T06:49:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1867302366, 2023-10-26T06:49:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641630, 2023-10-26T06:49:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nssearch.c" 2023-10-26T06:49:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1867877375, 2023-10-26T06:49:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641164, 2023-10-26T06:49:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.c" 2023-10-26T06:49:22.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1898385290, 2023-10-26T06:49:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642128, 2023-10-26T06:49:22.218 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei" 2023-10-26T06:49:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1903298307, 2023-10-26T06:49:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641506, 2023-10-26T06:49:22.219 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbnames.c" 2023-10-26T06:49:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1915494148, 2023-10-26T06:49:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641559, 2023-10-26T06:49:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exregion.c" 2023-10-26T06:49:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1917915767, 2023-10-26T06:49:22.221 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641615, 2023-10-26T06:49:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsalloc.c" 2023-10-26T06:49:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.222 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1931070766, 2023-10-26T06:49:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641487, 2023-10-26T06:49:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acnamesp.h" 2023-10-26T06:49:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.223 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 1973141389, 2023-10-26T06:49:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641525, 2023-10-26T06:49:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload2.c" 2023-10-26T06:49:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.224 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2020191195, 2023-10-26T06:49:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641462, 2023-10-26T06:49:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_dbg.c" 2023-10-26T06:49:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.225 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2032796486, 2023-10-26T06:49:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641497, 2023-10-26T06:49:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlresrc.h" 2023-10-26T06:49:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.226 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2033263012, 2023-10-26T06:49:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641605, 2023-10-26T06:49:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions" 2023-10-26T06:49:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2036771222, 2023-10-26T06:49:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641735, 2023-10-26T06:49:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/dptf_power.c" 2023-10-26T06:49:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2040115305, 2023-10-26T06:49:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641640, 2023-10-26T06:49:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopinfo.c" 2023-10-26T06:49:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2042821057, 2023-10-26T06:49:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641145, 2023-10-26T06:49:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.c" 2023-10-26T06:49:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2057805433, 2023-10-26T06:49:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641529, 2023-10-26T06:49:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evglock.c" 2023-10-26T06:49:22.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2073090595, 2023-10-26T06:49:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641496, 2023-10-26T06:49:22.232 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlcode.h" 2023-10-26T06:49:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2077952372, 2023-10-26T06:49:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641573, 2023-10-26T06:49:22.233 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwpci.c" 2023-10-26T06:49:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2100561825, 2023-10-26T06:49:22.234 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641683, 2023-10-26T06:49:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uthex.c" 2023-10-26T06:49:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2100777251, 2023-10-26T06:49:22.235 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641189, 2023-10-26T06:49:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.h" 2023-10-26T06:49:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2130158642, 2023-10-26T06:49:22.236 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641566, 2023-10-26T06:49:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstorob.c" 2023-10-26T06:49:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2131322354, 2023-10-26T06:49:22.237 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641674, 2023-10-26T06:49:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcache.c" 2023-10-26T06:49:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.238 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2132609636, 2023-10-26T06:49:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641499, 2023-10-26T06:49:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbconvert.c" 2023-10-26T06:49:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.239 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2137804459, 2023-10-26T06:49:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641176, 2023-10-26T06:49:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioprio.c" 2023-10-26T06:49:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.240 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2153273461, 2023-10-26T06:49:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641795, 2023-10-26T06:49:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/video_detect.c" 2023-10-26T06:49:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.241 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2165505569, 2023-10-26T06:49:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641716, 2023-10-26T06:49:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ghes.c" 2023-10-26T06:49:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2186641358, 2023-10-26T06:49:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641656, 2023-10-26T06:49:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmemory.c" 2023-10-26T06:49:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2187297885, 2023-10-26T06:49:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641156, 2023-10-26T06:49:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.h" 2023-10-26T06:49:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2189252655, 2023-10-26T06:49:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641167, 2023-10-26T06:49:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk.h" 2023-10-26T06:49:22.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2197976705, 2023-10-26T06:49:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641213, 2023-10-26T06:49:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.h" 2023-10-26T06:49:22.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2204841691, 2023-10-26T06:49:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641536, 2023-10-26T06:49:22.247 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evregion.c" 2023-10-26T06:49:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2206040355, 2023-10-26T06:49:22.248 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641473, 2023-10-26T06:49:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_tad.c" 2023-10-26T06:49:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2230881104, 2023-10-26T06:49:22.249 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641773, 2023-10-26T06:49:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/proc.c" 2023-10-26T06:49:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.250 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2232974011, 2023-10-26T06:49:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641215, 2023-10-26T06:49:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.h" 2023-10-26T06:49:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.251 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2238572910, 2023-10-26T06:49:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641521, 2023-10-26T06:49:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dspkginit.c" 2023-10-26T06:49:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2239460317, 2023-10-26T06:49:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641743, 2023-10-26T06:49:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hed.c" 2023-10-26T06:49:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.254 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.254 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2240993896, 2023-10-26T06:49:22.254 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641742, 2023-10-26T06:49:22.254 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/glue.c" 2023-10-26T06:49:22.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.255 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.255 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2255930474, 2023-10-26T06:49:22.255 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641492, 2023-10-26T06:49:22.255 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acresrc.h" 2023-10-26T06:49:22.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2266800560, 2023-10-26T06:49:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641673, 2023-10-26T06:49:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utbuffer.c" 2023-10-26T06:49:22.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.257 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.257 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2283873128, 2023-10-26T06:49:22.257 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641706, 2023-10-26T06:49:22.257 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxferror.c" 2023-10-26T06:49:22.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.258 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.258 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2289649586, 2023-10-26T06:49:22.258 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641138, 2023-10-26T06:49:22.258 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-merge.c" 2023-10-26T06:49:22.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.259 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.259 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2321566047, 2023-10-26T06:49:22.259 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641722, 2023-10-26T06:49:22.259 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bgrt.c" 2023-10-26T06:49:22.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.260 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.260 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2322925072, 2023-10-26T06:49:22.260 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641796, 2023-10-26T06:49:22.260 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/wakeup.c" 2023-10-26T06:49:22.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.261 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.261 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2332697512, 2023-10-26T06:49:22.261 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641726, 2023-10-26T06:49:22.262 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cm_sbs.c" 2023-10-26T06:49:22.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.262 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.262 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2332865147, 2023-10-26T06:49:22.263 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641524, 2023-10-26T06:49:22.263 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload.c" 2023-10-26T06:49:22.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.263 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.263 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2342434678, 2023-10-26T06:49:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641652, 2023-10-26T06:49:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsinfo.c" 2023-10-26T06:49:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.264 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2349278979, 2023-10-26T06:49:22.265 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641478, 2023-10-26T06:49:22.265 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acconvert.h" 2023-10-26T06:49:22.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.265 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.265 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2351909684, 2023-10-26T06:49:22.266 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641774, 2023-10-26T06:49:22.266 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_core.c" 2023-10-26T06:49:22.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.266 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.267 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2353555162, 2023-10-26T06:49:22.267 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641791, 2023-10-26T06:49:22.267 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sysfs.c" 2023-10-26T06:49:22.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.267 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.268 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2358691215, 2023-10-26T06:49:22.268 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641719, 2023-10-26T06:49:22.268 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/gtdt.c" 2023-10-26T06:49:22.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.269 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.269 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2365052796, 2023-10-26T06:49:22.269 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641498, 2023-10-26T06:49:22.269 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbcmds.c" 2023-10-26T06:49:22.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.270 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.270 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2371163525, 2023-10-26T06:49:22.270 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641759, 2023-10-26T06:49:22.270 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_irq.c" 2023-10-26T06:49:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2375361022, 2023-10-26T06:49:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641541, 2023-10-26T06:49:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfgpe.c" 2023-10-26T06:49:22.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.272 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.272 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2382759722, 2023-10-26T06:49:22.272 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641194, 2023-10-26T06:49:22.273 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.c" 2023-10-26T06:49:22.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.273 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.273 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2391715885, 2023-10-26T06:49:22.274 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641730, 2023-10-26T06:49:22.274 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/debugfs.c" 2023-10-26T06:49:22.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.274 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.274 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2407721159, 2023-10-26T06:49:22.275 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641654, 2023-10-26T06:49:22.275 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsirq.c" 2023-10-26T06:49:22.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.275 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.276 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2407860033, 2023-10-26T06:49:22.276 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641540, 2023-10-26T06:49:22.276 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfevnt.c" 2023-10-26T06:49:22.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.276 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.277 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2408195163, 2023-10-26T06:49:22.277 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641186, 2023-10-26T06:49:22.277 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.c" 2023-10-26T06:49:22.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.278 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.278 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2415194805, 2023-10-26T06:49:22.278 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641196, 2023-10-26T06:49:22.278 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.c" 2023-10-26T06:49:22.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.279 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.279 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2421353267, 2023-10-26T06:49:22.279 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641533, 2023-10-26T06:49:22.279 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeutil.c" 2023-10-26T06:49:22.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.280 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.280 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2435960617, 2023-10-26T06:49:22.280 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641504, 2023-10-26T06:49:22.280 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbinput.c" 2023-10-26T06:49:22.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.281 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.281 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2442645019, 2023-10-26T06:49:22.281 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641626, 2023-10-26T06:49:22.281 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nspredef.c" 2023-10-26T06:49:22.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.282 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.282 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2444795076, 2023-10-26T06:49:22.282 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641530, 2023-10-26T06:49:22.283 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpe.c" 2023-10-26T06:49:22.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.283 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.283 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2453310811, 2023-10-26T06:49:22.283 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641757, 2023-10-26T06:49:22.284 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osi.c" 2023-10-26T06:49:22.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.284 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.284 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2459900072, 2023-10-26T06:49:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641516, 2023-10-26T06:49:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsinit.c" 2023-10-26T06:49:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2462057415, 2023-10-26T06:49:22.286 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641513, 2023-10-26T06:49:22.286 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dscontrol.c" 2023-10-26T06:49:22.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.286 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.287 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2462439628, 2023-10-26T06:49:22.287 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641520, 2023-10-26T06:49:22.287 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsopcode.c" 2023-10-26T06:49:22.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.287 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.288 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2482407972, 2023-10-26T06:49:22.288 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641725, 2023-10-26T06:49:22.288 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/button.c" 2023-10-26T06:49:22.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.288 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.289 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2488258515, 2023-10-26T06:49:22.289 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641761, 2023-10-26T06:49:22.289 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_mcfg.c" 2023-10-26T06:49:22.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.289 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.290 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2513108701, 2023-10-26T06:49:22.290 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641760, 2023-10-26T06:49:22.290 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_link.c" 2023-10-26T06:49:22.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.291 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.291 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2530540332, 2023-10-26T06:49:22.291 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641678, 2023-10-26T06:49:22.291 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdelete.c" 2023-10-26T06:49:22.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.292 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.292 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2547914337, 2023-10-26T06:49:22.292 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641762, 2023-10-26T06:49:22.292 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_root.c" 2023-10-26T06:49:22.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2563185244, 2023-10-26T06:49:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641124, 2023-10-26T06:49:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.h" 2023-10-26T06:49:22.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.294 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.294 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2573651300, 2023-10-26T06:49:22.294 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641501, 2023-10-26T06:49:22.294 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbexec.c" 2023-10-26T06:49:22.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.295 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.295 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2583560170, 2023-10-26T06:49:22.295 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641645, 2023-10-26T06:49:22.295 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pswalk.c" 2023-10-26T06:49:22.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.296 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.296 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2615033275, 2023-10-26T06:49:22.296 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641676, 2023-10-26T06:49:22.296 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdebug.c" 2023-10-26T06:49:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2616392978, 2023-10-26T06:49:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641646, 2023-10-26T06:49:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psxface.c" 2023-10-26T06:49:22.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.298 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.298 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2618620362, 2023-10-26T06:49:22.298 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641505, 2023-10-26T06:49:22.299 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbmethod.c" 2023-10-26T06:49:22.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.299 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.299 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2622140000, 2023-10-26T06:49:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641527, 2023-10-26T06:49:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswstate.c" 2023-10-26T06:49:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.300 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2623497010, 2023-10-26T06:49:22.301 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641784, 2023-10-26T06:49:22.301 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbs.c" 2023-10-26T06:49:22.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.301 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.302 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2624523116, 2023-10-26T06:49:22.302 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641150, 2023-10-26T06:49:22.302 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-virtio.c" 2023-10-26T06:49:22.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.302 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.303 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2631264631, 2023-10-26T06:49:22.303 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641547, 2023-10-26T06:49:22.303 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdebug.c" 2023-10-26T06:49:22.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.303 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.304 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2640939625, 2023-10-26T06:49:22.304 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642129, 2023-10-26T06:49:22.304 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Kconfig" 2023-10-26T06:49:22.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.304 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.305 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2648428369, 2023-10-26T06:49:22.305 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641634, 2023-10-26T06:49:22.305 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfname.c" 2023-10-26T06:49:22.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.306 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.306 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2673270514, 2023-10-26T06:49:22.306 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641534, 2023-10-26T06:49:22.306 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evhandler.c" 2023-10-26T06:49:22.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.307 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.307 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2677252527, 2023-10-26T06:49:22.307 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641691, 2023-10-26T06:49:22.307 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utnonansi.c" 2023-10-26T06:49:22.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.308 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.308 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2704220775, 2023-10-26T06:49:22.308 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641574, 2023-10-26T06:49:22.308 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwregs.c" 2023-10-26T06:49:22.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.309 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.309 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2710737790, 2023-10-26T06:49:22.309 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641464, 2023-10-26T06:49:22.309 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_ipmi.c" 2023-10-26T06:49:22.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.310 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.310 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2715873574, 2023-10-26T06:49:22.310 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641509, 2023-10-26T06:49:22.310 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbtest.c" 2023-10-26T06:49:22.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.311 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.311 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2733861409, 2023-10-26T06:49:22.311 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641705, 2023-10-26T06:49:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxface.c" 2023-10-26T06:49:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2769706726, 2023-10-26T06:49:22.312 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641738, 2023-10-26T06:49:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec_sys.c" 2023-10-26T06:49:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2775345483, 2023-10-26T06:49:22.313 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641659, 2023-10-26T06:49:22.314 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsutils.c" 2023-10-26T06:49:22.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.314 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.314 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2775430705, 2023-10-26T06:49:22.315 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641758, 2023-10-26T06:49:22.315 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osl.c" 2023-10-26T06:49:22.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.315 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.315 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2779420420, 2023-10-26T06:49:22.316 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641514, 2023-10-26T06:49:22.316 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsdebug.c" 2023-10-26T06:49:22.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.316 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.316 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2807499155, 2023-10-26T06:49:22.317 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641458, 2023-10-26T06:49:22.317 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_amba.c" 2023-10-26T06:49:22.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.317 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.317 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2818925061, 2023-10-26T06:49:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642132, 2023-10-26T06:49:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf" 2023-10-26T06:49:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.318 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2823332246, 2023-10-26T06:49:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641779, 2023-10-26T06:49:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_thermal.c" 2023-10-26T06:49:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.319 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2829277535, 2023-10-26T06:49:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641493, 2023-10-26T06:49:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acstruct.h" 2023-10-26T06:49:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.320 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.321 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2840782783, 2023-10-26T06:49:22.321 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641648, 2023-10-26T06:49:22.321 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscalc.c" 2023-10-26T06:49:22.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.322 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.322 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2845091851, 2023-10-26T06:49:22.322 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641461, 2023-10-26T06:49:22.322 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_configfs.c" 2023-10-26T06:49:22.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.323 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.323 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2846669575, 2023-10-26T06:49:22.323 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642130, 2023-10-26T06:49:22.323 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64" 2023-10-26T06:49:22.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.324 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.324 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2864061061, 2023-10-26T06:49:22.324 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641710, 2023-10-26T06:49:22.324 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-base.c" 2023-10-26T06:49:22.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.325 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.325 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2883026173, 2023-10-26T06:49:22.325 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641579, 2023-10-26T06:49:22.325 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxfsleep.c" 2023-10-26T06:49:22.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.326 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.326 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2884938336, 2023-10-26T06:49:22.326 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641772, 2023-10-26T06:49:22.326 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pptt.c" 2023-10-26T06:49:22.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.327 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.327 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2888444433, 2023-10-26T06:49:22.327 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641704, 2023-10-26T06:49:22.327 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utuuid.c" 2023-10-26T06:49:22.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.328 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.328 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2892149636, 2023-10-26T06:49:22.328 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641548, 2023-10-26T06:49:22.328 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdump.c" 2023-10-26T06:49:22.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.329 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.329 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2893890557, 2023-10-26T06:49:22.329 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641651, 2023-10-26T06:49:22.330 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdumpinfo.c" 2023-10-26T06:49:22.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.330 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.330 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2895811211, 2023-10-26T06:49:22.330 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641631, 2023-10-26T06:49:22.331 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsutils.c" 2023-10-26T06:49:22.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.331 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.331 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2907526918, 2023-10-26T06:49:22.332 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641201, 2023-10-26T06:49:22.332 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.h" 2023-10-26T06:49:22.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.332 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.332 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2968649463, 2023-10-26T06:49:22.333 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641198, 2023-10-26T06:49:22.333 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.c" 2023-10-26T06:49:22.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.333 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.334 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2970122047, 2023-10-26T06:49:22.334 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641752, 2023-10-26T06:49:22.334 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.h" 2023-10-26T06:49:22.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.335 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.335 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2988378623, 2023-10-26T06:49:22.335 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641729, 2023-10-26T06:49:22.335 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/custom_method.c" 2023-10-26T06:49:22.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.336 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.336 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2992392907, 2023-10-26T06:49:22.336 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642141, 2023-10-26T06:49:22.336 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/apple.c" 2023-10-26T06:49:22.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.337 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.337 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2996710108, 2023-10-26T06:49:22.337 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641662, 2023-10-26T06:49:22.337 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfadt.c" 2023-10-26T06:49:22.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.338 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.338 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 2999571124, 2023-10-26T06:49:22.338 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641699, 2023-10-26T06:49:22.338 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstate.c" 2023-10-26T06:49:22.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.339 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.339 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3003519094, 2023-10-26T06:49:22.339 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641748, 2023-10-26T06:49:22.339 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/irq.c" 2023-10-26T06:49:22.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.340 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.340 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3010098167, 2023-10-26T06:49:22.340 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641146, 2023-10-26T06:49:22.340 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.h" 2023-10-26T06:49:22.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.341 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.341 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3012533925, 2023-10-26T06:49:22.341 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641701, 2023-10-26T06:49:22.342 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrsuppt.c" 2023-10-26T06:49:22.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.342 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.342 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3017218236, 2023-10-26T06:49:22.343 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641120, 2023-10-26T06:49:22.343 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Makefile" 2023-10-26T06:49:22.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.343 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.343 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3025933374, 2023-10-26T06:49:22.344 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641580, 2023-10-26T06:49:22.344 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsaccess.c" 2023-10-26T06:49:22.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.344 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.344 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3027111147, 2023-10-26T06:49:22.345 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641159, 2023-10-26T06:49:22.345 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.c" 2023-10-26T06:49:22.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.345 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.345 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3043506288, 2023-10-26T06:49:22.346 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641664, 2023-10-26T06:49:22.346 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbinstal.c" 2023-10-26T06:49:22.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.346 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.347 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3049115336, 2023-10-26T06:49:22.347 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641202, 2023-10-26T06:49:22.347 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.c" 2023-10-26T06:49:22.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.347 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.348 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3049803444, 2023-10-26T06:49:22.348 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641482, 2023-10-26T06:49:22.348 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acglobal.h" 2023-10-26T06:49:22.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.348 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.349 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3051933475, 2023-10-26T06:49:22.349 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641606, 2023-10-26T06:49:22.349 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Kconfig" 2023-10-26T06:49:22.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.349 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.350 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3058845248, 2023-10-26T06:49:22.350 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641793, 2023-10-26T06:49:22.350 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/thermal.c" 2023-10-26T06:49:22.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.351 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.351 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3067534083, 2023-10-26T06:49:22.351 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641153, 2023-10-26T06:49:22.351 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.c" 2023-10-26T06:49:22.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.352 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.352 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3075345878, 2023-10-26T06:49:22.352 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641764, 2023-10-26T06:49:22.352 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.h" 2023-10-26T06:49:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3078150046, 2023-10-26T06:49:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641149, 2023-10-26T06:49:22.353 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.h" 2023-10-26T06:49:22.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.354 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.354 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3079349178, 2023-10-26T06:49:22.354 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641568, 2023-10-26T06:49:22.355 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/extrace.c" 2023-10-26T06:49:22.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.355 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.355 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3087440570, 2023-10-26T06:49:22.355 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641667, 2023-10-26T06:49:22.356 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxface.c" 2023-10-26T06:49:22.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.356 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.356 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3093636190, 2023-10-26T06:49:22.356 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641681, 2023-10-26T06:49:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utexcep.c" 2023-10-26T06:49:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3095954108, 2023-10-26T06:49:22.357 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641570, 2023-10-26T06:49:22.358 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwacpi.c" 2023-10-26T06:49:22.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.358 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.358 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3108714731, 2023-10-26T06:49:22.359 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641692, 2023-10-26T06:49:22.359 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utobject.c" 2023-10-26T06:49:22.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.359 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.359 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3123035108, 2023-10-26T06:49:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641560, 2023-10-26T06:49:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresnte.c" 2023-10-26T06:49:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3129378409, 2023-10-26T06:49:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641466, 2023-10-26T06:49:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpit.c" 2023-10-26T06:49:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3130450232, 2023-10-26T06:49:22.362 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641132, 2023-10-26T06:49:22.362 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-integrity.c" 2023-10-26T06:49:22.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.362 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.363 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3153204988, 2023-10-26T06:49:22.363 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641617, 2023-10-26T06:49:22.363 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsconvert.c" 2023-10-26T06:49:22.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3165187279, 2023-10-26T06:49:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641685, 2023-10-26T06:49:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utinit.c" 2023-10-26T06:49:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3183375492, 2023-10-26T06:49:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641188, 2023-10-26T06:49:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.c" 2023-10-26T06:49:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.366 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.366 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3212452113, 2023-10-26T06:49:22.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641489, 2023-10-26T06:49:22.366 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acopcode.h" 2023-10-26T06:49:22.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.367 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.367 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3223618103, 2023-10-26T06:49:22.367 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641771, 2023-10-26T06:49:22.367 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/power.c" 2023-10-26T06:49:22.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.368 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.368 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3228380217, 2023-10-26T06:49:22.368 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641780, 2023-10-26T06:49:22.368 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_throttling.c" 2023-10-26T06:49:22.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.369 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.369 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3232295618, 2023-10-26T06:49:22.369 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641765, 2023-10-26T06:49:22.369 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_bxtwc.c" 2023-10-26T06:49:22.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.370 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.370 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3238085511, 2023-10-26T06:49:22.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641689, 2023-10-26T06:49:22.370 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmisc.c" 2023-10-26T06:49:22.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.371 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.371 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3261699459, 2023-10-26T06:49:22.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641571, 2023-10-26T06:49:22.371 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwesleep.c" 2023-10-26T06:49:22.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.372 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.372 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3282616241, 2023-10-26T06:49:22.372 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641797, 2023-10-26T06:49:22.372 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/utils.c" 2023-10-26T06:49:22.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.373 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.373 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3287130096, 2023-10-26T06:49:22.373 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641604, 2023-10-26T06:49:22.373 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig" 2023-10-26T06:49:22.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.374 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.374 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3293385623, 2023-10-26T06:49:22.374 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641746, 2023-10-26T06:49:22.375 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/internal.h" 2023-10-26T06:49:22.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.375 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.375 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3307640064, 2023-10-26T06:49:22.376 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641140, 2023-10-26T06:49:22.376 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs-zoned.c" 2023-10-26T06:49:22.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.376 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.376 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3341464787, 2023-10-26T06:49:22.377 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642134, 2023-10-26T06:49:22.377 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat" 2023-10-26T06:49:22.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.377 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.377 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3351441385, 2023-10-26T06:49:22.378 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641553, 2023-10-26T06:49:22.378 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exnames.c" 2023-10-26T06:49:22.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.378 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.379 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3354895548, 2023-10-26T06:49:22.379 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641769, 2023-10-26T06:49:22.379 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_xpower.c" 2023-10-26T06:49:22.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.379 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.380 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3375869242, 2023-10-26T06:49:22.380 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641510, 2023-10-26T06:49:22.380 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbutils.c" 2023-10-26T06:49:22.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.380 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.381 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3376351614, 2023-10-26T06:49:22.381 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641768, 2023-10-26T06:49:22.381 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_crc.c" 2023-10-26T06:49:22.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.382 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.382 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3376729002, 2023-10-26T06:49:22.382 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641549, 2023-10-26T06:49:22.382 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfield.c" 2023-10-26T06:49:22.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.383 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.383 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3378369136, 2023-10-26T06:49:22.383 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641508, 2023-10-26T06:49:22.383 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbstats.c" 2023-10-26T06:49:22.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.384 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.384 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3383682502, 2023-10-26T06:49:22.384 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641781, 2023-10-26T06:49:22.384 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/property.c" 2023-10-26T06:49:22.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.385 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.385 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3383713542, 2023-10-26T06:49:22.385 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641623, 2023-10-26T06:49:22.385 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsnames.c" 2023-10-26T06:49:22.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.386 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.386 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3385109591, 2023-10-26T06:49:22.386 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641507, 2023-10-26T06:49:22.386 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbobject.c" 2023-10-26T06:49:22.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.387 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.387 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3401522372, 2023-10-26T06:49:22.387 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641511, 2023-10-26T06:49:22.387 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbxface.c" 2023-10-26T06:49:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3406797860, 2023-10-26T06:49:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641618, 2023-10-26T06:49:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdump.c" 2023-10-26T06:49:22.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.389 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.389 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3416486257, 2023-10-26T06:49:22.389 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641135, 2023-10-26T06:49:22.389 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iolatency.c" 2023-10-26T06:49:22.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.390 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.390 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3416590643, 2023-10-26T06:49:22.390 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641688, 2023-10-26T06:49:22.390 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmath.c" 2023-10-26T06:49:22.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.391 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.391 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3424530554, 2023-10-26T06:49:22.391 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641131, 2023-10-26T06:49:22.392 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-flush.c" 2023-10-26T06:49:22.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.392 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.392 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3432040514, 2023-10-26T06:49:22.393 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641876, 2023-10-26T06:49:22.393 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/Makefile" 2023-10-26T06:49:22.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.393 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.393 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3453306275, 2023-10-26T06:49:22.394 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641737, 2023-10-26T06:49:22.394 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec.c" 2023-10-26T06:49:22.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.394 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.394 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3472127320, 2023-10-26T06:49:22.395 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641174, 2023-10-26T06:49:22.395 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/genhd.c" 2023-10-26T06:49:22.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.395 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.396 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3487042420, 2023-10-26T06:49:22.396 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641523, 2023-10-26T06:49:22.396 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswexec.c" 2023-10-26T06:49:22.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.396 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.397 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3490718695, 2023-10-26T06:49:22.397 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641165, 2023-10-26T06:49:22.397 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.h" 2023-10-26T06:49:22.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.397 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.398 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3494109665, 2023-10-26T06:49:22.398 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511642137, 2023-10-26T06:49:22.398 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Kconfig" 2023-10-26T06:49:22.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.399 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.399 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3494889446, 2023-10-26T06:49:22.399 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641753, 2023-10-26T06:49:22.399 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/mce.c" 2023-10-26T06:49:22.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.400 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.400 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3516238455, 2023-10-26T06:49:22.400 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641526, 2023-10-26T06:49:22.400 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswscope.c" 2023-10-26T06:49:22.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.401 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.401 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3527995509, 2023-10-26T06:49:22.401 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641740, 2023-10-26T06:49:22.401 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/evged.c" 2023-10-26T06:49:22.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.402 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.402 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3530643424, 2023-10-26T06:49:22.402 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641195, 2023-10-26T06:49:22.402 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.h" 2023-10-26T06:49:22.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.403 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.403 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3532994117, 2023-10-26T06:49:22.403 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641563, 2023-10-26T06:49:22.403 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exserial.c" 2023-10-26T06:49:22.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.404 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.404 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3540755488, 2023-10-26T06:49:22.404 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641139, 2023-10-26T06:49:22.404 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-cpumap.c" 2023-10-26T06:49:22.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.405 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.405 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3540941941, 2023-10-26T06:49:22.405 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641209, 2023-10-26T06:49:22.405 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.h" 2023-10-26T06:49:22.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.406 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.406 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3565507435, 2023-10-26T06:49:22.406 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641532, 2023-10-26T06:49:22.406 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeinit.c" 2023-10-26T06:49:22.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.407 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.407 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3580561433, 2023-10-26T06:49:22.407 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641776, 2023-10-26T06:49:22.408 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_idle.c" 2023-10-26T06:49:22.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.408 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.408 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3591491031, 2023-10-26T06:49:22.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641162, 2023-10-26T06:49:22.409 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-throttle.c" 2023-10-26T06:49:22.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.409 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.409 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3593885146, 2023-10-26T06:49:22.409 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641745, 2023-10-26T06:49:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/hmat.c" 2023-10-26T06:49:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3593961329, 2023-10-26T06:49:22.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641216, 2023-10-26T06:49:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/scsi_ioctl.c" 2023-10-26T06:49:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3598002516, 2023-10-26T06:49:22.411 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641133, 2023-10-26T06:49:22.412 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-ioc.c" 2023-10-26T06:49:22.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.412 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.412 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3605342716, 2023-10-26T06:49:22.413 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641698, 2023-10-26T06:49:22.413 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresrc.c" 2023-10-26T06:49:22.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.413 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.413 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3655345277, 2023-10-26T06:49:22.414 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641562, 2023-10-26T06:49:22.414 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresop.c" 2023-10-26T06:49:22.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.414 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.415 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3663502341, 2023-10-26T06:49:22.415 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641483, 2023-10-26T06:49:22.415 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/achware.h" 2023-10-26T06:49:22.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.415 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.416 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3686928690, 2023-10-26T06:49:22.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641576, 2023-10-26T06:49:22.416 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwtimer.c" 2023-10-26T06:49:22.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.416 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.417 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3691688194, 2023-10-26T06:49:22.417 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641708, 2023-10-26T06:49:22.417 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfmutex.c" 2023-10-26T06:49:22.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.417 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.418 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3692297133, 2023-10-26T06:49:22.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641577, 2023-10-26T06:49:22.418 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwvalid.c" 2023-10-26T06:49:22.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.418 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.419 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3698155362, 2023-10-26T06:49:22.419 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641693, 2023-10-26T06:49:22.419 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utosi.c" 2023-10-26T06:49:22.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.419 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.420 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3728705841, 2023-10-26T06:49:22.420 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641210, 2023-10-26T06:49:22.420 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.c" 2023-10-26T06:49:22.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.420 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.421 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3734519530, 2023-10-26T06:49:22.421 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641786, 2023-10-26T06:49:22.421 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.h" 2023-10-26T06:49:22.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.421 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.422 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3755854176, 2023-10-26T06:49:22.422 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641550, 2023-10-26T06:49:22.422 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfldio.c" 2023-10-26T06:49:22.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.422 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.423 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3772542819, 2023-10-26T06:49:22.423 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641182, 2023-10-26T06:49:22.423 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.c" 2023-10-26T06:49:22.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.424 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.424 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3775444314, 2023-10-26T06:49:22.424 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641750, 2023-10-26T06:49:22.424 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/core.c" 2023-10-26T06:49:22.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.425 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.425 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3788419901, 2023-10-26T06:49:22.425 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641554, 2023-10-26T06:49:22.425 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg1.c" 2023-10-26T06:49:22.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.426 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.426 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3790152511, 2023-10-26T06:49:22.426 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641173, 2023-10-26T06:49:22.426 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/elevator.c" 2023-10-26T06:49:22.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.427 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.427 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3804441800, 2023-10-26T06:49:22.427 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641187, 2023-10-26T06:49:22.427 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.h" 2023-10-26T06:49:22.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.428 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.428 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3813517771, 2023-10-26T06:49:22.428 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641672, 2023-10-26T06:49:22.428 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utascii.c" 2023-10-26T06:49:22.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.429 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.429 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3826469283, 2023-10-26T06:49:22.429 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641572, 2023-10-26T06:49:22.429 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwgpe.c" 2023-10-26T06:49:22.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.430 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.430 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3867396447, 2023-10-26T06:49:22.430 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641468, 2023-10-26T06:49:22.430 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_memhotplug.c" 2023-10-26T06:49:22.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.431 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.431 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3883988010, 2023-10-26T06:49:22.431 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641679, 2023-10-26T06:49:22.431 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uterror.c" 2023-10-26T06:49:22.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3894939169, 2023-10-26T06:49:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641128, 2023-10-26T06:49:22.432 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-cgroup.c" 2023-10-26T06:49:22.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.433 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.433 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3897911918, 2023-10-26T06:49:22.433 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641713, 2023-10-26T06:49:22.433 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/einj.c" 2023-10-26T06:49:22.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.434 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.434 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3899992596, 2023-10-26T06:49:22.434 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641515, 2023-10-26T06:49:22.434 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsfield.c" 2023-10-26T06:49:22.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.435 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.435 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3900048233, 2023-10-26T06:49:22.435 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641723, 2023-10-26T06:49:22.436 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/blacklist.c" 2023-10-26T06:49:22.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.436 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.436 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3909990700, 2023-10-26T06:49:22.436 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641718, 2023-10-26T06:49:22.437 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Makefile" 2023-10-26T06:49:22.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.437 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.437 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3921438395, 2023-10-26T06:49:22.437 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641731, 2023-10-26T06:49:22.438 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_pm.c" 2023-10-26T06:49:22.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.438 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.438 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3926457691, 2023-10-26T06:49:22.438 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641682, 2023-10-26T06:49:22.439 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utglobal.c" 2023-10-26T06:49:22.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.439 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.439 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3930898695, 2023-10-26T06:49:22.439 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641477, 2023-10-26T06:49:22.440 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/accommon.h" 2023-10-26T06:49:22.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.440 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.440 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3940003541, 2023-10-26T06:49:22.440 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641633, 2023-10-26T06:49:22.441 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfeval.c" 2023-10-26T06:49:22.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.441 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.441 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3953822932, 2023-10-26T06:49:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641686, 2023-10-26T06:49:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utlock.c" 2023-10-26T06:49:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.442 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3965687655, 2023-10-26T06:49:22.443 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641724, 2023-10-26T06:49:22.443 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bus.c" 2023-10-26T06:49:22.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.443 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.443 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3968115620, 2023-10-26T06:49:22.444 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641500, 2023-10-26T06:49:22.444 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbdisply.c" 2023-10-26T06:49:22.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.444 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.445 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3969602569, 2023-10-26T06:49:22.445 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641650, 2023-10-26T06:49:22.445 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdump.c" 2023-10-26T06:49:22.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.445 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.446 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3970491380, 2023-10-26T06:49:22.446 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641717, 2023-10-26T06:49:22.446 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/hest.c" 2023-10-26T06:49:22.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.446 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.447 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3992840165, 2023-10-26T06:49:22.447 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641649, 2023-10-26T06:49:22.447 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscreate.c" 2023-10-26T06:49:22.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.447 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.448 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3994400000, 2023-10-26T06:49:22.448 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641217, 2023-10-26T06:49:22.448 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/sed-opal.c" 2023-10-26T06:49:22.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4003665432, 2023-10-26T06:49:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641694, 2023-10-26T06:49:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utownerid.c" 2023-10-26T06:49:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.450 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.450 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4011185281, 2023-10-26T06:49:22.450 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641647, 2023-10-26T06:49:22.450 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsaddr.c" 2023-10-26T06:49:22.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.451 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.451 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4020789672, 2023-10-26T06:49:22.451 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641160, 2023-10-26T06:49:22.451 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.h" 2023-10-26T06:49:22.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4021836289, 2023-10-26T06:49:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641528, 2023-10-26T06:49:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evevent.c" 2023-10-26T06:49:22.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.453 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.453 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4021962475, 2023-10-26T06:49:22.453 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641625, 2023-10-26T06:49:22.453 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsparse.c" 2023-10-26T06:49:22.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.454 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.454 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4038804793, 2023-10-26T06:49:22.454 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641214, 2023-10-26T06:49:22.454 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.c" 2023-10-26T06:49:22.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.455 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.455 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4045108565, 2023-10-26T06:49:22.455 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641629, 2023-10-26T06:49:22.455 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair2.c" 2023-10-26T06:49:22.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.456 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.456 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4092786538, 2023-10-26T06:49:22.456 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641154, 2023-10-26T06:49:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.h" 2023-10-26T06:49:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4094901587, 2023-10-26T06:49:22.457 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641712, 2023-10-26T06:49:22.458 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/bert.c" 2023-10-26T06:49:22.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.458 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.458 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4096105601, 2023-10-26T06:49:22.458 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641175, 2023-10-26T06:49:22.459 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioctl.c" 2023-10-26T06:49:22.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.459 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.459 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4101569478, 2023-10-26T06:49:22.459 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641787, 2023-10-26T06:49:22.460 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/scan.c" 2023-10-26T06:49:22.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.460 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.460 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4117759923, 2023-10-26T06:49:22.461 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641177, 2023-10-26T06:49:22.461 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/kyber-iosched.c" 2023-10-26T06:49:22.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.461 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.461 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4121507065, 2023-10-26T06:49:22.462 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641158, 2023-10-26T06:49:22.462 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-softirq.c" 2023-10-26T06:49:22.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.462 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.463 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4122760522, 2023-10-26T06:49:22.463 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641642, 2023-10-26T06:49:22.463 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psscope.c" 2023-10-26T06:49:22.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.463 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.464 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4157687819, 2023-10-26T06:49:22.464 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641620, 2023-10-26T06:49:22.464 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nseval.c" 2023-10-26T06:49:22.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.464 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.465 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4172609384, 2023-10-26T06:49:22.465 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641191, 2023-10-26T06:49:22.465 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.h" 2023-10-26T06:49:22.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.465 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.466 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4172753001, 2023-10-26T06:49:22.466 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641193, 2023-10-26T06:49:22.466 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.h" 2023-10-26T06:49:22.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.467 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.467 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4173967666, 2023-10-26T06:49:22.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641517, 2023-10-26T06:49:22.467 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmethod.c" 2023-10-26T06:49:22.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.468 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.468 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4202120636, 2023-10-26T06:49:22.468 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641636, 2023-10-26T06:49:22.468 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psargs.c" 2023-10-26T06:49:22.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4203366067, 2023-10-26T06:49:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641455, 2023-10-26T06:49:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Makefile" 2023-10-26T06:49:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.470 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.470 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4220920159, 2023-10-26T06:49:22.470 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641711, 2023-10-26T06:49:22.470 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-internal.h" 2023-10-26T06:49:22.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.471 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.471 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4229969263, 2023-10-26T06:49:22.471 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641783, 2023-10-26T06:49:22.471 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/resource.c" 2023-10-26T06:49:22.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.472 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.472 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4244223367, 2023-10-26T06:49:22.472 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641660, 2023-10-26T06:49:22.472 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsxface.c" 2023-10-26T06:49:22.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.473 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.473 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4245465401, 2023-10-26T06:49:22.473 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641488, 2023-10-26T06:49:22.473 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acobject.h" 2023-10-26T06:49:22.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.474 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.474 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4277906601, 2023-10-26T06:49:22.474 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641502, 2023-10-26T06:49:22.474 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbfileio.c" 2023-10-26T06:49:22.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.475 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.475 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4284645662, 2023-10-26T06:49:22.475 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641459, 2023-10-26T06:49:22.475 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_apd.c" 2023-10-26T06:49:22.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:49:22.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:49:22.476 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-10-26T06:49:22.476 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4288022397, 2023-10-26T06:49:22.476 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511641476, 2023-10-26T06:49:22.476 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acapps.h" 2023-10-26T06:49:22.477 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:49:22.477 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-10-26T06:49:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6980a16f0 msgr2=0x7fe6980a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6980a16f0 0x7fe6980a3bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55aa521ceae0 tx=0x7fe6a80962c0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 msgr2=0x7fe6ac114d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 0x7fe6ac114d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800c920 tx=0x7fe6a800cc30 comp rx=0 tx=0).stop 2023-10-26T06:49:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 shutdown_connections 2023-10-26T06:49:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fe6980a16f0 0x7fe6980a3bb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6ac1a29e0 0x7fe6ac1a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6ac107a60 0x7fe6ac114d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 --2- 172.21.15.50:0/2358016754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6ac10f2f0 0x7fe6ac1152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 >> 172.21.15.50:0/2358016754 conn(0x7fe6ac06b650 msgr2=0x7fe6ac109270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.019+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 shutdown_connections 2023-10-26T06:49:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.020+0000 7fe6b239d700 1 -- 172.21.15.50:0/2358016754 wait complete. 2023-10-26T06:49:22.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-26T06:49:22.482 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psopinfo.o 2023-10-26T06:49:22.482 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ata/pata_sch.o 2023-10-26T06:49:22.483 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/power/clock_ops.o 2023-10-26T06:49:22.491 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/pcm.o 2023-10-26T06:49:22.533 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psparse.o 2023-10-26T06:49:22.706 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/lockd/procfs.o 2023-10-26T06:49:22.707 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psscope.o 2023-10-26T06:49:22.851 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/base/power/built-in.a 2023-10-26T06:49:22.925 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/smpboot.o 2023-10-26T06:49:22.947 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/regmap/regmap.o 2023-10-26T06:49:22.988 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/ata/built-in.a 2023-10-26T06:49:22.990 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sysctl.o 2023-10-26T06:49:22.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.989+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3743098719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d01081b0 msgr2=0x7f04d0113e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.989+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3743098719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d01081b0 0x7f04d0113e30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f04c00074e0 tx=0x7f04c000af90 comp rx=0 tx=0).stop 2023-10-26T06:49:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.990+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3743098719 shutdown_connections 2023-10-26T06:49:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.990+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3743098719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d01081b0 0x7f04d0113e30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.990+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3743098719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d010d090 0x7f04d010d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.990+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3743098719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01077f0 0x7f04d0107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.990+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3743098719 >> 172.21.15.50:0/3743098719 conn(0x7f04d006b840 msgr2=0x7f04d006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.991+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3743098719 shutdown_connections 2023-10-26T06:49:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.991+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3743098719 wait complete. 2023-10-26T06:49:22.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.994+0000 7f04d6b9d700 1 Processor -- start 2023-10-26T06:49:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.995+0000 7f04d6b9d700 1 -- start start 2023-10-26T06:49:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d6b9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d01077f0 0x7f04d01a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d6b9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 0x7f04d01a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:22.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d6b9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d010d090 0x7f04d01aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d6b9d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d01aa660 con 0x7f04d01077f0 2023-10-26T06:49:22.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d6b9d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d01aa7d0 con 0x7f04d010d090 2023-10-26T06:49:23.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d6b9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d01aa990 con 0x7f04d01081b0 2023-10-26T06:49:23.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 0x7f04d01a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 0x7f04d01a5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:53548/0 (socket says 172.21.15.50:53548) 2023-10-26T06:49:23.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.996+0000 7f04d4b99700 1 -- 172.21.15.50:0/3480043610 learned_addr learned my addr 172.21.15.50:0/3480043610 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:23.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.997+0000 7f04d539a700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d01077f0 0x7f04d01a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.997+0000 7f04d4b99700 1 -- 172.21.15.50:0/3480043610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d010d090 msgr2=0x7f04d01aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.997+0000 7f04d4b99700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d010d090 0x7f04d01aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.997+0000 7f04d4b99700 1 -- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d01077f0 msgr2=0x7f04d01a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.997+0000 7f04d4b99700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d01077f0 0x7f04d01a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.997+0000 7f04d4b99700 1 -- 172.21.15.50:0/3480043610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c00071c0 con 0x7f04d01081b0 2023-10-26T06:49:23.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.998+0000 7f04d539a700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d01077f0 0x7f04d01a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:49:23.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:22.998+0000 7f04d4b99700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 0x7f04d01a5c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007e20 tx=0x7f04c800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:23.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.001+0000 7f04c6ffd700 1 -- 172.21.15.50:0/3480043610 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c800ae00 con 0x7f04d01081b0 2023-10-26T06:49:23.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.001+0000 7f04c6ffd700 1 -- 172.21.15.50:0/3480043610 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c80128e0 con 0x7f04d01081b0 2023-10-26T06:49:23.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.001+0000 7f04c6ffd700 1 -- 172.21.15.50:0/3480043610 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8011810 con 0x7f04d01081b0 2023-10-26T06:49:23.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.002+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d01aac70 con 0x7f04d01081b0 2023-10-26T06:49:23.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.002+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d01b24b0 con 0x7f04d01081b0 2023-10-26T06:49:23.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.009+0000 7f04c6ffd700 1 -- 172.21.15.50:0/3480043610 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f04c8012d10 con 0x7f04d01081b0 2023-10-26T06:49:23.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.012+0000 7f04c6ffd700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f04bc0a1670 0x7f04bc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.013+0000 7f04c6ffd700 1 -- 172.21.15.50:0/3480043610 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f04c80cd240 con 0x7f04d01081b0 2023-10-26T06:49:23.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.015+0000 7f04d539a700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f04bc0a1670 0x7f04bc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:22 smithi050 ceph-mon[94997]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-26T06:49:23.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.016+0000 7f04d539a700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f04bc0a1670 0x7f04bc0a3b30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005fd0 tx=0x7f04cc00a5e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:23.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.019+0000 7f04eb751b80 1 Processor -- start 2023-10-26T06:49:23.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.020+0000 7f04eb751b80 1 -- start start 2023-10-26T06:49:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.020+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092cd60 0x5627d092d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.020+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092d680 0x5627d09272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.020+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.021+0000 7f04eb751b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d089a6e0 con 0x5627d092d680 2023-10-26T06:49:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.021+0000 7f04d5b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.021+0000 7f04d5b9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47822/0 (socket says 172.21.15.50:47822) 2023-10-26T06:49:23.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.021+0000 7f04d5b9b700 1 -- 172.21.15.50:0/631130460 learned_addr learned my addr 172.21.15.50:0/631130460 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.021+0000 7f04eb751b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d0880c60 con 0x5627d0927820 2023-10-26T06:49:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.021+0000 7f04eb751b80 1 -- 172.21.15.50:0/631130460 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d087e580 con 0x5627d092cd60 2023-10-26T06:49:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.022+0000 7f04d5b9b700 1 -- 172.21.15.50:0/631130460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092cd60 msgr2=0x5627d092d140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:49:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.022+0000 7f04d5b9b700 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092cd60 0x5627d092d140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.022+0000 7f04d5b9b700 1 -- 172.21.15.50:0/631130460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092d680 msgr2=0x5627d09272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.022+0000 7f04d5b9b700 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092d680 0x5627d09272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.022+0000 7f04d5b9b700 1 -- 172.21.15.50:0/631130460 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d08373f0 con 0x5627d0927820 2023-10-26T06:49:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.023+0000 7f04d5b9b700 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04c0005910 tx=0x7f04c000af10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8a14209e391fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.024+0000 7f04bbfff700 1 -- 172.21.15.50:0/631130460 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000f070 con 0x5627d0927820 2023-10-26T06:49:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.024+0000 7f04bbfff700 1 -- 172.21.15.50:0/631130460 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c0007e80 con 0x5627d0927820 2023-10-26T06:49:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.024+0000 7f04bbfff700 1 -- 172.21.15.50:0/631130460 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0004350 con 0x5627d0927820 2023-10-26T06:49:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 -- 172.21.15.50:0/631130460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 msgr2=0x5627d0927c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04c0005910 tx=0x7f04c000af10 comp rx=0 tx=0).stop 2023-10-26T06:49:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 -- 172.21.15.50:0/631130460 shutdown_connections 2023-10-26T06:49:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092cd60 0x5627d092d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 --2- 172.21.15.50:0/631130460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092d680 0x5627d09272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 -- 172.21.15.50:0/631130460 >> 172.21.15.50:0/631130460 conn(0x5627d089b720 msgr2=0x5627d0921cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.025+0000 7f04eb751b80 1 -- 172.21.15.50:0/631130460 shutdown_connections 2023-10-26T06:49:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.026+0000 7f04eb751b80 1 -- 172.21.15.50:0/631130460 wait complete. 2023-10-26T06:49:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.026+0000 7f04eb751b80 1 -- start start 2023-10-26T06:49:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.027+0000 7f04eb751b80 1 Processor -- start 2023-10-26T06:49:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.027+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d09336d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d0932270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04d539a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d09336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04d539a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d09336d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47834/0 (socket says 172.21.15.50:47834) 2023-10-26T06:49:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d09329b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04eb751b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d0879e70 con 0x5627d092cd60 2023-10-26T06:49:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04eb751b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d0816710 con 0x5627d0927820 2023-10-26T06:49:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04eb751b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d08163b0 con 0x5627d092d680 2023-10-26T06:49:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04eb751b80 10 client.0 _ll_register_callbacks cb 0x5627d0760a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.028+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d0932270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.029+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d0932270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35036/0 (socket says 172.21.15.50:35036) 2023-10-26T06:49:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.029+0000 7f04d4b99700 1 -- 172.21.15.50:0/3763530258 learned_addr learned my addr 172.21.15.50:0/3763530258 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04d539a700 1 -- 172.21.15.50:0/3763530258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 msgr2=0x5627d09329b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:49:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04d539a700 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d09329b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04d539a700 1 -- 172.21.15.50:0/3763530258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 msgr2=0x5627d0932270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04d539a700 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d0932270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04d539a700 1 -- 172.21.15.50:0/3763530258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d01146f0 con 0x5627d0927820 2023-10-26T06:49:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04d539a700 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d09336d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00e6e0 tx=0x7f04cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a273275fe29515d server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.030+0000 7f04b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:49:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.031+0000 7f04b97fa700 1 -- 172.21.15.50:0/3763530258 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc01d860 con 0x5627d0927820 2023-10-26T06:49:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.031+0000 7f04b97fa700 1 -- 172.21.15.50:0/3763530258 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f04cc01d9c0 con 0x5627d0927820 2023-10-26T06:49:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.032+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d08f68b0 con 0x5627d0927820 2023-10-26T06:49:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.032+0000 7f04b97fa700 1 -- 172.21.15.50:0/3763530258 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04cc01db80 con 0x5627d0927820 2023-10-26T06:49:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04eb751b80 10 client.26552 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5627d06a4de0 con 0x5627d0927820 2023-10-26T06:49:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04b97fa700 1 -- 172.21.15.50:0/3763530258 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5627d08f68b0 con 0x5627d0927820 2023-10-26T06:49:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04b97fa700 1 -- 172.21.15.50:0/3763530258 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f04cc00f3c0 con 0x5627d0927820 2023-10-26T06:49:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04eb751b80 10 client.26552 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04eb751b80 10 client.26552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:49:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.033+0000 7f04eb751b80 20 client.26552 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.034+0000 7f04eb751b80 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d0941160 0x5627d0943580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.034+0000 7f04eb751b80 4 client.26552 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-26T06:49:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.034+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627d0872e50 con 0x5627d0941160 2023-10-26T06:49:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.034+0000 7f04d4b99700 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d0941160 0x5627d0943580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.035+0000 7f04b97fa700 10 client.26552 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.036+0000 7f04d4b99700 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d0941160 0x5627d0943580 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b61dcb19e3a5633 server_cookie=3caa77fcc4ade7a9 in_seq=0 out_seq=0 2023-10-26T06:49:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.037+0000 7f04b97fa700 1 -- 172.21.15.50:0/3763530258 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627d0872e50 con 0x5627d0941160 2023-10-26T06:49:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.037+0000 7f04b97fa700 10 client.26552 handle_command_reply: tid=0 2023-10-26T06:49:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.037+0000 7f04eb751b80 1 client.26552 shutdown 2023-10-26T06:49:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 msgr2=0x5627d09336d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d09336d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00e6e0 tx=0x7f04cc004750 comp rx=0 tx=0).stop 2023-10-26T06:49:23.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 shutdown_connections 2023-10-26T06:49:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d0941160 0x5627d0943580 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d09329b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d09336d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04b97fa700 0 client.26552 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 --2- 172.21.15.50:0/3763530258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d0932270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.038+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 >> 172.21.15.50:0/3763530258 conn(0x5627d089b720 msgr2=0x5627d09262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.039+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 shutdown_connections 2023-10-26T06:49:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.039+0000 7f04eb751b80 1 -- 172.21.15.50:0/3763530258 wait complete. 2023-10-26T06:49:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.039+0000 7f04eb751b80 20 client.26552 trim_cache size 0 max 16384 2023-10-26T06:49:23.080 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/client.o 2023-10-26T06:49:23.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.078+0000 7f04eb751b80 1 Processor -- start 2023-10-26T06:49:23.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.081+0000 7f04eb751b80 1 -- start start 2023-10-26T06:49:23.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.081+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.081+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d091c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.082+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d091c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.082+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d091c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35052/0 (socket says 172.21.15.50:35052) 2023-10-26T06:49:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.082+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d0938060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.083+0000 7f04eb751b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d06fa920 con 0x5627d092cd60 2023-10-26T06:49:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.083+0000 7f04eb751b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d09385a0 con 0x5627d0927820 2023-10-26T06:49:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.083+0000 7f04eb751b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d0923d90 con 0x5627d092d680 2023-10-26T06:49:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.083+0000 7f04d4b99700 1 -- 172.21.15.50:0/304951163 learned_addr learned my addr 172.21.15.50:0/304951163 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.083+0000 7f04d539a700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.084+0000 7f04d4b99700 1 -- 172.21.15.50:0/304951163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 msgr2=0x5627d0938060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:49:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.084+0000 7f04d5b9b700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d0938060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.084+0000 7f04d4b99700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d0938060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.084+0000 7f04d4b99700 1 -- 172.21.15.50:0/304951163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 msgr2=0x5627d0927c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-26T06:49:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.084+0000 7f04d4b99700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.084+0000 7f04d4b99700 1 -- 172.21.15.50:0/304951163 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d068dc60 con 0x5627d092cd60 2023-10-26T06:49:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.085+0000 7f04d539a700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:49:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.085+0000 7f04d5b9b700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d0938060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-26T06:49:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.085+0000 7f04d4b99700 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d091c820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f04c8004b80 tx=0x7f04c800af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e20dd07269b2ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.086+0000 7f04c4bff700 1 -- 172.21.15.50:0/304951163 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80b2ea0 con 0x5627d092cd60 2023-10-26T06:49:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.086+0000 7f04c4bff700 1 -- 172.21.15.50:0/304951163 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c809e530 con 0x5627d092cd60 2023-10-26T06:49:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.086+0000 7f04c4bff700 1 -- 172.21.15.50:0/304951163 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c809e160 con 0x5627d092cd60 2023-10-26T06:49:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.087+0000 7f04eb751b80 1 -- 172.21.15.50:0/304951163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 msgr2=0x5627d091c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.087+0000 7f04eb751b80 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d091c820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f04c8004b80 tx=0x7f04c800af60 comp rx=0 tx=0).stop 2023-10-26T06:49:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.090+0000 7f04eb751b80 1 -- 172.21.15.50:0/304951163 shutdown_connections 2023-10-26T06:49:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.090+0000 7f04eb751b80 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d092d680 0x5627d0938060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.090+0000 7f04eb751b80 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d0927820 0x5627d0927c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.090+0000 7f04eb751b80 1 --2- 172.21.15.50:0/304951163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d092cd60 0x5627d091c820 secure :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f04c8004b80 tx=0x7f04c800af60 comp rx=0 tx=0).stop 2023-10-26T06:49:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.090+0000 7f04eb751b80 1 -- 172.21.15.50:0/304951163 >> 172.21.15.50:0/304951163 conn(0x5627d089b720 msgr2=0x5627d093c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.091+0000 7f04eb751b80 1 -- 172.21.15.50:0/304951163 shutdown_connections 2023-10-26T06:49:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.091+0000 7f04eb751b80 1 -- 172.21.15.50:0/304951163 wait complete. 2023-10-26T06:49:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.092+0000 7f04eb751b80 1 -- start start 2023-10-26T06:49:23.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.092+0000 7f04eb751b80 1 Processor -- start 2023-10-26T06:49:23.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d0927820 0x5627d09369d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 0x5627d0936f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d0937560 0x5627d0994fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d0995660 con 0x5627d0927820 2023-10-26T06:49:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d09957d0 con 0x5627d092d680 2023-10-26T06:49:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d09a69a0 con 0x5627d0937560 2023-10-26T06:49:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.096+0000 7f04eb751b80 10 client.0 _ll_register_callbacks cb 0x5627d0760a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-26T06:49:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 0x5627d0936f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 0x5627d0936f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:47852/0 (socket says 172.21.15.50:47852) 2023-10-26T06:49:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 -- 172.21.15.50:0/2863469676 learned_addr learned my addr 172.21.15.50:0/2863469676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:49:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 -- 172.21.15.50:0/2863469676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d0937560 msgr2=0x5627d0994fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-26T06:49:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d5b9b700 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d0937560 0x5627d0994fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d0937560 0x5627d0994fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 -- 172.21.15.50:0/2863469676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d0927820 msgr2=0x5627d09369d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-26T06:49:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d0927820 0x5627d09369d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.097+0000 7f04d4b99700 1 -- 172.21.15.50:0/2863469676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627d06a4de0 con 0x5627d092d680 2023-10-26T06:49:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.098+0000 7f04d4b99700 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 0x5627d0936f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04c80cb040 tx=0x7f04c8099d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2f26f55a9457dc server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:49:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.098+0000 7f04b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-26T06:49:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.098+0000 7f04b97fa700 1 -- 172.21.15.50:0/2863469676 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80b2ea0 con 0x5627d092d680 2023-10-26T06:49:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.098+0000 7f04b97fa700 1 -- 172.21.15.50:0/2863469676 <== mon.2 v2:172.21.15.125:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f04c80cc040 con 0x5627d092d680 2023-10-26T06:49:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.098+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d087eef0 con 0x5627d092d680 2023-10-26T06:49:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.099+0000 7f04b97fa700 1 -- 172.21.15.50:0/2863469676 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04c8098820 con 0x5627d092d680 2023-10-26T06:49:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.100+0000 7f04eb751b80 10 client.26558 fetch_fsmap learned FSMap version 28 2023-10-26T06:49:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.100+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f04d01b24b0 con 0x5627d092d680 2023-10-26T06:49:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04b97fa700 1 -- 172.21.15.50:0/2863469676 <== mon.2 v2:172.21.15.125:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c80b6070 con 0x5627d092d680 2023-10-26T06:49:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04b97fa700 1 -- 172.21.15.50:0/2863469676 <== mon.2 v2:172.21.15.125:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f04c80998d0 con 0x5627d092d680 2023-10-26T06:49:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04eb751b80 10 client.26558 fetch_fsmap finished waiting for FSMap version 28 2023-10-26T06:49:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04eb751b80 10 client.26558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-26T06:49:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04eb751b80 20 client.26558 populate_metadata read hostname 'smithi050' 2023-10-26T06:49:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04eb751b80 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d09a7d80 0x5627d09aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:49:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04eb751b80 4 client.26558 mds_command: new command op to 24740 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-26T06:49:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.101+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 --> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627d087eef0 con 0x5627d09a7d80 2023-10-26T06:49:23.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.104+0000 7f04d539a700 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d09a7d80 0x5627d09aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:49:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.108+0000 7f04b97fa700 10 client.26558 ms_handle_connect on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:23.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.108+0000 7f04d539a700 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d09a7d80 0x5627d09aa1a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b3deeabb132778 server_cookie=e98745e939e43207 in_seq=0 out_seq=0 2023-10-26T06:49:23.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.109+0000 7f04b97fa700 1 -- 172.21.15.50:0/2863469676 <== mds.0 v2:172.21.15.125:6838/1086282741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627d087eef0 con 0x5627d09a7d80 2023-10-26T06:49:23.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.109+0000 7f04b97fa700 10 client.26558 handle_command_reply: tid=0 2023-10-26T06:49:23.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.109+0000 7f04eb751b80 1 client.26558 shutdown 2023-10-26T06:49:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 msgr2=0x5627d0936f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 0x5627d0936f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04c80cb040 tx=0x7f04c8099d40 comp rx=0 tx=0).stop 2023-10-26T06:49:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 shutdown_connections 2023-10-26T06:49:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:6838/1086282741,v1:172.21.15.125:6839/1086282741] conn(0x5627d09a7d80 0x5627d09aa1a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5627d0937560 0x5627d0994fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627d0927820 0x5627d09369d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 --2- 172.21.15.50:0/2863469676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x5627d092d680 0x5627d0936f10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04b97fa700 0 client.26558 ms_handle_reset on v2:172.21.15.125:6838/1086282741 2023-10-26T06:49:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.111+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 >> 172.21.15.50:0/2863469676 conn(0x5627d089b720 msgr2=0x5627d0921a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:23.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.113+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 shutdown_connections 2023-10-26T06:49:23.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.113+0000 7f04eb751b80 1 -- 172.21.15.50:0/2863469676 wait complete. 2023-10-26T06:49:23.116 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2023-10-26T06:49:23.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.114+0000 7f04eb751b80 20 client.26558 trim_cache size 0 max 16384 2023-10-26T06:49:23.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.115+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f04bc0a1670 msgr2=0x7f04bc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.115+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f04bc0a1670 0x7f04bc0a3b30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005fd0 tx=0x7f04cc00a5e0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.115+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 msgr2=0x7f04d01a5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:49:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.115+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 0x7f04d01a5c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007e20 tx=0x7f04c800a340 comp rx=0 tx=0).stop 2023-10-26T06:49:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.116+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 shutdown_connections 2023-10-26T06:49:23.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.116+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f04bc0a1670 0x7f04bc0a3b30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.116+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f04d010d090 0x7f04d01aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.116+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04d01077f0 0x7f04d01a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.116+0000 7f04d6b9d700 1 --2- 172.21.15.50:0/3480043610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d01081b0 0x7f04d01a5c80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:49:23.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.116+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 >> 172.21.15.50:0/3480043610 conn(0x7f04d006b840 msgr2=0x7f04d0070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:49:23.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.117+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 shutdown_connections 2023-10-26T06:49:23.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:49:23.117+0000 7f04d6b9d700 1 -- 172.21.15.50:0/3480043610 wait complete. 2023-10-26T06:49:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:22 smithi125 ceph-mon[130643]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-26T06:49:23.174 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 6396365, 'ino': 1099511641155, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.c'}, {'damage_type': 'backtrace', 'id': 8724614, 'ino': 1099511642131, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Kconfig'}, {'damage_type': 'backtrace', 'id': 15235323, 'ino': 1099511641632, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nswalk.c'}, {'damage_type': 'backtrace', 'id': 23742792, 'ino': 1099511641481, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acevents.h'}, {'damage_type': 'backtrace', 'id': 36944612, 'ino': 1099511641171, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/cmdline-parser.c'}, {'damage_type': 'backtrace', 'id': 45192167, 'ino': 1099511641709, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Makefile'}, {'damage_type': 'backtrace', 'id': 48314283, 'ino': 1099511641733, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dock.c'}, {'damage_type': 'backtrace', 'id': 58692571, 'ino': 1099511641671, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utalloc.c'}, {'damage_type': 'backtrace', 'id': 68020737, 'ino': 1099511641471, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pnp.c'}, {'damage_type': 'backtrace', 'id': 81746971, 'ino': 1099511641669, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfroot.c'}, {'damage_type': 'backtrace', 'id': 100552245, 'ino': 1099511641661, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbdata.c'}, {'damage_type': 'backtrace', 'id': 111184379, 'ino': 1099511641211, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.h'}, {'damage_type': 'backtrace', 'id': 113990077, 'ino': 1099511641456, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ac.c'}, {'damage_type': 'backtrace', 'id': 115701723, 'ino': 1099511641637, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psloop.c'}, {'damage_type': 'backtrace', 'id': 123851159, 'ino': 1099511641485, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/aclocal.h'}, {'damage_type': 'backtrace', 'id': 131020073, 'ino': 1099511641203, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.h'}, {'damage_type': 'backtrace', 'id': 146724333, 'ino': 1099511641495, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acutils.h'}, {'damage_type': 'backtrace', 'id': 165828755, 'ino': 1099511641778, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_perflib.c'}, {'damage_type': 'backtrace', 'id': 176509780, 'ino': 1099511641538, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evsci.c'}, {'damage_type': 'backtrace', 'id': 176723801, 'ino': 1099511641531, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeblk.c'}, {'damage_type': 'backtrace', 'id': 187550821, 'ino': 1099511641126, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio-integrity.c'}, {'damage_type': 'backtrace', 'id': 193622644, 'ino': 1099511641148, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.c'}, {'damage_type': 'backtrace', 'id': 199491637, 'ino': 1099511641696, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utprint.c'}, {'damage_type': 'backtrace', 'id': 203617230, 'ino': 1099511641179, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/opal_proto.h'}, {'damage_type': 'backtrace', 'id': 224275425, 'ino': 1099511641561, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresolv.c'}, {'damage_type': 'backtrace', 'id': 235644809, 'ino': 1099511641143, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-pci.c'}, {'damage_type': 'backtrace', 'id': 245545049, 'ino': 1099511641756, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nvs.c'}, {'damage_type': 'backtrace', 'id': 246301521, 'ino': 1099511641657, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmisc.c'}, {'damage_type': 'backtrace', 'id': 265872550, 'ino': 1099511641665, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbprint.c'}, {'damage_type': 'backtrace', 'id': 272376403, 'ino': 1099511641736, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/int340x_thermal.c'}, {'damage_type': 'backtrace', 'id': 287942716, 'ino': 1099511641684, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utids.c'}, {'damage_type': 'backtrace', 'id': 316796750, 'ino': 1099511641119, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig.iosched'}, {'damage_type': 'backtrace', 'id': 321432901, 'ino': 1099511641714, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst-dbg.c'}, {'damage_type': 'backtrace', 'id': 324261249, 'ino': 1099511641127, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bio.c'}, {'damage_type': 'backtrace', 'id': 328628672, 'ino': 1099511641639, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopcode.c'}, {'damage_type': 'backtrace', 'id': 331437290, 'ino': 1099511641624, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsobject.c'}, {'damage_type': 'backtrace', 'id': 339845913, 'ino': 1099511641785, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.c'}, {'damage_type': 'backtrace', 'id': 351574134, 'ino': 1099511641747, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ioapic.c'}, {'damage_type': 'backtrace', 'id': 362749787, 'ino': 1099511641741, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/fan.c'}, {'damage_type': 'backtrace', 'id': 380868601, 'ino': 1099511641564, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstore.c'}, {'damage_type': 'backtrace', 'id': 402131392, 'ino': 1099511641552, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmutex.c'}, {'damage_type': 'backtrace', 'id': 437244359, 'ino': 1099511641479, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdebug.h'}, {'damage_type': 'backtrace', 'id': 444959933, 'ino': 1099511641873, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi'}, {'damage_type': 'backtrace', 'id': 447741010, 'ino': 1099511642139, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.c'}, {'damage_type': 'backtrace', 'id': 450929988, 'ino': 1099511641184, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.c'}, {'damage_type': 'backtrace', 'id': 466751840, 'ino': 1099511641567, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exsystem.c'}, {'damage_type': 'backtrace', 'id': 469860688, 'ino': 1099511641151, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.c'}, {'damage_type': 'backtrace', 'id': 475429065, 'ino': 1099511641653, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsio.c'}, {'damage_type': 'backtrace', 'id': 482582713, 'ino': 1099511641744, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Makefile'}, {'damage_type': 'backtrace', 'id': 483051065, 'ino': 1099511641484, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acinterp.h'}, {'damage_type': 'backtrace', 'id': 506694709, 'ino': 1099511641545, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconvrt.c'}, {'damage_type': 'backtrace', 'id': 515282732, 'ino': 1099511641670, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utaddress.c'}, {'damage_type': 'backtrace', 'id': 518618698, 'ino': 1099511641707, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfinit.c'}, {'damage_type': 'backtrace', 'id': 524051054, 'ino': 1099511641130, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-exec.c'}, {'damage_type': 'backtrace', 'id': 524103295, 'ino': 1099511641152, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq.h'}, {'damage_type': 'backtrace', 'id': 532415024, 'ino': 1099511641720, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/iort.c'}, {'damage_type': 'backtrace', 'id': 539460608, 'ino': 1099511641782, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/reboot.c'}, {'damage_type': 'backtrace', 'id': 541756134, 'ino': 1099511641666, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbutils.c'}, {'damage_type': 'backtrace', 'id': 542564652, 'ino': 1099511641166, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-zoned.c'}, {'damage_type': 'backtrace', 'id': 542900395, 'ino': 1099511641700, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstring.c'}, {'damage_type': 'backtrace', 'id': 550315803, 'ino': 1099511641472, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_processor.c'}, {'damage_type': 'backtrace', 'id': 603749015, 'ino': 1099511641792, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/tables.c'}, {'damage_type': 'backtrace', 'id': 603996647, 'ino': 1099511641635, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfobj.c'}, {'damage_type': 'backtrace', 'id': 612640870, 'ino': 1099511641157, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-settings.c'}, {'damage_type': 'backtrace', 'id': 618119290, 'ino': 1099511641542, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfregn.c'}, {'damage_type': 'backtrace', 'id': 624100791, 'ino': 1099511641749, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Makefile'}, {'damage_type': 'backtrace', 'id': 626550018, 'ino': 1099511641551, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exmisc.c'}, {'damage_type': 'backtrace', 'id': 640434255, 'ino': 1099511641474, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_video.c'}, {'damage_type': 'backtrace', 'id': 651332900, 'ino': 1099511641460, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_cmos_rtc.c'}, {'damage_type': 'backtrace', 'id': 655518708, 'ino': 1099511641569, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exutils.c'}, {'damage_type': 'backtrace', 'id': 658939165, 'ino': 1099511641136, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-lib.c'}, {'damage_type': 'backtrace', 'id': 665546368, 'ino': 1099511641208, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.c'}, {'damage_type': 'backtrace', 'id': 681554914, 'ino': 1099511641169, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg-lib.c'}, {'damage_type': 'backtrace', 'id': 714715726, 'ino': 1099511641181, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Makefile'}, {'damage_type': 'backtrace', 'id': 717228407, 'ino': 1099511642133, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Kconfig'}, {'damage_type': 'backtrace', 'id': 746516422, 'ino': 1099511641491, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acpredef.h'}, {'damage_type': 'backtrace', 'id': 746749984, 'ino': 1099511641668, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxfload.c'}, {'damage_type': 'backtrace', 'id': 751019542, 'ino': 1099511641183, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.h'}, {'damage_type': 'backtrace', 'id': 751544179, 'ino': 1099511641788, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.c'}, {'damage_type': 'backtrace', 'id': 773171897, 'ino': 1099511641163, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-timeout.c'}, {'damage_type': 'backtrace', 'id': 774129809, 'ino': 1099511641206, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.c'}, {'damage_type': 'backtrace', 'id': 775540447, 'ino': 1099511641556, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg3.c'}, {'damage_type': 'backtrace', 'id': 776484859, 'ino': 1099511641680, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uteval.c'}, {'damage_type': 'backtrace', 'id': 787599185, 'ino': 1099511641218, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/t10-pi.c'}, {'damage_type': 'backtrace', 'id': 796546875, 'ino': 1099511641544, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconfig.c'}, {'damage_type': 'backtrace', 'id': 816654758, 'ino': 1099511641134, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iocost.c'}, {'damage_type': 'backtrace', 'id': 818280352, 'ino': 1099511641763, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_slot.c'}, {'damage_type': 'backtrace', 'id': 819832805, 'ino': 1099511641734, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/Makefile'}, {'damage_type': 'backtrace', 'id': 833721065, 'ino': 1099511641539, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxface.c'}, {'damage_type': 'backtrace', 'id': 840825491, 'ino': 1099511641766, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtdc_ti.c'}, {'damage_type': 'backtrace', 'id': 849910116, 'ino': 1099511641789, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sleep.h'}, {'damage_type': 'backtrace', 'id': 854405434, 'ino': 1099511641575, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwsleep.c'}, {'damage_type': 'backtrace', 'id': 859743700, 'ino': 1099511641794, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/utils.c'}, {'damage_type': 'backtrace', 'id': 870460073, 'ino': 1099511641469, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_pad.c'}, {'damage_type': 'backtrace', 'id': 894518533, 'ino': 1099511641168, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bounce.c'}, {'damage_type': 'backtrace', 'id': 904668910, 'ino': 1099511641199, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.h'}, {'damage_type': 'backtrace', 'id': 918113137, 'ino': 1099511641518, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmthdat.c'}, {'damage_type': 'backtrace', 'id': 921227924, 'ino': 1099511641205, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.h'}, {'damage_type': 'backtrace', 'id': 922879567, 'ino': 1099511641180, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partition-generic.c'}, {'damage_type': 'backtrace', 'id': 942976263, 'ino': 1099511641621, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsinit.c'}, {'damage_type': 'backtrace', 'id': 945056436, 'ino': 1099511642135, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/Kconfig'}, {'damage_type': 'backtrace', 'id': 952043643, 'ino': 1099511641170, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bsg.c'}, {'damage_type': 'backtrace', 'id': 962252984, 'ino': 1099511641690, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmutex.c'}, {'damage_type': 'backtrace', 'id': 966717306, 'ino': 1099511641703, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uttrack.c'}, {'damage_type': 'backtrace', 'id': 996060119, 'ino': 1099511641616, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsarguments.c'}, {'damage_type': 'backtrace', 'id': 1002480666, 'ino': 1099511641467, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpss.c'}, {'damage_type': 'backtrace', 'id': 1011263702, 'ino': 1099511641535, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evmisc.c'}, {'damage_type': 'backtrace', 'id': 1014246855, 'ino': 1099511641465, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpat.c'}, {'damage_type': 'backtrace', 'id': 1022876451, 'ino': 1099511641207, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/osf.h'}, {'damage_type': 'backtrace', 'id': 1030028027, 'ino': 1099511641767, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_chtwc.c'}, {'damage_type': 'backtrace', 'id': 1033914258, 'ino': 1099511641503, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbhistry.c'}, {'damage_type': 'backtrace', 'id': 1038435968, 'ino': 1099511641755, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/numa.c'}, {'damage_type': 'backtrace', 'id': 1042290408, 'ino': 1099511641475, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_watchdog.c'}, {'damage_type': 'backtrace', 'id': 1042460940, 'ino': 1099511641512, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsargs.c'}, {'damage_type': 'backtrace', 'id': 1050771726, 'ino': 1099511641204, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/msdos.c'}, {'damage_type': 'backtrace', 'id': 1053481490, 'ino': 1099511641732, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_sysfs.c'}, {'damage_type': 'backtrace', 'id': 1056868002, 'ino': 1099511641695, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utpredef.c'}, {'damage_type': 'backtrace', 'id': 1085590677, 'ino': 1099511641122, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-cgroup.c'}, {'damage_type': 'backtrace', 'id': 1096017194, 'ino': 1099511641172, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/compat_ioctl.c'}, {'damage_type': 'backtrace', 'id': 1111432432, 'ino': 1099511641144, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-rdma.c'}, {'damage_type': 'backtrace', 'id': 1111967084, 'ino': 1099511641675, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcopy.c'}, {'damage_type': 'backtrace', 'id': 1112666052, 'ino': 1099511641470, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_platform.c'}, {'damage_type': 'backtrace', 'id': 1188861939, 'ino': 1099511641728, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cppc_acpi.c'}, {'damage_type': 'backtrace', 'id': 1191481729, 'ino': 1099511641190, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.c'}, {'damage_type': 'backtrace', 'id': 1201518582, 'ino': 1099511641697, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresdecode.c'}, {'damage_type': 'backtrace', 'id': 1267865570, 'ino': 1099511641777, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_pdc.c'}, {'damage_type': 'backtrace', 'id': 1277007388, 'ino': 1099511641770, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/tps68470_pmic.c'}, {'damage_type': 'backtrace', 'id': 1291552181, 'ino': 1099511641578, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxface.c'}, {'damage_type': 'backtrace', 'id': 1306231681, 'ino': 1099511641628, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair.c'}, {'damage_type': 'backtrace', 'id': 1315668498, 'ino': 1099511641178, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/mq-deadline.c'}, {'damage_type': 'backtrace', 'id': 1316322009, 'ino': 1099511641142, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.h'}, {'damage_type': 'backtrace', 'id': 1320700604, 'ino': 1099511641775, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_driver.c'}, {'damage_type': 'backtrace', 'id': 1330941324, 'ino': 1099511642136, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit'}, {'damage_type': 'backtrace', 'id': 1339123381, 'ino': 1099511641557, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg6.c'}, {'damage_type': 'backtrace', 'id': 1344992156, 'ino': 1099511641125, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-wf2q.c'}, {'damage_type': 'backtrace', 'id': 1346623550, 'ino': 1099511641121, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/badblocks.c'}, {'damage_type': 'backtrace', 'id': 1361239431, 'ino': 1099511641141, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs.c'}, {'damage_type': 'backtrace', 'id': 1366736501, 'ino': 1099511641546, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/excreate.c'}, {'damage_type': 'backtrace', 'id': 1372392620, 'ino': 1099511641137, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-map.c'}, {'damage_type': 'backtrace', 'id': 1385911610, 'ino': 1099511641677, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdecode.c'}, {'damage_type': 'backtrace', 'id': 1398419322, 'ino': 1099511641212, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.c'}, {'damage_type': 'backtrace', 'id': 1403616200, 'ino': 1099511641622, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsload.c'}, {'damage_type': 'backtrace', 'id': 1403744183, 'ino': 1099511641641, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psparse.c'}, {'damage_type': 'backtrace', 'id': 1405689145, 'ino': 1099511641739, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/event.c'}, {'damage_type': 'backtrace', 'id': 1411700779, 'ino': 1099511641627, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsprepkg.c'}, {'damage_type': 'backtrace', 'id': 1412850996, 'ino': 1099511641486, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acmacros.h'}, {'damage_type': 'backtrace', 'id': 1418976570, 'ino': 1099511641643, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pstree.c'}, {'damage_type': 'backtrace', 'id': 1423459279, 'ino': 1099511641522, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsutils.c'}, {'damage_type': 'backtrace', 'id': 1432828725, 'ino': 1099511641480, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acdispat.h'}, {'damage_type': 'backtrace', 'id': 1439527154, 'ino': 1099511641463, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_extlog.c'}, {'damage_type': 'backtrace', 'id': 1444434412, 'ino': 1099511641874, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Kconfig'}, {'damage_type': 'backtrace', 'id': 1455618672, 'ino': 1099511641161, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-sysfs.c'}, {'damage_type': 'backtrace', 'id': 1459358494, 'ino': 1099511641147, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sysfs.c'}, {'damage_type': 'backtrace', 'id': 1462429501, 'ino': 1099511641715, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/erst.c'}, {'damage_type': 'backtrace', 'id': 1462835714, 'ino': 1099511641721, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/battery.c'}, {'damage_type': 'backtrace', 'id': 1476819184, 'ino': 1099511641663, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfind.c'}, {'damage_type': 'backtrace', 'id': 1529004252, 'ino': 1099511641790, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/spcr.c'}, {'damage_type': 'backtrace', 'id': 1530685082, 'ino': 1099511642138, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic'}, {'damage_type': 'backtrace', 'id': 1533985443, 'ino': 1099511641702, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrtoul64.c'}, {'damage_type': 'backtrace', 'id': 1534654707, 'ino': 1099511642140, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86'}, {'damage_type': 'backtrace', 'id': 1546122364, 'ino': 1099511641558, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exprep.c'}, {'damage_type': 'backtrace', 'id': 1568494127, 'ino': 1099511641457, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_adxl.c'}, {'damage_type': 'backtrace', 'id': 1574154179, 'ino': 1099511641875, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica'}, {'damage_type': 'backtrace', 'id': 1623364898, 'ino': 1099511641727, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/container.c'}, {'damage_type': 'backtrace', 'id': 1638363523, 'ino': 1099511641197, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.h'}, {'damage_type': 'backtrace', 'id': 1641856920, 'ino': 1099511641185, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/aix.h'}, {'damage_type': 'backtrace', 'id': 1646012115, 'ino': 1099511641129, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-core.c'}, {'damage_type': 'backtrace', 'id': 1681438253, 'ino': 1099511641619, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdumpdv.c'}, {'damage_type': 'backtrace', 'id': 1690436767, 'ino': 1099511641565, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstoren.c'}, {'damage_type': 'backtrace', 'id': 1697254763, 'ino': 1099511641638, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psobject.c'}, {'damage_type': 'backtrace', 'id': 1706844082, 'ino': 1099511641751, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.c'}, {'damage_type': 'backtrace', 'id': 1729688523, 'ino': 1099511641494, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/actables.h'}, {'damage_type': 'backtrace', 'id': 1751438725, 'ino': 1099511641490, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acparser.h'}, {'damage_type': 'backtrace', 'id': 1762234735, 'ino': 1099511641543, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exconcat.c'}, {'damage_type': 'backtrace', 'id': 1765542504, 'ino': 1099511641555, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg2.c'}, {'damage_type': 'backtrace', 'id': 1782002653, 'ino': 1099511641537, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evrgnini.c'}, {'damage_type': 'backtrace', 'id': 1794854272, 'ino': 1099511641123, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.c'}, {'damage_type': 'backtrace', 'id': 1801853836, 'ino': 1099511641658, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsserial.c'}, {'damage_type': 'backtrace', 'id': 1805408452, 'ino': 1099511641754, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/nfit.h'}, {'damage_type': 'backtrace', 'id': 1807962373, 'ino': 1099511641655, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rslist.c'}, {'damage_type': 'backtrace', 'id': 1809952859, 'ino': 1099511641519, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsobject.c'}, {'damage_type': 'backtrace', 'id': 1812819953, 'ino': 1099511641644, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psutils.c'}, {'damage_type': 'backtrace', 'id': 1820295788, 'ino': 1099511641200, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.c'}, {'damage_type': 'backtrace', 'id': 1828323853, 'ino': 1099511641192, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.c'}, {'damage_type': 'backtrace', 'id': 1867302366, 'ino': 1099511641630, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nssearch.c'}, {'damage_type': 'backtrace', 'id': 1867877375, 'ino': 1099511641164, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.c'}, {'damage_type': 'backtrace', 'id': 1898385290, 'ino': 1099511642128, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei'}, {'damage_type': 'backtrace', 'id': 1903298307, 'ino': 1099511641506, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbnames.c'}, {'damage_type': 'backtrace', 'id': 1915494148, 'ino': 1099511641559, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exregion.c'}, {'damage_type': 'backtrace', 'id': 1917915767, 'ino': 1099511641615, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsalloc.c'}, {'damage_type': 'backtrace', 'id': 1931070766, 'ino': 1099511641487, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acnamesp.h'}, {'damage_type': 'backtrace', 'id': 1973141389, 'ino': 1099511641525, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload2.c'}, {'damage_type': 'backtrace', 'id': 2020191195, 'ino': 1099511641462, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_dbg.c'}, {'damage_type': 'backtrace', 'id': 2032796486, 'ino': 1099511641497, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlresrc.h'}, {'damage_type': 'backtrace', 'id': 2033263012, 'ino': 1099511641605, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions'}, {'damage_type': 'backtrace', 'id': 2036771222, 'ino': 1099511641735, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf/dptf_power.c'}, {'damage_type': 'backtrace', 'id': 2040115305, 'ino': 1099511641640, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psopinfo.c'}, {'damage_type': 'backtrace', 'id': 2042821057, 'ino': 1099511641145, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.c'}, {'damage_type': 'backtrace', 'id': 2057805433, 'ino': 1099511641529, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evglock.c'}, {'damage_type': 'backtrace', 'id': 2073090595, 'ino': 1099511641496, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/amlcode.h'}, {'damage_type': 'backtrace', 'id': 2077952372, 'ino': 1099511641573, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwpci.c'}, {'damage_type': 'backtrace', 'id': 2100561825, 'ino': 1099511641683, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uthex.c'}, {'damage_type': 'backtrace', 'id': 2100777251, 'ino': 1099511641189, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.h'}, {'damage_type': 'backtrace', 'id': 2130158642, 'ino': 1099511641566, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exstorob.c'}, {'damage_type': 'backtrace', 'id': 2131322354, 'ino': 1099511641674, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utcache.c'}, {'damage_type': 'backtrace', 'id': 2132609636, 'ino': 1099511641499, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbconvert.c'}, {'damage_type': 'backtrace', 'id': 2137804459, 'ino': 1099511641176, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioprio.c'}, {'damage_type': 'backtrace', 'id': 2153273461, 'ino': 1099511641795, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/video_detect.c'}, {'damage_type': 'backtrace', 'id': 2165505569, 'ino': 1099511641716, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/ghes.c'}, {'damage_type': 'backtrace', 'id': 2186641358, 'ino': 1099511641656, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsmemory.c'}, {'damage_type': 'backtrace', 'id': 2187297885, 'ino': 1099511641156, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-rq-qos.h'}, {'damage_type': 'backtrace', 'id': 2189252655, 'ino': 1099511641167, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk.h'}, {'damage_type': 'backtrace', 'id': 2197976705, 'ino': 1099511641213, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sysv68.h'}, {'damage_type': 'backtrace', 'id': 2204841691, 'ino': 1099511641536, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evregion.c'}, {'damage_type': 'backtrace', 'id': 2206040355, 'ino': 1099511641473, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_tad.c'}, {'damage_type': 'backtrace', 'id': 2230881104, 'ino': 1099511641773, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/proc.c'}, {'damage_type': 'backtrace', 'id': 2232974011, 'ino': 1099511641215, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.h'}, {'damage_type': 'backtrace', 'id': 2238572910, 'ino': 1099511641521, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dspkginit.c'}, {'damage_type': 'backtrace', 'id': 2239460317, 'ino': 1099511641743, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hed.c'}, {'damage_type': 'backtrace', 'id': 2240993896, 'ino': 1099511641742, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/glue.c'}, {'damage_type': 'backtrace', 'id': 2255930474, 'ino': 1099511641492, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acresrc.h'}, {'damage_type': 'backtrace', 'id': 2266800560, 'ino': 1099511641673, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utbuffer.c'}, {'damage_type': 'backtrace', 'id': 2283873128, 'ino': 1099511641706, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxferror.c'}, {'damage_type': 'backtrace', 'id': 2289649586, 'ino': 1099511641138, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-merge.c'}, {'damage_type': 'backtrace', 'id': 2321566047, 'ino': 1099511641722, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bgrt.c'}, {'damage_type': 'backtrace', 'id': 2322925072, 'ino': 1099511641796, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/wakeup.c'}, {'damage_type': 'backtrace', 'id': 2332697512, 'ino': 1099511641726, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/cm_sbs.c'}, {'damage_type': 'backtrace', 'id': 2332865147, 'ino': 1099511641524, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswload.c'}, {'damage_type': 'backtrace', 'id': 2342434678, 'ino': 1099511641652, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsinfo.c'}, {'damage_type': 'backtrace', 'id': 2349278979, 'ino': 1099511641478, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acconvert.h'}, {'damage_type': 'backtrace', 'id': 2351909684, 'ino': 1099511641774, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_core.c'}, {'damage_type': 'backtrace', 'id': 2353555162, 'ino': 1099511641791, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sysfs.c'}, {'damage_type': 'backtrace', 'id': 2358691215, 'ino': 1099511641719, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/gtdt.c'}, {'damage_type': 'backtrace', 'id': 2365052796, 'ino': 1099511641498, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbcmds.c'}, {'damage_type': 'backtrace', 'id': 2371163525, 'ino': 1099511641759, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_irq.c'}, {'damage_type': 'backtrace', 'id': 2375361022, 'ino': 1099511641541, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfgpe.c'}, {'damage_type': 'backtrace', 'id': 2382759722, 'ino': 1099511641194, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.c'}, {'damage_type': 'backtrace', 'id': 2391715885, 'ino': 1099511641730, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/debugfs.c'}, {'damage_type': 'backtrace', 'id': 2407721159, 'ino': 1099511641654, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsirq.c'}, {'damage_type': 'backtrace', 'id': 2407860033, 'ino': 1099511641540, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evxfevnt.c'}, {'damage_type': 'backtrace', 'id': 2408195163, 'ino': 1099511641186, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.c'}, {'damage_type': 'backtrace', 'id': 2415194805, 'ino': 1099511641196, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ibm.c'}, {'damage_type': 'backtrace', 'id': 2421353267, 'ino': 1099511641533, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeutil.c'}, {'damage_type': 'backtrace', 'id': 2435960617, 'ino': 1099511641504, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbinput.c'}, {'damage_type': 'backtrace', 'id': 2442645019, 'ino': 1099511641626, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nspredef.c'}, {'damage_type': 'backtrace', 'id': 2444795076, 'ino': 1099511641530, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpe.c'}, {'damage_type': 'backtrace', 'id': 2453310811, 'ino': 1099511641757, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osi.c'}, {'damage_type': 'backtrace', 'id': 2459900072, 'ino': 1099511641516, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsinit.c'}, {'damage_type': 'backtrace', 'id': 2462057415, 'ino': 1099511641513, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dscontrol.c'}, {'damage_type': 'backtrace', 'id': 2462439628, 'ino': 1099511641520, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsopcode.c'}, {'damage_type': 'backtrace', 'id': 2482407972, 'ino': 1099511641725, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/button.c'}, {'damage_type': 'backtrace', 'id': 2488258515, 'ino': 1099511641761, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_mcfg.c'}, {'damage_type': 'backtrace', 'id': 2513108701, 'ino': 1099511641760, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_link.c'}, {'damage_type': 'backtrace', 'id': 2530540332, 'ino': 1099511641678, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdelete.c'}, {'damage_type': 'backtrace', 'id': 2547914337, 'ino': 1099511641762, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pci_root.c'}, {'damage_type': 'backtrace', 'id': 2563185244, 'ino': 1099511641124, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/bfq-iosched.h'}, {'damage_type': 'backtrace', 'id': 2573651300, 'ino': 1099511641501, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbexec.c'}, {'damage_type': 'backtrace', 'id': 2583560170, 'ino': 1099511641645, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/pswalk.c'}, {'damage_type': 'backtrace', 'id': 2615033275, 'ino': 1099511641676, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utdebug.c'}, {'damage_type': 'backtrace', 'id': 2616392978, 'ino': 1099511641646, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psxface.c'}, {'damage_type': 'backtrace', 'id': 2618620362, 'ino': 1099511641505, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbmethod.c'}, {'damage_type': 'backtrace', 'id': 2622140000, 'ino': 1099511641527, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswstate.c'}, {'damage_type': 'backtrace', 'id': 2623497010, 'ino': 1099511641784, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbs.c'}, {'damage_type': 'backtrace', 'id': 2624523116, 'ino': 1099511641150, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-virtio.c'}, {'damage_type': 'backtrace', 'id': 2631264631, 'ino': 1099511641547, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdebug.c'}, {'damage_type': 'backtrace', 'id': 2640939625, 'ino': 1099511642129, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/Kconfig'}, {'damage_type': 'backtrace', 'id': 2648428369, 'ino': 1099511641634, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfname.c'}, {'damage_type': 'backtrace', 'id': 2673270514, 'ino': 1099511641534, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evhandler.c'}, {'damage_type': 'backtrace', 'id': 2677252527, 'ino': 1099511641691, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utnonansi.c'}, {'damage_type': 'backtrace', 'id': 2704220775, 'ino': 1099511641574, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwregs.c'}, {'damage_type': 'backtrace', 'id': 2710737790, 'ino': 1099511641464, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_ipmi.c'}, {'damage_type': 'backtrace', 'id': 2715873574, 'ino': 1099511641509, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbtest.c'}, {'damage_type': 'backtrace', 'id': 2733861409, 'ino': 1099511641705, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxface.c'}, {'damage_type': 'backtrace', 'id': 2769706726, 'ino': 1099511641738, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec_sys.c'}, {'damage_type': 'backtrace', 'id': 2775345483, 'ino': 1099511641659, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsutils.c'}, {'damage_type': 'backtrace', 'id': 2775430705, 'ino': 1099511641758, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/osl.c'}, {'damage_type': 'backtrace', 'id': 2779420420, 'ino': 1099511641514, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsdebug.c'}, {'damage_type': 'backtrace', 'id': 2807499155, 'ino': 1099511641458, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_amba.c'}, {'damage_type': 'backtrace', 'id': 2818925061, 'ino': 1099511642132, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/dptf'}, {'damage_type': 'backtrace', 'id': 2823332246, 'ino': 1099511641779, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_thermal.c'}, {'damage_type': 'backtrace', 'id': 2829277535, 'ino': 1099511641493, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acstruct.h'}, {'damage_type': 'backtrace', 'id': 2840782783, 'ino': 1099511641648, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscalc.c'}, {'damage_type': 'backtrace', 'id': 2845091851, 'ino': 1099511641461, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_configfs.c'}, {'damage_type': 'backtrace', 'id': 2846669575, 'ino': 1099511642130, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64'}, {'damage_type': 'backtrace', 'id': 2864061061, 'ino': 1099511641710, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-base.c'}, {'damage_type': 'backtrace', 'id': 2883026173, 'ino': 1099511641579, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwxfsleep.c'}, {'damage_type': 'backtrace', 'id': 2884938336, 'ino': 1099511641772, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pptt.c'}, {'damage_type': 'backtrace', 'id': 2888444433, 'ino': 1099511641704, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utuuid.c'}, {'damage_type': 'backtrace', 'id': 2892149636, 'ino': 1099511641548, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exdump.c'}, {'damage_type': 'backtrace', 'id': 2893890557, 'ino': 1099511641651, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdumpinfo.c'}, {'damage_type': 'backtrace', 'id': 2895811211, 'ino': 1099511641631, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsutils.c'}, {'damage_type': 'backtrace', 'id': 2907526918, 'ino': 1099511641201, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ldm.h'}, {'damage_type': 'backtrace', 'id': 2968649463, 'ino': 1099511641198, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/karma.c'}, {'damage_type': 'backtrace', 'id': 2970122047, 'ino': 1099511641752, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/intel.h'}, {'damage_type': 'backtrace', 'id': 2988378623, 'ino': 1099511641729, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/custom_method.c'}, {'damage_type': 'backtrace', 'id': 2992392907, 'ino': 1099511642141, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/apple.c'}, {'damage_type': 'backtrace', 'id': 2996710108, 'ino': 1099511641662, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbfadt.c'}, {'damage_type': 'backtrace', 'id': 2999571124, 'ino': 1099511641699, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstate.c'}, {'damage_type': 'backtrace', 'id': 3003519094, 'ino': 1099511641748, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/irq.c'}, {'damage_type': 'backtrace', 'id': 3010098167, 'ino': 1099511641146, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-sched.h'}, {'damage_type': 'backtrace', 'id': 3012533925, 'ino': 1099511641701, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utstrsuppt.c'}, {'damage_type': 'backtrace', 'id': 3017218236, 'ino': 1099511641120, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Makefile'}, {'damage_type': 'backtrace', 'id': 3025933374, 'ino': 1099511641580, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsaccess.c'}, {'damage_type': 'backtrace', 'id': 3027111147, 'ino': 1099511641159, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.c'}, {'damage_type': 'backtrace', 'id': 3043506288, 'ino': 1099511641664, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbinstal.c'}, {'damage_type': 'backtrace', 'id': 3049115336, 'ino': 1099511641202, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/mac.c'}, {'damage_type': 'backtrace', 'id': 3049803444, 'ino': 1099511641482, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acglobal.h'}, {'damage_type': 'backtrace', 'id': 3051933475, 'ino': 1099511641606, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/Kconfig'}, {'damage_type': 'backtrace', 'id': 3058845248, 'ino': 1099511641793, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/thermal.c'}, {'damage_type': 'backtrace', 'id': 3067534083, 'ino': 1099511641153, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.c'}, {'damage_type': 'backtrace', 'id': 3075345878, 'ino': 1099511641764, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic.h'}, {'damage_type': 'backtrace', 'id': 3078150046, 'ino': 1099511641149, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-tag.h'}, {'damage_type': 'backtrace', 'id': 3079349178, 'ino': 1099511641568, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/extrace.c'}, {'damage_type': 'backtrace', 'id': 3087440570, 'ino': 1099511641667, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/tbxface.c'}, {'damage_type': 'backtrace', 'id': 3093636190, 'ino': 1099511641681, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utexcep.c'}, {'damage_type': 'backtrace', 'id': 3095954108, 'ino': 1099511641570, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwacpi.c'}, {'damage_type': 'backtrace', 'id': 3108714731, 'ino': 1099511641692, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utobject.c'}, {'damage_type': 'backtrace', 'id': 3123035108, 'ino': 1099511641560, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresnte.c'}, {'damage_type': 'backtrace', 'id': 3129378409, 'ino': 1099511641466, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_lpit.c'}, {'damage_type': 'backtrace', 'id': 3130450232, 'ino': 1099511641132, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-integrity.c'}, {'damage_type': 'backtrace', 'id': 3153204988, 'ino': 1099511641617, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsconvert.c'}, {'damage_type': 'backtrace', 'id': 3165187279, 'ino': 1099511641685, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utinit.c'}, {'damage_type': 'backtrace', 'id': 3183375492, 'ino': 1099511641188, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/atari.c'}, {'damage_type': 'backtrace', 'id': 3212452113, 'ino': 1099511641489, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acopcode.h'}, {'damage_type': 'backtrace', 'id': 3223618103, 'ino': 1099511641771, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/power.c'}, {'damage_type': 'backtrace', 'id': 3228380217, 'ino': 1099511641780, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_throttling.c'}, {'damage_type': 'backtrace', 'id': 3232295618, 'ino': 1099511641765, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_bxtwc.c'}, {'damage_type': 'backtrace', 'id': 3238085511, 'ino': 1099511641689, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmisc.c'}, {'damage_type': 'backtrace', 'id': 3261699459, 'ino': 1099511641571, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwesleep.c'}, {'damage_type': 'backtrace', 'id': 3282616241, 'ino': 1099511641797, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/x86/utils.c'}, {'damage_type': 'backtrace', 'id': 3287130096, 'ino': 1099511641604, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/Kconfig'}, {'damage_type': 'backtrace', 'id': 3293385623, 'ino': 1099511641746, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/internal.h'}, {'damage_type': 'backtrace', 'id': 3307640064, 'ino': 1099511641140, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-debugfs-zoned.c'}, {'damage_type': 'backtrace', 'id': 3341464787, 'ino': 1099511642134, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat'}, {'damage_type': 'backtrace', 'id': 3351441385, 'ino': 1099511641553, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exnames.c'}, {'damage_type': 'backtrace', 'id': 3354895548, 'ino': 1099511641769, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_xpower.c'}, {'damage_type': 'backtrace', 'id': 3375869242, 'ino': 1099511641510, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbutils.c'}, {'damage_type': 'backtrace', 'id': 3376351614, 'ino': 1099511641768, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/pmic/intel_pmic_crc.c'}, {'damage_type': 'backtrace', 'id': 3376729002, 'ino': 1099511641549, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfield.c'}, {'damage_type': 'backtrace', 'id': 3378369136, 'ino': 1099511641508, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbstats.c'}, {'damage_type': 'backtrace', 'id': 3383682502, 'ino': 1099511641781, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/property.c'}, {'damage_type': 'backtrace', 'id': 3383713542, 'ino': 1099511641623, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsnames.c'}, {'damage_type': 'backtrace', 'id': 3385109591, 'ino': 1099511641507, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbobject.c'}, {'damage_type': 'backtrace', 'id': 3401522372, 'ino': 1099511641511, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbxface.c'}, {'damage_type': 'backtrace', 'id': 3406797860, 'ino': 1099511641618, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsdump.c'}, {'damage_type': 'backtrace', 'id': 3416486257, 'ino': 1099511641135, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-iolatency.c'}, {'damage_type': 'backtrace', 'id': 3416590643, 'ino': 1099511641688, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utmath.c'}, {'damage_type': 'backtrace', 'id': 3424530554, 'ino': 1099511641131, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-flush.c'}, {'damage_type': 'backtrace', 'id': 3432040514, 'ino': 1099511641876, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/Makefile'}, {'damage_type': 'backtrace', 'id': 3453306275, 'ino': 1099511641737, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/ec.c'}, {'damage_type': 'backtrace', 'id': 3472127320, 'ino': 1099511641174, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/genhd.c'}, {'damage_type': 'backtrace', 'id': 3487042420, 'ino': 1099511641523, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswexec.c'}, {'damage_type': 'backtrace', 'id': 3490718695, 'ino': 1099511641165, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-wbt.h'}, {'damage_type': 'backtrace', 'id': 3494109665, 'ino': 1099511642137, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/Kconfig'}, {'damage_type': 'backtrace', 'id': 3494889446, 'ino': 1099511641753, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/mce.c'}, {'damage_type': 'backtrace', 'id': 3516238455, 'ino': 1099511641526, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dswscope.c'}, {'damage_type': 'backtrace', 'id': 3527995509, 'ino': 1099511641740, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/evged.c'}, {'damage_type': 'backtrace', 'id': 3530643424, 'ino': 1099511641195, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/efi.h'}, {'damage_type': 'backtrace', 'id': 3532994117, 'ino': 1099511641563, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exserial.c'}, {'damage_type': 'backtrace', 'id': 3540755488, 'ino': 1099511641139, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-mq-cpumap.c'}, {'damage_type': 'backtrace', 'id': 3540941941, 'ino': 1099511641209, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sgi.h'}, {'damage_type': 'backtrace', 'id': 3565507435, 'ino': 1099511641532, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evgpeinit.c'}, {'damage_type': 'backtrace', 'id': 3580561433, 'ino': 1099511641776, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/processor_idle.c'}, {'damage_type': 'backtrace', 'id': 3591491031, 'ino': 1099511641162, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-throttle.c'}, {'damage_type': 'backtrace', 'id': 3593885146, 'ino': 1099511641745, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/hmat/hmat.c'}, {'damage_type': 'backtrace', 'id': 3593961329, 'ino': 1099511641216, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/scsi_ioctl.c'}, {'damage_type': 'backtrace', 'id': 3598002516, 'ino': 1099511641133, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-ioc.c'}, {'damage_type': 'backtrace', 'id': 3605342716, 'ino': 1099511641698, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utresrc.c'}, {'damage_type': 'backtrace', 'id': 3655345277, 'ino': 1099511641562, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exresop.c'}, {'damage_type': 'backtrace', 'id': 3663502341, 'ino': 1099511641483, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/achware.h'}, {'damage_type': 'backtrace', 'id': 3686928690, 'ino': 1099511641576, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwtimer.c'}, {'damage_type': 'backtrace', 'id': 3691688194, 'ino': 1099511641708, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utxfmutex.c'}, {'damage_type': 'backtrace', 'id': 3692297133, 'ino': 1099511641577, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwvalid.c'}, {'damage_type': 'backtrace', 'id': 3698155362, 'ino': 1099511641693, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utosi.c'}, {'damage_type': 'backtrace', 'id': 3728705841, 'ino': 1099511641210, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/sun.c'}, {'damage_type': 'backtrace', 'id': 3734519530, 'ino': 1099511641786, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/sbshc.h'}, {'damage_type': 'backtrace', 'id': 3755854176, 'ino': 1099511641550, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exfldio.c'}, {'damage_type': 'backtrace', 'id': 3772542819, 'ino': 1099511641182, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/acorn.c'}, {'damage_type': 'backtrace', 'id': 3775444314, 'ino': 1099511641750, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/nfit/core.c'}, {'damage_type': 'backtrace', 'id': 3788419901, 'ino': 1099511641554, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/exoparg1.c'}, {'damage_type': 'backtrace', 'id': 3790152511, 'ino': 1099511641173, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/elevator.c'}, {'damage_type': 'backtrace', 'id': 3804441800, 'ino': 1099511641187, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/amiga.h'}, {'damage_type': 'backtrace', 'id': 3813517771, 'ino': 1099511641672, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utascii.c'}, {'damage_type': 'backtrace', 'id': 3826469283, 'ino': 1099511641572, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/hwgpe.c'}, {'damage_type': 'backtrace', 'id': 3867396447, 'ino': 1099511641468, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_memhotplug.c'}, {'damage_type': 'backtrace', 'id': 3883988010, 'ino': 1099511641679, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/uterror.c'}, {'damage_type': 'backtrace', 'id': 3894939169, 'ino': 1099511641128, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-cgroup.c'}, {'damage_type': 'backtrace', 'id': 3897911918, 'ino': 1099511641713, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/einj.c'}, {'damage_type': 'backtrace', 'id': 3899992596, 'ino': 1099511641515, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsfield.c'}, {'damage_type': 'backtrace', 'id': 3900048233, 'ino': 1099511641723, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/blacklist.c'}, {'damage_type': 'backtrace', 'id': 3909990700, 'ino': 1099511641718, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/arm64/Makefile'}, {'damage_type': 'backtrace', 'id': 3921438395, 'ino': 1099511641731, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/device_pm.c'}, {'damage_type': 'backtrace', 'id': 3926457691, 'ino': 1099511641682, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utglobal.c'}, {'damage_type': 'backtrace', 'id': 3930898695, 'ino': 1099511641477, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/accommon.h'}, {'damage_type': 'backtrace', 'id': 3940003541, 'ino': 1099511641633, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsxfeval.c'}, {'damage_type': 'backtrace', 'id': 3953822932, 'ino': 1099511641686, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utlock.c'}, {'damage_type': 'backtrace', 'id': 3965687655, 'ino': 1099511641724, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/bus.c'}, {'damage_type': 'backtrace', 'id': 3968115620, 'ino': 1099511641500, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbdisply.c'}, {'damage_type': 'backtrace', 'id': 3969602569, 'ino': 1099511641650, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsdump.c'}, {'damage_type': 'backtrace', 'id': 3970491380, 'ino': 1099511641717, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/hest.c'}, {'damage_type': 'backtrace', 'id': 3992840165, 'ino': 1099511641649, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rscreate.c'}, {'damage_type': 'backtrace', 'id': 3994400000, 'ino': 1099511641217, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/sed-opal.c'}, {'damage_type': 'backtrace', 'id': 4003665432, 'ino': 1099511641694, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/utownerid.c'}, {'damage_type': 'backtrace', 'id': 4011185281, 'ino': 1099511641647, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsaddr.c'}, {'damage_type': 'backtrace', 'id': 4020789672, 'ino': 1099511641160, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-stat.h'}, {'damage_type': 'backtrace', 'id': 4021836289, 'ino': 1099511641528, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/evevent.c'}, {'damage_type': 'backtrace', 'id': 4021962475, 'ino': 1099511641625, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsparse.c'}, {'damage_type': 'backtrace', 'id': 4038804793, 'ino': 1099511641214, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/ultrix.c'}, {'damage_type': 'backtrace', 'id': 4045108565, 'ino': 1099511641629, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nsrepair2.c'}, {'damage_type': 'backtrace', 'id': 4092786538, 'ino': 1099511641154, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-pm.h'}, {'damage_type': 'backtrace', 'id': 4094901587, 'ino': 1099511641712, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/bert.c'}, {'damage_type': 'backtrace', 'id': 4096105601, 'ino': 1099511641175, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/ioctl.c'}, {'damage_type': 'backtrace', 'id': 4101569478, 'ino': 1099511641787, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/scan.c'}, {'damage_type': 'backtrace', 'id': 4117759923, 'ino': 1099511641177, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/kyber-iosched.c'}, {'damage_type': 'backtrace', 'id': 4121507065, 'ino': 1099511641158, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/blk-softirq.c'}, {'damage_type': 'backtrace', 'id': 4122760522, 'ino': 1099511641642, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psscope.c'}, {'damage_type': 'backtrace', 'id': 4157687819, 'ino': 1099511641620, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/nseval.c'}, {'damage_type': 'backtrace', 'id': 4172609384, 'ino': 1099511641191, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/check.h'}, {'damage_type': 'backtrace', 'id': 4172753001, 'ino': 1099511641193, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/block/partitions/cmdline.h'}, {'damage_type': 'backtrace', 'id': 4173967666, 'ino': 1099511641517, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dsmethod.c'}, {'damage_type': 'backtrace', 'id': 4202120636, 'ino': 1099511641636, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/psargs.c'}, {'damage_type': 'backtrace', 'id': 4203366067, 'ino': 1099511641455, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/Makefile'}, {'damage_type': 'backtrace', 'id': 4220920159, 'ino': 1099511641711, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/apei/apei-internal.h'}, {'damage_type': 'backtrace', 'id': 4229969263, 'ino': 1099511641783, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/resource.c'}, {'damage_type': 'backtrace', 'id': 4244223367, 'ino': 1099511641660, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/rsxface.c'}, {'damage_type': 'backtrace', 'id': 4245465401, 'ino': 1099511641488, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acobject.h'}, {'damage_type': 'backtrace', 'id': 4277906601, 'ino': 1099511641502, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/dbfileio.c'}, {'damage_type': 'backtrace', 'id': 4284645662, 'ino': 1099511641459, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpi_apd.c'}, {'damage_type': 'backtrace', 'id': 4288022397, 'ino': 1099511641476, 'path': '/volumes/_nogroup/sv_1/e5637e95-292b-4ecb-84bd-f467baf5f25a/client.0/tmp/t/linux-5.4/drivers/acpi/acpica/acapps.h'}] 2023-10-26T06:49:23.174 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-26T06:49:23.182 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/pstree.o 2023-10-26T06:49:23.192 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/power/cpu.o 2023-10-26T06:49:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:22 smithi153 ceph-mon[131657]: pgmap v490: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 1.0 MiB/s wr, 87 op/s 2023-10-26T06:49:23.360 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/lockd/built-in.a 2023-10-26T06:49:23.404 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/pcm_native.o 2023-10-26T06:49:23.415 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/dir.o 2023-10-26T06:49:23.597 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psutils.o 2023-10-26T06:49:24.024 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/pswalk.o 2023-10-26T06:49:24.072 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/tsc_sync.o 2023-10-26T06:49:24.157 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/power/hibernate_64.o 2023-10-26T06:49:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:24 smithi125 ceph-mon[130643]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 1.2 MiB/s wr, 91 op/s 2023-10-26T06:49:24.453 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/psxface.o 2023-10-26T06:49:24.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:24 smithi153 ceph-mon[131657]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 1.2 MiB/s wr, 91 op/s 2023-10-26T06:49:24.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:24 smithi050 ceph-mon[94997]: pgmap v491: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 1.2 MiB/s wr, 91 op/s 2023-10-26T06:49:24.549 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/block/loop.o 2023-10-26T06:49:24.558 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/setup_percpu.o 2023-10-26T06:49:24.591 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sysctl_binary.o 2023-10-26T06:49:24.873 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsaddr.o 2023-10-26T06:49:24.885 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/power/hibernate_asm_64.o 2023-10-26T06:49:24.930 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/regmap/regcache.o 2023-10-26T06:49:24.979 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/power/hibernate.o 2023-10-26T06:49:25.225 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/pcm_lib.o 2023-10-26T06:49:25.239 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/mpparse.o 2023-10-26T06:49:25.284 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rscalc.o 2023-10-26T06:49:25.435 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/capability.o 2023-10-26T06:49:25.451 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/file.o 2023-10-26T06:49:25.712 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/regmap/regcache-rbtree.o 2023-10-26T06:49:25.736 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/power/built-in.a 2023-10-26T06:49:25.780 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/ptrace.o 2023-10-26T06:49:25.786 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rscreate.o 2023-10-26T06:49:25.966 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/block/built-in.a 2023-10-26T06:49:26.016 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/base/test/built-in.a 2023-10-26T06:49:26.061 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/trace_clock.o 2023-10-26T06:49:26.137 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs_common/nfsacl.o 2023-10-26T06:49:26.258 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/machine_kexec_64.o 2023-10-26T06:49:26.265 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsdumpinfo.o 2023-10-26T06:49:26.281 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/bus/built-in.a 2023-10-26T06:49:26.322 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs_common/grace.o 2023-10-26T06:49:26.374 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/regmap/regcache-flat.o 2023-10-26T06:49:26.643 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/pcm_misc.o 2023-10-26T06:49:26.698 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsinfo.o 2023-10-26T06:49:26.805 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/regmap/regmap-debugfs.o 2023-10-26T06:49:26.870 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/user.o 2023-10-26T06:49:26.902 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/firewire/built-in.a 2023-10-26T06:49:26.941 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/getroot.o 2023-10-26T06:49:26.945 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/reboot.o 2023-10-26T06:49:27.052 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/nfs_common/built-in.a 2023-10-26T06:49:27.100 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/regmap/regmap-i2c.o 2023-10-26T06:49:27.159 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/kernel/relocate_kernel_64.o 2023-10-26T06:49:27.159 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsio.o 2023-10-26T06:49:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:26 smithi125 ceph-mon[130643]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 973 KiB/s wr, 83 op/s 2023-10-26T06:49:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:26 smithi153 ceph-mon[131657]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 973 KiB/s wr, 83 op/s 2023-10-26T06:49:27.245 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/crash.o 2023-10-26T06:49:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:26 smithi050 ceph-mon[94997]: pgmap v492: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 973 KiB/s wr, 83 op/s 2023-10-26T06:49:27.307 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/pcm_memory.o 2023-10-26T06:49:27.400 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/signal.o 2023-10-26T06:49:27.482 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/component.o 2023-10-26T06:49:27.560 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsirq.o 2023-10-26T06:49:27.579 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/core.o 2023-10-26T06:49:27.690 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/base/regmap/built-in.a 2023-10-26T06:49:27.782 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/video/fbdev.o 2023-10-26T06:49:27.920 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/crash_dump_64.o 2023-10-26T06:49:27.923 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/inode.o 2023-10-26T06:49:27.960 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rslist.o 2023-10-26T06:49:28.011 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/memalloc.o 2023-10-26T06:49:28.244 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nls/nls_base.o 2023-10-26T06:49:28.395 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsmemory.o 2023-10-26T06:49:28.416 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/video/built-in.a 2023-10-26T06:49:28.473 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cdrom/cdrom.o 2023-10-26T06:49:28.493 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/module.o 2023-10-26T06:49:28.593 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/pcm_timer.o 2023-10-26T06:49:28.741 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nls/nls_cp437.o 2023-10-26T06:49:28.792 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsmisc.o 2023-10-26T06:49:29.107 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/doublefault.o 2023-10-26T06:49:29.137 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nls/nls_ascii.o 2023-10-26T06:49:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:28 smithi125 ceph-mon[130643]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2023-10-26T06:49:29.177 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/sgbuf.o 2023-10-26T06:49:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:28 smithi153 ceph-mon[131657]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2023-10-26T06:49:29.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:28 smithi050 ceph-mon[94997]: pgmap v493: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2023-10-26T06:49:29.277 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/bus.o 2023-10-26T06:49:29.294 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsserial.o 2023-10-26T06:49:29.553 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nls/nls_iso8859-1.o 2023-10-26T06:49:29.671 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sys.o 2023-10-26T06:49:29.707 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsutils.o 2023-10-26T06:49:29.774 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/early_printk.o 2023-10-26T06:49:29.790 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/core/seq_device.o 2023-10-26T06:49:29.894 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/super.o 2023-10-26T06:49:29.960 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nls/nls_utf8.o 2023-10-26T06:49:29.993 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/cdrom/built-in.a 2023-10-26T06:49:30.048 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/io.o 2023-10-26T06:49:30.057 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/dd.o 2023-10-26T06:49:30.205 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/rsxface.o 2023-10-26T06:49:30.354 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/nls/built-in.a 2023-10-26T06:49:30.389 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/core/built-in.a 2023-10-26T06:49:30.426 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hda_bus_type.o 2023-10-26T06:49:30.464 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/syscore.o 2023-10-26T06:49:30.612 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/hpet.o 2023-10-26T06:49:30.707 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbdata.o 2023-10-26T06:49:30.878 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_bus.o 2023-10-26T06:49:31.057 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/umh.o 2023-10-26T06:49:31.085 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/backend.o 2023-10-26T06:49:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:30 smithi125 ceph-mon[130643]: pgmap v494: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 1.1 MiB/s wr, 84 op/s 2023-10-26T06:49:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:30 smithi153 ceph-mon[131657]: pgmap v494: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 1.1 MiB/s wr, 84 op/s 2023-10-26T06:49:31.266 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbfadt.o 2023-10-26T06:49:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:30 smithi050 ceph-mon[94997]: pgmap v494: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 1.1 MiB/s wr, 84 op/s 2023-10-26T06:49:31.345 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/driver.o 2023-10-26T06:49:31.461 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/frontend.o 2023-10-26T06:49:31.466 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/amd_nb.o 2023-10-26T06:49:31.603 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_device.o 2023-10-26T06:49:31.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/direct.o 2023-10-26T06:49:31.796 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbfind.o 2023-10-26T06:49:31.884 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/class.o 2023-10-26T06:49:31.885 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/dnotify/dnotify.o 2023-10-26T06:49:31.990 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/workqueue.o 2023-10-26T06:49:32.224 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbinstal.o 2023-10-26T06:49:32.251 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/pcspeaker.o 2023-10-26T06:49:32.328 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/generic.o 2023-10-26T06:49:32.499 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_sysfs.o 2023-10-26T06:49:32.541 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/notify/dnotify/built-in.a 2023-10-26T06:49:32.597 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/notify/fanotify/built-in.a 2023-10-26T06:49:32.607 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/platform.o 2023-10-26T06:49:32.648 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/check.o 2023-10-26T06:49:32.652 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbprint.o 2023-10-26T06:49:32.661 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/inotify/inotify_fsnotify.o 2023-10-26T06:49:32.872 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/pagelist.o 2023-10-26T06:49:33.095 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbutils.o 2023-10-26T06:49:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:32 smithi125 ceph-mon[130643]: pgmap v495: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:49:33.180 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/inotify/inotify_user.o 2023-10-26T06:49:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:32 smithi153 ceph-mon[131657]: pgmap v495: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:49:33.239 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/pci-swiotlb.o 2023-10-26T06:49:33.248 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_regmap.o 2023-10-26T06:49:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:32 smithi050 ceph-mon[94997]: pgmap v495: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:49:33.388 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/isoch.o 2023-10-26T06:49:33.566 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbxface.o 2023-10-26T06:49:33.652 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/cpu.o 2023-10-26T06:49:33.811 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/uprobes.o 2023-10-26T06:49:33.916 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_controller.o 2023-10-26T06:49:34.053 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbxfload.o 2023-10-26T06:49:34.084 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/notify/inotify/built-in.a 2023-10-26T06:49:34.086 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/compat_ioctl.o 2023-10-26T06:49:34.137 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/fsnotify.o 2023-10-26T06:49:34.273 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/pid.o 2023-10-26T06:49:34.277 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/read.o 2023-10-26T06:49:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:34 smithi125 ceph-mon[130643]: pgmap v496: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2023-10-26T06:49:34.428 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/firmware.o 2023-10-26T06:49:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:34 smithi153 ceph-mon[131657]: pgmap v496: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2023-10-26T06:49:34.509 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/tbxfroot.o 2023-10-26T06:49:34.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:34 smithi050 ceph-mon[94997]: pgmap v496: 97 pgs: 97 active+clean; 1.4 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2023-10-26T06:49:34.592 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/sysfb.o 2023-10-26T06:49:34.672 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_stream.o 2023-10-26T06:49:34.729 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/amd64-agp.o 2023-10-26T06:49:34.833 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/init.o 2023-10-26T06:49:34.862 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/notification.o 2023-10-26T06:49:34.945 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utaddress.o 2023-10-26T06:49:35.197 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/sysfb_efi.o 2023-10-26T06:49:35.247 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/map.o 2023-10-26T06:49:35.260 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/task_work.o 2023-10-26T06:49:35.375 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utalloc.o 2023-10-26T06:49:35.462 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/array.o 2023-10-26T06:49:35.476 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/intel-agp.o 2023-10-26T06:49:35.487 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/group.o 2023-10-26T06:49:35.641 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/symlink.o 2023-10-26T06:49:35.690 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/devres.o 2023-10-26T06:49:35.812 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utascii.o 2023-10-26T06:49:35.971 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/extable.o 2023-10-26T06:49:36.028 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdmi_chmap.o 2023-10-26T06:49:36.046 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/perf_regs.o 2023-10-26T06:49:36.198 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/mark.o 2023-10-26T06:49:36.217 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/agp/intel-gtt.o 2023-10-26T06:49:36.245 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utbuffer.o 2023-10-26T06:49:36.413 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/attribute_container.o 2023-10-26T06:49:36.642 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/unlink.o 2023-10-26T06:49:36.703 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/tracepoint.o 2023-10-26T06:49:36.713 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utcopy.o 2023-10-26T06:49:36.898 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/params.o 2023-10-26T06:49:36.914 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/trace.o 2023-10-26T06:49:37.006 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/transport_class.o 2023-10-26T06:49:37.087 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/notify/fdinfo.o 2023-10-26T06:49:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:36 smithi125 ceph-mon[130643]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 949 KiB/s wr, 57 op/s 2023-10-26T06:49:37.183 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/itmt.o 2023-10-26T06:49:37.195 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/char/agp/built-in.a 2023-10-26T06:49:37.224 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utexcep.o 2023-10-26T06:49:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:36 smithi153 ceph-mon[131657]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 949 KiB/s wr, 57 op/s 2023-10-26T06:49:37.253 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/hw_random/core.o 2023-10-26T06:49:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:36 smithi050 ceph-mon[94997]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 949 KiB/s wr, 57 op/s 2023-10-26T06:49:37.458 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/topology.o 2023-10-26T06:49:37.637 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utdebug.o 2023-10-26T06:49:37.675 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/notify/built-in.a 2023-10-26T06:49:37.685 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_component.o 2023-10-26T06:49:37.728 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/umip.o 2023-10-26T06:49:37.732 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/char/ipmi/built-in.a 2023-10-26T06:49:37.778 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/hdac_i915.o 2023-10-26T06:49:37.928 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/kthread.o 2023-10-26T06:49:37.992 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/hw_random/via-rng.o 2023-10-26T06:49:38.006 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/write.o 2023-10-26T06:49:38.022 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/container.o 2023-10-26T06:49:38.048 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utdecode.o 2023-10-26T06:49:38.345 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/unwind_orc.o 2023-10-26T06:49:38.401 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/hda/intel-nhlt.o 2023-10-26T06:49:38.408 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/char/hw_random/built-in.a 2023-10-26T06:49:38.427 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/property.o 2023-10-26T06:49:38.455 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/char/pcmcia/built-in.a 2023-10-26T06:49:38.472 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/802/fddi.o 2023-10-26T06:49:38.483 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utdelete.o 2023-10-26T06:49:38.504 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/mem.o 2023-10-26T06:49:38.940 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/hda/built-in.a 2023-10-26T06:49:38.960 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/uterror.o 2023-10-26T06:49:38.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/sys_ni.o 2023-10-26T06:49:39.052 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/i2c/other/built-in.a 2023-10-26T06:49:39.057 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/audit_64.o 2023-10-26T06:49:39.086 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/i2c/built-in.a 2023-10-26T06:49:39.136 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/ad1816a/built-in.a 2023-10-26T06:49:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:38 smithi125 ceph-mon[130643]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2023-10-26T06:49:39.173 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/ad1848/built-in.a 2023-10-26T06:49:39.186 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/nsproxy.o 2023-10-26T06:49:39.213 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/cs423x/built-in.a 2023-10-26T06:49:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:38 smithi153 ceph-mon[131657]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2023-10-26T06:49:39.250 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/es1688/built-in.a 2023-10-26T06:49:39.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:38 smithi050 ceph-mon[94997]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2023-10-26T06:49:39.294 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/galaxy/built-in.a 2023-10-26T06:49:39.334 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/gus/built-in.a 2023-10-26T06:49:39.356 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/random.o 2023-10-26T06:49:39.370 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/uteval.o 2023-10-26T06:49:39.376 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/msnd/built-in.a 2023-10-26T06:49:39.417 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/opti9xx/built-in.a 2023-10-26T06:49:39.459 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/802/built-in.a 2023-10-26T06:49:39.465 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/sb/built-in.a 2023-10-26T06:49:39.534 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/wavefront/built-in.a 2023-10-26T06:49:39.598 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/wss/built-in.a 2023-10-26T06:49:39.615 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/bpf/built-in.a 2023-10-26T06:49:39.629 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/isa/built-in.a 2023-10-26T06:49:39.652 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/pci-calgary_64.o 2023-10-26T06:49:39.674 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/sock.o 2023-10-26T06:49:39.719 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/mips/built-in.a 2023-10-26T06:49:39.742 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/cacheinfo.o 2023-10-26T06:49:39.760 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/parisc/built-in.a 2023-10-26T06:49:39.812 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/ac97/built-in.a 2023-10-26T06:49:39.851 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utglobal.o 2023-10-26T06:49:39.854 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/ali5451/built-in.a 2023-10-26T06:49:39.894 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/asihpi/built-in.a 2023-10-26T06:49:39.935 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/au88x0/built-in.a 2023-10-26T06:49:39.977 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/aw2/built-in.a 2023-10-26T06:49:40.019 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/ca0106/built-in.a 2023-10-26T06:49:40.065 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/cs46xx/built-in.a 2023-10-26T06:49:40.071 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/notifier.o 2023-10-26T06:49:40.076 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/namespace.o 2023-10-26T06:49:40.105 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/cs5535audio/built-in.a 2023-10-26T06:49:40.149 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/ctxfi/built-in.a 2023-10-26T06:49:40.190 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/echoaudio/built-in.a 2023-10-26T06:49:40.231 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/emu10k1/built-in.a 2023-10-26T06:49:40.254 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/uthex.o 2023-10-26T06:49:40.286 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_bind.o 2023-10-26T06:49:40.432 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/devcon.o 2023-10-26T06:49:40.669 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/tce_64.o 2023-10-26T06:49:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utids.o 2023-10-26T06:49:40.843 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/ksysfs.o 2023-10-26T06:49:40.887 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/swnode.o 2023-10-26T06:49:40.937 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_codec.o 2023-10-26T06:49:41.125 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/mount_clnt.o 2023-10-26T06:49:41.153 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utinit.o 2023-10-26T06:49:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:40 smithi125 ceph-mon[130643]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2023-10-26T06:49:41.234 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/misc.o 2023-10-26T06:49:41.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:40 smithi153 ceph-mon[131657]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2023-10-26T06:49:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:40 smithi050 ceph-mon[94997]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2023-10-26T06:49:41.290 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/mmconf-fam10h_64.o 2023-10-26T06:49:41.488 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/cred.o 2023-10-26T06:49:41.592 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utlock.o 2023-10-26T06:49:41.618 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/devtmpfs.o 2023-10-26T06:49:41.841 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/hpet.o 2023-10-26T06:49:41.978 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/vsmp_64.o 2023-10-26T06:49:42.026 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/request_sock.o 2023-10-26T06:49:42.055 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utmath.o 2023-10-26T06:49:42.221 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfstrace.o 2023-10-26T06:49:42.384 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/kernel/head_64.o 2023-10-26T06:49:42.437 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/reboot.o 2023-10-26T06:49:42.469 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/node.o 2023-10-26T06:49:42.470 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utmisc.o 2023-10-26T06:49:42.547 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/head64.o 2023-10-26T06:49:42.709 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/char/nvram.o 2023-10-26T06:49:42.873 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_jack.o 2023-10-26T06:49:42.909 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utmutex.o 2023-10-26T06:49:42.986 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/skbuff.o 2023-10-26T06:49:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:42 smithi125 ceph-mon[130643]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-26T06:49:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:42 smithi153 ceph-mon[131657]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-26T06:49:43.253 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/ebda.o 2023-10-26T06:49:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:42 smithi050 ceph-mon[94997]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 1.3 MiB/s wr, 96 op/s 2023-10-26T06:49:43.303 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/module.o 2023-10-26T06:49:43.350 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utnonansi.o 2023-10-26T06:49:43.355 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/async.o 2023-10-26T06:49:43.447 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/char/built-in.a 2023-10-26T06:49:43.494 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/base/platform-msi.o 2023-10-26T06:49:43.708 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_auto_parser.o 2023-10-26T06:49:43.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/nvs.o 2023-10-26T06:49:43.764 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/kernel/platform-quirks.o 2023-10-26T06:49:43.776 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utobject.o 2023-10-26T06:49:43.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/range.o 2023-10-26T06:49:44.025 INFO:tasks.workunit.client.0.smithi050.stdout: LDS arch/x86/kernel/vmlinux.lds 2023-10-26T06:49:44.082 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/base/built-in.a 2023-10-26T06:49:44.136 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/kernel/built-in.a 2023-10-26T06:49:44.188 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/smpboot.o 2023-10-26T06:49:44.248 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utosi.o 2023-10-26T06:49:44.301 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/export.o 2023-10-26T06:49:44.330 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/built-in.a 2023-10-26T06:49:44.341 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/task_mmu.o 2023-10-26T06:49:44.381 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/dquot.o 2023-10-26T06:49:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:44 smithi125 ceph-mon[130643]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2023-10-26T06:49:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:44 smithi153 ceph-mon[131657]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2023-10-26T06:49:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:44 smithi050 ceph-mon[94997]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2023-10-26T06:49:44.591 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/quota_v2.o 2023-10-26T06:49:44.608 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_sysfs.o 2023-10-26T06:49:44.717 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utownerid.o 2023-10-26T06:49:44.819 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/ucount.o 2023-10-26T06:49:45.151 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utpredef.o 2023-10-26T06:49:45.188 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utresdecode.o 2023-10-26T06:49:45.225 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_controller.o 2023-10-26T06:49:45.320 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/kmod.o 2023-10-26T06:49:45.501 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/sysfs.o 2023-10-26T06:49:45.568 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/inode.o 2023-10-26T06:49:45.587 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/dns_resolver/dns_key.o 2023-10-26T06:49:45.595 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utresrc.o 2023-10-26T06:49:45.970 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/quota_tree.o 2023-10-26T06:49:46.041 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utstate.o 2023-10-26T06:49:46.154 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/groups.o 2023-10-26T06:49:46.215 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/dns_resolver/dns_query.o 2023-10-26T06:49:46.276 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/root.o 2023-10-26T06:49:46.398 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/datagram.o 2023-10-26T06:49:46.416 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_proc.o 2023-10-26T06:49:46.470 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utstring.o 2023-10-26T06:49:46.510 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfsroot.o 2023-10-26T06:49:46.684 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/quota.o 2023-10-26T06:49:46.933 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/base.o 2023-10-26T06:49:46.936 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utstrsuppt.o 2023-10-26T06:49:46.954 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/dns_resolver/built-in.a 2023-10-26T06:49:46.954 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/freezer.o 2023-10-26T06:49:47.052 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/stream.o 2023-10-26T06:49:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:46 smithi125 ceph-mon[130643]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-10-26T06:49:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:46 smithi153 ceph-mon[131657]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-10-26T06:49:47.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:46 smithi050 ceph-mon[94997]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-10-26T06:49:47.390 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_hwdep.o 2023-10-26T06:49:47.398 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utstrtoul64.o 2023-10-26T06:49:47.611 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/sysctl.o 2023-10-26T06:49:47.682 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/generic.o 2023-10-26T06:49:47.700 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/kqid.o 2023-10-26T06:49:47.761 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/profile.o 2023-10-26T06:49:47.806 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utxface.o 2023-10-26T06:49:48.002 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/pci/hda/hda_intel.o 2023-10-26T06:49:48.129 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/scm.o 2023-10-26T06:49:48.185 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/compat.o 2023-10-26T06:49:48.305 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utxfinit.o 2023-10-26T06:49:48.473 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/actions/built-in.a 2023-10-26T06:49:48.493 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/array.o 2023-10-26T06:49:48.514 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/analogbits/built-in.a 2023-10-26T06:49:48.557 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/bcm/built-in.a 2023-10-26T06:49:48.569 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/stacktrace.o 2023-10-26T06:49:48.588 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs2super.o 2023-10-26T06:49:48.605 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/imgtec/built-in.a 2023-10-26T06:49:48.653 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/imx/built-in.a 2023-10-26T06:49:48.706 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/ingenic/built-in.a 2023-10-26T06:49:48.726 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utxferror.o 2023-10-26T06:49:48.752 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/mediatek/built-in.a 2023-10-26T06:49:48.795 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/mvebu/built-in.a 2023-10-26T06:49:48.841 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/renesas/built-in.a 2023-10-26T06:49:48.851 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/quota/netlink.o 2023-10-26T06:49:48.890 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/ti/built-in.a 2023-10-26T06:49:48.944 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/x86/clk-pmc-atom.o 2023-10-26T06:49:49.167 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpica/utxfmutex.o 2023-10-26T06:49:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:48 smithi125 ceph-mon[130643]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2023-10-26T06:49:49.188 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/gen_stats.o 2023-10-26T06:49:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:48 smithi153 ceph-mon[131657]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2023-10-26T06:49:49.261 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/hda/built-in.a 2023-10-26T06:49:49.266 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/futex.o 2023-10-26T06:49:49.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:48 smithi050 ceph-mon[94997]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2023-10-26T06:49:49.329 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/ice1712/built-in.a 2023-10-26T06:49:49.376 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/korg1212/built-in.a 2023-10-26T06:49:49.420 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/lola/built-in.a 2023-10-26T06:49:49.446 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/fd.o 2023-10-26T06:49:49.466 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/lx6464es/built-in.a 2023-10-26T06:49:49.496 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/x86/built-in.a 2023-10-26T06:49:49.506 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/mixart/built-in.a 2023-10-26T06:49:49.534 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/quota/built-in.a 2023-10-26T06:49:49.543 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/nm256/built-in.a 2023-10-26T06:49:49.549 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/proc.o 2023-10-26T06:49:49.552 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-devres.o 2023-10-26T06:49:49.583 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/oxygen/built-in.a 2023-10-26T06:49:49.585 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/wakeup.o 2023-10-26T06:49:49.604 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/acpi/acpica/built-in.a 2023-10-26T06:49:49.622 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/pcxhr/built-in.a 2023-10-26T06:49:49.661 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/riptide/built-in.a 2023-10-26T06:49:49.700 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/rme9652/built-in.a 2023-10-26T06:49:49.742 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/trident/built-in.a 2023-10-26T06:49:49.788 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/vx222/built-in.a 2023-10-26T06:49:49.828 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/ymfpci/built-in.a 2023-10-26T06:49:49.864 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pci/built-in.a 2023-10-26T06:49:49.928 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crypto/aes.o 2023-10-26T06:49:50.004 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/gen_estimator.o 2023-10-26T06:49:50.039 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-bulk.o 2023-10-26T06:49:50.044 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pcmcia/pdaudiocf/built-in.a 2023-10-26T06:49:50.084 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pcmcia/vx/built-in.a 2023-10-26T06:49:50.099 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/sleep.o 2023-10-26T06:49:50.114 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/pcmcia/built-in.a 2023-10-26T06:49:50.122 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/proc_tty.o 2023-10-26T06:49:50.160 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/ppc/built-in.a 2023-10-26T06:49:50.198 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/sh/built-in.a 2023-10-26T06:49:50.237 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/soc/built-in.a 2023-10-26T06:49:50.281 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/sparc/built-in.a 2023-10-26T06:49:50.326 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/spi/built-in.a 2023-10-26T06:49:50.378 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/synth/emux/built-in.a 2023-10-26T06:49:50.412 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/synth/built-in.a 2023-10-26T06:49:50.466 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/6fire/built-in.a 2023-10-26T06:49:50.505 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/bcd2000/built-in.a 2023-10-26T06:49:50.531 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crypto/arc4.o 2023-10-26T06:49:50.547 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/caiaq/built-in.a 2023-10-26T06:49:50.582 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clkdev.o 2023-10-26T06:49:50.588 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/hiface/built-in.a 2023-10-26T06:49:50.627 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/misc/built-in.a 2023-10-26T06:49:50.660 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/cmdline.o 2023-10-26T06:49:50.671 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/usx2y/built-in.a 2023-10-26T06:49:50.688 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs2xdr.o 2023-10-26T06:49:50.708 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/usb/built-in.a 2023-10-26T06:49:50.777 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/x86/built-in.a 2023-10-26T06:49:50.821 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/xen/built-in.a 2023-10-26T06:49:50.856 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/dma.o 2023-10-26T06:49:50.881 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/sound_core.o 2023-10-26T06:49:50.927 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crypto/des.o 2023-10-26T06:49:50.969 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/net_namespace.o 2023-10-26T06:49:51.111 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/consoles.o 2023-10-26T06:49:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:50 smithi125 ceph-mon[130643]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2023-10-26T06:49:51.180 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/device_sysfs.o 2023-10-26T06:49:51.187 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk.o 2023-10-26T06:49:51.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:50 smithi153 ceph-mon[131657]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2023-10-26T06:49:51.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:50 smithi050 ceph-mon[94997]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2023-10-26T06:49:51.324 INFO:tasks.workunit.client.0.smithi050.stdout: CC sound/last.o 2023-10-26T06:49:51.347 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/smp.o 2023-10-26T06:49:51.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/cpuinfo.o 2023-10-26T06:49:51.692 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crypto/sha256.o 2023-10-26T06:49:51.872 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/device_pm.o 2023-10-26T06:49:51.888 INFO:tasks.workunit.client.0.smithi050.stdout: AR sound/built-in.a 2023-10-26T06:49:51.985 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs3super.o 2023-10-26T06:49:52.039 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/fonts/fonts.o 2023-10-26T06:49:52.091 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/uid16.o 2023-10-26T06:49:52.145 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/devices.o 2023-10-26T06:49:52.383 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/secure_seq.o 2023-10-26T06:49:52.466 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/fonts/font_8x8.o 2023-10-26T06:49:52.475 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/crypto/built-in.a 2023-10-26T06:49:52.526 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs3client.o 2023-10-26T06:49:52.589 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/fonts/font_8x16.o 2023-10-26T06:49:52.598 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/interrupts.o 2023-10-26T06:49:52.889 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/proc.o 2023-10-26T06:49:52.964 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/fonts/built-in.a 2023-10-26T06:49:52.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/module.o 2023-10-26T06:49:53.043 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/lz4/lz4_decompress.o 2023-10-26T06:49:53.048 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clocksource/acpi_pm.o 2023-10-26T06:49:53.066 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/loadavg.o 2023-10-26T06:49:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:52 smithi125 ceph-mon[130643]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2023-10-26T06:49:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:52 smithi153 ceph-mon[131657]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2023-10-26T06:49:53.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:52 smithi050 ceph-mon[94997]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.3 MiB/s wr, 133 op/s 2023-10-26T06:49:53.380 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-divider.o 2023-10-26T06:49:53.440 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/flow_dissector.o 2023-10-26T06:49:53.523 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs3proc.o 2023-10-26T06:49:53.592 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/meminfo.o 2023-10-26T06:49:53.606 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/bus.o 2023-10-26T06:49:53.656 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clocksource/i8253.o 2023-10-26T06:49:54.000 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-fixed-factor.o 2023-10-26T06:49:54.079 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clocksource/built-in.a 2023-10-26T06:49:54.088 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/lz4/built-in.a 2023-10-26T06:49:54.151 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/lzo/lzo1x_compress.o 2023-10-26T06:49:54.164 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ethernet/eth.o 2023-10-26T06:49:54.316 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/stat.o 2023-10-26T06:49:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:54 smithi125 ceph-mon[130643]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.2 MiB/s wr, 108 op/s 2023-10-26T06:49:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:54 smithi153 ceph-mon[131657]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.2 MiB/s wr, 108 op/s 2023-10-26T06:49:54.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:54 smithi050 ceph-mon[94997]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 1.2 MiB/s wr, 108 op/s 2023-10-26T06:49:54.579 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-fixed-rate.o 2023-10-26T06:49:54.629 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/glue.o 2023-10-26T06:49:54.720 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/lzo/lzo1x_decompress_safe.o 2023-10-26T06:49:54.817 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs3xdr.o 2023-10-26T06:49:54.975 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/uptime.o 2023-10-26T06:49:55.182 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/sysctl_net_core.o 2023-10-26T06:49:55.190 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-gate.o 2023-10-26T06:49:55.250 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/lzo/built-in.a 2023-10-26T06:49:55.308 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/kallsyms.o 2023-10-26T06:49:55.329 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/div64.o 2023-10-26T06:49:55.398 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/ethernet/built-in.a 2023-10-26T06:49:55.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:55 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:49:55.432 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/scan.o 2023-10-26T06:49:55.451 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs3acl.o 2023-10-26T06:49:55.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:55 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:49:55.506 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/util.o 2023-10-26T06:49:55.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:55 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:49:55.537 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/gcd.o 2023-10-26T06:49:55.751 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/lcm.o 2023-10-26T06:49:55.757 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-multiplier.o 2023-10-26T06:49:56.008 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/int_pow.o 2023-10-26T06:49:56.015 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/version.o 2023-10-26T06:49:56.272 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/int_sqrt.o 2023-10-26T06:49:56.326 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-mux.o 2023-10-26T06:49:56.330 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/dev.o 2023-10-26T06:49:56.395 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/acct.o 2023-10-26T06:49:56.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:56 smithi125 ceph-mon[130643]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2023-10-26T06:49:56.467 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/reciprocal_div.o 2023-10-26T06:49:56.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:56 smithi153 ceph-mon[131657]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2023-10-26T06:49:56.508 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-lshift.o 2023-10-26T06:49:56.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:56 smithi050 ceph-mon[94997]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2023-10-26T06:49:56.548 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/softirqs.o 2023-10-26T06:49:56.588 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4proc.o 2023-10-26T06:49:56.664 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/math/rational.o 2023-10-26T06:49:56.681 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/resource.o 2023-10-26T06:49:56.817 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/math/built-in.a 2023-10-26T06:49:56.832 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-composite.o 2023-10-26T06:49:56.918 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/msr-smp.o 2023-10-26T06:49:57.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/namespaces.o 2023-10-26T06:49:57.047 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-mul1.o 2023-10-26T06:49:57.374 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/crash_core.o 2023-10-26T06:49:57.387 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-fractional-divider.o 2023-10-26T06:49:57.395 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/cache-smp.o 2023-10-26T06:49:57.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:49:57.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:49:57.424 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:49:57.462 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_processor.o 2023-10-26T06:49:57.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:49:57.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:49:57.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:49:57.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:49:57.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:49:57.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:49:57.589 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-mul2.o 2023-10-26T06:49:57.688 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/msr.o 2023-10-26T06:49:57.791 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/self.o 2023-10-26T06:49:57.909 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/clk/clk-gpio.o 2023-10-26T06:49:58.085 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/kexec_core.o 2023-10-26T06:49:58.144 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-mul3.o 2023-10-26T06:49:58.267 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_core.o 2023-10-26T06:49:58.358 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/thread_self.o 2023-10-26T06:49:58.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:49:58 smithi125 ceph-mon[130643]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2023-10-26T06:49:58.449 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/msr-reg.o 2023-10-26T06:49:58.474 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/clk/built-in.a 2023-10-26T06:49:58.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:49:58 smithi153 ceph-mon[131657]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2023-10-26T06:49:58.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:49:58 smithi050 ceph-mon[94997]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.2 MiB/s wr, 71 op/s 2023-10-26T06:49:58.527 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/kexec.o 2023-10-26T06:49:58.560 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/msr-reg-export.o 2023-10-26T06:49:58.690 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-rshift.o 2023-10-26T06:49:58.746 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/hweight.o 2023-10-26T06:49:58.860 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/iomem.o 2023-10-26T06:49:58.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_pdc.o 2023-10-26T06:49:58.918 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/proc_sysctl.o 2023-10-26T06:49:59.237 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-sub1.o 2023-10-26T06:49:59.237 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/iomap_copy_64.o 2023-10-26T06:49:59.259 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ramfs/inode.o 2023-10-26T06:49:59.266 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/compat.o 2023-10-26T06:49:59.329 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/clear_page_64.o 2023-10-26T06:49:59.440 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/cmdline.o 2023-10-26T06:49:59.477 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/ec.o 2023-10-26T06:49:59.665 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/cmpxchg16b_emu.o 2023-10-26T06:49:59.768 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/copy_page_64.o 2023-10-26T06:49:59.791 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/generic_mpih-add1.o 2023-10-26T06:49:59.872 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/copy_user_64.o 2023-10-26T06:49:59.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4xdr.o 2023-10-26T06:50:00.006 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/cpu.o 2023-10-26T06:50:00.027 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ramfs/file-mmu.o 2023-10-26T06:50:00.045 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/proc_net.o 2023-10-26T06:50:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:49:59.999+0000 7f8f3a015700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-26T06:50:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:49:59.999+0000 7f8f3a015700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-26T06:50:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:49:59.999+0000 7f8f3a015700 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2023-10-26T06:50:00.269 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/utsname.o 2023-10-26T06:50:00.463 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpicoder.o 2023-10-26T06:50:00.505 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/csum-copy_64.o 2023-10-26T06:50:00.580 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/ramfs/built-in.a 2023-10-26T06:50:00.611 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/csum-partial_64.o 2023-10-26T06:50:00.657 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter/nf_defrag_ipv4.o 2023-10-26T06:50:00.672 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/dock.o 2023-10-26T06:50:00.852 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/kcore.o 2023-10-26T06:50:00.852 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/pid_namespace.o 2023-10-26T06:50:00.983 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/csum-wrappers_64.o 2023-10-26T06:50:01.149 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpi-bit.o 2023-10-26T06:50:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:00 smithi125 ceph-mon[130643]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.3 MiB/s wr, 79 op/s 2023-10-26T06:50:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:00 smithi125 ceph-mon[130643]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-26T06:50:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:00 smithi125 ceph-mon[130643]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-26T06:50:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:00 smithi125 ceph-mon[130643]: mds.i(mds.1): Metadata damage detected 2023-10-26T06:50:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:00 smithi153 ceph-mon[131657]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.3 MiB/s wr, 79 op/s 2023-10-26T06:50:01.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:00 smithi153 ceph-mon[131657]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-26T06:50:01.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:00 smithi153 ceph-mon[131657]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-26T06:50:01.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:00 smithi153 ceph-mon[131657]: mds.i(mds.1): Metadata damage detected 2023-10-26T06:50:01.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-mon[94997]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.3 MiB/s wr, 79 op/s 2023-10-26T06:50:01.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-mon[94997]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-26T06:50:01.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-mon[94997]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-26T06:50:01.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:00 smithi050 ceph-mon[94997]: mds.i(mds.1): Metadata damage detected 2023-10-26T06:50:01.331 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/ethtool.o 2023-10-26T06:50:01.363 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/pci_root.o 2023-10-26T06:50:01.378 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/delay.o 2023-10-26T06:50:01.625 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/vmcore.o 2023-10-26T06:50:01.645 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/stop_machine.o 2023-10-26T06:50:01.673 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpi-cmp.o 2023-10-26T06:50:01.717 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter/nf_reject_ipv4.o 2023-10-26T06:50:01.774 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/error-inject.o 2023-10-26T06:50:02.213 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpih-cmp.o 2023-10-26T06:50:02.317 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/pci_link.o 2023-10-26T06:50:02.359 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/getuser.o 2023-10-26T06:50:02.469 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/audit.o 2023-10-26T06:50:02.480 INFO:tasks.workunit.client.0.smithi050.stdout: GEN arch/x86/lib/inat-tables.c 2023-10-26T06:50:02.500 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4state.o 2023-10-26T06:50:02.536 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/insn-eval.o 2023-10-26T06:50:02.537 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/kmsg.o 2023-10-26T06:50:02.751 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpih-div.o 2023-10-26T06:50:02.856 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter/ip_tables.o 2023-10-26T06:50:03.018 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc/page.o 2023-10-26T06:50:03.146 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/pci_irq.o 2023-10-26T06:50:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:02 smithi125 ceph-mon[130643]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 1.3 MiB/s wr, 99 op/s 2023-10-26T06:50:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:02 smithi153 ceph-mon[131657]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 1.3 MiB/s wr, 99 op/s 2023-10-26T06:50:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:02 smithi050 ceph-mon[94997]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 1.3 MiB/s wr, 99 op/s 2023-10-26T06:50:03.281 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/dev_addr_lists.o 2023-10-26T06:50:03.312 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/insn.o 2023-10-26T06:50:03.388 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpih-mul.o 2023-10-26T06:50:03.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/kaslr.o 2023-10-26T06:50:03.785 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/proc/built-in.a 2023-10-26T06:50:03.843 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_lpss.o 2023-10-26T06:50:03.854 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/route.o 2023-10-26T06:50:03.885 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/memcpy_64.o 2023-10-26T06:50:04.003 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/memmove_64.o 2023-10-26T06:50:04.070 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpi-pow.o 2023-10-26T06:50:04.101 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/memset_64.o 2023-10-26T06:50:04.149 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4renewd.o 2023-10-26T06:50:04.154 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/auditfilter.o 2023-10-26T06:50:04.216 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/misc.o 2023-10-26T06:50:04.316 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/dst.o 2023-10-26T06:50:04.334 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/putuser.o 2023-10-26T06:50:04.400 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter/iptable_filter.o 2023-10-26T06:50:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:04 smithi125 ceph-mon[130643]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-10-26T06:50:04.459 INFO:tasks.workunit.client.0.smithi050.stdout: AS arch/x86/lib/retpoline.o 2023-10-26T06:50:04.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:04 smithi153 ceph-mon[131657]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-10-26T06:50:04.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:04 smithi050 ceph-mon[94997]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-10-26T06:50:04.566 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_apd.o 2023-10-26T06:50:04.622 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/usercopy.o 2023-10-26T06:50:04.735 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/mpi/mpiutil.o 2023-10-26T06:50:05.114 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_platform.o 2023-10-26T06:50:05.150 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4super.o 2023-10-26T06:50:05.168 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/usercopy_64.o 2023-10-26T06:50:05.340 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/mpi/built-in.a 2023-10-26T06:50:05.374 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter/iptable_mangle.o 2023-10-26T06:50:05.408 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/xz/xz_dec_syms.o 2023-10-26T06:50:05.450 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/netevent.o 2023-10-26T06:50:05.583 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/auditsc.o 2023-10-26T06:50:05.758 INFO:tasks.workunit.client.0.smithi050.stdout: CC arch/x86/lib/inat.o 2023-10-26T06:50:05.763 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_pnp.o 2023-10-26T06:50:05.776 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/xz/xz_dec_stream.o 2023-10-26T06:50:05.959 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/lib/lib.a 2023-10-26T06:50:06.021 INFO:tasks.workunit.client.0.smithi050.stdout: EXPORTS arch/x86/lib/lib-ksyms.o 2023-10-26T06:50:06.121 INFO:tasks.workunit.client.0.smithi050.stdout: AR arch/x86/lib/built-in.a 2023-10-26T06:50:06.178 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4file.o 2023-10-26T06:50:06.190 INFO:tasks.workunit.client.0.smithi050.stdout: AR virt/lib/built-in.a 2023-10-26T06:50:06.224 INFO:tasks.workunit.client.0.smithi050.stdout: AR virt/built-in.a 2023-10-26T06:50:06.231 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/neighbour.o 2023-10-26T06:50:06.233 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/rtnetlink.o 2023-10-26T06:50:06.275 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/xz/xz_dec_lzma2.o 2023-10-26T06:50:06.281 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/connector/cn_queue.o 2023-10-26T06:50:06.344 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/power.o 2023-10-26T06:50:06.403 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter/ipt_REJECT.o 2023-10-26T06:50:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:06 smithi125 ceph-mon[130643]: osdmap e87: 12 total, 12 up, 12 in 2023-10-26T06:50:06.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:06 smithi125 ceph-mon[130643]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 1.5 MiB/s wr, 123 op/s 2023-10-26T06:50:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:06 smithi153 ceph-mon[131657]: osdmap e87: 12 total, 12 up, 12 in 2023-10-26T06:50:06.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:06 smithi153 ceph-mon[131657]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 1.5 MiB/s wr, 123 op/s 2023-10-26T06:50:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:06 smithi050 ceph-mon[94997]: osdmap e87: 12 total, 12 up, 12 in 2023-10-26T06:50:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:06 smithi050 ceph-mon[94997]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 1.5 MiB/s wr, 123 op/s 2023-10-26T06:50:06.919 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/xz/xz_dec_bcj.o 2023-10-26T06:50:07.112 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/event.o 2023-10-26T06:50:07.142 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/audit_watch.o 2023-10-26T06:50:07.260 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/connector/connector.o 2023-10-26T06:50:07.380 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/delegation.o 2023-10-26T06:50:07.445 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/ipv4/netfilter/nf_log_arp.o 2023-10-26T06:50:07.449 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/xz/built-in.a 2023-10-26T06:50:07.532 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_deflate/deflate.o 2023-10-26T06:50:07.954 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/sysfs.o 2023-10-26T06:50:08.079 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/audit_fsnotify.o 2023-10-26T06:50:08.199 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_deflate/deftree.o 2023-10-26T06:50:08.316 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/connector/cn_proc.o 2023-10-26T06:50:08.426 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/ipv4/netfilter/nf_log_ipv4.o 2023-10-26T06:50:08.697 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/ip6_tables.o 2023-10-26T06:50:08.698 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/property.o 2023-10-26T06:50:08.779 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_deflate/deflate_syms.o 2023-10-26T06:50:08.838 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/audit_tree.o 2023-10-26T06:50:08.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/utils.o 2023-10-26T06:50:08.998 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4idmap.o 2023-10-26T06:50:09.142 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/zlib_deflate/built-in.a 2023-10-26T06:50:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:08 smithi125 ceph-mon[130643]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2023-10-26T06:50:09.200 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_inflate/inffast.o 2023-10-26T06:50:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:08 smithi153 ceph-mon[131657]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2023-10-26T06:50:09.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:08 smithi050 ceph-mon[94997]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 1.5 MiB/s wr, 122 op/s 2023-10-26T06:50:09.325 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/connector/built-in.a 2023-10-26T06:50:09.378 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/ip6table_filter.o 2023-10-26T06:50:09.464 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_inflate/inflate.o 2023-10-26T06:50:09.537 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/ipv4/netfilter/iptable_nat.o 2023-10-26T06:50:09.564 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_cmos_rtc.o 2023-10-26T06:50:09.844 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/kprobes.o 2023-10-26T06:50:10.080 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_inflate/infutil.o 2023-10-26T06:50:10.084 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/link_watch.o 2023-10-26T06:50:10.148 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/x86/apple.o 2023-10-26T06:50:10.323 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/inetpeer.o 2023-10-26T06:50:10.401 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/ip6table_mangle.o 2023-10-26T06:50:10.406 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/callback.o 2023-10-26T06:50:10.454 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_inflate/inftrees.o 2023-10-26T06:50:10.580 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/ipv4/netfilter/built-in.a 2023-10-26T06:50:10.642 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/nf_defrag_ipv6_hooks.o 2023-10-26T06:50:10.675 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/zlib_inflate/inflate_syms.o 2023-10-26T06:50:10.721 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/x86/utils.o 2023-10-26T06:50:11.030 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/zlib_inflate/built-in.a 2023-10-26T06:50:11.070 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/lockref.o 2023-10-26T06:50:11.090 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/filter.o 2023-10-26T06:50:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:10 smithi125 ceph-mon[130643]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2023-10-26T06:50:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:10 smithi153 ceph-mon[131657]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2023-10-26T06:50:11.256 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/debugfs.o 2023-10-26T06:50:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:10 smithi050 ceph-mon[94997]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.5 MiB/s wr, 125 op/s 2023-10-26T06:50:11.382 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/callback_xdr.o 2023-10-26T06:50:11.385 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bcd.o 2023-10-26T06:50:11.466 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/sort.o 2023-10-26T06:50:11.567 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/parser.o 2023-10-26T06:50:11.703 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/numa.o 2023-10-26T06:50:11.715 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/protocol.o 2023-10-26T06:50:11.879 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/debug_locks.o 2023-10-26T06:50:12.072 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/callback_proc.o 2023-10-26T06:50:12.110 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/sysfs/file.o 2023-10-26T06:50:12.124 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/nf_conntrack_reasm.o 2023-10-26T06:50:12.143 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/random32.o 2023-10-26T06:50:12.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:11 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:12.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:11 smithi125 ceph-mon[130643]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2023-10-26T06:50:12.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:11 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:12.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:11 smithi153 ceph-mon[131657]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2023-10-26T06:50:12.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:11 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:12.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:11 smithi050 ceph-mon[94997]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2023-10-26T06:50:12.639 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/seccomp.o 2023-10-26T06:50:13.863 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_input.o 2023-10-26T06:50:14.039 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bust_spinlocks.o 2023-10-26T06:50:14.087 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_lpat.o 2023-10-26T06:50:14.117 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/sysfs/dir.o 2023-10-26T06:50:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:14 smithi125 ceph-mon[130643]: osdmap e88: 12 total, 12 up, 12 in 2023-10-26T06:50:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:14 smithi125 ceph-mon[130643]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2023-10-26T06:50:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:14 smithi153 ceph-mon[131657]: osdmap e88: 12 total, 12 up, 12 in 2023-10-26T06:50:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:14 smithi153 ceph-mon[131657]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2023-10-26T06:50:14.485 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/nf_reject_ipv6.o 2023-10-26T06:50:14.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:14 smithi050 ceph-mon[94997]: osdmap e88: 12 total, 12 up, 12 in 2023-10-26T06:50:14.521 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:14 smithi050 ceph-mon[94997]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2023-10-26T06:50:14.598 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/kasprintf.o 2023-10-26T06:50:14.620 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/sysfs/symlink.o 2023-10-26T06:50:14.637 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4namespace.o 2023-10-26T06:50:14.699 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_lpit.o 2023-10-26T06:50:14.965 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bitmap.o 2023-10-26T06:50:15.014 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/relay.o 2023-10-26T06:50:15.104 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_fragment.o 2023-10-26T06:50:15.194 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/sysfs/mount.o 2023-10-26T06:50:15.277 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/ac.o 2023-10-26T06:50:15.599 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/ip6t_ipv6header.o 2023-10-26T06:50:15.730 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4getroot.o 2023-10-26T06:50:15.869 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/sysfs/group.o 2023-10-26T06:50:15.896 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/scatterlist.o 2023-10-26T06:50:15.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/button.o 2023-10-26T06:50:15.948 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/utsname_sysctl.o 2023-10-26T06:50:16.261 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_forward.o 2023-10-26T06:50:16.338 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/delayacct.o 2023-10-26T06:50:16.380 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/sysfs/built-in.a 2023-10-26T06:50:16.423 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/list_sort.o 2023-10-26T06:50:16.578 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/sock_diag.o 2023-10-26T06:50:16.612 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/fan.o 2023-10-26T06:50:16.628 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4client.o 2023-10-26T06:50:16.637 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter/ip6t_REJECT.o 2023-10-26T06:50:16.716 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/af_inet6.o 2023-10-26T06:50:16.746 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/uuid.o 2023-10-26T06:50:16.839 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/taskstats.o 2023-10-26T06:50:17.042 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/iov_iter.o 2023-10-26T06:50:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:16 smithi125 ceph-mon[130643]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 86 op/s 2023-10-26T06:50:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:16 smithi153 ceph-mon[131657]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 86 op/s 2023-10-26T06:50:17.257 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_video.o 2023-10-26T06:50:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:16 smithi050 ceph-mon[94997]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 86 op/s 2023-10-26T06:50:17.335 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_options.o 2023-10-26T06:50:17.685 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/ipv6/netfilter/nf_log_ipv6.o 2023-10-26T06:50:17.690 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/dev_ioctl.o 2023-10-26T06:50:17.829 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/tsacct.o 2023-10-26T06:50:17.888 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4session.o 2023-10-26T06:50:18.145 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/main.o 2023-10-26T06:50:18.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:17 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:18.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:17 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:18.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:17 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:18.457 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/tracepoint.o 2023-10-26T06:50:18.576 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/tso.o 2023-10-26T06:50:18.601 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/video_detect.o 2023-10-26T06:50:18.608 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_output.o 2023-10-26T06:50:18.818 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/ipv6/netfilter/built-in.a 2023-10-26T06:50:18.867 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/anycast.o 2023-10-26T06:50:18.919 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/clz_ctz.o 2023-10-26T06:50:18.963 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/dns_resolve.o 2023-10-26T06:50:19.104 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bsearch.o 2023-10-26T06:50:19.124 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/elfcore.o 2023-10-26T06:50:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:18 smithi125 ceph-mon[130643]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 91 op/s 2023-10-26T06:50:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:18 smithi153 ceph-mon[131657]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 91 op/s 2023-10-26T06:50:19.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:18 smithi050 ceph-mon[94997]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 91 op/s 2023-10-26T06:50:19.357 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_driver.o 2023-10-26T06:50:19.671 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/find_bit.o 2023-10-26T06:50:19.703 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/sock_reuseport.o 2023-10-26T06:50:19.778 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4trace.o 2023-10-26T06:50:19.973 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_output.o 2023-10-26T06:50:20.402 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/irq_work.o 2023-10-26T06:50:20.474 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/status.o 2023-10-26T06:50:20.483 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/llist.o 2023-10-26T06:50:20.720 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/fib_notifier.o 2023-10-26T06:50:20.728 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_sockglue.o 2023-10-26T06:50:20.882 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_idle.o 2023-10-26T06:50:20.966 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/memweight.o 2023-10-26T06:50:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:20 smithi125 ceph-mon[130643]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 84 op/s 2023-10-26T06:50:21.191 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/kfifo.o 2023-10-26T06:50:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:20 smithi153 ceph-mon[131657]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 84 op/s 2023-10-26T06:50:21.247 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/crash_dump.o 2023-10-26T06:50:21.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:20 smithi050 ceph-mon[94997]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 84 op/s 2023-10-26T06:50:21.517 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/xdp.o 2023-10-26T06:50:21.715 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_input.o 2023-10-26T06:50:21.781 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_throttling.o 2023-10-26T06:50:21.856 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/jump_label.o 2023-10-26T06:50:21.954 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nfs/nfs4sysctl.o 2023-10-26T06:50:21.969 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/percpu-refcount.o 2023-10-26T06:50:22.138 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/inet_hashtables.o 2023-10-26T06:50:22.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:21 smithi125 ceph-mon[130643]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 83 op/s 2023-10-26T06:50:22.194 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/driver-ops.o 2023-10-26T06:50:22.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:21 smithi153 ceph-mon[131657]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 83 op/s 2023-10-26T06:50:22.270 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:21 smithi050 ceph-mon[94997]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 83 op/s 2023-10-26T06:50:22.477 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/rhashtable.o 2023-10-26T06:50:22.584 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_thermal.o 2023-10-26T06:50:22.590 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/iomem.o 2023-10-26T06:50:22.689 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/flow_offload.o 2023-10-26T06:50:23.001 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/nfs/built-in.a 2023-10-26T06:50:23.113 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/tracefs/inode.o 2023-10-26T06:50:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:22 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:23.173 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/addrconf.o 2023-10-26T06:50:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:22 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:23.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:22 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:50:23.281 INFO:tasks.workunit.client.0.smithi050.stdout: CC kernel/rseq.o 2023-10-26T06:50:23.297 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/processor_perflib.o 2023-10-26T06:50:23.603 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/inet_timewait_sock.o 2023-10-26T06:50:23.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/once.o 2023-10-26T06:50:23.846 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/net-sysfs.o 2023-10-26T06:50:23.865 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/tracefs/built-in.a 2023-10-26T06:50:23.908 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/open.o 2023-10-26T06:50:24.032 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/refcount.o 2023-10-26T06:50:24.044 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/sta_info.o 2023-10-26T06:50:24.114 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/container.o 2023-10-26T06:50:24.261 INFO:tasks.workunit.client.0.smithi050.stdout: AR kernel/built-in.a 2023-10-26T06:50:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:24 smithi125 ceph-mon[130643]: pgmap v523: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 88 op/s 2023-10-26T06:50:24.443 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/usercopy.o 2023-10-26T06:50:24.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:24 smithi153 ceph-mon[131657]: pgmap v523: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 88 op/s 2023-10-26T06:50:24.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:24 smithi050 ceph-mon[94997]: pgmap v523: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 88 op/s 2023-10-26T06:50:24.518 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/core.o 2023-10-26T06:50:24.686 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/inet_connection_sock.o 2023-10-26T06:50:24.688 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/thermal.o 2023-10-26T06:50:24.868 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/errseq.o 2023-10-26T06:50:25.114 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bucket_locks.o 2023-10-26T06:50:25.137 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/read_write.o 2023-10-26T06:50:25.215 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/net-procfs.o 2023-10-26T06:50:25.557 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/acpi_memhotplug.o 2023-10-26T06:50:25.667 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/generic-radix-tree.o 2023-10-26T06:50:25.757 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_log.o 2023-10-26T06:50:26.051 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/netpoll.o 2023-10-26T06:50:26.069 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/addrlabel.o 2023-10-26T06:50:26.113 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/ioapic.o 2023-10-26T06:50:26.186 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp.o 2023-10-26T06:50:26.319 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/string_helpers.o 2023-10-26T06:50:26.535 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/wep.o 2023-10-26T06:50:26.720 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/file_table.o 2023-10-26T06:50:26.831 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/battery.o 2023-10-26T06:50:26.904 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_queue.o 2023-10-26T06:50:27.012 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/hexdump.o 2023-10-26T06:50:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:26 smithi125 ceph-mon[130643]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 85 op/s 2023-10-26T06:50:27.173 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/route.o 2023-10-26T06:50:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:26 smithi153 ceph-mon[131657]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 85 op/s 2023-10-26T06:50:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:26 smithi050 ceph-mon[94997]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 85 op/s 2023-10-26T06:50:27.331 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/kstrtox.o 2023-10-26T06:50:27.421 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/fib_rules.o 2023-10-26T06:50:27.594 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/super.o 2023-10-26T06:50:27.623 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/aead_api.o 2023-10-26T06:50:27.874 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/bgrt.o 2023-10-26T06:50:27.945 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/iomap.o 2023-10-26T06:50:28.132 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_sockopt.o 2023-10-26T06:50:28.210 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/wpa.o 2023-10-26T06:50:28.505 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/cppc_acpi.o 2023-10-26T06:50:28.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/pci_iomap.o 2023-10-26T06:50:28.735 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_input.o 2023-10-26T06:50:28.901 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/char_dev.o 2023-10-26T06:50:28.915 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/net-traces.o 2023-10-26T06:50:29.085 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/utils.o 2023-10-26T06:50:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:28 smithi125 ceph-mon[130643]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 87 op/s 2023-10-26T06:50:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:28 smithi153 ceph-mon[131657]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 87 op/s 2023-10-26T06:50:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:28 smithi050 ceph-mon[94997]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 87 op/s 2023-10-26T06:50:29.345 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/iomap_copy.o 2023-10-26T06:50:29.442 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/acpi/spcr.o 2023-10-26T06:50:29.616 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/scan.o 2023-10-26T06:50:29.674 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/devres.o 2023-10-26T06:50:29.763 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/stat.o 2023-10-26T06:50:30.113 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/acpi/built-in.a 2023-10-26T06:50:30.136 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nfnetlink.o 2023-10-26T06:50:30.298 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_fib.o 2023-10-26T06:50:30.368 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/cpufreq.o 2023-10-26T06:50:30.382 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/check_signature.o 2023-10-26T06:50:30.673 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/logic_pio.o 2023-10-26T06:50:30.717 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/exec.o 2023-10-26T06:50:31.157 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/ptp_classifier.o 2023-10-26T06:50:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:30 smithi125 ceph-mon[130643]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 88 op/s 2023-10-26T06:50:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:30 smithi153 ceph-mon[131657]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 88 op/s 2023-10-26T06:50:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:30 smithi050 ceph-mon[94997]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 88 op/s 2023-10-26T06:50:31.278 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nfnetlink_log.o 2023-10-26T06:50:31.280 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/interval_tree.o 2023-10-26T06:50:31.616 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/offchannel.o 2023-10-26T06:50:31.632 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/assoc_array.o 2023-10-26T06:50:31.883 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ipv6_sockglue.o 2023-10-26T06:50:31.955 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/freq_table.o 2023-10-26T06:50:31.994 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/dst_cache.o 2023-10-26T06:50:32.012 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_output.o 2023-10-26T06:50:32.265 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/pipe.o 2023-10-26T06:50:32.369 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bitrev.o 2023-10-26T06:50:32.495 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/cpufreq_performance.o 2023-10-26T06:50:32.533 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_core.o 2023-10-26T06:50:32.733 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crc-ccitt.o 2023-10-26T06:50:32.933 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/cpufreq_userspace.o 2023-10-26T06:50:33.011 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/core/gro_cells.o 2023-10-26T06:50:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:32 smithi125 ceph-mon[130643]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2023-10-26T06:50:33.213 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crc16.o 2023-10-26T06:50:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:32 smithi153 ceph-mon[131657]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2023-10-26T06:50:33.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:32 smithi050 ceph-mon[94997]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2023-10-26T06:50:33.443 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/namei.o 2023-10-26T06:50:33.452 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ndisc.o 2023-10-26T06:50:33.464 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/ht.o 2023-10-26T06:50:33.483 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/cpufreq_ondemand.o 2023-10-26T06:50:33.628 INFO:tasks.workunit.client.0.smithi050.stdout: HOSTCC lib/gen_crc32table 2023-10-26T06:50:33.810 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/genalloc.o 2023-10-26T06:50:33.830 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/core/built-in.a 2023-10-26T06:50:33.924 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fcntl.o 2023-10-26T06:50:34.175 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/cpufreq_governor.o 2023-10-26T06:50:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:34 smithi125 ceph-mon[130643]: pgmap v528: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 88 op/s 2023-10-26T06:50:34.467 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_timer.o 2023-10-26T06:50:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:34 smithi153 ceph-mon[131657]: pgmap v528: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 88 op/s 2023-10-26T06:50:34.494 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_standalone.o 2023-10-26T06:50:34.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:34 smithi050 ceph-mon[94997]: pgmap v528: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 88 op/s 2023-10-26T06:50:34.575 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/percpu_counter.o 2023-10-26T06:50:34.819 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/cpufreq_governor_attr_set.o 2023-10-26T06:50:34.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_ipv4.o 2023-10-26T06:50:35.090 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/iommu-helper.o 2023-10-26T06:50:35.117 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/agg-tx.o 2023-10-26T06:50:35.149 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/udp.o 2023-10-26T06:50:35.294 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/error-inject.o 2023-10-26T06:50:35.308 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/acpi-cpufreq.o 2023-10-26T06:50:35.681 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_expect.o 2023-10-26T06:50:35.727 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/syscall.o 2023-10-26T06:50:35.966 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/ioctl.o 2023-10-26T06:50:35.966 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpuidle/governors/menu.o 2023-10-26T06:50:36.170 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpufreq/intel_pstate.o 2023-10-26T06:50:36.309 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/nlattr.o 2023-10-26T06:50:36.481 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/cpuidle/governors/built-in.a 2023-10-26T06:50:36.528 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpuidle/cpuidle.o 2023-10-26T06:50:36.868 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/readdir.o 2023-10-26T06:50:36.874 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/agg-rx.o 2023-10-26T06:50:37.011 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_helper.o 2023-10-26T06:50:37.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/udplite.o 2023-10-26T06:50:37.037 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_minisocks.o 2023-10-26T06:50:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:36 smithi125 ceph-mon[130643]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-10-26T06:50:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:36 smithi153 ceph-mon[131657]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-10-26T06:50:37.245 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/cpu_rmap.o 2023-10-26T06:50:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:36 smithi050 ceph-mon[94997]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-10-26T06:50:37.542 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpuidle/driver.o 2023-10-26T06:50:37.604 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/cpufreq/built-in.a 2023-10-26T06:50:37.658 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_proto.o 2023-10-26T06:50:37.742 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/dynamic_queue_limits.o 2023-10-26T06:50:37.766 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/select.o 2023-10-26T06:50:38.012 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpuidle/governor.o 2023-10-26T06:50:38.027 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/raw.o 2023-10-26T06:50:38.057 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/glob.o 2023-10-26T06:50:38.350 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpuidle/sysfs.o 2023-10-26T06:50:38.359 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_cong.o 2023-10-26T06:50:38.518 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/strncpy_from_user.o 2023-10-26T06:50:38.542 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_user.o 2023-10-26T06:50:38.551 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/vht.o 2023-10-26T06:50:38.897 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/cpuidle/poll_state.o 2023-10-26T06:50:38.900 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_proto_generic.o 2023-10-26T06:50:39.133 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/strnlen_user.o 2023-10-26T06:50:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:38 smithi125 ceph-mon[130643]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:50:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:38 smithi153 ceph-mon[131657]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:50:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:38 smithi050 ceph-mon[94997]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 1.1 MiB/s wr, 75 op/s 2023-10-26T06:50:39.271 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/cpuidle/built-in.a 2023-10-26T06:50:39.309 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/dcache.o 2023-10-26T06:50:39.344 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/crypto/hisilicon/built-in.a 2023-10-26T06:50:39.378 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/crypto/built-in.a 2023-10-26T06:50:39.448 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/dw/core.o 2023-10-26T06:50:39.503 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_kapi.o 2023-10-26T06:50:39.581 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_metrics.o 2023-10-26T06:50:39.661 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/net_utils.o 2023-10-26T06:50:39.693 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/icmp.o 2023-10-26T06:50:39.866 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_proto_tcp.o 2023-10-26T06:50:40.298 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/he.o 2023-10-26T06:50:40.342 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/sg_pool.o 2023-10-26T06:50:40.421 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/dw/dw.o 2023-10-26T06:50:40.695 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_domainhash.o 2023-10-26T06:50:40.894 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/inode.o 2023-10-26T06:50:40.902 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_fastopen.o 2023-10-26T06:50:40.953 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/asn1_decoder.o 2023-10-26T06:50:41.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/dw/idma32.o 2023-10-26T06:50:41.097 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/mcast.o 2023-10-26T06:50:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:40 smithi125 ceph-mon[130643]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2023-10-26T06:50:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:40 smithi153 ceph-mon[131657]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2023-10-26T06:50:41.256 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_proto_udp.o 2023-10-26T06:50:41.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:40 smithi050 ceph-mon[94997]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2023-10-26T06:50:41.390 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/ibss.o 2023-10-26T06:50:41.447 INFO:tasks.workunit.client.0.smithi050.stdout: GEN lib/oid_registry_data.c 2023-10-26T06:50:41.522 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/ucs2_string.o 2023-10-26T06:50:41.622 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/dw/built-in.a 2023-10-26T06:50:41.674 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/hsu/hsu.o 2023-10-26T06:50:41.865 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_addrlist.o 2023-10-26T06:50:41.985 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/sbitmap.o 2023-10-26T06:50:42.074 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_rate.o 2023-10-26T06:50:42.309 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_proto_icmp.o 2023-10-26T06:50:42.453 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/attr.o 2023-10-26T06:50:42.471 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/hsu/built-in.a 2023-10-26T06:50:42.510 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/mediatek/built-in.a 2023-10-26T06:50:42.552 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/qcom/built-in.a 2023-10-26T06:50:42.595 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/ti/built-in.a 2023-10-26T06:50:42.630 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/xilinx/built-in.a 2023-10-26T06:50:42.669 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/dmaengine.o 2023-10-26T06:50:42.774 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/argv_split.o 2023-10-26T06:50:42.905 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_mgmt.o 2023-10-26T06:50:43.074 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_recovery.o 2023-10-26T06:50:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:42 smithi125 ceph-mon[130643]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2023-10-26T06:50:43.228 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/reassembly.o 2023-10-26T06:50:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:42 smithi153 ceph-mon[131657]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2023-10-26T06:50:43.247 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/bug.o 2023-10-26T06:50:43.259 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/bad_inode.o 2023-10-26T06:50:43.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:42 smithi050 ceph-mon[94997]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2023-10-26T06:50:43.404 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_extend.o 2023-10-26T06:50:43.455 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/iface.o 2023-10-26T06:50:43.725 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/chacha.o 2023-10-26T06:50:43.746 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/file.o 2023-10-26T06:50:43.767 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/virt-dma.o 2023-10-26T06:50:44.108 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_unlabeled.o 2023-10-26T06:50:44.210 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_ulp.o 2023-10-26T06:50:44.261 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/clz_tab.o 2023-10-26T06:50:44.401 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/cmdline.o 2023-10-26T06:50:44.411 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma/acpi-dma.o 2023-10-26T06:50:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:44 smithi125 ceph-mon[130643]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2023-10-26T06:50:44.436 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_acct.o 2023-10-26T06:50:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:44 smithi153 ceph-mon[131657]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2023-10-26T06:50:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:44 smithi050 ceph-mon[94997]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2023-10-26T06:50:44.519 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/tcp_ipv6.o 2023-10-26T06:50:44.639 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/cpumask.o 2023-10-26T06:50:44.736 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/filesystems.o 2023-10-26T06:50:45.184 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma/built-in.a 2023-10-26T06:50:45.207 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/ctype.o 2023-10-26T06:50:45.242 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/dma-buf.o 2023-10-26T06:50:45.253 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_offload.o 2023-10-26T06:50:45.375 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/dec_and_lock.o 2023-10-26T06:50:45.376 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_seqadj.o 2023-10-26T06:50:45.401 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_cipso_v4.o 2023-10-26T06:50:45.501 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/namespace.o 2023-10-26T06:50:45.568 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/rate.o 2023-10-26T06:50:45.679 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress.o 2023-10-26T06:50:45.856 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress_bunzip2.o 2023-10-26T06:50:46.172 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/dma-fence.o 2023-10-26T06:50:46.367 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ping.o 2023-10-26T06:50:46.431 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_proto_icmpv6.o 2023-10-26T06:50:46.441 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/datagram.o 2023-10-26T06:50:46.513 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress_inflate.o 2023-10-26T06:50:46.564 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlabel/netlabel_calipso.o 2023-10-26T06:50:47.032 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress_unlz4.o 2023-10-26T06:50:47.131 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/dma-fence-array.o 2023-10-26T06:50:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:46 smithi125 ceph-mon[130643]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1020 KiB/s wr, 69 op/s 2023-10-26T06:50:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:46 smithi153 ceph-mon[131657]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1020 KiB/s wr, 69 op/s 2023-10-26T06:50:47.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:46 smithi050 ceph-mon[94997]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1020 KiB/s wr, 69 op/s 2023-10-26T06:50:47.435 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/michael.o 2023-10-26T06:50:47.442 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/exthdrs.o 2023-10-26T06:50:47.459 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/raw.o 2023-10-26T06:50:47.488 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_netlink.o 2023-10-26T06:50:47.521 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress_unlzma.o 2023-10-26T06:50:47.598 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/dma-fence-chain.o 2023-10-26T06:50:47.619 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/netlabel/built-in.a 2023-10-26T06:50:47.648 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/seq_file.o 2023-10-26T06:50:47.676 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/tkip.o 2023-10-26T06:50:48.083 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/dma-resv.o 2023-10-26T06:50:48.160 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress_unlzo.o 2023-10-26T06:50:48.234 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/udp.o 2023-10-26T06:50:48.626 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/xattr.o 2023-10-26T06:50:48.710 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/decompress_unxz.o 2023-10-26T06:50:48.816 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/seqno-fence.o 2023-10-26T06:50:48.837 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/datagram.o 2023-10-26T06:50:48.901 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/dump_stack.o 2023-10-26T06:50:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:48 smithi125 ceph-mon[130643]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1000 KiB/s wr, 72 op/s 2023-10-26T06:50:49.206 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_ftp.o 2023-10-26T06:50:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:48 smithi153 ceph-mon[131657]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1000 KiB/s wr, 72 op/s 2023-10-26T06:50:49.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:48 smithi050 ceph-mon[94997]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1000 KiB/s wr, 72 op/s 2023-10-26T06:50:49.310 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/aes_cmac.o 2023-10-26T06:50:49.385 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/dma-buf/sync_file.o 2023-10-26T06:50:49.396 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_mc.o 2023-10-26T06:50:49.510 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/earlycpio.o 2023-10-26T06:50:49.721 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/libfs.o 2023-10-26T06:50:49.728 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/extable.o 2023-10-26T06:50:50.054 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/dma-buf/built-in.a 2023-10-26T06:50:50.101 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_device.o 2023-10-26T06:50:50.178 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_flowlabel.o 2023-10-26T06:50:50.198 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/flex_proportions.o 2023-10-26T06:50:50.328 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/aes_gmac.o 2023-10-26T06:50:50.408 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_irc.o 2023-10-26T06:50:50.427 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlink/af_netlink.o 2023-10-26T06:50:50.658 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/idr.o 2023-10-26T06:50:50.680 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/udplite.o 2023-10-26T06:50:50.828 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_mc_sysfs.o 2023-10-26T06:50:50.835 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fs-writeback.o 2023-10-26T06:50:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:50 smithi125 ceph-mon[130643]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2023-10-26T06:50:51.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:50 smithi153 ceph-mon[131657]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2023-10-26T06:50:51.242 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/ioremap.o 2023-10-26T06:50:51.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:50 smithi050 ceph-mon[94997]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 1.2 MiB/s wr, 78 op/s 2023-10-26T06:50:51.401 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/fils_aead.o 2023-10-26T06:50:51.452 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/inet6_connection_sock.o 2023-10-26T06:50:51.518 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_conntrack_sip.o 2023-10-26T06:50:51.655 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/udp_offload.o 2023-10-26T06:50:51.677 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_module.o 2023-10-26T06:50:51.849 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/irq_regs.o 2023-10-26T06:50:52.163 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/is_single_threaded.o 2023-10-26T06:50:52.283 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_device_sysfs.o 2023-10-26T06:50:52.323 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netlink/genetlink.o 2023-10-26T06:50:52.491 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/udp_offload.o 2023-10-26T06:50:52.554 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/cfg.o 2023-10-26T06:50:52.577 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/klist.o 2023-10-26T06:50:52.804 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/pnode.o 2023-10-26T06:50:52.879 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/arp.o 2023-10-26T06:50:52.989 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/wq.o 2023-10-26T06:50:53.093 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/kobject.o 2023-10-26T06:50:53.109 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_core.o 2023-10-26T06:50:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:52 smithi125 ceph-mon[130643]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 949 KiB/s wr, 66 op/s 2023-10-26T06:50:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:52 smithi153 ceph-mon[131657]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 949 KiB/s wr, 66 op/s 2023-10-26T06:50:53.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:52 smithi050 ceph-mon[94997]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 949 KiB/s wr, 66 op/s 2023-10-26T06:50:53.515 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/splice.o 2023-10-26T06:50:53.589 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/seg6.o 2023-10-26T06:50:53.655 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_pci.o 2023-10-26T06:50:53.655 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/netlink/built-in.a 2023-10-26T06:50:53.716 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_proto.o 2023-10-26T06:50:53.858 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/kobject_uevent.o 2023-10-26T06:50:54.341 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/icmp.o 2023-10-26T06:50:54.371 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/edac_pci_sysfs.o 2023-10-26T06:50:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:54 smithi125 ceph-mon[130643]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2023-10-26T06:50:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:54 smithi153 ceph-mon[131657]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2023-10-26T06:50:54.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:54 smithi050 ceph-mon[94997]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2023-10-26T06:50:54.548 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/ethtool.o 2023-10-26T06:50:54.615 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/fib6_notifier.o 2023-10-26T06:50:54.814 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/sync.o 2023-10-26T06:50:54.997 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/memcat_p.o 2023-10-26T06:50:55.053 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_helper.o 2023-10-26T06:50:55.089 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/edac/mce_amd.o 2023-10-26T06:50:55.251 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/utimes.o 2023-10-26T06:50:55.396 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/nmi_backtrace.o 2023-10-26T06:50:55.572 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/sysctl_net_ipv6.o 2023-10-26T06:50:55.634 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/xfrm6_policy.o 2023-10-26T06:50:55.702 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/devinet.o 2023-10-26T06:50:55.803 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/edac/built-in.a 2023-10-26T06:50:55.875 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firewire/init_ohci1394_dma.o 2023-10-26T06:50:56.019 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/nodemask.o 2023-10-26T06:50:56.035 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/d_path.o 2023-10-26T06:50:56.134 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_masquerade.o 2023-10-26T06:50:56.150 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/rx.o 2023-10-26T06:50:56.445 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/plist.o 2023-10-26T06:50:56.499 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firewire/built-in.a 2023-10-26T06:50:56.552 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_ftp.o 2023-10-26T06:50:56.596 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/broadcom/built-in.a 2023-10-26T06:50:56.679 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/radix-tree.o 2023-10-26T06:50:56.692 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/xfrm6_state.o 2023-10-26T06:50:56.886 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/libstub/efi-stub-helper.o 2023-10-26T06:50:56.897 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/stack.o 2023-10-26T06:50:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:56 smithi125 ceph-mon[130643]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 923 KiB/s wr, 62 op/s 2023-10-26T06:50:57.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:56 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:50:57.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:56 smithi153 ceph-mon[131657]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 923 KiB/s wr, 62 op/s 2023-10-26T06:50:57.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:56 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:50:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:56 smithi050 ceph-mon[94997]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 923 KiB/s wr, 62 op/s 2023-10-26T06:50:57.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:56 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:50:57.413 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/efi-bgrt.o 2023-10-26T06:50:57.464 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fs_struct.o 2023-10-26T06:50:57.497 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/af_inet.o 2023-10-26T06:50:57.622 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/ratelimit.o 2023-10-26T06:50:57.678 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_irc.o 2023-10-26T06:50:57.821 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/xfrm6_input.o 2023-10-26T06:50:57.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/libstub/gop.o 2023-10-26T06:50:58.069 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/libstub/secureboot.o 2023-10-26T06:50:58.069 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/statfs.o 2023-10-26T06:50:58.086 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/rbtree.o 2023-10-26T06:50:58.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:57 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:57 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:57 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:50:58.810 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/seq_buf.o 2023-10-26T06:50:58.842 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/nf_nat_sip.o 2023-10-26T06:50:58.849 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fs_pin.o 2023-10-26T06:50:58.880 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/libstub/tpm.o 2023-10-26T06:50:59.104 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/packet/af_packet.o 2023-10-26T06:50:59.118 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/xfrm6_output.o 2023-10-26T06:50:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:58 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi153 to 196.2M 2023-10-26T06:50:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:58 smithi125 ceph-mon[130643]: Unable to set osd_memory_target on smithi153 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-26T06:50:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:58 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi125 to 196.2M 2023-10-26T06:50:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:58 smithi125 ceph-mon[130643]: Unable to set osd_memory_target on smithi125 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-10-26T06:50:59.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:58 smithi125 ceph-mon[130643]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 908 KiB/s wr, 61 op/s 2023-10-26T06:50:59.218 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/spectmgmt.o 2023-10-26T06:50:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:58 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi153 to 196.2M 2023-10-26T06:50:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:58 smithi153 ceph-mon[131657]: Unable to set osd_memory_target on smithi153 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-26T06:50:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:58 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi125 to 196.2M 2023-10-26T06:50:59.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:58 smithi153 ceph-mon[131657]: Unable to set osd_memory_target on smithi125 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-10-26T06:50:59.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:58 smithi153 ceph-mon[131657]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 908 KiB/s wr, 61 op/s 2023-10-26T06:50:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:58 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi153 to 196.2M 2023-10-26T06:50:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:58 smithi050 ceph-mon[94997]: Unable to set osd_memory_target on smithi153 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-26T06:50:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:58 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi125 to 196.2M 2023-10-26T06:50:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:58 smithi050 ceph-mon[94997]: Unable to set osd_memory_target on smithi125 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-10-26T06:50:59.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:58 smithi050 ceph-mon[94997]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 908 KiB/s wr, 61 op/s 2023-10-26T06:50:59.308 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/igmp.o 2023-10-26T06:50:59.373 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/sha1.o 2023-10-26T06:50:59.380 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/nsfs.o 2023-10-26T06:50:59.653 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/efi/libstub/lib.a 2023-10-26T06:50:59.692 INFO:tasks.workunit.client.0.smithi050.stdout: EXPORTS drivers/firmware/efi/libstub/lib-ksyms.o 2023-10-26T06:50:59.763 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/show_mem.o 2023-10-26T06:50:59.763 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/efi/libstub/built-in.a 2023-10-26T06:50:59.809 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/efi.o 2023-10-26T06:50:59.997 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fs_types.o 2023-10-26T06:51:00.105 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/x_tables.o 2023-10-26T06:51:00.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:51:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:51:00.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:50:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:51:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:51:00.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:51:00.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:50:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:51:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-26T06:51:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:51:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:51:00.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:50:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:51:00.286 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/xfrm6_protocol.o 2023-10-26T06:51:00.308 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/siphash.o 2023-10-26T06:51:00.312 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/tx.o 2023-10-26T06:51:00.696 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fs_context.o 2023-10-26T06:51:00.775 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/vars.o 2023-10-26T06:51:00.924 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/string.o 2023-10-26T06:51:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:00 smithi125 ceph-mon[130643]: Adjusting osd_memory_target on smithi050 to 223.0M 2023-10-26T06:51:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:00 smithi125 ceph-mon[130643]: Unable to set osd_memory_target on smithi050 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-10-26T06:51:01.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:00 smithi125 ceph-mon[130643]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1021 KiB/s wr, 66 op/s 2023-10-26T06:51:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:00 smithi153 ceph-mon[131657]: Adjusting osd_memory_target on smithi050 to 223.0M 2023-10-26T06:51:01.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:00 smithi153 ceph-mon[131657]: Unable to set osd_memory_target on smithi050 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-10-26T06:51:01.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:00 smithi153 ceph-mon[131657]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1021 KiB/s wr, 66 op/s 2023-10-26T06:51:01.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:00 smithi050 ceph-mon[94997]: Adjusting osd_memory_target on smithi050 to 223.0M 2023-10-26T06:51:01.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:00 smithi050 ceph-mon[94997]: Unable to set osd_memory_target on smithi050 to 233877504: error parsing value: Value '233877504' is below minimum 939524096 2023-10-26T06:51:01.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:00 smithi050 ceph-mon[94997]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1021 KiB/s wr, 66 op/s 2023-10-26T06:51:01.340 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/fib_frontend.o 2023-10-26T06:51:01.376 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/netfilter.o 2023-10-26T06:51:01.453 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/packet/built-in.a 2023-10-26T06:51:01.501 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/fib_semantics.o 2023-10-26T06:51:01.581 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fs_parser.o 2023-10-26T06:51:01.621 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/timerqueue.o 2023-10-26T06:51:01.680 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/reboot.o 2023-10-26T06:51:01.879 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_tcpudp.o 2023-10-26T06:51:01.926 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/vsprintf.o 2023-10-26T06:51:02.191 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/memattr.o 2023-10-26T06:51:02.208 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fsopen.o 2023-10-26T06:51:02.505 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/proc.o 2023-10-26T06:51:02.796 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/tpm.o 2023-10-26T06:51:02.846 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/imx/built-in.a 2023-10-26T06:51:02.931 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/arm/built-in.a 2023-10-26T06:51:02.959 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_CONNSECMARK.o 2023-10-26T06:51:02.983 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/bridge/synopsys/built-in.a 2023-10-26T06:51:03.019 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/bridge/built-in.a 2023-10-26T06:51:03.052 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/buffer.o 2023-10-26T06:51:03.064 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/hisilicon/built-in.a 2023-10-26T06:51:03.108 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i2c/built-in.a 2023-10-26T06:51:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:02 smithi125 ceph-mon[130643]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-10-26T06:51:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:02 smithi153 ceph-mon[131657]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-10-26T06:51:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:02 smithi050 ceph-mon[94997]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-10-26T06:51:03.297 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/fib_trie.o 2023-10-26T06:51:03.451 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/capsule.o 2023-10-26T06:51:03.571 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/key.o 2023-10-26T06:51:03.595 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/syncookies.o 2023-10-26T06:51:03.652 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i915/display/built-in.a 2023-10-26T06:51:03.723 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i915/gem/built-in.a 2023-10-26T06:51:03.775 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i915/gt/built-in.a 2023-10-26T06:51:03.817 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i915/gt/uc/built-in.a 2023-10-26T06:51:03.863 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i915/oa/built-in.a 2023-10-26T06:51:03.922 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/win_minmax.o 2023-10-26T06:51:03.937 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_drv.o 2023-10-26T06:51:04.037 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_NFLOG.o 2023-10-26T06:51:04.128 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/memmap.o 2023-10-26T06:51:04.374 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/xarray.o 2023-10-26T06:51:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:04 smithi125 ceph-mon[130643]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 1.2 MiB/s wr, 81 op/s 2023-10-26T06:51:04.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:04 smithi153 ceph-mon[131657]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 1.2 MiB/s wr, 81 op/s 2023-10-26T06:51:04.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:04 smithi050 ceph-mon[94997]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 1.2 MiB/s wr, 81 op/s 2023-10-26T06:51:04.754 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/efivars.o 2023-10-26T06:51:04.804 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/calipso.o 2023-10-26T06:51:04.840 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_SECMARK.o 2023-10-26T06:51:05.016 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/fib_notifier.o 2023-10-26T06:51:05.187 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/block_dev.o 2023-10-26T06:51:05.478 INFO:tasks.workunit.client.0.smithi050.stdout: GEN lib/crc32table.h 2023-10-26T06:51:05.501 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/oid_registry.o 2023-10-26T06:51:05.505 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/esrt.o 2023-10-26T06:51:05.615 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/util.o 2023-10-26T06:51:05.633 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_TCPMSS.o 2023-10-26T06:51:05.947 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/lib.a 2023-10-26T06:51:05.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/inet_fragment.o 2023-10-26T06:51:06.024 INFO:tasks.workunit.client.0.smithi050.stdout: CC lib/crc32.o 2023-10-26T06:51:06.044 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_irq.o 2023-10-26T06:51:06.170 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/runtime-map.o 2023-10-26T06:51:06.317 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ah6.o 2023-10-26T06:51:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:06 smithi125 ceph-mon[130643]: osdmap e89: 12 total, 12 up, 12 in 2023-10-26T06:51:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:06 smithi125 ceph-mon[130643]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.2 MiB/s wr, 81 op/s 2023-10-26T06:51:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:06 smithi153 ceph-mon[131657]: osdmap e89: 12 total, 12 up, 12 in 2023-10-26T06:51:06.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:06 smithi153 ceph-mon[131657]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.2 MiB/s wr, 81 op/s 2023-10-26T06:51:06.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:06 smithi050 ceph-mon[94997]: osdmap e89: 12 total, 12 up, 12 in 2023-10-26T06:51:06.519 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:06 smithi050 ceph-mon[94997]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 1.2 MiB/s wr, 81 op/s 2023-10-26T06:51:06.558 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/direct-io.o 2023-10-26T06:51:06.636 INFO:tasks.workunit.client.0.smithi050.stdout: EXPORTS lib/lib-ksyms.o 2023-10-26T06:51:06.727 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/runtime-wrappers.o 2023-10-26T06:51:06.743 INFO:tasks.workunit.client.0.smithi050.stdout: AR lib/built-in.a 2023-10-26T06:51:06.766 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_conntrack.o 2023-10-26T06:51:06.877 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_getparam.o 2023-10-26T06:51:07.264 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ping.o 2023-10-26T06:51:07.569 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/esp6.o 2023-10-26T06:51:07.649 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/efi/earlycon.o 2023-10-26T06:51:07.832 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/meson/built-in.a 2023-10-26T06:51:07.871 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_policy.o 2023-10-26T06:51:07.885 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/rfkill/core.o 2023-10-26T06:51:07.896 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/mpage.o 2023-10-26T06:51:08.224 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/efi/built-in.a 2023-10-26T06:51:08.277 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/psci/built-in.a 2023-10-26T06:51:08.323 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/tegra/built-in.a 2023-10-26T06:51:08.363 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/xilinx/built-in.a 2023-10-26T06:51:08.405 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/dmi_scan.o 2023-10-26T06:51:08.583 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_params.o 2023-10-26T06:51:08.607 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_tunnel_core.o 2023-10-26T06:51:08.656 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/wme.o 2023-10-26T06:51:08.782 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/rfkill/input.o 2023-10-26T06:51:08.881 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/proc_namespace.o 2023-10-26T06:51:08.976 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/netfilter/xt_state.o 2023-10-26T06:51:09.020 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/sit.o 2023-10-26T06:51:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:08 smithi125 ceph-mon[130643]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2023-10-26T06:51:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:08 smithi153 ceph-mon[131657]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2023-10-26T06:51:09.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:08 smithi050 ceph-mon[94997]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2023-10-26T06:51:09.345 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/dmi-id.o 2023-10-26T06:51:09.352 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/rfkill/built-in.a 2023-10-26T06:51:09.405 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/netfilter/nf_log_common.o 2023-10-26T06:51:09.590 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/eventpoll.o 2023-10-26T06:51:09.652 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_pci.o 2023-10-26T06:51:09.815 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/chan.o 2023-10-26T06:51:09.842 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/gre_offload.o 2023-10-26T06:51:09.871 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/firmware/memmap.o 2023-10-26T06:51:09.980 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/trace.o 2023-10-26T06:51:10.496 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/netfilter/xt_mark.o 2023-10-26T06:51:10.523 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/firmware/built-in.a 2023-10-26T06:51:10.581 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/anon_inodes.o 2023-10-26T06:51:10.639 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/addrconf_core.o 2023-10-26T06:51:10.664 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_scatterlist.o 2023-10-26T06:51:10.937 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/metrics.o 2023-10-26T06:51:11.158 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/sch_generic.o 2023-10-26T06:51:11.170 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_suspend.o 2023-10-26T06:51:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:10 smithi125 ceph-mon[130643]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.3 MiB/s wr, 86 op/s 2023-10-26T06:51:11.191 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/signalfd.o 2023-10-26T06:51:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:10 smithi153 ceph-mon[131657]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.3 MiB/s wr, 86 op/s 2023-10-26T06:51:11.266 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/netfilter/xt_nat.o 2023-10-26T06:51:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:10 smithi050 ceph-mon[94997]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.3 MiB/s wr, 86 op/s 2023-10-26T06:51:11.725 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/exthdrs_core.o 2023-10-26T06:51:11.937 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_sysfs.o 2023-10-26T06:51:11.964 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netlink.o 2023-10-26T06:51:11.981 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/timerfd.o 2023-10-26T06:51:12.146 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/netfilter/xt_LOG.o 2023-10-26T06:51:12.324 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/omapdrm/displays/built-in.a 2023-10-26T06:51:12.366 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/omapdrm/dss/built-in.a 2023-10-26T06:51:12.397 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/omapdrm/built-in.a 2023-10-26T06:51:12.482 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/usbhid/hid-core.o 2023-10-26T06:51:12.744 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_checksum.o 2023-10-26T06:51:12.814 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/sch_mq.o 2023-10-26T06:51:12.839 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/eventfd.o 2023-10-26T06:51:12.920 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/nexthop.o 2023-10-26T06:51:13.047 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_utils.o 2023-10-26T06:51:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:12 smithi125 ceph-mon[130643]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2023-10-26T06:51:13.190 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/netfilter/xt_MASQUERADE.o 2023-10-26T06:51:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:12 smithi153 ceph-mon[131657]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2023-10-26T06:51:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:12 smithi050 ceph-mon[94997]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.3 MiB/s wr, 78 op/s 2023-10-26T06:51:13.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/usbhid/hiddev.o 2023-10-26T06:51:13.634 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/aio.o 2023-10-26T06:51:13.736 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/sch_api.o 2023-10-26T06:51:13.787 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_icmp.o 2023-10-26T06:51:14.061 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_csr.o 2023-10-26T06:51:14.262 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] net/netfilter/xt_addrtype.o 2023-10-26T06:51:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:14 smithi125 ceph-mon[130643]: osdmap e90: 12 total, 12 up, 12 in 2023-10-26T06:51:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:14 smithi125 ceph-mon[130643]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2023-10-26T06:51:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:14 smithi153 ceph-mon[131657]: osdmap e90: 12 total, 12 up, 12 in 2023-10-26T06:51:14.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:14 smithi153 ceph-mon[131657]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2023-10-26T06:51:14.486 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/usbhid/hid-pidff.o 2023-10-26T06:51:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:14 smithi050 ceph-mon[94997]: osdmap e90: 12 total, 12 up, 12 in 2023-10-26T06:51:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:14 smithi050 ceph-mon[94997]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2023-10-26T06:51:14.523 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ip_tunnel.o 2023-10-26T06:51:14.847 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/output_core.o 2023-10-26T06:51:14.926 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/mlme.o 2023-10-26T06:51:15.200 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_device_info.o 2023-10-26T06:51:15.343 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/io_uring.o 2023-10-26T06:51:15.384 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/hid/usbhid/built-in.a 2023-10-26T06:51:15.431 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/netfilter/built-in.a 2023-10-26T06:51:15.441 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-core.o 2023-10-26T06:51:15.526 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/vga/vgaarb.o 2023-10-26T06:51:15.658 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/sch_blackhole.o 2023-10-26T06:51:15.930 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/protocol.o 2023-10-26T06:51:16.108 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/sysctl_net_ipv4.o 2023-10-26T06:51:16.486 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/cls_api.o 2023-10-26T06:51:16.491 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/vga/built-in.a 2023-10-26T06:51:16.542 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/ip6_offload.o 2023-10-26T06:51:16.581 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_pch.o 2023-10-26T06:51:16.782 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-input.o 2023-10-26T06:51:16.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_pm.o 2023-10-26T06:51:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:16 smithi125 ceph-mon[130643]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2023-10-26T06:51:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:16 smithi153 ceph-mon[131657]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2023-10-26T06:51:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:16 smithi050 ceph-mon[94997]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2023-10-26T06:51:17.317 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/proc.o 2023-10-26T06:51:17.554 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/locks.o 2023-10-26T06:51:17.604 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hwmon/hwmon.o 2023-10-26T06:51:17.620 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/tcpv6_offload.o 2023-10-26T06:51:18.163 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/tdls.o 2023-10-26T06:51:18.400 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-quirks.o 2023-10-26T06:51:18.416 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/fib_rules.o 2023-10-26T06:51:18.627 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/hwmon/built-in.a 2023-10-26T06:51:18.682 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/panel/built-in.a 2023-10-26T06:51:18.686 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/exthdrs_offload.o 2023-10-26T06:51:18.726 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/inet6_hashtables.o 2023-10-26T06:51:18.821 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/act_api.o 2023-10-26T06:51:18.993 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-debug.o 2023-10-26T06:51:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:18 smithi125 ceph-mon[130643]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2023-10-26T06:51:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:18 smithi153 ceph-mon[131657]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2023-10-26T06:51:19.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:18 smithi050 ceph-mon[94997]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2023-10-26T06:51:19.353 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/compat.o 2023-10-26T06:51:19.599 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ipmr.o 2023-10-26T06:51:19.899 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/auth_gss.o 2023-10-26T06:51:19.914 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hidraw.o 2023-10-26T06:51:19.986 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv6/mcast_snoop.o 2023-10-26T06:51:20.095 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/compat_ioctl.o 2023-10-26T06:51:20.215 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/ocb.o 2023-10-26T06:51:20.304 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/sch_fifo.o 2023-10-26T06:51:20.618 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-generic.o 2023-10-26T06:51:21.092 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/ipv6/built-in.a 2023-10-26T06:51:21.136 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-a4tech.o 2023-10-26T06:51:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:20 smithi125 ceph-mon[130643]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2023-10-26T06:51:21.190 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sched/ematch.o 2023-10-26T06:51:21.212 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/binfmt_misc.o 2023-10-26T06:51:21.218 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_runtime_pm.o 2023-10-26T06:51:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:20 smithi153 ceph-mon[131657]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2023-10-26T06:51:21.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:20 smithi050 ceph-mon[94997]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 1.2 MiB/s wr, 69 op/s 2023-10-26T06:51:21.407 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/rcar-du/built-in.a 2023-10-26T06:51:21.456 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/hwtracing/intel_th/built-in.a 2023-10-26T06:51:21.522 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/algos/i2c-algo-bit.o 2023-10-26T06:51:21.638 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ipmr_base.o 2023-10-26T06:51:21.656 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/gss_generic_token.o 2023-10-26T06:51:21.675 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-apple.o 2023-10-26T06:51:21.782 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/led.o 2023-10-26T06:51:22.079 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/binfmt_script.o 2023-10-26T06:51:22.151 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/sched/built-in.a 2023-10-26T06:51:22.196 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/i2c/algos/built-in.a 2023-10-26T06:51:22.213 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/syncookies.o 2023-10-26T06:51:22.269 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-belkin.o 2023-10-26T06:51:22.273 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/busses/i2c-i801.o 2023-10-26T06:51:22.346 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/gss_mech_switch.o 2023-10-26T06:51:22.405 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_sideband.o 2023-10-26T06:51:22.600 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/binfmt_elf.o 2023-10-26T06:51:22.800 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-cherry.o 2023-10-26T06:51:22.879 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/compat_binfmt_elf.o 2023-10-26T06:51:22.960 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/pm.o 2023-10-26T06:51:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:22 smithi125 ceph-mon[130643]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2023-10-26T06:51:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:22 smithi153 ceph-mon[131657]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2023-10-26T06:51:23.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:22 smithi050 ceph-mon[94997]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2023-10-26T06:51:23.282 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/i2c/busses/built-in.a 2023-10-26T06:51:23.331 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/i2c/muxes/built-in.a 2023-10-26T06:51:23.335 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-chicony.o 2023-10-26T06:51:23.378 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/i2c-boardinfo.o 2023-10-26T06:51:23.410 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tunnel4.o 2023-10-26T06:51:23.434 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/svcauth_gss.o 2023-10-26T06:51:23.488 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_uncore.o 2023-10-26T06:51:23.845 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-cypress.o 2023-10-26T06:51:23.898 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/rc80211_minstrel.o 2023-10-26T06:51:23.938 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/i2c-core-base.o 2023-10-26T06:51:24.128 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/mbcache.o 2023-10-26T06:51:24.395 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-ezkey.o 2023-10-26T06:51:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:24 smithi125 ceph-mon[130643]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2023-10-26T06:51:24.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:24 smithi153 ceph-mon[131657]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2023-10-26T06:51:24.510 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/ipconfig.o 2023-10-26T06:51:24.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:24 smithi050 ceph-mon[94997]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2023-10-26T06:51:24.569 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/i3c/built-in.a 2023-10-26T06:51:24.612 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/tilcdc/built-in.a 2023-10-26T06:51:24.670 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/unix/af_unix.o 2023-10-26T06:51:24.882 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/posix_acl.o 2023-10-26T06:51:24.892 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-gyration.o 2023-10-26T06:51:24.965 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/gss_rpc_upcall.o 2023-10-26T06:51:25.428 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-ite.o 2023-10-26T06:51:25.513 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/i2c-core-smbus.o 2023-10-26T06:51:25.671 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/mac80211/rc80211_minstrel_ht.o 2023-10-26T06:51:25.711 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/coredump.o 2023-10-26T06:51:25.828 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_wakeref.o 2023-10-26T06:51:25.903 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/netfilter.o 2023-10-26T06:51:25.926 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-kensington.o 2023-10-26T06:51:26.033 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/gss_rpc_xdr.o 2023-10-26T06:51:26.288 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_memcpy.o 2023-10-26T06:51:26.433 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-lg.o 2023-10-26T06:51:26.483 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/unix/garbage.o 2023-10-26T06:51:26.563 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_mm.o 2023-10-26T06:51:26.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/i2c-core-acpi.o 2023-10-26T06:51:26.940 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/drop_caches.o 2023-10-26T06:51:26.942 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/tcp_cubic.o 2023-10-26T06:51:27.141 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_gss/trace.o 2023-10-26T06:51:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:26 smithi125 ceph-mon[130643]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2023-10-26T06:51:27.184 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-lgff.o 2023-10-26T06:51:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:26 smithi153 ceph-mon[131657]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2023-10-26T06:51:27.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:26 smithi050 ceph-mon[94997]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.1 MiB/s wr, 61 op/s 2023-10-26T06:51:27.347 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/i2c/i2c-smbus.o 2023-10-26T06:51:27.478 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/unix/sysctl_net_unix.o 2023-10-26T06:51:27.515 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_sw_fence.o 2023-10-26T06:51:27.643 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/fhandle.o 2023-10-26T06:51:27.715 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-lg4ff.o 2023-10-26T06:51:27.883 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/mac80211/built-in.a 2023-10-26T06:51:27.967 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/i2c/built-in.a 2023-10-26T06:51:27.990 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-microsoft.o 2023-10-26T06:51:28.027 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-monterey.o 2023-10-26T06:51:28.029 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/cipso_ipv4.o 2023-10-26T06:51:28.069 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_sw_fence_work.o 2023-10-26T06:51:28.376 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/unix/scm.o 2023-10-26T06:51:28.408 INFO:tasks.workunit.client.0.smithi050.stdout: CC fs/dcookies.o 2023-10-26T06:51:28.418 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/sunrpc/auth_gss/built-in.a 2023-10-26T06:51:28.480 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/clnt.o 2023-10-26T06:51:28.489 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_syncmap.o 2023-10-26T06:51:28.549 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_user_extensions.o 2023-10-26T06:51:28.559 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/idle/built-in.a 2023-10-26T06:51:28.587 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-ntrig.o 2023-10-26T06:51:28.600 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/xfrm4_policy.o 2023-10-26T06:51:28.920 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/xprt.o 2023-10-26T06:51:28.951 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_ioc32.o 2023-10-26T06:51:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:28 smithi125 ceph-mon[130643]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2023-10-26T06:51:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:28 smithi153 ceph-mon[131657]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2023-10-26T06:51:29.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:28 smithi050 ceph-mon[94997]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2023-10-26T06:51:29.334 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-pl.o 2023-10-26T06:51:29.380 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/unix/built-in.a 2023-10-26T06:51:29.390 INFO:tasks.workunit.client.0.smithi050.stdout: AR fs/built-in.a 2023-10-26T06:51:29.441 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/tiny/built-in.a 2023-10-26T06:51:29.516 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/joystick/built-in.a 2023-10-26T06:51:29.538 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/keyboard/atkbd.o 2023-10-26T06:51:29.573 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-petalynx.o 2023-10-26T06:51:29.686 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/xfrm4_state.o 2023-10-26T06:51:29.689 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/core.o 2023-10-26T06:51:29.909 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/socklib.o 2023-10-26T06:51:29.989 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_debugfs.o 2023-10-26T06:51:30.142 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-redragon.o 2023-10-26T06:51:30.405 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/keyboard/built-in.a 2023-10-26T06:51:30.461 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/misc/built-in.a 2023-10-26T06:51:30.486 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_crtc_helper.o 2023-10-26T06:51:30.521 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/psmouse-base.o 2023-10-26T06:51:30.614 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-samsung.o 2023-10-26T06:51:30.673 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/xfrm4_input.o 2023-10-26T06:51:30.752 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/synaptics.o 2023-10-26T06:51:30.906 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/xprtsock.o 2023-10-26T06:51:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:30 smithi125 ceph-mon[130643]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2023-10-26T06:51:31.196 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-sony.o 2023-10-26T06:51:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:30 smithi153 ceph-mon[131657]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2023-10-26T06:51:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:30 smithi050 ceph-mon[94997]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2023-10-26T06:51:31.452 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/serio/serio.o 2023-10-26T06:51:31.501 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_policy.o 2023-10-26T06:51:31.732 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/sysfs.o 2023-10-26T06:51:31.736 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/xfrm4_output.o 2023-10-26T06:51:31.787 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/focaltech.o 2023-10-26T06:51:32.181 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/serio/i8042.o 2023-10-26T06:51:32.307 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-sunplus.o 2023-10-26T06:51:32.355 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/alps.o 2023-10-26T06:51:32.702 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_pipe_crc.o 2023-10-26T06:51:32.757 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/ipv4/xfrm4_protocol.o 2023-10-26T06:51:32.765 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/sched.o 2023-10-26T06:51:32.841 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/hid/hid-topseed.o 2023-10-26T06:51:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:32 smithi125 ceph-mon[130643]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2023-10-26T06:51:33.213 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/radiotap.o 2023-10-26T06:51:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:32 smithi153 ceph-mon[131657]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2023-10-26T06:51:33.261 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/serio/serport.o 2023-10-26T06:51:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:32 smithi050 ceph-mon[94997]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2023-10-26T06:51:33.389 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/hid/built-in.a 2023-10-26T06:51:33.498 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_state.o 2023-10-26T06:51:33.648 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/byd.o 2023-10-26T06:51:33.808 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_pmu.o 2023-10-26T06:51:33.841 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/ipv4/built-in.a 2023-10-26T06:51:33.897 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/serio/libps2.o 2023-10-26T06:51:33.956 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_hash.o 2023-10-26T06:51:34.016 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/util.o 2023-10-26T06:51:34.203 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/logips2pp.o 2023-10-26T06:51:34.279 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_breadcrumbs.o 2023-10-26T06:51:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:34 smithi125 ceph-mon[130643]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:51:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:34 smithi153 ceph-mon[131657]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:51:34.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:34 smithi050 ceph-mon[94997]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:51:34.554 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_dp_helper.o 2023-10-26T06:51:34.604 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/serio/built-in.a 2023-10-26T06:51:34.663 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_input.o 2023-10-26T06:51:34.874 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/lifebook.o 2023-10-26T06:51:35.169 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_dsc.o 2023-10-26T06:51:35.448 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/trackpoint.o 2023-10-26T06:51:35.547 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth.o 2023-10-26T06:51:35.625 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_context.o 2023-10-26T06:51:35.645 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_cs.o 2023-10-26T06:51:35.762 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_pool.o 2023-10-26T06:51:35.768 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/socket.o 2023-10-26T06:51:36.008 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_output.o 2023-10-26T06:51:36.102 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/cypress_ps2.o 2023-10-26T06:51:36.461 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/reg.o 2023-10-26T06:51:36.686 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_probe_helper.o 2023-10-26T06:51:36.753 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_plane_helper.o 2023-10-26T06:51:36.768 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/mouse/psmouse-smbus.o 2023-10-26T06:51:37.013 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_null.o 2023-10-26T06:51:37.094 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_pm.o 2023-10-26T06:51:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:36 smithi125 ceph-mon[130643]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2023-10-26T06:51:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:36 smithi153 ceph-mon[131657]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2023-10-26T06:51:37.238 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_sysctl.o 2023-10-26T06:51:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:36 smithi050 ceph-mon[94997]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2023-10-26T06:51:37.369 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/mouse/built-in.a 2023-10-26T06:51:37.388 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/auth_unix.o 2023-10-26T06:51:37.432 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/tablet/built-in.a 2023-10-26T06:51:37.489 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/iommu.o 2023-10-26T06:51:37.498 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/touchscreen/of_touchscreen.o 2023-10-26T06:51:37.882 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_user.o 2023-10-26T06:51:38.005 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/scan.o 2023-10-26T06:51:38.047 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/touchscreen/built-in.a 2023-10-26T06:51:38.050 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_replay.o 2023-10-26T06:51:38.089 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/input.o 2023-10-26T06:51:38.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:37 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:51:38.205 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_dp_mst_topology.o 2023-10-26T06:51:38.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:37 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:51:38.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:37 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:51:38.384 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/svc.o 2023-10-26T06:51:38.844 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/iommu-traces.o 2023-10-26T06:51:38.849 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/iommu-sysfs.o 2023-10-26T06:51:38.864 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_gt.o 2023-10-26T06:51:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:38 smithi125 ceph-mon[130643]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2023-10-26T06:51:39.193 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_device.o 2023-10-26T06:51:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:38 smithi153 ceph-mon[131657]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2023-10-26T06:51:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:38 smithi050 ceph-mon[94997]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2023-10-26T06:51:39.402 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/input-compat.o 2023-10-26T06:51:39.433 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/compat.o 2023-10-26T06:51:39.732 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/iova.o 2023-10-26T06:51:39.943 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_irq.o 2023-10-26T06:51:39.974 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sysctl_net.o 2023-10-26T06:51:39.995 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/input-mt.o 2023-10-26T06:51:40.052 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/svcsock.o 2023-10-26T06:51:40.218 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_algo.o 2023-10-26T06:51:40.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:39 smithi153 ceph-mon[131657]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2023-10-26T06:51:40.248 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/nl80211.o 2023-10-26T06:51:40.271 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:39 smithi050 ceph-mon[94997]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2023-10-26T06:51:40.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:39 smithi125 ceph-mon[130643]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 1.2 MiB/s wr, 75 op/s 2023-10-26T06:51:40.638 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/amd_iommu.o 2023-10-26T06:51:40.698 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/input-poller.o 2023-10-26T06:51:40.782 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/svcauth.o 2023-10-26T06:51:40.985 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm.o 2023-10-26T06:51:41.000 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/irqchip/built-in.a 2023-10-26T06:51:41.045 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_atomic_helper.o 2023-10-26T06:51:41.292 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/ff-core.o 2023-10-26T06:51:41.327 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/xfrm/xfrm_user.o 2023-10-26T06:51:41.432 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/ff-memless.o 2023-10-26T06:51:41.567 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/svcauth_unix.o 2023-10-26T06:51:41.916 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/mlme.o 2023-10-26T06:51:41.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm_irq.o 2023-10-26T06:51:42.112 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/input-polldev.o 2023-10-26T06:51:42.289 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/amd_iommu_init.o 2023-10-26T06:51:42.649 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/ibss.o 2023-10-26T06:51:42.720 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/sparse-keymap.o 2023-10-26T06:51:42.924 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_hangcheck.o 2023-10-26T06:51:42.932 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/addr.o 2023-10-26T06:51:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:42 smithi125 ceph-mon[130643]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2023-10-26T06:51:43.190 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/xfrm/built-in.a 2023-10-26T06:51:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:42 smithi153 ceph-mon[131657]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2023-10-26T06:51:43.258 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/leds/trigger/built-in.a 2023-10-26T06:51:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:42 smithi050 ceph-mon[94997]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2023-10-26T06:51:43.303 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/leds/led-core.o 2023-10-26T06:51:43.326 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/input-leds.o 2023-10-26T06:51:43.631 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/amd_iommu_quirks.o 2023-10-26T06:51:43.760 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/leds/led-class.o 2023-10-26T06:51:43.896 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/input/evdev.o 2023-10-26T06:51:43.901 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/rpcb_clnt.o 2023-10-26T06:51:43.911 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_lrc.o 2023-10-26T06:51:43.981 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_kms_helper_common.o 2023-10-26T06:51:43.998 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/dmar.o 2023-10-26T06:51:44.246 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_dp_dual_mode_helper.o 2023-10-26T06:51:44.319 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/leds/led-triggers.o 2023-10-26T06:51:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:44 smithi125 ceph-mon[130643]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2023-10-26T06:51:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:44 smithi153 ceph-mon[131657]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2023-10-26T06:51:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:44 smithi050 ceph-mon[94997]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2023-10-26T06:51:44.574 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/macintosh/mac_hid.o 2023-10-26T06:51:44.930 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/input/built-in.a 2023-10-26T06:51:44.938 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/timer.o 2023-10-26T06:51:44.956 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/leds/built-in.a 2023-10-26T06:51:45.008 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_renderstate.o 2023-10-26T06:51:45.026 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/intel-iommu.o 2023-10-26T06:51:45.078 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_simple_kms_helper.o 2023-10-26T06:51:45.141 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/macintosh/built-in.a 2023-10-26T06:51:45.188 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/intel-pasid.o 2023-10-26T06:51:45.254 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_reset.o 2023-10-26T06:51:45.705 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/sme.o 2023-10-26T06:51:45.903 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/xdr.o 2023-10-26T06:51:46.010 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/mailbox/mailbox.o 2023-10-26T06:51:46.033 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/sunrpc_syms.o 2023-10-26T06:51:46.036 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/iommu/intel-trace.o 2023-10-26T06:51:46.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/mailbox/pcc.o 2023-10-26T06:51:46.673 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_ringbuffer.o 2023-10-26T06:51:46.829 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/cache.o 2023-10-26T06:51:47.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/chan.o 2023-10-26T06:51:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:46 smithi125 ceph-mon[130643]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.0 MiB/s wr, 64 op/s 2023-10-26T06:51:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:46 smithi153 ceph-mon[131657]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.0 MiB/s wr, 64 op/s 2023-10-26T06:51:47.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:46 smithi050 ceph-mon[94997]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.0 MiB/s wr, 64 op/s 2023-10-26T06:51:47.277 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/mailbox/built-in.a 2023-10-26T06:51:47.325 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_modeset_helper.o 2023-10-26T06:51:47.584 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/rpc_pipe.o 2023-10-26T06:51:47.587 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/iommu/built-in.a 2023-10-26T06:51:47.629 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_mocs.o 2023-10-26T06:51:47.636 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_sseu.o 2023-10-26T06:51:47.947 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_timeline.o 2023-10-26T06:51:48.225 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/md.o 2023-10-26T06:51:48.314 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_scdc_helper.o 2023-10-26T06:51:48.374 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/common/b2c2/built-in.a 2023-10-26T06:51:48.416 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/common/saa7146/built-in.a 2023-10-26T06:51:48.458 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/common/siano/built-in.a 2023-10-26T06:51:48.500 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/common/v4l2-tpg/built-in.a 2023-10-26T06:51:48.545 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/common/videobuf2/built-in.a 2023-10-26T06:51:48.580 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/common/built-in.a 2023-10-26T06:51:48.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/intel_workarounds.o 2023-10-26T06:51:48.645 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/firewire/built-in.a 2023-10-26T06:51:48.655 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/svc_xprt.o 2023-10-26T06:51:48.709 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/i2c/built-in.a 2023-10-26T06:51:48.745 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/ethtool.o 2023-10-26T06:51:48.768 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/mmc/siano/built-in.a 2023-10-26T06:51:48.801 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/mmc/built-in.a 2023-10-26T06:51:48.866 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/b2c2/built-in.a 2023-10-26T06:51:48.910 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/md-bitmap.o 2023-10-26T06:51:48.920 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/ddbridge/built-in.a 2023-10-26T06:51:48.965 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/dm1105/built-in.a 2023-10-26T06:51:48.983 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm.o 2023-10-26T06:51:49.010 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-table.o 2023-10-26T06:51:49.020 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/intel/ipu3/built-in.a 2023-10-26T06:51:49.051 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/intel/built-in.a 2023-10-26T06:51:49.096 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/mantis/built-in.a 2023-10-26T06:51:49.139 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/netup_unidvb/built-in.a 2023-10-26T06:51:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:48 smithi125 ceph-mon[130643]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 973 KiB/s wr, 65 op/s 2023-10-26T06:51:49.182 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/ngene/built-in.a 2023-10-26T06:51:49.226 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/pluto2/built-in.a 2023-10-26T06:51:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:48 smithi153 ceph-mon[131657]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 973 KiB/s wr, 65 op/s 2023-10-26T06:51:49.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:48 smithi050 ceph-mon[94997]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 973 KiB/s wr, 65 op/s 2023-10-26T06:51:49.272 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/pt1/built-in.a 2023-10-26T06:51:49.317 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/pt3/built-in.a 2023-10-26T06:51:49.362 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/saa7146/built-in.a 2023-10-26T06:51:49.407 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/smipcie/built-in.a 2023-10-26T06:51:49.451 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/ttpci/built-in.a 2023-10-26T06:51:49.486 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/pci/built-in.a 2023-10-26T06:51:49.590 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/cros-ec-cec/built-in.a 2023-10-26T06:51:49.634 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/davinci/built-in.a 2023-10-26T06:51:49.678 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/meson/built-in.a 2023-10-26T06:51:49.720 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/omap/built-in.a 2023-10-26T06:51:49.811 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/stm32/built-in.a 2023-10-26T06:51:49.867 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/sunxi/sun4i-csi/built-in.a 2023-10-26T06:51:49.917 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/sunxi/sun6i-csi/built-in.a 2023-10-26T06:51:49.953 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/sunxi/built-in.a 2023-10-26T06:51:49.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/gen6_renderstate.o 2023-10-26T06:51:50.003 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/platform/built-in.a 2023-10-26T06:51:50.124 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/gen7_renderstate.o 2023-10-26T06:51:50.124 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/rc/keymaps/built-in.a 2023-10-26T06:51:50.150 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/mesh.o 2023-10-26T06:51:50.163 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/rc/built-in.a 2023-10-26T06:51:50.205 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/spi/built-in.a 2023-10-26T06:51:50.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:49 smithi153 ceph-mon[131657]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:51:50.252 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/tuners/built-in.a 2023-10-26T06:51:50.257 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/gen8_renderstate.o 2023-10-26T06:51:50.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:49 smithi050 ceph-mon[94997]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:51:50.314 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/b2c2/built-in.a 2023-10-26T06:51:50.354 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/dvb-usb/built-in.a 2023-10-26T06:51:50.385 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/gen9_renderstate.o 2023-10-26T06:51:50.397 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/xprtmultipath.o 2023-10-26T06:51:50.401 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/dvb-usb-v2/built-in.a 2023-10-26T06:51:50.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:49 smithi125 ceph-mon[130643]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.1 MiB/s wr, 66 op/s 2023-10-26T06:51:50.440 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/s2255/built-in.a 2023-10-26T06:51:50.446 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_gem_framebuffer_helper.o 2023-10-26T06:51:50.485 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/siano/built-in.a 2023-10-26T06:51:50.495 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/stkwebcam/built-in.a 2023-10-26T06:51:50.515 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_busy.o 2023-10-26T06:51:50.542 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/ttusb-budget/built-in.a 2023-10-26T06:51:50.549 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/ttusb-dec/built-in.a 2023-10-26T06:51:50.551 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/mfd/built-in.a 2023-10-26T06:51:50.589 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/cardreader/built-in.a 2023-10-26T06:51:50.592 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/zr364xx/built-in.a 2023-10-26T06:51:50.594 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/stats.o 2023-10-26T06:51:50.626 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/cb710/built-in.a 2023-10-26T06:51:50.627 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/usb/built-in.a 2023-10-26T06:51:50.670 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/eeprom/built-in.a 2023-10-26T06:51:50.701 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/media/built-in.a 2023-10-26T06:51:50.716 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/lis3lv02d/built-in.a 2023-10-26T06:51:50.767 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/mic/bus/built-in.a 2023-10-26T06:51:50.789 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/ti-st/built-in.a 2023-10-26T06:51:50.799 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/mic/built-in.a 2023-10-26T06:51:50.835 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_atomic_state_helper.o 2023-10-26T06:51:50.836 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/misc/built-in.a 2023-10-26T06:51:50.909 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/ap.o 2023-10-26T06:51:51.220 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/trace.o 2023-10-26T06:51:51.273 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_clflush.o 2023-10-26T06:51:51.488 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/mmc/built-in.a 2023-10-26T06:51:51.532 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-target.o 2023-10-26T06:51:51.594 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/dsa/b53/built-in.a 2023-10-26T06:51:51.637 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/dsa/microchip/built-in.a 2023-10-26T06:51:51.660 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/3com/built-in.a 2023-10-26T06:51:51.681 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/dsa/mv88e6xxx/built-in.a 2023-10-26T06:51:51.703 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/8390/built-in.a 2023-10-26T06:51:51.726 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/dsa/sja1105/built-in.a 2023-10-26T06:51:51.749 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/adaptec/built-in.a 2023-10-26T06:51:51.759 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/dsa/built-in.a 2023-10-26T06:51:51.797 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/agere/built-in.a 2023-10-26T06:51:51.825 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/nfc/built-in.a 2023-10-26T06:51:51.834 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/alacritech/built-in.a 2023-10-26T06:51:51.870 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_client_blt.o 2023-10-26T06:51:51.877 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/sunrpc/sysctl.o 2023-10-26T06:51:51.879 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/alteon/built-in.a 2023-10-26T06:51:51.924 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/amazon/built-in.a 2023-10-26T06:51:51.969 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/amd/built-in.a 2023-10-26T06:51:52.014 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/aquantia/built-in.a 2023-10-26T06:51:52.058 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/arc/built-in.a 2023-10-26T06:51:52.107 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/atheros/built-in.a 2023-10-26T06:51:52.153 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/aurora/built-in.a 2023-10-26T06:51:52.208 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/broadcom/tg3.o 2023-10-26T06:51:52.289 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_context.o 2023-10-26T06:51:52.317 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-linear.o 2023-10-26T06:51:52.380 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-stripe.o 2023-10-26T06:51:52.447 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_damage_helper.o 2023-10-26T06:51:52.526 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/sunrpc/built-in.a 2023-10-26T06:51:52.624 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/nvme/host/built-in.a 2023-10-26T06:51:52.668 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/nvme/target/built-in.a 2023-10-26T06:51:52.699 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/nvme/built-in.a 2023-10-26T06:51:52.747 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/fddi/built-in.a 2023-10-26T06:51:52.792 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/brocade/built-in.a 2023-10-26T06:51:52.849 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/ocb.o 2023-10-26T06:51:52.904 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_format_helper.o 2023-10-26T06:51:53.024 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/nvmem/core.o 2023-10-26T06:51:53.114 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/nvmem/nvmem-sysfs.o 2023-10-26T06:51:53.165 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-ioctl.o 2023-10-26T06:51:53.260 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:52 smithi153 ceph-mon[131657]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 890 KiB/s wr, 52 op/s 2023-10-26T06:51:53.260 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:52 smithi125 ceph-mon[130643]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 890 KiB/s wr, 52 op/s 2023-10-26T06:51:53.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:52 smithi050 ceph-mon[94997]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 890 KiB/s wr, 52 op/s 2023-10-26T06:51:53.458 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cadence/built-in.a 2023-10-26T06:51:53.500 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/pmsr.o 2023-10-26T06:51:53.607 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_self_refresh_helper.o 2023-10-26T06:51:53.902 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/nvmem/built-in.a 2023-10-26T06:51:53.953 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/hamradio/built-in.a 2023-10-26T06:51:53.996 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_dmabuf.o 2023-10-26T06:51:54.120 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-io.o 2023-10-26T06:51:54.296 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/mdio-boardinfo.o 2023-10-26T06:51:54.300 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cavium/common/built-in.a 2023-10-26T06:51:54.348 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cavium/liquidio/built-in.a 2023-10-26T06:51:54.391 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cavium/octeon/built-in.a 2023-10-26T06:51:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:54 smithi125 ceph-mon[130643]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2023-10-26T06:51:54.433 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cavium/thunder/built-in.a 2023-10-26T06:51:54.464 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cavium/built-in.a 2023-10-26T06:51:54.467 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pci/controller/dwc/built-in.a 2023-10-26T06:51:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:54 smithi153 ceph-mon[131657]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2023-10-26T06:51:54.504 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pci/controller/built-in.a 2023-10-26T06:51:54.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:54 smithi050 ceph-mon[94997]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.0 MiB/s wr, 59 op/s 2023-10-26T06:51:54.520 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_domain.o 2023-10-26T06:51:54.564 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/hotplug/pci_hotplug_core.o 2023-10-26T06:51:55.033 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/phy.o 2023-10-26T06:51:55.076 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-kcopyd.o 2023-10-26T06:51:55.132 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pcie/portdrv_core.o 2023-10-26T06:51:55.198 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/usb/built-in.a 2023-10-26T06:51:55.243 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pcie/portdrv_pci.o 2023-10-26T06:51:55.395 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/hotplug/acpi_pcihp.o 2023-10-26T06:51:55.736 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_execbuffer.o 2023-10-26T06:51:55.858 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pci/switch/built-in.a 2023-10-26T06:51:55.863 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pcie/err.o 2023-10-26T06:51:55.903 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/bridge/panel.o 2023-10-26T06:51:56.063 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pci/hotplug/built-in.a 2023-10-26T06:51:56.073 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-sysfs.o 2023-10-26T06:51:56.120 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-stats.o 2023-10-26T06:51:56.145 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/phy-c45.o 2023-10-26T06:51:56.476 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pcie/aspm.o 2023-10-26T06:51:56.531 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/phy-core.o 2023-10-26T06:51:56.836 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/chelsio/built-in.a 2023-10-26T06:51:56.890 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/cs.o 2023-10-26T06:51:56.913 INFO:tasks.workunit.client.0.smithi050.stdout: GEN net/wireless/shipped-certs.c 2023-10-26T06:51:56.941 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_fb_helper.o 2023-10-26T06:51:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:56 smithi125 ceph-mon[130643]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 984 KiB/s wr, 49 op/s 2023-10-26T06:51:57.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:56 smithi153 ceph-mon[131657]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 984 KiB/s wr, 49 op/s 2023-10-26T06:51:57.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:56 smithi050 ceph-mon[94997]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 984 KiB/s wr, 49 op/s 2023-10-26T06:51:57.317 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-rq.o 2023-10-26T06:51:57.406 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/phy_device.o 2023-10-26T06:51:57.420 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pcie/aer.o 2023-10-26T06:51:57.524 INFO:tasks.workunit.client.0.smithi050.stdout: CC net/wireless/shipped-certs.o 2023-10-26T06:51:57.743 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/socket_sysfs.o 2023-10-26T06:51:57.785 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_fence.o 2023-10-26T06:51:58.185 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-builtin.o 2023-10-26T06:51:58.206 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/admtek/built-in.a 2023-10-26T06:51:58.246 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/ath/built-in.a 2023-10-26T06:51:58.255 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/wireless/built-in.a 2023-10-26T06:51:58.290 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/atmel/built-in.a 2023-10-26T06:51:58.334 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/broadcom/built-in.a 2023-10-26T06:51:58.359 INFO:tasks.workunit.client.0.smithi050.stdout: AR net/built-in.a 2023-10-26T06:51:58.378 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/cisco/built-in.a 2023-10-26T06:51:58.381 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/cardbus.o 2023-10-26T06:51:58.399 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pcie/pme.o 2023-10-26T06:51:58.418 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/intel/built-in.a 2023-10-26T06:51:58.460 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/intersil/built-in.a 2023-10-26T06:51:58.499 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/marvell/built-in.a 2023-10-26T06:51:58.539 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/mediatek/built-in.a 2023-10-26T06:51:58.581 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/quantenna/built-in.a 2023-10-26T06:51:58.626 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/ralink/built-in.a 2023-10-26T06:51:58.654 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_internal.o 2023-10-26T06:51:58.665 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/realtek/built-in.a 2023-10-26T06:51:58.709 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/rsi/built-in.a 2023-10-26T06:51:58.747 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/st/built-in.a 2023-10-26T06:51:58.789 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/ti/built-in.a 2023-10-26T06:51:58.795 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/ds.o 2023-10-26T06:51:58.835 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/zydas/built-in.a 2023-10-26T06:51:58.836 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/mdio_bus.o 2023-10-26T06:51:58.865 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/wireless/built-in.a 2023-10-26T06:51:58.872 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-raid1.o 2023-10-26T06:51:58.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/access.o 2023-10-26T06:51:59.006 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-log.o 2023-10-26T06:51:59.035 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/broadcom/built-in.a 2023-10-26T06:51:59.065 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pci/pcie/built-in.a 2023-10-26T06:51:59.085 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cisco/built-in.a 2023-10-26T06:51:59.106 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-region-hash.o 2023-10-26T06:51:59.129 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/cortina/built-in.a 2023-10-26T06:51:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:58 smithi125 ceph-mon[130643]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1001 KiB/s wr, 54 op/s 2023-10-26T06:51:59.182 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/dec/tulip/built-in.a 2023-10-26T06:51:59.215 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/dec/built-in.a 2023-10-26T06:51:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:58 smithi153 ceph-mon[131657]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1001 KiB/s wr, 54 op/s 2023-10-26T06:51:59.260 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/dlink/built-in.a 2023-10-26T06:51:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:58 smithi050 ceph-mon[94997]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1001 KiB/s wr, 54 op/s 2023-10-26T06:51:59.309 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/emulex/built-in.a 2023-10-26T06:51:59.381 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/ezchip/built-in.a 2023-10-26T06:51:59.436 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/fujitsu/built-in.a 2023-10-26T06:51:59.480 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/google/built-in.a 2023-10-26T06:51:59.530 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/hp/built-in.a 2023-10-26T06:51:59.582 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/huawei/built-in.a 2023-10-26T06:51:59.630 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/i825xx/built-in.a 2023-10-26T06:51:59.712 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000/e1000_main.o 2023-10-26T06:51:59.726 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_object.o 2023-10-26T06:51:59.873 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/pcmcia_resource.o 2023-10-26T06:51:59.892 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/mdio_device.o 2023-10-26T06:51:59.914 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/bus.o 2023-10-26T06:52:00.057 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/perf/built-in.a 2023-10-26T06:52:00.112 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/platform/x86/eeepc-laptop.o 2023-10-26T06:52:00.125 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_object_blt.o 2023-10-26T06:52:00.163 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/md/dm-zero.o 2023-10-26T06:52:00.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:51:59 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:52:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:51:59 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:52:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:51:59 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:52:00.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/phy/realtek.o 2023-10-26T06:52:00.991 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/probe.o 2023-10-26T06:52:01.063 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/md/built-in.a 2023-10-26T06:52:01.065 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/cistpl.o 2023-10-26T06:52:01.070 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_auth.o 2023-10-26T06:52:01.160 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/platform/x86/pmc_atom.o 2023-10-26T06:52:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:00 smithi125 ceph-mon[130643]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 60 op/s 2023-10-26T06:52:01.185 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/pcmcia_cis.o 2023-10-26T06:52:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:00 smithi153 ceph-mon[131657]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 60 op/s 2023-10-26T06:52:01.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:00 smithi050 ceph-mon[94997]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 60 op/s 2023-10-26T06:52:01.317 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_mman.o 2023-10-26T06:52:01.773 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/rsrc_mgr.o 2023-10-26T06:52:01.807 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/phy/built-in.a 2023-10-26T06:52:01.866 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/marvell/octeontx2/built-in.a 2023-10-26T06:52:01.873 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/platform/x86/built-in.a 2023-10-26T06:52:01.904 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/platform/built-in.a 2023-10-26T06:52:01.912 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/marvell/sky2.o 2023-10-26T06:52:01.980 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/mellanox/built-in.a 2023-10-26T06:52:02.049 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/pnpacpi/core.o 2023-10-26T06:52:02.149 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/rsrc_nonstatic.o 2023-10-26T06:52:02.158 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/micrel/built-in.a 2023-10-26T06:52:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:52:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:52:02.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:52:02.201 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/mii.o 2023-10-26T06:52:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:52:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:52:02.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:52:02.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:52:02.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:52:02.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:52:02.368 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/Space.o 2023-10-26T06:52:02.413 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000/e1000_hw.o 2023-10-26T06:52:02.482 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/host-bridge.o 2023-10-26T06:52:02.670 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/pnpacpi/rsparser.o 2023-10-26T06:52:02.709 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_pages.o 2023-10-26T06:52:03.014 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pcmcia/yenta_socket.o 2023-10-26T06:52:03.099 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/remove.o 2023-10-26T06:52:03.109 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pci.o 2023-10-26T06:52:03.143 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_cache.o 2023-10-26T06:52:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:02 smithi125 ceph-mon[130643]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2023-10-26T06:52:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:02 smithi153 ceph-mon[131657]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2023-10-26T06:52:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:02 smithi050 ceph-mon[94997]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.1 MiB/s wr, 70 op/s 2023-10-26T06:52:03.507 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pnp/pnpacpi/built-in.a 2023-10-26T06:52:03.550 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/core.o 2023-10-26T06:52:03.713 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/82571.o 2023-10-26T06:52:03.746 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/power/supply/power_supply_core.o 2023-10-26T06:52:03.823 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_phys.o 2023-10-26T06:52:04.147 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pcmcia/built-in.a 2023-10-26T06:52:04.180 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/card.o 2023-10-26T06:52:04.194 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000/e1000_ethtool.o 2023-10-26T06:52:04.208 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/power/supply/power_supply_sysfs.o 2023-10-26T06:52:04.406 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/marvell/built-in.a 2023-10-26T06:52:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:04 smithi125 ceph-mon[130643]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 1.4 MiB/s wr, 84 op/s 2023-10-26T06:52:04.470 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/driver.o 2023-10-26T06:52:04.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:04 smithi153 ceph-mon[131657]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 1.4 MiB/s wr, 84 op/s 2023-10-26T06:52:04.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:04 smithi050 ceph-mon[94997]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 1.4 MiB/s wr, 84 op/s 2023-10-26T06:52:04.522 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/loopback.o 2023-10-26T06:52:04.739 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/power/supply/power_supply_leds.o 2023-10-26T06:52:04.747 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/ich8lan.o 2023-10-26T06:52:04.865 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e100.o 2023-10-26T06:52:04.865 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_pm.o 2023-10-26T06:52:05.010 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/resource.o 2023-10-26T06:52:05.243 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/power/supply/power_supply_hwmon.o 2023-10-26T06:52:05.411 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pci-driver.o 2023-10-26T06:52:05.569 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_file.o 2023-10-26T06:52:05.733 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/power/supply/built-in.a 2023-10-26T06:52:05.779 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/power/built-in.a 2023-10-26T06:52:05.786 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000/e1000_param.o 2023-10-26T06:52:05.837 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/netconsole.o 2023-10-26T06:52:05.857 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/manager.o 2023-10-26T06:52:05.944 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_shmem.o 2023-10-26T06:52:06.418 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/microchip/built-in.a 2023-10-26T06:52:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:06 smithi125 ceph-mon[130643]: osdmap e91: 12 total, 12 up, 12 in 2023-10-26T06:52:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:06 smithi125 ceph-mon[130643]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.2 MiB/s wr, 84 op/s 2023-10-26T06:52:06.452 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/support.o 2023-10-26T06:52:06.459 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/80003es2lan.o 2023-10-26T06:52:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:06 smithi153 ceph-mon[131657]: osdmap e91: 12 total, 12 up, 12 in 2023-10-26T06:52:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:06 smithi153 ceph-mon[131657]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.2 MiB/s wr, 84 op/s 2023-10-26T06:52:06.516 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pps/clients/built-in.a 2023-10-26T06:52:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:06 smithi050 ceph-mon[94997]: osdmap e91: 12 total, 12 up, 12 in 2023-10-26T06:52:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:06 smithi050 ceph-mon[94997]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.2 MiB/s wr, 84 op/s 2023-10-26T06:52:06.557 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pps/generators/built-in.a 2023-10-26T06:52:06.598 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/interface.o 2023-10-26T06:52:06.599 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/search.o 2023-10-26T06:52:06.599 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pps/pps.o 2023-10-26T06:52:06.757 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_gem.o 2023-10-26T06:52:06.850 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/intel/e1000/built-in.a 2023-10-26T06:52:06.908 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/mac.o 2023-10-26T06:52:06.968 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ptp/ptp_clock.o 2023-10-26T06:52:07.149 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/quirks.o 2023-10-26T06:52:07.211 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pps/kapi.o 2023-10-26T06:52:07.274 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pci-sysfs.o 2023-10-26T06:52:07.316 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_shrinker.o 2023-10-26T06:52:07.442 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_ioctl.o 2023-10-26T06:52:07.725 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ptp/ptp_chardev.o 2023-10-26T06:52:07.764 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pps/sysfs.o 2023-10-26T06:52:07.833 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pnp/system.o 2023-10-26T06:52:07.843 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/manage.o 2023-10-26T06:52:07.923 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pwm/built-in.a 2023-10-26T06:52:07.965 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/rom.o 2023-10-26T06:52:08.226 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pps/built-in.a 2023-10-26T06:52:08.229 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/setup-res.o 2023-10-26T06:52:08.283 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pnp/built-in.a 2023-10-26T06:52:08.287 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_stolen.o 2023-10-26T06:52:08.298 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ptp/ptp_sysfs.o 2023-10-26T06:52:08.343 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_throttle.o 2023-10-26T06:52:08.356 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/irq.o 2023-10-26T06:52:08.587 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_irq.o 2023-10-26T06:52:08.604 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/vpd.o 2023-10-26T06:52:08.670 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/nvm.o 2023-10-26T06:52:08.884 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/ptp/built-in.a 2023-10-26T06:52:08.899 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_memory.o 2023-10-26T06:52:08.926 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_tiling.o 2023-10-26T06:52:08.998 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/mscc/built-in.a 2023-10-26T06:52:09.043 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/phy.o 2023-10-26T06:52:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:08 smithi125 ceph-mon[130643]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2023-10-26T06:52:09.212 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/setup-bus.o 2023-10-26T06:52:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:08 smithi153 ceph-mon[131657]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2023-10-26T06:52:09.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:08 smithi050 ceph-mon[94997]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2023-10-26T06:52:09.310 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ras/ras.o 2023-10-26T06:52:09.413 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/lib.o 2023-10-26T06:52:09.422 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/ras/debugfs.o 2023-10-26T06:52:09.513 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/systohc.o 2023-10-26T06:52:10.026 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/myricom/built-in.a 2023-10-26T06:52:10.065 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/class.o 2023-10-26T06:52:10.091 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/interface.o 2023-10-26T06:52:10.136 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/param.o 2023-10-26T06:52:10.183 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/ras/built-in.a 2023-10-26T06:52:10.760 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_userptr.o 2023-10-26T06:52:10.863 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/vc.o 2023-10-26T06:52:10.931 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/natsemi/built-in.a 2023-10-26T06:52:11.012 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/mmap.o 2023-10-26T06:52:11.013 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/neterion/built-in.a 2023-10-26T06:52:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:10 smithi125 ceph-mon[130643]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.5 MiB/s wr, 80 op/s 2023-10-26T06:52:11.230 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/setup-irq.o 2023-10-26T06:52:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:10 smithi153 ceph-mon[131657]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.5 MiB/s wr, 80 op/s 2023-10-26T06:52:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:10 smithi050 ceph-mon[94997]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.5 MiB/s wr, 80 op/s 2023-10-26T06:52:11.309 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/scsi/pcmcia/built-in.a 2023-10-26T06:52:11.476 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi.o 2023-10-26T06:52:11.530 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/proc.o 2023-10-26T06:52:11.563 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/ethtool.o 2023-10-26T06:52:11.565 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/hosts.o 2023-10-26T06:52:11.667 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/slot.o 2023-10-26T06:52:11.795 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/amlogic/built-in.a 2023-10-26T06:52:11.838 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/bcm/built-in.a 2023-10-26T06:52:11.879 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/fsl/built-in.a 2023-10-26T06:52:11.923 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/mediatek/built-in.a 2023-10-26T06:52:11.964 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/qcom/built-in.a 2023-10-26T06:52:12.005 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/renesas/built-in.a 2023-10-26T06:52:12.047 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/sunxi/built-in.a 2023-10-26T06:52:12.086 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/ti/built-in.a 2023-10-26T06:52:12.114 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/nvmem.o 2023-10-26T06:52:12.127 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/xilinx/built-in.a 2023-10-26T06:52:12.138 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_wait.o 2023-10-26T06:52:12.166 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/soc/built-in.a 2023-10-26T06:52:12.246 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/dev.o 2023-10-26T06:52:12.266 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/proc.o 2023-10-26T06:52:12.363 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/sysfs.o 2023-10-26T06:52:12.399 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pci-acpi.o 2023-10-26T06:52:12.613 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_ioctl.o 2023-10-26T06:52:12.636 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gem/i915_gemfs.o 2023-10-26T06:52:12.771 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/netdev.o 2023-10-26T06:52:12.835 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_drv.o 2023-10-26T06:52:12.944 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/rtc-mc146818-lib.o 2023-10-26T06:52:12.968 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/thermal/broadcom/built-in.a 2023-10-26T06:52:12.995 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/netronome/built-in.a 2023-10-26T06:52:13.013 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/thermal/intel/built-in.a 2023-10-26T06:52:13.036 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsicam.o 2023-10-26T06:52:13.042 INFO:tasks.workunit.client.0.smithi050.stdout: CC [M] drivers/thermal/intel/x86_pkg_temp_thermal.o 2023-10-26T06:52:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:12 smithi125 ceph-mon[130643]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2023-10-26T06:52:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:12 smithi153 ceph-mon[131657]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2023-10-26T06:52:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:12 smithi050 ceph-mon[94997]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2023-10-26T06:52:13.305 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/thermal/samsung/built-in.a 2023-10-26T06:52:13.305 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/quirks.o 2023-10-26T06:52:13.352 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_active.o 2023-10-26T06:52:13.540 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/rtc/rtc-cmos.o 2023-10-26T06:52:13.577 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_pci.o 2023-10-26T06:52:13.693 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_error.o 2023-10-26T06:52:13.723 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/thermal/st/built-in.a 2023-10-26T06:52:13.726 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_buddy.o 2023-10-26T06:52:13.769 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/thermal/tegra/built-in.a 2023-10-26T06:52:13.813 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/thermal/thermal_core.o 2023-10-26T06:52:14.284 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/msi.o 2023-10-26T06:52:14.370 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/tty/ipwireless/built-in.a 2023-10-26T06:52:14.404 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/rtc/built-in.a 2023-10-26T06:52:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:14 smithi125 ceph-mon[130643]: osdmap e92: 12 total, 12 up, 12 in 2023-10-26T06:52:14.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:14 smithi125 ceph-mon[130643]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 73 op/s 2023-10-26T06:52:14.458 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_core.o 2023-10-26T06:52:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:14 smithi153 ceph-mon[131657]: osdmap e92: 12 total, 12 up, 12 in 2023-10-26T06:52:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:14 smithi153 ceph-mon[131657]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 73 op/s 2023-10-26T06:52:14.495 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_cmd_parser.o 2023-10-26T06:52:14.515 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/vt_ioctl.o 2023-10-26T06:52:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:14 smithi050 ceph-mon[94997]: osdmap e92: 12 total, 12 up, 12 in 2023-10-26T06:52:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:14 smithi050 ceph-mon[94997]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 73 op/s 2023-10-26T06:52:14.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/vc_screen.o 2023-10-26T06:52:14.938 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_lib.o 2023-10-26T06:52:15.176 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/thermal/thermal_sysfs.o 2023-10-26T06:52:15.465 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/ats.o 2023-10-26T06:52:15.510 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_pnp.o 2023-10-26T06:52:15.582 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/ni/built-in.a 2023-10-26T06:52:15.621 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_sysfs.o 2023-10-26T06:52:15.702 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/selection.o 2023-10-26T06:52:15.782 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_gem_evict.o 2023-10-26T06:52:15.785 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/intel/e1000e/ptp.o 2023-10-26T06:52:15.840 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/thermal/thermal_helpers.o 2023-10-26T06:52:16.161 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/pci/pci-label.o 2023-10-26T06:52:16.201 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_port.o 2023-10-26T06:52:16.359 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/thermal/thermal_hwmon.o 2023-10-26T06:52:16.369 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/serial_core.o 2023-10-26T06:52:16.440 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/keyboard.o 2023-10-26T06:52:16.456 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/constants.o 2023-10-26T06:52:16.635 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/intel/e1000e/built-in.a 2023-10-26T06:52:16.682 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/intel/built-in.a 2023-10-26T06:52:16.771 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/nvidia/forcedeth.o 2023-10-26T06:52:16.852 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/pci/built-in.a 2023-10-26T06:52:16.871 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/thermal/step_wise.o 2023-10-26T06:52:16.916 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/consolemap.o 2023-10-26T06:52:16.999 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_gem_fence_reg.o 2023-10-26T06:52:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:16 smithi125 ceph-mon[130643]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 66 op/s 2023-10-26T06:52:17.173 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_lib_dma.o 2023-10-26T06:52:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:16 smithi153 ceph-mon[131657]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 66 op/s 2023-10-26T06:52:17.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:16 smithi050 ceph-mon[94997]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 66 op/s 2023-10-26T06:52:17.374 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/thermal/user_space.o 2023-10-26T06:52:17.579 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_dma.o 2023-10-26T06:52:17.728 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_io.o 2023-10-26T06:52:17.749 INFO:tasks.workunit.client.0.smithi050.stdout: CONMK drivers/tty/vt/consolemap_deftbl.c 2023-10-26T06:52:17.768 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/vt.o 2023-10-26T06:52:17.815 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/thermal/built-in.a 2023-10-26T06:52:17.831 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_scan.o 2023-10-26T06:52:17.856 INFO:tasks.workunit.client.0.smithi050.stdout: SHIPPED drivers/tty/vt/defkeymap.c 2023-10-26T06:52:17.874 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/n_tty.o 2023-10-26T06:52:17.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_dwlib.o 2023-10-26T06:52:18.177 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_gem_gtt.o 2023-10-26T06:52:18.315 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/oki-semi/built-in.a 2023-10-26T06:52:18.358 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_hashtab.o 2023-10-26T06:52:18.517 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_pci.o 2023-10-26T06:52:18.911 INFO:tasks.workunit.client.0.smithi050.stdout: GEN drivers/scsi/scsi_devinfo_tbl.c 2023-10-26T06:52:18.936 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_devinfo.o 2023-10-26T06:52:19.013 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/class/usblp.o 2023-10-26T06:52:19.150 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/common/common.o 2023-10-26T06:52:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:18 smithi125 ceph-mon[130643]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 62 op/s 2023-10-26T06:52:19.185 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/nvidia/built-in.a 2023-10-26T06:52:19.192 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_exar.o 2023-10-26T06:52:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:18 smithi153 ceph-mon[131657]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 62 op/s 2023-10-26T06:52:19.236 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/packetengines/built-in.a 2023-10-26T06:52:19.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:18 smithi050 ceph-mon[94997]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 62 op/s 2023-10-26T06:52:19.279 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/pensando/built-in.a 2023-10-26T06:52:19.322 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/qlogic/built-in.a 2023-10-26T06:52:19.377 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/qualcomm/emac/built-in.a 2023-10-26T06:52:19.406 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/qualcomm/built-in.a 2023-10-26T06:52:19.453 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/rdc/built-in.a 2023-10-26T06:52:19.513 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/realtek/8139too.o 2023-10-26T06:52:19.741 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_ioctl.o 2023-10-26T06:52:19.793 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/consolemap_deftbl.o 2023-10-26T06:52:19.833 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_sysctl.o 2023-10-26T06:52:19.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/vt/defkeymap.o 2023-10-26T06:52:19.911 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/common/debug.o 2023-10-26T06:52:19.921 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/class/built-in.a 2023-10-26T06:52:19.968 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_gem.o 2023-10-26T06:52:19.973 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_early.o 2023-10-26T06:52:20.147 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/tty/vt/built-in.a 2023-10-26T06:52:20.221 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/backlight/backlight.o 2023-10-26T06:52:20.377 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/common/built-in.a 2023-10-26T06:52:20.433 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/usb.o 2023-10-26T06:52:20.444 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_proc.o 2023-10-26T06:52:20.467 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/hub.o 2023-10-26T06:52:20.520 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_lpss.o 2023-10-26T06:52:20.553 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/backlight/generic_bl.o 2023-10-26T06:52:20.721 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/realtek/r8169_main.o 2023-10-26T06:52:20.995 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/early/ehci-dbgp.o 2023-10-26T06:52:21.157 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/backlight/built-in.a 2023-10-26T06:52:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:20 smithi125 ceph-mon[130643]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 66 op/s 2023-10-26T06:52:21.213 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/console/dummycon.o 2023-10-26T06:52:21.217 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_debugfs.o 2023-10-26T06:52:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:20 smithi153 ceph-mon[131657]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 66 op/s 2023-10-26T06:52:21.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:20 smithi050 ceph-mon[94997]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 66 op/s 2023-10-26T06:52:21.273 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/8250/8250_mid.o 2023-10-26T06:52:21.350 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_mm.o 2023-10-26T06:52:21.703 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/early/built-in.a 2023-10-26T06:52:21.717 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_globals.o 2023-10-26T06:52:21.747 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/console/vgacon.o 2023-10-26T06:52:21.795 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/serial/earlycon.o 2023-10-26T06:52:21.844 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_trace.o 2023-10-26T06:52:22.019 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/tty/serial/8250/built-in.a 2023-10-26T06:52:22.104 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/renesas/built-in.a 2023-10-26T06:52:22.150 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_ldisc.o 2023-10-26T06:52:22.154 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/watchdog/built-in.a 2023-10-26T06:52:22.199 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_buffer.o 2023-10-26T06:52:22.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:21 smithi153 ceph-mon[131657]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 63 op/s 2023-10-26T06:52:22.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:21 smithi050 ceph-mon[94997]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 63 op/s 2023-10-26T06:52:22.406 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/tty/serial/built-in.a 2023-10-26T06:52:22.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:21 smithi125 ceph-mon[130643]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 63 op/s 2023-10-26T06:52:22.430 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_query.o 2023-10-26T06:52:22.457 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/net/ethernet/realtek/r8169_firmware.o 2023-10-26T06:52:22.551 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/hcd.o 2023-10-26T06:52:22.560 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_logging.o 2023-10-26T06:52:22.721 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/console/built-in.a 2023-10-26T06:52:22.802 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fb_cmdline.o 2023-10-26T06:52:22.872 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/logo/logo.o 2023-10-26T06:52:22.902 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_port.o 2023-10-26T06:52:22.937 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/pci-quirks.o 2023-10-26T06:52:23.257 INFO:tasks.workunit.client.0.smithi050.stdout: LOGO drivers/video/logo/logo_linux_clut224.c 2023-10-26T06:52:23.293 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/logo/logo_linux_clut224.o 2023-10-26T06:52:23.353 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fb_notify.o 2023-10-26T06:52:23.363 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_pm.o 2023-10-26T06:52:23.374 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/realtek/built-in.a 2023-10-26T06:52:23.409 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_request.o 2023-10-26T06:52:23.429 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/logo/built-in.a 2023-10-26T06:52:23.435 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/rocker/built-in.a 2023-10-26T06:52:23.474 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/samsung/built-in.a 2023-10-26T06:52:23.483 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/ehci-hcd.o 2023-10-26T06:52:23.518 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/seeq/built-in.a 2023-10-26T06:52:23.567 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/sfc/built-in.a 2023-10-26T06:52:23.609 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/silan/built-in.a 2023-10-26T06:52:23.649 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/sis/built-in.a 2023-10-26T06:52:23.669 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_mutex.o 2023-10-26T06:52:23.688 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/smsc/built-in.a 2023-10-26T06:52:23.734 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/socionext/built-in.a 2023-10-26T06:52:23.774 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/stmicro/built-in.a 2023-10-26T06:52:23.782 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/sun/built-in.a 2023-10-26T06:52:23.824 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/synopsys/built-in.a 2023-10-26T06:52:23.849 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/fbdev/omap2/omapfb/displays/built-in.a 2023-10-26T06:52:23.868 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/tehuti/built-in.a 2023-10-26T06:52:23.868 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fbmem.o 2023-10-26T06:52:23.871 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/fbdev/omap2/omapfb/dss/built-in.a 2023-10-26T06:52:23.878 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/urb.o 2023-10-26T06:52:23.907 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/fbdev/omap2/omapfb/built-in.a 2023-10-26T06:52:23.911 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/ti/built-in.a 2023-10-26T06:52:23.945 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/fbdev/omap2/built-in.a 2023-10-26T06:52:23.961 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/via/built-in.a 2023-10-26T06:52:23.990 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_crtc.o 2023-10-26T06:52:24.006 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/wiznet/built-in.a 2023-10-26T06:52:24.047 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/xilinx/built-in.a 2023-10-26T06:52:24.058 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_common.o 2023-10-26T06:52:24.090 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/xircom/built-in.a 2023-10-26T06:52:24.139 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/ethernet/built-in.a 2023-10-26T06:52:24.267 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_ldsem.o 2023-10-26T06:52:24.324 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_transport_spi.o 2023-10-26T06:52:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:24 smithi125 ceph-mon[130643]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 72 op/s 2023-10-26T06:52:24.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:24 smithi153 ceph-mon[131657]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 72 op/s 2023-10-26T06:52:24.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:24 smithi050 ceph-mon[94997]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 72 op/s 2023-10-26T06:52:24.533 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/net/built-in.a 2023-10-26T06:52:24.641 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_baudrate.o 2023-10-26T06:52:24.722 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/message.o 2023-10-26T06:52:24.844 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_scheduler.o 2023-10-26T06:52:24.845 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/sd.o 2023-10-26T06:52:24.953 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/hdmi.o 2023-10-26T06:52:25.135 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fbmon.o 2023-10-26T06:52:25.165 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_jobctrl.o 2023-10-26T06:52:25.674 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/sr.o 2023-10-26T06:52:25.727 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/misc/built-in.a 2023-10-26T06:52:25.770 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/efifb.o 2023-10-26T06:52:25.846 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/ehci-pci.o 2023-10-26T06:52:25.857 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/n_null.o 2023-10-26T06:52:25.967 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/driver.o 2023-10-26T06:52:25.990 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_trace_points.o 2023-10-26T06:52:26.223 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fbcmap.o 2023-10-26T06:52:26.367 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/pty.o 2023-10-26T06:52:26.542 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/ohci-hcd.o 2023-10-26T06:52:26.586 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/config.o 2023-10-26T06:52:26.715 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/sr_ioctl.o 2023-10-26T06:52:26.749 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_vma.o 2023-10-26T06:52:26.891 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fbsysfs.o 2023-10-26T06:52:26.951 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/intel_wopcm.o 2023-10-26T06:52:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:26 smithi125 ceph-mon[130643]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2023-10-26T06:52:27.173 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/tty_audit.o 2023-10-26T06:52:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:26 smithi153 ceph-mon[131657]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2023-10-26T06:52:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:26 smithi050 ceph-mon[94997]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 1.3 MiB/s wr, 61 op/s 2023-10-26T06:52:27.507 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/sr_vendor.o 2023-10-26T06:52:27.565 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/modedb.o 2023-10-26T06:52:27.573 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/file.o 2023-10-26T06:52:27.812 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/tty/sysrq.o 2023-10-26T06:52:27.946 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/sg.o 2023-10-26T06:52:28.086 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_fourcc.o 2023-10-26T06:52:28.181 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/ohci-pci.o 2023-10-26T06:52:28.190 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/buffer.o 2023-10-26T06:52:28.194 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/mon/mon_main.o 2023-10-26T06:52:28.199 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc.o 2023-10-26T06:52:28.328 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fbcvt.o 2023-10-26T06:52:28.559 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/phy/built-in.a 2023-10-26T06:52:28.606 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/uhci-hcd.o 2023-10-26T06:52:28.730 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/tty/built-in.a 2023-10-26T06:52:28.806 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci.o 2023-10-26T06:52:28.806 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/mon/mon_stat.o 2023-10-26T06:52:28.810 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/sysfs.o 2023-10-26T06:52:28.844 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/scsiglue.o 2023-10-26T06:52:28.907 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fb_defio.o 2023-10-26T06:52:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:28 smithi125 ceph-mon[130643]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.3 MiB/s wr, 68 op/s 2023-10-26T06:52:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:28 smithi153 ceph-mon[131657]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.3 MiB/s wr, 68 op/s 2023-10-26T06:52:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:28 smithi050 ceph-mon[94997]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.3 MiB/s wr, 68 op/s 2023-10-26T06:52:29.272 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc_fw.o 2023-10-26T06:52:29.298 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/mon/mon_text.o 2023-10-26T06:52:29.394 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/scsi/scsi_sysfs.o 2023-10-26T06:52:29.639 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/endpoint.o 2023-10-26T06:52:29.645 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/protocol.o 2023-10-26T06:52:29.701 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fbcon.o 2023-10-26T06:52:30.042 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/devio.o 2023-10-26T06:52:30.065 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/mon/mon_bin.o 2023-10-26T06:52:30.223 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/transport.o 2023-10-26T06:52:30.321 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_modes.o 2023-10-26T06:52:30.383 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc.o 2023-10-26T06:52:30.466 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/scsi/built-in.a 2023-10-26T06:52:30.585 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_edid.o 2023-10-26T06:52:31.029 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-mem.o 2023-10-26T06:52:31.086 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/mon/built-in.a 2023-10-26T06:52:31.152 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_ads.o 2023-10-26T06:52:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:30 smithi125 ceph-mon[130643]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.4 MiB/s wr, 77 op/s 2023-10-26T06:52:31.198 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/usb.o 2023-10-26T06:52:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:30 smithi153 ceph-mon[131657]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.4 MiB/s wr, 77 op/s 2023-10-26T06:52:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:30 smithi050 ceph-mon[94997]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.4 MiB/s wr, 77 op/s 2023-10-26T06:52:31.388 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_ct.o 2023-10-26T06:52:31.523 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/initializers.o 2023-10-26T06:52:31.523 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/bitblit.o 2023-10-26T06:52:31.717 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/notify.o 2023-10-26T06:52:32.115 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_encoder_slave.o 2023-10-26T06:52:32.141 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-ext-caps.o 2023-10-26T06:52:32.182 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/sierra_ms.o 2023-10-26T06:52:32.252 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/generic.o 2023-10-26T06:52:32.346 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/softcursor.o 2023-10-26T06:52:32.500 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_fw.o 2023-10-26T06:52:32.553 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/quirks.o 2023-10-26T06:52:32.589 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_trace_points.o 2023-10-26T06:52:32.756 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/option_ms.o 2023-10-26T06:52:32.766 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-ring.o 2023-10-26T06:52:32.818 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/tileblit.o 2023-10-26T06:52:32.843 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_log.o 2023-10-26T06:52:32.983 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/devices.o 2023-10-26T06:52:33.167 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/storage/usual-tables.o 2023-10-26T06:52:33.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:32 smithi125 ceph-mon[130643]: pgmap v591: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2023-10-26T06:52:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:32 smithi153 ceph-mon[131657]: pgmap v591: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2023-10-26T06:52:33.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:32 smithi050 ceph-mon[94997]: pgmap v591: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 1.3 MiB/s wr, 75 op/s 2023-10-26T06:52:33.311 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-hub.o 2023-10-26T06:52:33.418 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_submission.o 2023-10-26T06:52:33.476 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_prime.o 2023-10-26T06:52:33.482 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/cfbfillrect.o 2023-10-26T06:52:33.664 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/storage/built-in.a 2023-10-26T06:52:33.742 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-dbg.o 2023-10-26T06:52:33.756 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/phy.o 2023-10-26T06:52:33.900 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_rect.o 2023-10-26T06:52:34.149 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/cfbcopyarea.o 2023-10-26T06:52:34.246 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc.o 2023-10-26T06:52:34.247 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/cfbimgblt.o 2023-10-26T06:52:34.253 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/port.o 2023-10-26T06:52:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:34 smithi125 ceph-mon[130643]: pgmap v592: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2023-10-26T06:52:34.460 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/sysfillrect.o 2023-10-26T06:52:34.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:34 smithi153 ceph-mon[131657]: pgmap v592: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2023-10-26T06:52:34.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:34 smithi050 ceph-mon[94997]: pgmap v592: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2023-10-26T06:52:34.607 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_vma_manager.o 2023-10-26T06:52:34.793 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc_fw.o 2023-10-26T06:52:34.816 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-trace.o 2023-10-26T06:52:34.840 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_atomic.o 2023-10-26T06:52:34.863 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/syscopyarea.o 2023-10-26T06:52:34.959 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/hcd-pci.o 2023-10-26T06:52:35.095 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_flip_work.o 2023-10-26T06:52:35.213 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-debugfs.o 2023-10-26T06:52:35.225 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/core/usb-acpi.o 2023-10-26T06:52:35.510 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/sysimgblt.o 2023-10-26T06:52:35.708 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/usb/host/xhci-pci.o 2023-10-26T06:52:35.729 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/video/fbdev/core/fb_sys_fops.o 2023-10-26T06:52:35.743 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_atomic_plane.o 2023-10-26T06:52:35.963 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/core/built-in.a 2023-10-26T06:52:35.978 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_modeset_lock.o 2023-10-26T06:52:36.053 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_audio.o 2023-10-26T06:52:36.071 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_atomic.o 2023-10-26T06:52:36.155 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_bios.o 2023-10-26T06:52:36.240 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_bridge.o 2023-10-26T06:52:36.321 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/fbdev/core/built-in.a 2023-10-26T06:52:36.363 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/fbdev/built-in.a 2023-10-26T06:52:36.423 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/video/built-in.a 2023-10-26T06:52:36.513 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_bw.o 2023-10-26T06:52:36.651 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_cdclk.o 2023-10-26T06:52:36.762 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/host/built-in.a 2023-10-26T06:52:36.805 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/usb/built-in.a 2023-10-26T06:52:36.921 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_color.o 2023-10-26T06:52:36.974 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_combo_phy.o 2023-10-26T06:52:37.081 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_connector.o 2023-10-26T06:52:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:36 smithi125 ceph-mon[130643]: pgmap v593: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.1 MiB/s wr, 69 op/s 2023-10-26T06:52:37.206 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_display.o 2023-10-26T06:52:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:36 smithi153 ceph-mon[131657]: pgmap v593: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.1 MiB/s wr, 69 op/s 2023-10-26T06:52:37.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:36 smithi050 ceph-mon[94997]: pgmap v593: 97 pgs: 97 active+clean; 1.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.1 MiB/s wr, 69 op/s 2023-10-26T06:52:37.302 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_framebuffer.o 2023-10-26T06:52:37.658 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_display_power.o 2023-10-26T06:52:37.714 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_connector.o 2023-10-26T06:52:38.084 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dpio_phy.o 2023-10-26T06:52:38.118 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_blend.o 2023-10-26T06:52:38.225 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dpll_mgr.o 2023-10-26T06:52:38.380 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_encoder.o 2023-10-26T06:52:38.390 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_fbc.o 2023-10-26T06:52:38.802 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_fifo_underrun.o 2023-10-26T06:52:38.850 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_mode_object.o 2023-10-26T06:52:38.994 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_frontbuffer.o 2023-10-26T06:52:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:38 smithi125 ceph-mon[130643]: pgmap v594: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2023-10-26T06:52:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:38 smithi153 ceph-mon[131657]: pgmap v594: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2023-10-26T06:52:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:38 smithi050 ceph-mon[94997]: pgmap v594: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2023-10-26T06:52:39.378 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_property.o 2023-10-26T06:52:39.565 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_hdcp.o 2023-10-26T06:52:39.644 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_plane.o 2023-10-26T06:52:39.685 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_hotplug.o 2023-10-26T06:52:40.024 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_color_mgmt.o 2023-10-26T06:52:40.059 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_print.o 2023-10-26T06:52:40.137 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_lpe_audio.o 2023-10-26T06:52:40.274 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_overlay.o 2023-10-26T06:52:40.634 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_dumb_buffers.o 2023-10-26T06:52:40.636 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_psr.o 2023-10-26T06:52:40.719 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_quirks.o 2023-10-26T06:52:40.811 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_mode_config.o 2023-10-26T06:52:41.114 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_sprite.o 2023-10-26T06:52:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:40 smithi125 ceph-mon[130643]: pgmap v595: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2023-10-26T06:52:41.207 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_vblank.o 2023-10-26T06:52:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:40 smithi153 ceph-mon[131657]: pgmap v595: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2023-10-26T06:52:41.242 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_tc.o 2023-10-26T06:52:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:40 smithi050 ceph-mon[94997]: pgmap v595: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2023-10-26T06:52:41.628 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_acpi.o 2023-10-26T06:52:41.684 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_syncobj.o 2023-10-26T06:52:41.894 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_opregion.o 2023-10-26T06:52:42.041 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_lease.o 2023-10-26T06:52:42.383 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_writeback.o 2023-10-26T06:52:42.394 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_fbdev.o 2023-10-26T06:52:42.606 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_client.o 2023-10-26T06:52:42.752 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/dvo_ch7017.o 2023-10-26T06:52:42.849 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/dvo_ch7xxx.o 2023-10-26T06:52:42.862 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_client_modeset.o 2023-10-26T06:52:43.051 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_atomic_uapi.o 2023-10-26T06:52:43.069 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_hdcp.o 2023-10-26T06:52:43.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:42 smithi125 ceph-mon[130643]: pgmap v596: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2023-10-26T06:52:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:42 smithi153 ceph-mon[131657]: pgmap v596: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2023-10-26T06:52:43.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:42 smithi050 ceph-mon[94997]: pgmap v596: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 72 op/s 2023-10-26T06:52:43.415 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/dvo_ivch.o 2023-10-26T06:52:43.575 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_ioc32.o 2023-10-26T06:52:43.719 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_panel.o 2023-10-26T06:52:43.729 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/dvo_ns2501.o 2023-10-26T06:52:43.791 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_agpsupport.o 2023-10-26T06:52:43.901 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/dvo_sil164.o 2023-10-26T06:52:43.977 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_debugfs.o 2023-10-26T06:52:44.071 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/dvo_tfp410.o 2023-10-26T06:52:44.234 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_debugfs_crc.o 2023-10-26T06:52:44.337 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_mipi_dsi.o 2023-10-26T06:52:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:44 smithi125 ceph-mon[130643]: pgmap v597: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2023-10-26T06:52:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:44 smithi153 ceph-mon[131657]: pgmap v597: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2023-10-26T06:52:44.485 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/drm_panel_orientation_quirks.o 2023-10-26T06:52:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:44 smithi050 ceph-mon[94997]: pgmap v597: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2023-10-26T06:52:44.517 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/icl_dsi.o 2023-10-26T06:52:44.755 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_crt.o 2023-10-26T06:52:44.789 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_ddi.o 2023-10-26T06:52:44.920 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dp.o 2023-10-26T06:52:44.936 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dp_aux_backlight.o 2023-10-26T06:52:44.981 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dp_link_training.o 2023-10-26T06:52:45.091 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dp_mst.o 2023-10-26T06:52:45.138 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dsi.o 2023-10-26T06:52:45.939 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dsi_dcs_backlight.o 2023-10-26T06:52:46.021 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dsi_vbt.o 2023-10-26T06:52:46.022 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_dvo.o 2023-10-26T06:52:46.179 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_gmbus.o 2023-10-26T06:52:46.203 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_hdmi.o 2023-10-26T06:52:46.252 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_lspcon.o 2023-10-26T06:52:46.993 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_lvds.o 2023-10-26T06:52:47.025 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_panel.o 2023-10-26T06:52:47.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:46 smithi125 ceph-mon[130643]: pgmap v598: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2023-10-26T06:52:47.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:46 smithi153 ceph-mon[131657]: pgmap v598: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2023-10-26T06:52:47.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:46 smithi050 ceph-mon[94997]: pgmap v598: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2023-10-26T06:52:47.293 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_sdvo.o 2023-10-26T06:52:47.391 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_tv.o 2023-10-26T06:52:47.394 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/intel_vdsc.o 2023-10-26T06:52:47.475 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/vlv_dsi.o 2023-10-26T06:52:48.032 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/display/vlv_dsi_pll.o 2023-10-26T06:52:48.072 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_hsw.o 2023-10-26T06:52:48.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:47 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:52:48.195 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_bdw.o 2023-10-26T06:52:48.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:47 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:52:48.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:47 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:52:48.621 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_chv.o 2023-10-26T06:52:48.659 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_sklgt2.o 2023-10-26T06:52:48.672 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_sklgt3.o 2023-10-26T06:52:49.014 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_sklgt4.o 2023-10-26T06:52:49.051 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_bxt.o 2023-10-26T06:52:49.150 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_kblgt2.o 2023-10-26T06:52:49.171 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_kblgt3.o 2023-10-26T06:52:49.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:48 smithi125 ceph-mon[130643]: pgmap v599: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2023-10-26T06:52:49.188 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_glk.o 2023-10-26T06:52:49.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:48 smithi153 ceph-mon[131657]: pgmap v599: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2023-10-26T06:52:49.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:48 smithi050 ceph-mon[94997]: pgmap v599: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2023-10-26T06:52:49.531 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_cflgt2.o 2023-10-26T06:52:49.598 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_cflgt3.o 2023-10-26T06:52:49.602 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_cnl.o 2023-10-26T06:52:49.957 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/oa/i915_oa_icl.o 2023-10-26T06:52:49.962 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_perf.o 2023-10-26T06:52:50.068 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_gpu_error.o 2023-10-26T06:52:50.112 INFO:tasks.workunit.client.0.smithi050.stdout: CC drivers/gpu/drm/i915/i915_vgpu.o 2023-10-26T06:52:50.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:49 smithi125 ceph-mon[130643]: pgmap v600: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 1.5 MiB/s wr, 72 op/s 2023-10-26T06:52:50.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:49 smithi153 ceph-mon[131657]: pgmap v600: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 1.5 MiB/s wr, 72 op/s 2023-10-26T06:52:50.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:49 smithi050 ceph-mon[94997]: pgmap v600: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 1.5 MiB/s wr, 72 op/s 2023-10-26T06:52:51.154 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/i915/built-in.a 2023-10-26T06:52:51.351 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/drm/built-in.a 2023-10-26T06:52:51.467 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/gpu/built-in.a 2023-10-26T06:52:51.570 INFO:tasks.workunit.client.0.smithi050.stdout: AR drivers/built-in.a 2023-10-26T06:52:52.183 INFO:tasks.workunit.client.0.smithi050.stdout: GEN .version 2023-10-26T06:52:52.276 INFO:tasks.workunit.client.0.smithi050.stdout: CHK include/generated/compile.h 2023-10-26T06:52:52.352 INFO:tasks.workunit.client.0.smithi050.stdout: LD vmlinux.o 2023-10-26T06:52:52.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:52 smithi125 ceph-mon[130643]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:52:52.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:52 smithi125 ceph-mon[130643]: pgmap v601: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 1.4 MiB/s wr, 70 op/s 2023-10-26T06:52:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:52 smithi153 ceph-mon[131657]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:52:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:52 smithi153 ceph-mon[131657]: pgmap v601: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 1.4 MiB/s wr, 70 op/s 2023-10-26T06:52:52.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:52 smithi050 ceph-mon[94997]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-10-26T06:52:52.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:52 smithi050 ceph-mon[94997]: pgmap v601: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 1.4 MiB/s wr, 70 op/s 2023-10-26T06:52:54.083 INFO:tasks.workunit.client.0.smithi050.stdout: MODPOST vmlinux.o 2023-10-26T06:52:54.347 INFO:tasks.workunit.client.0.smithi050.stdout: MODINFO modules.builtin.modinfo 2023-10-26T06:52:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:54 smithi125 ceph-mon[130643]: pgmap v602: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 1.6 MiB/s wr, 75 op/s 2023-10-26T06:52:54.442 INFO:tasks.workunit.client.0.smithi050.stdout: LD .tmp_vmlinux1 2023-10-26T06:52:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:54 smithi153 ceph-mon[131657]: pgmap v602: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 1.6 MiB/s wr, 75 op/s 2023-10-26T06:52:54.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:54 smithi050 ceph-mon[94997]: pgmap v602: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 1.6 MiB/s wr, 75 op/s 2023-10-26T06:52:56.975 INFO:tasks.workunit.client.0.smithi050.stdout: KSYM .tmp_kallsyms1.o 2023-10-26T06:52:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:56 smithi125 ceph-mon[130643]: pgmap v603: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.5 MiB/s wr, 69 op/s 2023-10-26T06:52:57.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:56 smithi153 ceph-mon[131657]: pgmap v603: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.5 MiB/s wr, 69 op/s 2023-10-26T06:52:57.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:56 smithi050 ceph-mon[94997]: pgmap v603: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.5 MiB/s wr, 69 op/s 2023-10-26T06:52:57.608 INFO:tasks.workunit.client.0.smithi050.stdout: LD .tmp_vmlinux2 2023-10-26T06:52:59.158 INFO:tasks.workunit.client.0.smithi050.stdout: KSYM .tmp_kallsyms2.o 2023-10-26T06:52:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:52:58 smithi125 ceph-mon[130643]: pgmap v604: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 80 op/s 2023-10-26T06:52:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:52:58 smithi153 ceph-mon[131657]: pgmap v604: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 80 op/s 2023-10-26T06:52:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:52:58 smithi050 ceph-mon[94997]: pgmap v604: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 80 op/s 2023-10-26T06:52:59.803 INFO:tasks.workunit.client.0.smithi050.stdout: LD vmlinux 2023-10-26T06:53:00.959 INFO:tasks.workunit.client.0.smithi050.stderr:ld: final link failed: Resource temporarily unavailable 2023-10-26T06:53:01.027 INFO:tasks.workunit.client.0.smithi050.stderr:make: *** [Makefile:1077: vmlinux] Error 1 2023-10-26T06:53:01.028 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-26T06:53:01.028 INFO:tasks.workunit:Stopping ['kernel_untar_build.sh'] on client.0... 2023-10-26T06:53:01.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-26T06:53:01.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:00 smithi125 ceph-mon[130643]: pgmap v605: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2023-10-26T06:53:01.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:00 smithi153 ceph-mon[131657]: pgmap v605: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2023-10-26T06:53:01.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:00 smithi050 ceph-mon[94997]: pgmap v605: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2023-10-26T06:53:02.068 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi050 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' 2023-10-26T06:53:02.170 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4c9e8c1b74f8497791d203256b4e25df Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi050 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' 2023-10-26T06:53:02.173 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-26T06:53:02.183 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-26T06:53:02.183 INFO:teuthology.task.exec:Executing custom commands... 2023-10-26T06:53:02.184 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:53:02.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-26T06:53:02.189 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:01 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:53:02.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:01 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:53:02.250 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:01 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:53:02.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-26T06:53:03.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:02 smithi125 ceph-mon[130643]: pgmap v606: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 82 op/s 2023-10-26T06:53:03.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:53:03.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:53:03.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:02 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:53:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:02 smithi153 ceph-mon[131657]: pgmap v606: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 82 op/s 2023-10-26T06:53:03.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:53:03.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:53:03.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:02 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:53:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:02 smithi050 ceph-mon[94997]: pgmap v606: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 82 op/s 2023-10-26T06:53:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:53:03.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:53:03.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:02 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:53:04.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:04 smithi125 ceph-mon[130643]: pgmap v607: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 82 op/s 2023-10-26T06:53:04.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:04 smithi153 ceph-mon[131657]: pgmap v607: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 82 op/s 2023-10-26T06:53:04.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:04 smithi050 ceph-mon[94997]: pgmap v607: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 82 op/s 2023-10-26T06:53:06.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:06 smithi125 ceph-mon[130643]: osdmap e93: 12 total, 12 up, 12 in 2023-10-26T06:53:06.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:06 smithi125 ceph-mon[130643]: pgmap v609: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 2.4 MiB/s wr, 86 op/s 2023-10-26T06:53:06.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:06 smithi153 ceph-mon[131657]: osdmap e93: 12 total, 12 up, 12 in 2023-10-26T06:53:06.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:06 smithi153 ceph-mon[131657]: pgmap v609: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 2.4 MiB/s wr, 86 op/s 2023-10-26T06:53:06.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:06 smithi050 ceph-mon[94997]: osdmap e93: 12 total, 12 up, 12 in 2023-10-26T06:53:06.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:06 smithi050 ceph-mon[94997]: pgmap v609: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 2.4 MiB/s wr, 86 op/s 2023-10-26T06:53:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:08 smithi125 ceph-mon[130643]: pgmap v610: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.3 MiB/s wr, 90 op/s 2023-10-26T06:53:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:08 smithi153 ceph-mon[131657]: pgmap v610: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.3 MiB/s wr, 90 op/s 2023-10-26T06:53:09.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:08 smithi050 ceph-mon[94997]: pgmap v610: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.3 MiB/s wr, 90 op/s 2023-10-26T06:53:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:10 smithi125 ceph-mon[130643]: pgmap v611: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2023-10-26T06:53:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:10 smithi153 ceph-mon[131657]: pgmap v611: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2023-10-26T06:53:11.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:10 smithi050 ceph-mon[94997]: pgmap v611: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2023-10-26T06:53:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:12 smithi125 ceph-mon[130643]: pgmap v612: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 84 op/s 2023-10-26T06:53:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:12 smithi153 ceph-mon[131657]: pgmap v612: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 84 op/s 2023-10-26T06:53:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:12 smithi050 ceph-mon[94997]: pgmap v612: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 84 op/s 2023-10-26T06:53:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:14 smithi125 ceph-mon[130643]: osdmap e94: 12 total, 12 up, 12 in 2023-10-26T06:53:14.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:14 smithi125 ceph-mon[130643]: pgmap v614: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 91 op/s 2023-10-26T06:53:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:14 smithi153 ceph-mon[131657]: osdmap e94: 12 total, 12 up, 12 in 2023-10-26T06:53:14.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:14 smithi153 ceph-mon[131657]: pgmap v614: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 91 op/s 2023-10-26T06:53:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:14 smithi050 ceph-mon[94997]: osdmap e94: 12 total, 12 up, 12 in 2023-10-26T06:53:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:14 smithi050 ceph-mon[94997]: pgmap v614: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 91 op/s 2023-10-26T06:53:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:16 smithi125 ceph-mon[130643]: pgmap v615: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 4.6 MiB/s wr, 64 op/s 2023-10-26T06:53:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:16 smithi153 ceph-mon[131657]: pgmap v615: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 4.6 MiB/s wr, 64 op/s 2023-10-26T06:53:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:16 smithi050 ceph-mon[94997]: pgmap v615: 97 pgs: 97 active+clean; 1.7 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 4.6 MiB/s wr, 64 op/s 2023-10-26T06:53:19.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:18 smithi125 ceph-mon[130643]: pgmap v616: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 11 MiB/s wr, 61 op/s 2023-10-26T06:53:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:18 smithi153 ceph-mon[131657]: pgmap v616: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 11 MiB/s wr, 61 op/s 2023-10-26T06:53:19.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:18 smithi050 ceph-mon[94997]: pgmap v616: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 11 MiB/s wr, 61 op/s 2023-10-26T06:53:21.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:20 smithi125 ceph-mon[130643]: pgmap v617: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 17 MiB/s wr, 64 op/s 2023-10-26T06:53:21.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:20 smithi153 ceph-mon[131657]: pgmap v617: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 17 MiB/s wr, 64 op/s 2023-10-26T06:53:21.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:20 smithi050 ceph-mon[94997]: pgmap v617: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 17 MiB/s wr, 64 op/s 2023-10-26T06:53:23.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:22 smithi125 ceph-mon[130643]: pgmap v618: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 16 MiB/s wr, 61 op/s 2023-10-26T06:53:23.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:22 smithi153 ceph-mon[131657]: pgmap v618: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 16 MiB/s wr, 61 op/s 2023-10-26T06:53:23.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:22 smithi050 ceph-mon[94997]: pgmap v618: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 16 MiB/s wr, 61 op/s 2023-10-26T06:53:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:24 smithi125 ceph-mon[130643]: pgmap v619: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 15 MiB/s wr, 62 op/s 2023-10-26T06:53:24.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:24 smithi153 ceph-mon[131657]: pgmap v619: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 15 MiB/s wr, 62 op/s 2023-10-26T06:53:24.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:24 smithi050 ceph-mon[94997]: pgmap v619: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 15 MiB/s wr, 62 op/s 2023-10-26T06:53:27.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:26 smithi125 ceph-mon[130643]: pgmap v620: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 14 MiB/s wr, 55 op/s 2023-10-26T06:53:27.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:26 smithi153 ceph-mon[131657]: pgmap v620: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 14 MiB/s wr, 55 op/s 2023-10-26T06:53:27.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:26 smithi050 ceph-mon[94997]: pgmap v620: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 14 MiB/s wr, 55 op/s 2023-10-26T06:53:29.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:28 smithi125 ceph-mon[130643]: pgmap v621: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 12 MiB/s wr, 57 op/s 2023-10-26T06:53:29.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:28 smithi153 ceph-mon[131657]: pgmap v621: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 12 MiB/s wr, 57 op/s 2023-10-26T06:53:29.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:28 smithi050 ceph-mon[94997]: pgmap v621: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 12 MiB/s wr, 57 op/s 2023-10-26T06:53:31.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:30 smithi125 ceph-mon[130643]: pgmap v622: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 7.0 MiB/s wr, 44 op/s 2023-10-26T06:53:31.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:30 smithi153 ceph-mon[131657]: pgmap v622: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 7.0 MiB/s wr, 44 op/s 2023-10-26T06:53:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:30 smithi050 ceph-mon[94997]: pgmap v622: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 7.0 MiB/s wr, 44 op/s 2023-10-26T06:53:32.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:31 smithi153 ceph-mon[131657]: pgmap v623: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 40 op/s 2023-10-26T06:53:32.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:31 smithi050 ceph-mon[94997]: pgmap v623: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 40 op/s 2023-10-26T06:53:32.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:31 smithi125 ceph-mon[130643]: pgmap v623: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 40 op/s 2023-10-26T06:53:34.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:34 smithi125 ceph-mon[130643]: pgmap v624: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 30 op/s 2023-10-26T06:53:34.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:34 smithi153 ceph-mon[131657]: pgmap v624: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 30 op/s 2023-10-26T06:53:34.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:34 smithi050 ceph-mon[94997]: pgmap v624: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 30 op/s 2023-10-26T06:53:37.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:36 smithi125 ceph-mon[130643]: pgmap v625: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-10-26T06:53:37.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:36 smithi153 ceph-mon[131657]: pgmap v625: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-10-26T06:53:37.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:36 smithi050 ceph-mon[94997]: pgmap v625: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-10-26T06:53:39.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:38 smithi125 ceph-mon[130643]: pgmap v626: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2023-10-26T06:53:39.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:38 smithi153 ceph-mon[131657]: pgmap v626: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2023-10-26T06:53:39.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:38 smithi050 ceph-mon[94997]: pgmap v626: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2023-10-26T06:53:41.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:40 smithi125 ceph-mon[130643]: pgmap v627: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 707 KiB/s wr, 16 op/s 2023-10-26T06:53:41.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:40 smithi153 ceph-mon[131657]: pgmap v627: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 707 KiB/s wr, 16 op/s 2023-10-26T06:53:41.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:40 smithi050 ceph-mon[94997]: pgmap v627: 97 pgs: 97 active+clean; 1.9 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 707 KiB/s wr, 16 op/s 2023-10-26T06:53:41.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-26T06:53:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1394019766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f08073540 msgr2=0x7f8f0810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:41.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1394019766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f08073540 0x7f8f0810c9c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009990 tx=0x7f8efc009ca0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1394019766 shutdown_connections 2023-10-26T06:53:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1394019766 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f0810cf00 0x7f8f0810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1394019766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1394019766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f08073540 0x7f8f0810c9c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1394019766 >> 172.21.15.50:0/1394019766 conn(0x7f8f080fc190 msgr2=0x7f8f080fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:41.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1394019766 shutdown_connections 2023-10-26T06:53:41.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.574+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1394019766 wait complete. 2023-10-26T06:53:41.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 Processor -- start 2023-10-26T06:53:41.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 -- start start 2023-10-26T06:53:41.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08073540 0x7f8f08199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 0x7f8f0819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819dcf0 con 0x7f8f0810cf00 2023-10-26T06:53:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819de60 con 0x7f8f08073540 2023-10-26T06:53:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.575+0000 7f8f0dfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819e020 con 0x7f8f08072c20 2023-10-26T06:53:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 0x7f8f0819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:41.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:51074/0 (socket says 172.21.15.50:51074) 2023-10-26T06:53:41.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f077fe700 1 -- 172.21.15.50:0/1838676186 learned_addr learned my addr 172.21.15.50:0/1838676186 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:41.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 0x7f8f0819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44486/0 (socket says 172.21.15.50:44486) 2023-10-26T06:53:41.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f06ffd700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08073540 0x7f8f08199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:41.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 -- 172.21.15.50:0/1838676186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 msgr2=0x7f8f08198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:41.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 -- 172.21.15.50:0/1838676186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08073540 msgr2=0x7f8f08199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:41.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08073540 0x7f8f08199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f07fff700 1 -- 172.21.15.50:0/1838676186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0095f0 con 0x7f8f0810cf00 2023-10-26T06:53:41.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.576+0000 7f8f077fe700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:53:41.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.577+0000 7f8f07fff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 0x7f8f0819d6b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8f00007f10 tx=0x7f8f0000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:41.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.577+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00009ea0 con 0x7f8f0810cf00 2023-10-26T06:53:41.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.577+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f0000f040 con 0x7f8f0810cf00 2023-10-26T06:53:41.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.577+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0819e300 con 0x7f8f0810cf00 2023-10-26T06:53:41.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.577+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00004350 con 0x7f8f0810cf00 2023-10-26T06:53:41.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.577+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f081a5b40 con 0x7f8f0810cf00 2023-10-26T06:53:41.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.578+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08108110 con 0x7f8f0810cf00 2023-10-26T06:53:41.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.580+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8f0000db20 con 0x7f8f0810cf00 2023-10-26T06:53:41.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.582+0000 7f8f04ff9700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8ef00a15f0 0x7f8ef00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:41.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.582+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8f000cd380 con 0x7f8f0810cf00 2023-10-26T06:53:41.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.582+0000 7f8f077fe700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8ef00a15f0 0x7f8ef00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:41.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.583+0000 7f8f077fe700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8ef00a15f0 0x7f8ef00a3ab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005950 tx=0x7f8ef800b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:41.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.584+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f000966d0 con 0x7f8f0810cf00 2023-10-26T06:53:41.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.826+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f0819a0d0 con 0x7f8ef00a15f0 2023-10-26T06:53:41.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.835+0000 7f8f04ff9700 1 -- 172.21.15.50:0/1838676186 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f8f0819a0d0 con 0x7f8ef00a15f0 2023-10-26T06:53:41.837 INFO:teuthology.orchestra.run.smithi050.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-26T00:00:00", "created": "2023-10-26T06:43:40", "first": "2023-10-26T06:44:00", "last": "2023-10-26T06:53:00", "last_pruned": "2023-10-26T06:53:00", "created_count": 10, "pruned_count": 4, "active": true} 2023-10-26T06:53:41.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.837+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8ef00a15f0 msgr2=0x7f8ef00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:41.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.837+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8ef00a15f0 0x7f8ef00a3ab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005950 tx=0x7f8ef800b500 comp rx=0 tx=0).stop 2023-10-26T06:53:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.837+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 msgr2=0x7f8f0819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.837+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 0x7f8f0819d6b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8f00007f10 tx=0x7f8f0000d3b0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 shutdown_connections 2023-10-26T06:53:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f8ef00a15f0 0x7f8ef00a3ab0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f0810cf00 0x7f8f0819d6b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f08072c20 0x7f8f08198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 --2- 172.21.15.50:0/1838676186 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8f08073540 0x7f8f08199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 >> 172.21.15.50:0/1838676186 conn(0x7f8f080fc190 msgr2=0x7f8f080fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 shutdown_connections 2023-10-26T06:53:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:41.838+0000 7f8f0dfff700 1 -- 172.21.15.50:0/1838676186 wait complete. 2023-10-26T06:53:41.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-26T06:53:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 -- 172.21.15.50:0/3906428559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 msgr2=0x7fefc0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 --2- 172.21.15.50:0/3906428559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0100b40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009990 tx=0x7fefb4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 -- 172.21.15.50:0/3906428559 shutdown_connections 2023-10-26T06:53:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 --2- 172.21.15.50:0/3906428559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc0101080 0x7fefc010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 --2- 172.21.15.50:0/3906428559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 0x7fefc0106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 --2- 172.21.15.50:0/3906428559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0100b40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 -- 172.21.15.50:0/3906428559 >> 172.21.15.50:0/3906428559 conn(0x7fefc00fc190 msgr2=0x7fefc00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:42.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 -- 172.21.15.50:0/3906428559 shutdown_connections 2023-10-26T06:53:42.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.061+0000 7fefc5dff700 1 -- 172.21.15.50:0/3906428559 wait complete. 2023-10-26T06:53:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.062+0000 7fefc5dff700 1 Processor -- start 2023-10-26T06:53:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.062+0000 7fefc5dff700 1 -- start start 2023-10-26T06:53:42.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefc5dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefc5dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc0101080 0x7fefc01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefc5dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 0x7fefc019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefc5dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc019dcb0 con 0x7fefc01006c0 2023-10-26T06:53:42.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefc5dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc019de20 con 0x7fefc01066d0 2023-10-26T06:53:42.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefc5dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc019dfe0 con 0x7fefc0101080 2023-10-26T06:53:42.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44496/0 (socket says 172.21.15.50:44496) 2023-10-26T06:53:42.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 -- 172.21.15.50:0/1333575612 learned_addr learned my addr 172.21.15.50:0/1333575612 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:42.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbeffd700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc0101080 0x7fefc01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbffff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 0x7fefc019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 -- 172.21.15.50:0/1333575612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc0101080 msgr2=0x7fefc01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc0101080 0x7fefc01992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 -- 172.21.15.50:0/1333575612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 msgr2=0x7fefc019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 0x7fefc019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbf7fe700 1 -- 172.21.15.50:0/1333575612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40095f0 con 0x7fefc01006c0 2023-10-26T06:53:42.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.063+0000 7fefbffff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 0x7fefc019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:53:42.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.064+0000 7fefbf7fe700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0198d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fefb000e9a0 tx=0x7fefb000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:42.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.064+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0009790 con 0x7fefc01006c0 2023-10-26T06:53:42.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.064+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefb000cbd0 con 0x7fefc01006c0 2023-10-26T06:53:42.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.064+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0018680 con 0x7fefc01006c0 2023-10-26T06:53:42.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.064+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc019e2c0 con 0x7fefc01006c0 2023-10-26T06:53:42.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.064+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc01a5b00 con 0x7fefc01006c0 2023-10-26T06:53:42.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.065+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc0101e00 con 0x7fefc01006c0 2023-10-26T06:53:42.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.067+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fefb000cd40 con 0x7fefc01006c0 2023-10-26T06:53:42.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.068+0000 7fefbcff9700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fefa80a15f0 0x7fefa80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.069+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fefb0014070 con 0x7fefc01006c0 2023-10-26T06:53:42.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.069+0000 7fefbeffd700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fefa80a15f0 0x7fefa80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.069+0000 7fefbeffd700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fefa80a15f0 0x7fefa80a3ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fefb400b2e0 tx=0x7fefb4005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:42.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.072+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fefb0096710 con 0x7fefc01006c0 2023-10-26T06:53:42.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:41 smithi153 ceph-mon[131657]: from='client.16503 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:53:42.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:41 smithi153 ceph-mon[131657]: pgmap v628: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 789 KiB/s wr, 23 op/s 2023-10-26T06:53:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:41 smithi050 ceph-mon[94997]: from='client.16503 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:53:42.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:41 smithi050 ceph-mon[94997]: pgmap v628: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 789 KiB/s wr, 23 op/s 2023-10-26T06:53:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.313+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 --> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fefc019a170 con 0x7fefa80a15f0 2023-10-26T06:53:42.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.321+0000 7fefbcff9700 1 -- 172.21.15.50:0/1333575612 <== mgr.14214 v2:172.21.15.50:6800/3705474252 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fefc019a170 con 0x7fefa80a15f0 2023-10-26T06:53:42.323 INFO:teuthology.orchestra.run.smithi050.stdout:/ 1m 6m3h 2023-10-26T06:53:42.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fefa80a15f0 msgr2=0x7fefa80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fefa80a15f0 0x7fefa80a3ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fefb400b2e0 tx=0x7fefb4005fd0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 msgr2=0x7fefc0198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0198d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fefb000e9a0 tx=0x7fefb000ed60 comp rx=0 tx=0).stop 2023-10-26T06:53:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 shutdown_connections 2023-10-26T06:53:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fefa80a15f0 0x7fefa80a3ab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefc01066d0 0x7fefc019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefc01006c0 0x7fefc0198d90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 --2- 172.21.15.50:0/1333575612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc0101080 0x7fefc01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 >> 172.21.15.50:0/1333575612 conn(0x7fefc00fc190 msgr2=0x7fefc00fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:42.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 shutdown_connections 2023-10-26T06:53:42.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.324+0000 7fefc5dff700 1 -- 172.21.15.50:0/1333575612 wait complete. 2023-10-26T06:53:42.345 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-26T06:53:42.359 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-26T06:53:42.359 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-26T06:53:42.364 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-26T06:53:42.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:53:42.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:41 smithi125 ceph-mon[130643]: from='client.16503 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:53:42.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:41 smithi125 ceph-mon[130643]: pgmap v628: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 789 KiB/s wr, 23 op/s 2023-10-26T06:53:42.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/3104214080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b581066b0 msgr2=0x7f5b58106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/3104214080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b581066b0 0x7f5b58106a90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5b48009990 tx=0x7f5b48009ca0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/3104214080 shutdown_connections 2023-10-26T06:53:42.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/3104214080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b58101060 0x7f5b5810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/3104214080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b581066b0 0x7f5b58106a90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/3104214080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b581006a0 0x7f5b58100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/3104214080 >> 172.21.15.50:0/3104214080 conn(0x7f5b580fc170 msgr2=0x7f5b580fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:42.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/3104214080 shutdown_connections 2023-10-26T06:53:42.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.579+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/3104214080 wait complete. 2023-10-26T06:53:42.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.580+0000 7f5b5e3ff700 1 Processor -- start 2023-10-26T06:53:42.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.580+0000 7f5b5e3ff700 1 -- start start 2023-10-26T06:53:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5e3ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b581006a0 0x7f5b5819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5e3ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 0x7f5b5819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5e3ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b581066b0 0x7f5b58196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5e3ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58196fe0 con 0x7f5b58101060 2023-10-26T06:53:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5e3ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58197150 con 0x7f5b581066b0 2023-10-26T06:53:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5e3ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58197310 con 0x7f5b581006a0 2023-10-26T06:53:42.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 0x7f5b5819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 0x7f5b5819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44520/0 (socket says 172.21.15.50:44520) 2023-10-26T06:53:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b577fe700 1 -- 172.21.15.50:0/17583164 learned_addr learned my addr 172.21.15.50:0/17583164 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:42.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b57fff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b581006a0 0x7f5b5819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.581+0000 7f5b5c99c700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b581066b0 0x7f5b58196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b577fe700 1 -- 172.21.15.50:0/17583164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b581006a0 msgr2=0x7f5b5819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b577fe700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b581006a0 0x7f5b5819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b577fe700 1 -- 172.21.15.50:0/17583164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b581066b0 msgr2=0x7f5b58196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b577fe700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b581066b0 0x7f5b58196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b577fe700 1 -- 172.21.15.50:0/17583164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480095f0 con 0x7f5b58101060 2023-10-26T06:53:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b577fe700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 0x7f5b5819cd40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e9a0 tx=0x7f5b4c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c009790 con 0x7f5b58101060 2023-10-26T06:53:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b581975f0 con 0x7f5b58101060 2023-10-26T06:53:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b4c010430 con 0x7f5b58101060 2023-10-26T06:53:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c018620 con 0x7f5b58101060 2023-10-26T06:53:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.582+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b581a37f0 con 0x7f5b58101060 2023-10-26T06:53:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.583+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b58108ca0 con 0x7f5b58101060 2023-10-26T06:53:42.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.587+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5b4c0105a0 con 0x7f5b58101060 2023-10-26T06:53:42.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.588+0000 7f5b557fa700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b400a15f0 0x7f5b400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.588+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5b4c014070 con 0x7f5b58101060 2023-10-26T06:53:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.589+0000 7f5b57fff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b400a15f0 0x7f5b400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.589+0000 7f5b57fff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b400a15f0 0x7f5b400a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800b2e0 tx=0x7f5b48005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.590+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b4c0967a0 con 0x7f5b58101060 2023-10-26T06:53:42.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.802+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b58101de0 con 0x7f5b58101060 2023-10-26T06:53:42.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.803+0000 7f5b557fa700 1 -- 172.21.15.50:0/17583164 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+22840 (secure 0 0 0) 0x7f5b4c026090 con 0x7f5b58101060 2023-10-26T06:53:42.805 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:53:42.806 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":94,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:53:13.120277+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:53:42.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.805+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b400a15f0 msgr2=0x7f5b400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.805+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b400a15f0 0x7f5b400a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800b2e0 tx=0x7f5b48005fd0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 msgr2=0x7f5b5819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:42.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 0x7f5b5819cd40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e9a0 tx=0x7f5b4c00ecb0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 shutdown_connections 2023-10-26T06:53:42.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f5b400a15f0 0x7f5b400a3ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5b581066b0 0x7f5b58196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b581006a0 0x7f5b5819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 --2- 172.21.15.50:0/17583164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b58101060 0x7f5b5819cd40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:42.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 >> 172.21.15.50:0/17583164 conn(0x7f5b580fc170 msgr2=0x7f5b580fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:42.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 shutdown_connections 2023-10-26T06:53:42.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:42.806+0000 7f5b5e3ff700 1 -- 172.21.15.50:0/17583164 wait complete. 2023-10-26T06:53:42.827 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:53:42.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:53:43.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 -- 172.21.15.50:0/2459942305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 msgr2=0x7f94bc10ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 --2- 172.21.15.50:0/2459942305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc10ca10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009990 tx=0x7f94ac009ca0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 -- 172.21.15.50:0/2459942305 shutdown_connections 2023-10-26T06:53:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 --2- 172.21.15.50:0/2459942305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94bc10cf50 0x7f94bc10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 --2- 172.21.15.50:0/2459942305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94bc072c20 0x7f94bc073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 --2- 172.21.15.50:0/2459942305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc10ca10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.036+0000 7f94c31ff700 1 -- 172.21.15.50:0/2459942305 >> 172.21.15.50:0/2459942305 conn(0x7f94bc0fc200 msgr2=0x7f94bc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:43.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.037+0000 7f94c31ff700 1 -- 172.21.15.50:0/2459942305 shutdown_connections 2023-10-26T06:53:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.037+0000 7f94c31ff700 1 -- 172.21.15.50:0/2459942305 wait complete. 2023-10-26T06:53:43.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.038+0000 7f94c31ff700 1 Processor -- start 2023-10-26T06:53:43.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.038+0000 7f94c31ff700 1 -- start start 2023-10-26T06:53:43.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c31ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94bc072c20 0x7f94bc198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c31ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c31ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94bc10cf50 0x7f94bc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c31ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc19dd10 con 0x7f94bc073540 2023-10-26T06:53:43.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c31ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc19de80 con 0x7f94bc072c20 2023-10-26T06:53:43.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c31ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc19e040 con 0x7f94bc10cf50 2023-10-26T06:53:43.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44536/0 (socket says 172.21.15.50:44536) 2023-10-26T06:53:43.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 -- 172.21.15.50:0/1324219731 learned_addr learned my addr 172.21.15.50:0/1324219731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:43.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c0f9b700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94bc072c20 0x7f94bc198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94c179c700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94bc10cf50 0x7f94bc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 -- 172.21.15.50:0/1324219731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94bc10cf50 msgr2=0x7f94bc19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94bc10cf50 0x7f94bc19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 -- 172.21.15.50:0/1324219731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94bc072c20 msgr2=0x7f94bc198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94bc072c20 0x7f94bc198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.039+0000 7f94b3fff700 1 -- 172.21.15.50:0/1324219731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0095f0 con 0x7f94bc073540 2023-10-26T06:53:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.040+0000 7f94b3fff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc199330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000c00 tx=0x7f94ac005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.040+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac01d070 con 0x7f94bc073540 2023-10-26T06:53:43.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.040+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94ac022470 con 0x7f94bc073540 2023-10-26T06:53:43.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.040+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc19e2c0 con 0x7f94bc073540 2023-10-26T06:53:43.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.040+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac017650 con 0x7f94bc073540 2023-10-26T06:53:43.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.040+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc1a5b60 con 0x7f94bc073540 2023-10-26T06:53:43.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.041+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc108160 con 0x7f94bc073540 2023-10-26T06:53:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.043+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f94ac0225e0 con 0x7f94bc073540 2023-10-26T06:53:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.044+0000 7f94b1ffb700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f94a40a15f0 0x7f94a40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.045+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f94ac0ce580 con 0x7f94bc073540 2023-10-26T06:53:43.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.045+0000 7f94c0f9b700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f94a40a15f0 0x7f94a40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.045+0000 7f94c0f9b700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f94a40a15f0 0x7f94a40a3ab0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009c60 tx=0x7f94b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:43.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.048+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f94ac097a80 con 0x7f94bc073540 2023-10-26T06:53:43.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:42 smithi153 ceph-mon[131657]: from='client.16509 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:53:43.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:42 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/17583164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:53:43.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.260+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94bc19a0f0 con 0x7f94bc073540 2023-10-26T06:53:43.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.260+0000 7f94b1ffb700 1 -- 172.21.15.50:0/1324219731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94ac027020 con 0x7f94bc073540 2023-10-26T06:53:43.262 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:53:43.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f94a40a15f0 msgr2=0x7f94a40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f94a40a15f0 0x7f94a40a3ab0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009c60 tx=0x7f94b8009260 comp rx=0 tx=0).stop 2023-10-26T06:53:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 msgr2=0x7f94bc199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc199330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000c00 tx=0x7f94ac005740 comp rx=0 tx=0).stop 2023-10-26T06:53:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 shutdown_connections 2023-10-26T06:53:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f94a40a15f0 0x7f94a40a3ab0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94bc10cf50 0x7f94bc19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94bc072c20 0x7f94bc198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 --2- 172.21.15.50:0/1324219731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94bc073540 0x7f94bc199330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 >> 172.21.15.50:0/1324219731 conn(0x7f94bc0fc200 msgr2=0x7f94bc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:43.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 shutdown_connections 2023-10-26T06:53:43.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.263+0000 7f94c31ff700 1 -- 172.21.15.50:0/1324219731 wait complete. 2023-10-26T06:53:43.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:42 smithi050 ceph-mon[94997]: from='client.16509 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:53:43.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:42 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/17583164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:53:43.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:53:43.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:42 smithi125 ceph-mon[130643]: from='client.16509 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-26T06:53:43.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:42 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/17583164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:53:43.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/3428280341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b4072c20 msgr2=0x7fb2b4073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/3428280341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b4072c20 0x7fb2b4073000 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009990 tx=0x7fb2a4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/3428280341 shutdown_connections 2023-10-26T06:53:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/3428280341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b410cf60 0x7fb2b410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/3428280341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b4072c20 0x7fb2b4073000 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/3428280341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b4073540 0x7fb2b410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/3428280341 >> 172.21.15.50:0/3428280341 conn(0x7fb2b40fc1b0 msgr2=0x7fb2b40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:43.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/3428280341 shutdown_connections 2023-10-26T06:53:43.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.491+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/3428280341 wait complete. 2023-10-26T06:53:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.492+0000 7fb2ba1ff700 1 Processor -- start 2023-10-26T06:53:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.492+0000 7fb2ba1ff700 1 -- start start 2023-10-26T06:53:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2ba1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b4072c20 0x7fb2b4198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2ba1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b4073540 0x7fb2b4199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2ba1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 0x7fb2b419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2ba1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419dd40 con 0x7fb2b410cf60 2023-10-26T06:53:43.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2ba1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419deb0 con 0x7fb2b4073540 2023-10-26T06:53:43.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2ba1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b419e070 con 0x7fb2b4072c20 2023-10-26T06:53:43.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 0x7fb2b419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 0x7fb2b419d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44558/0 (socket says 172.21.15.50:44558) 2023-10-26T06:53:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2abfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b4073540 0x7fb2b4199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2b3fff700 1 -- 172.21.15.50:0/1668334482 learned_addr learned my addr 172.21.15.50:0/1668334482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:43.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2b37fe700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b4072c20 0x7fb2b4198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2abfff700 1 -- 172.21.15.50:0/1668334482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b4072c20 msgr2=0x7fb2b4198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2abfff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b4072c20 0x7fb2b4198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2abfff700 1 -- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 msgr2=0x7fb2b419d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2abfff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 0x7fb2b419d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2abfff700 1 -- 172.21.15.50:0/1668334482 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40095f0 con 0x7fb2b4073540 2023-10-26T06:53:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.493+0000 7fb2b3fff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 0x7fb2b419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:53:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.494+0000 7fb2abfff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b4073540 0x7fb2b4199360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00e9f0 tx=0x7fb29c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.494+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00c9c0 con 0x7fb2b4073540 2023-10-26T06:53:43.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.494+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b419e350 con 0x7fb2b4073540 2023-10-26T06:53:43.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.494+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb29c010430 con 0x7fb2b4073540 2023-10-26T06:53:43.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.494+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c018680 con 0x7fb2b4073540 2023-10-26T06:53:43.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.494+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b41a5b90 con 0x7fb2b4073540 2023-10-26T06:53:43.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.495+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4108170 con 0x7fb2b4073540 2023-10-26T06:53:43.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.497+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb29c010860 con 0x7fb2b4073540 2023-10-26T06:53:43.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.499+0000 7fb2b17fa700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb2a00a15f0 0x7fb2a00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.499+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb29c014070 con 0x7fb2b4073540 2023-10-26T06:53:43.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.499+0000 7fb2b37fe700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb2a00a15f0 0x7fb2a00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.499+0000 7fb2b37fe700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb2a00a15f0 0x7fb2a00a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b2e0 tx=0x7fb2a4005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:43.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.501+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb29c096710 con 0x7fb2b4073540 2023-10-26T06:53:43.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.711+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2b419a120 con 0x7fb2b4073540 2023-10-26T06:53:43.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.712+0000 7fb2b17fa700 1 -- 172.21.15.50:0/1668334482 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb29c099d30 con 0x7fb2b4073540 2023-10-26T06:53:43.714 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:53:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb2a00a15f0 msgr2=0x7fb2a00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb2a00a15f0 0x7fb2a00a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b2e0 tx=0x7fb2a4005fd0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b4073540 msgr2=0x7fb2b4199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b4073540 0x7fb2b4199360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00e9f0 tx=0x7fb29c00ed00 comp rx=0 tx=0).stop 2023-10-26T06:53:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 shutdown_connections 2023-10-26T06:53:43.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb2a00a15f0 0x7fb2a00a3ab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2b410cf60 0x7fb2b419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2b4072c20 0x7fb2b4198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 --2- 172.21.15.50:0/1668334482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2b4073540 0x7fb2b4199360 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.714+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 >> 172.21.15.50:0/1668334482 conn(0x7fb2b40fc1b0 msgr2=0x7fb2b40fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.715+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 shutdown_connections 2023-10-26T06:53:43.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.715+0000 7fb2ba1ff700 1 -- 172.21.15.50:0/1668334482 wait complete. 2023-10-26T06:53:43.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:53:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 -- 172.21.15.50:0/446137200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 msgr2=0x7f90b01055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 --2- 172.21.15.50:0/446137200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b01055f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f90a40099c0 tx=0x7f90a4009cd0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 -- 172.21.15.50:0/446137200 shutdown_connections 2023-10-26T06:53:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 --2- 172.21.15.50:0/446137200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b0105b30 0x7f90b010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 --2- 172.21.15.50:0/446137200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90b0067d40 0x7f90b0068120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 --2- 172.21.15.50:0/446137200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b01055f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 -- 172.21.15.50:0/446137200 >> 172.21.15.50:0/446137200 conn(0x7f90b00767f0 msgr2=0x7f90b0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 -- 172.21.15.50:0/446137200 shutdown_connections 2023-10-26T06:53:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.943+0000 7f90b65ff700 1 -- 172.21.15.50:0/446137200 wait complete. 2023-10-26T06:53:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.944+0000 7f90b65ff700 1 Processor -- start 2023-10-26T06:53:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.944+0000 7f90b65ff700 1 -- start start 2023-10-26T06:53:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b65ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b0067d40 0x7f90b0107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b65ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b0107a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b65ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90b0105b30 0x7f90b0107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b65ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b01a93d0 con 0x7f90b0105170 2023-10-26T06:53:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b65ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b01a9510 con 0x7f90b0105b30 2023-10-26T06:53:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b65ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b01a9680 con 0x7f90b0067d40 2023-10-26T06:53:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b0107a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b0107a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32962/0 (socket says 172.21.15.50:32962) 2023-10-26T06:53:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 -- 172.21.15.50:0/511056736 learned_addr learned my addr 172.21.15.50:0/511056736 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90affff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b0067d40 0x7f90b0107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90b4b9c700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90b0105b30 0x7f90b0107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 -- 172.21.15.50:0/511056736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b0067d40 msgr2=0x7f90b0107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b0067d40 0x7f90b0107550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 -- 172.21.15.50:0/511056736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90b0105b30 msgr2=0x7f90b0107fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90b0105b30 0x7f90b0107fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.945+0000 7f90af7fe700 1 -- 172.21.15.50:0/511056736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40095f0 con 0x7f90b0105170 2023-10-26T06:53:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.946+0000 7f90af7fe700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b0107a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f90a400f690 tx=0x7f90a400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.946+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a401c070 con 0x7f90b0105170 2023-10-26T06:53:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.946+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90a400fcf0 con 0x7f90b0105170 2023-10-26T06:53:43.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.946+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4022c60 con 0x7f90b0105170 2023-10-26T06:53:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.946+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b01a9900 con 0x7f90b0105170 2023-10-26T06:53:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.946+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b01a9d20 con 0x7f90b0105170 2023-10-26T06:53:43.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.947+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b0101e40 con 0x7f90b0105170 2023-10-26T06:53:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.949+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f90a4020070 con 0x7f90b0105170 2023-10-26T06:53:43.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.950+0000 7f90ad7fa700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f90980a1670 0x7f90980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:43.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.951+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f90a40cdd60 con 0x7f90b0105170 2023-10-26T06:53:43.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.951+0000 7f90affff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f90980a1670 0x7f90980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:43.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.951+0000 7f90affff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f90980a1670 0x7f90980a3b30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009c60 tx=0x7f90a0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:43.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:43.955+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90a4097140 con 0x7f90b0105170 2023-10-26T06:53:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.169+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90b0110690 con 0x7f90b0105170 2023-10-26T06:53:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.170+0000 7f90ad7fa700 1 -- 172.21.15.50:0/511056736 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90a400fe60 con 0x7f90b0105170 2023-10-26T06:53:44.172 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:53:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.172+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f90980a1670 msgr2=0x7f90980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.172+0000 7f90b65ff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f90980a1670 0x7f90980a3b30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009c60 tx=0x7f90a0009260 comp rx=0 tx=0).stop 2023-10-26T06:53:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.172+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 msgr2=0x7f90b0107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.172+0000 7f90b65ff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b0107a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f90a400f690 tx=0x7f90a400bfd0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 shutdown_connections 2023-10-26T06:53:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f90980a1670 0x7f90980a3b30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90b0105b30 0x7f90b0107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b0067d40 0x7f90b0107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 --2- 172.21.15.50:0/511056736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b0105170 0x7f90b0107a90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 >> 172.21.15.50:0/511056736 conn(0x7f90b00767f0 msgr2=0x7f90b010bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 shutdown_connections 2023-10-26T06:53:44.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.173+0000 7f90b65ff700 1 -- 172.21.15.50:0/511056736 wait complete. 2023-10-26T06:53:44.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-26T06:53:44.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.397+0000 7f9acadff700 1 -- 172.21.15.50:0/4150195030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 msgr2=0x7f9ac4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:44.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.397+0000 7f9acadff700 1 --2- 172.21.15.50:0/4150195030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac4100b20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009990 tx=0x7f9ab0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 -- 172.21.15.50:0/4150195030 shutdown_connections 2023-10-26T06:53:44.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 --2- 172.21.15.50:0/4150195030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ac4101060 0x7f9ac410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 --2- 172.21.15.50:0/4150195030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 0x7f9ac4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 --2- 172.21.15.50:0/4150195030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac4100b20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 -- 172.21.15.50:0/4150195030 >> 172.21.15.50:0/4150195030 conn(0x7f9ac40fc170 msgr2=0x7f9ac40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:44.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 -- 172.21.15.50:0/4150195030 shutdown_connections 2023-10-26T06:53:44.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.398+0000 7f9acadff700 1 -- 172.21.15.50:0/4150195030 wait complete. 2023-10-26T06:53:44.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 Processor -- start 2023-10-26T06:53:44.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 -- start start 2023-10-26T06:53:44.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:44.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ac4101060 0x7f9ac419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:44.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 0x7f9ac4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4199180 con 0x7f9ac41006a0 2023-10-26T06:53:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41992f0 con 0x7f9ac4101060 2023-10-26T06:53:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.399+0000 7f9acadff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41994b0 con 0x7f9ac41066b0 2023-10-26T06:53:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac419e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32982/0 (socket says 172.21.15.50:32982) 2023-10-26T06:53:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 -- 172.21.15.50:0/2998044882 learned_addr learned my addr 172.21.15.50:0/2998044882 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:53:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac3fff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ac4101060 0x7f9ac419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac939c700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 0x7f9ac4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 -- 172.21.15.50:0/2998044882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 msgr2=0x7f9ac4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 0x7f9ac4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 -- 172.21.15.50:0/2998044882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ac4101060 msgr2=0x7f9ac419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ac4101060 0x7f9ac419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:44.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 -- 172.21.15.50:0/2998044882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00095f0 con 0x7f9ac41006a0 2023-10-26T06:53:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac939c700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 0x7f9ac4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:53:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac8b9b700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac419e990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800d980 tx=0x7f9ab800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:44.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.400+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8004220 con 0x7f9ac41006a0 2023-10-26T06:53:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.401+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ab8007640 con 0x7f9ac41006a0 2023-10-26T06:53:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.401+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac4199790 con 0x7f9ac41006a0 2023-10-26T06:53:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.401+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8005610 con 0x7f9ac41006a0 2023-10-26T06:53:44.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.401+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac41a5a30 con 0x7f9ac41006a0 2023-10-26T06:53:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.402+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac4101de0 con 0x7f9ac41006a0 2023-10-26T06:53:44.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.404+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9ab8004750 con 0x7f9ac41006a0 2023-10-26T06:53:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.405+0000 7f9ac1ffb700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ab40a1670 0x7f9ab40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:53:44.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.405+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9ab80cce60 con 0x7f9ac41006a0 2023-10-26T06:53:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.405+0000 7f9ac3fff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ab40a1670 0x7f9ab40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:53:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.406+0000 7f9ac3fff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ab40a1670 0x7f9ab40a3b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9ac419a210 tx=0x7f9ab000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:53:44.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.409+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ab80961b0 con 0x7f9ac41006a0 2023-10-26T06:53:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:44 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1324219731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:53:44.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:44 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1668334482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:53:44.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:44 smithi125 ceph-mon[130643]: pgmap v629: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 519 KiB/s wr, 18 op/s 2023-10-26T06:53:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:44 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1324219731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:53:44.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:44 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1668334482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:53:44.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:44 smithi153 ceph-mon[131657]: pgmap v629: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 519 KiB/s wr, 18 op/s 2023-10-26T06:53:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:44 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1324219731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:53:44.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:44 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1668334482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:53:44.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:44 smithi050 ceph-mon[94997]: pgmap v629: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 519 KiB/s wr, 18 op/s 2023-10-26T06:53:44.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.685+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f9ac4067530 con 0x7f9ac41006a0 2023-10-26T06:53:44.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.696+0000 7f9ac1ffb700 1 -- 172.21.15.50:0/2998044882 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+734408 (secure 0 0 0) 0x7f9ab8016020 con 0x7f9ac41006a0 2023-10-26T06:53:44.700 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:53:44.700 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:53:44.701 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 24, 2023-10-26T06:53:44.701 INFO:teuthology.orchestra.run.smithi050.stdout: "active_gid": 14214, 2023-10-26T06:53:44.701 INFO:teuthology.orchestra.run.smithi050.stdout: "active_name": "x", 2023-10-26T06:53:44.702 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addrs": { 2023-10-26T06:53:44.702 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:44.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:44.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:44.703 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2023-10-26T06:53:44.703 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3705474252 2023-10-26T06:53:44.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:44.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-10-26T06:53:44.704 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2023-10-26T06:53:44.704 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3705474252 2023-10-26T06:53:44.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:44.705 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:44.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.705 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addr": "172.21.15.50:6801/3705474252", 2023-10-26T06:53:44.706 INFO:teuthology.orchestra.run.smithi050.stdout: "active_change": "2023-10-26T06:35:29.546101+0000", 2023-10-26T06:53:44.706 INFO:teuthology.orchestra.run.smithi050.stdout: "active_mgr_features": 4540138322906710015, 2023-10-26T06:53:44.707 INFO:teuthology.orchestra.run.smithi050.stdout: "available": true, 2023-10-26T06:53:44.707 INFO:teuthology.orchestra.run.smithi050.stdout: "standbys": [ 2023-10-26T06:53:44.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:44.707 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24160, 2023-10-26T06:53:44.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "z", 2023-10-26T06:53:44.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540138322906710015, 2023-10-26T06:53:44.708 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2023-10-26T06:53:44.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:44.709 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2023-10-26T06:53:44.709 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:44.709 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:44.710 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:44.710 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:44.710 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:44.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.711 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.711 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:44.712 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.712 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.713 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.713 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2023-10-26T06:53:44.713 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.714 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.715 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:44.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:44.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.715 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.716 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.716 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.716 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.717 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:44.717 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:44.718 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:44.718 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:44.718 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:44.718 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:44.719 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.719 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.719 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.720 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.720 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:44.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:44.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.721 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.722 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.722 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.722 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.723 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.723 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.723 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.724 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:44.724 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:44.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.725 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:44.726 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.726 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.727 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:44.727 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:44.727 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:44.728 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:44.728 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:44.728 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:44.728 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.729 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.729 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.729 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.730 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:44.730 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:44.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.731 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.732 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.732 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.732 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.733 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.733 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.734 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2023-10-26T06:53:44.734 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2023-10-26T06:53:44.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.735 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.736 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.736 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2023-10-26T06:53:44.737 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.737 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.738 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2023-10-26T06:53:44.738 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2023-10-26T06:53:44.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2023-10-26T06:53:44.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.740 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.740 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.740 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2023-10-26T06:53:44.741 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.741 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.742 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2023-10-26T06:53:44.742 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2023-10-26T06:53:44.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.742 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.743 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.743 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.744 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.744 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2023-10-26T06:53:44.744 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.745 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.745 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2023-10-26T06:53:44.746 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2023-10-26T06:53:44.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.746 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.747 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.747 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.748 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.748 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2023-10-26T06:53:44.748 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.749 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.749 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2023-10-26T06:53:44.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2023-10-26T06:53:44.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:44.750 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.751 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2023-10-26T06:53:44.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.751 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.751 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.752 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2023-10-26T06:53:44.752 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.753 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.753 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2023-10-26T06:53:44.753 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2023-10-26T06:53:44.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.754 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.754 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.755 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.755 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.755 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2023-10-26T06:53:44.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.756 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.757 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2023-10-26T06:53:44.757 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2023-10-26T06:53:44.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.758 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.758 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:44.759 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.759 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.759 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.760 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-26T06:53:44.760 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.760 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.761 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2023-10-26T06:53:44.761 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2023-10-26T06:53:44.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.762 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.762 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.763 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.763 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2023-10-26T06:53:44.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.764 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:44.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:44.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:44.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2023-10-26T06:53:44.766 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:44.766 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:44.767 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:44.767 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2023-10-26T06:53:44.767 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2023-10-26T06:53:44.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.768 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.768 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:44.769 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.769 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.769 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.770 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2023-10-26T06:53:44.770 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.770 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.771 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2023-10-26T06:53:44.771 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2023-10-26T06:53:44.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.772 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2023-10-26T06:53:44.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.773 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.773 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.773 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2023-10-26T06:53:44.774 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-26T06:53:44.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.774 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.775 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2023-10-26T06:53:44.775 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2023-10-26T06:53:44.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:44.776 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.776 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:44.777 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2023-10-26T06:53:44.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2023-10-26T06:53:44.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.777 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-26T06:53:44.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-26T06:53:44.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.778 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.779 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2023-10-26T06:53:44.779 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2023-10-26T06:53:44.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:44.780 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.780 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2023-10-26T06:53:44.780 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:44.781 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2023-10-26T06:53:44.781 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.781 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-26T06:53:44.781 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.782 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.783 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2023-10-26T06:53:44.783 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2023-10-26T06:53:44.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.783 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.784 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2023-10-26T06:53:44.784 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.784 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.785 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.785 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-26T06:53:44.785 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-26T06:53:44.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.786 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2023-10-26T06:53:44.786 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2023-10-26T06:53:44.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:44.787 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.787 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2023-10-26T06:53:44.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2023-10-26T06:53:44.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2023-10-26T06:53:44.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.788 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2023-10-26T06:53:44.789 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-26T06:53:44.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.789 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.790 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2023-10-26T06:53:44.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2023-10-26T06:53:44.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.791 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.791 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2023-10-26T06:53:44.792 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.792 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.792 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2023-10-26T06:53:44.793 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-26T06:53:44.793 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.793 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.794 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2023-10-26T06:53:44.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2023-10-26T06:53:44.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:44.795 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.795 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:44.795 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2023-10-26T06:53:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2023-10-26T06:53:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-26T06:53:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-26T06:53:44.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.797 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.797 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:44.798 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:44.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.798 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.799 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.799 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.799 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:44.800 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:44.801 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:44.801 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:44.801 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.802 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.802 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.803 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:44.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:44.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.804 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.804 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.804 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.805 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.805 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.805 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.806 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.806 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.807 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:44.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:44.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.808 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:44.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.809 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.809 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.809 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:44.809 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:44.810 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:44.810 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:44.810 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:44.811 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:44.811 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.811 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.811 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.812 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.812 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.812 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:44.813 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:44.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.813 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.814 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.814 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.815 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.815 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.816 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.816 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2023-10-26T06:53:44.817 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2023-10-26T06:53:44.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:44.817 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:44.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.818 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.819 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.819 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-26T06:53:44.819 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.820 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2023-10-26T06:53:44.821 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2023-10-26T06:53:44.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.821 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.822 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2023-10-26T06:53:44.822 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.822 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.823 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.823 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2023-10-26T06:53:44.823 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2023-10-26T06:53:44.823 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap" 2023-10-26T06:53:44.824 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.824 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2023-10-26T06:53:44.824 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.825 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.825 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2023-10-26T06:53:44.826 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2023-10-26T06:53:44.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.826 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.827 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.827 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.827 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.828 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-26T06:53:44.828 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.829 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.829 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:44.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:44.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.830 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:44.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.831 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-26T06:53:44.832 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2023-10-26T06:53:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2023-10-26T06:53:44.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-26T06:53:44.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-26T06:53:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.836 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2023-10-26T06:53:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2023-10-26T06:53:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-26T06:53:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:44.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2023-10-26T06:53:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:44.841 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2023-10-26T06:53:44.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2023-10-26T06:53:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2023-10-26T06:53:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-26T06:53:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2023-10-26T06:53:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2023-10-26T06:53:44.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2023-10-26T06:53:44.847 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-26T06:53:44.848 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2023-10-26T06:53:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2023-10-26T06:53:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:44.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2023-10-26T06:53:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-26T06:53:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2023-10-26T06:53:44.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2023-10-26T06:53:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.854 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-26T06:53:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-26T06:53:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2023-10-26T06:53:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2023-10-26T06:53:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:44.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-26T06:53:44.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.860 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2023-10-26T06:53:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2023-10-26T06:53:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2023-10-26T06:53:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-26T06:53:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2023-10-26T06:53:44.864 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2023-10-26T06:53:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.865 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.866 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2023-10-26T06:53:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2023-10-26T06:53:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2023-10-26T06:53:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-26T06:53:44.867 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2023-10-26T06:53:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2023-10-26T06:53:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:44.870 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-26T06:53:44.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.872 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2023-10-26T06:53:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2023-10-26T06:53:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.873 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.874 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-26T06:53:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.876 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2023-10-26T06:53:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2023-10-26T06:53:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.878 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-26T06:53:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.879 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2023-10-26T06:53:44.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2023-10-26T06:53:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.881 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-26T06:53:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.883 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2023-10-26T06:53:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2023-10-26T06:53:44.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-26T06:53:44.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2023-10-26T06:53:44.886 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.887 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2023-10-26T06:53:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2023-10-26T06:53:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-26T06:53:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.889 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2023-10-26T06:53:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.890 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2023-10-26T06:53:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2023-10-26T06:53:44.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-26T06:53:44.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.896 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2023-10-26T06:53:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2023-10-26T06:53:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.898 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-26T06:53:44.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2023-10-26T06:53:44.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2023-10-26T06:53:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2023-10-26T06:53:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.902 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-26T06:53:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.903 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2023-10-26T06:53:44.904 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.905 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2023-10-26T06:53:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2023-10-26T06:53:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-26T06:53:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2023-10-26T06:53:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2023-10-26T06:53:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2023-10-26T06:53:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-26T06:53:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2023-10-26T06:53:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2023-10-26T06:53:44.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2023-10-26T06:53:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-26T06:53:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.915 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2023-10-26T06:53:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.916 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2023-10-26T06:53:44.917 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2023-10-26T06:53:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-26T06:53:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.919 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2023-10-26T06:53:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.920 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2023-10-26T06:53:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2023-10-26T06:53:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-26T06:53:44.922 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2023-10-26T06:53:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2023-10-26T06:53:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.925 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-26T06:53:44.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2023-10-26T06:53:44.927 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.928 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2023-10-26T06:53:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2023-10-26T06:53:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.929 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-26T06:53:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.930 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.931 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.932 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2023-10-26T06:53:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2023-10-26T06:53:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-26T06:53:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2023-10-26T06:53:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2023-10-26T06:53:44.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2023-10-26T06:53:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-26T06:53:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2023-10-26T06:53:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.939 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2023-10-26T06:53:44.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2023-10-26T06:53:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.942 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2023-10-26T06:53:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2023-10-26T06:53:44.944 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2023-10-26T06:53:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.945 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-26T06:53:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.947 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2023-10-26T06:53:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2023-10-26T06:53:44.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.949 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2023-10-26T06:53:44.949 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.950 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-26T06:53:44.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.952 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2023-10-26T06:53:44.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2023-10-26T06:53:44.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.953 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.953 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2023-10-26T06:53:44.953 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.954 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.954 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-26T06:53:44.955 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.956 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2023-10-26T06:53:44.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2023-10-26T06:53:44.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2023-10-26T06:53:44.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.958 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.958 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2023-10-26T06:53:44.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.959 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.959 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2023-10-26T06:53:44.960 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2023-10-26T06:53:44.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.961 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.962 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-26T06:53:44.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.963 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2023-10-26T06:53:44.964 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2023-10-26T06:53:44.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:44.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.966 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2023-10-26T06:53:44.966 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.967 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.967 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2023-10-26T06:53:44.967 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2023-10-26T06:53:44.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:44.968 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:44.969 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.969 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.969 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.969 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2023-10-26T06:53:44.969 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.970 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.970 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.971 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2023-10-26T06:53:44.971 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2023-10-26T06:53:44.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.971 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.972 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.972 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.972 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.973 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.973 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-26T06:53:44.973 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.974 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.974 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.974 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:44.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:44.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.975 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.976 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:44.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.976 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.977 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:44.977 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:44.977 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:44.978 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:44.978 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:44.978 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:44.978 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.979 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.980 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.980 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2023-10-26T06:53:44.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2023-10-26T06:53:44.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.981 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.982 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.982 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.982 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.982 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.983 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-26T06:53:44.983 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.983 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.984 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:44.984 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:44.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.985 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.985 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:44.986 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.986 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.986 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.987 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-26T06:53:44.987 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.987 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.988 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:44.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:44.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:44.989 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.989 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:44.989 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:44.990 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:44.991 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:44.991 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:44.991 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:44.991 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:44.992 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:44.992 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:44.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.993 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.993 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.994 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:44.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:44.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:44.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.996 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:44.996 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:44.996 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:44.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:44.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:44.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:44.997 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-26T06:53:44.998 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-26T06:53:44.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:44.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:44.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:44.999 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:44.999 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:44.999 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:44.999 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.000 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-26T06:53:45.000 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.000 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.001 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.001 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-26T06:53:45.001 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-26T06:53:45.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.002 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.002 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2023-10-26T06:53:45.003 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.003 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.004 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-26T06:53:45.004 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.004 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2023-10-26T06:53:45.005 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2023-10-26T06:53:45.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.006 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.006 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.007 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.007 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.007 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2023-10-26T06:53:45.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.009 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2023-10-26T06:53:45.009 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2023-10-26T06:53:45.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-26T06:53:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.012 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.012 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2023-10-26T06:53:45.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2023-10-26T06:53:45.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.013 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.014 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.015 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2023-10-26T06:53:45.015 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.016 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.016 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2023-10-26T06:53:45.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2023-10-26T06:53:45.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.017 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.018 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2023-10-26T06:53:45.018 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.018 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.019 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.019 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2023-10-26T06:53:45.019 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2023-10-26T06:53:45.019 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.020 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2023-10-26T06:53:45.020 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.020 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.020 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.021 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2023-10-26T06:53:45.021 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2023-10-26T06:53:45.022 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.022 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.022 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.022 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-26T06:53:45.023 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.023 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.023 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-26T06:53:45.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.025 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2023-10-26T06:53:45.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2023-10-26T06:53:45.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.026 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.026 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-26T06:53:45.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.028 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.028 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2023-10-26T06:53:45.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2023-10-26T06:53:45.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.030 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.031 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-26T06:53:45.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.031 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.032 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2023-10-26T06:53:45.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2023-10-26T06:53:45.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.033 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.033 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.034 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.034 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.034 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.034 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-26T06:53:45.035 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.035 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.036 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2023-10-26T06:53:45.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2023-10-26T06:53:45.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.037 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.037 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.037 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.038 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-26T06:53:45.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.039 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.039 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2023-10-26T06:53:45.040 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2023-10-26T06:53:45.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.040 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.041 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.041 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.041 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.041 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-26T06:53:45.042 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.043 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.043 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2023-10-26T06:53:45.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2023-10-26T06:53:45.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.044 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.045 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2023-10-26T06:53:45.045 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.045 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.045 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.046 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2023-10-26T06:53:45.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.047 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.047 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2023-10-26T06:53:45.047 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2023-10-26T06:53:45.048 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.048 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.048 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.049 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.049 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.049 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-26T06:53:45.050 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.050 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.050 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.051 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2023-10-26T06:53:45.051 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2023-10-26T06:53:45.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.052 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.052 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.053 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-26T06:53:45.053 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.054 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.055 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2023-10-26T06:53:45.055 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2023-10-26T06:53:45.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.055 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.056 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.057 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.057 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-26T06:53:45.057 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.057 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2023-10-26T06:53:45.058 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2023-10-26T06:53:45.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.060 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.060 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.060 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.060 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.060 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2023-10-26T06:53:45.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.062 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2023-10-26T06:53:45.062 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2023-10-26T06:53:45.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.063 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.063 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.064 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-26T06:53:45.064 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.065 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.065 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2023-10-26T06:53:45.066 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2023-10-26T06:53:45.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.066 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.067 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.067 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.067 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.068 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.068 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-26T06:53:45.068 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.069 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.070 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2023-10-26T06:53:45.070 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.071 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.071 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.071 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.072 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.072 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.073 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.074 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.074 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.074 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.075 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.075 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.075 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.075 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.076 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.076 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.077 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.077 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.078 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.078 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.078 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.079 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.079 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.079 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.079 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.080 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.080 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.080 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.081 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.081 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.082 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.082 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.082 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.083 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.083 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.083 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.084 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.084 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.084 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.084 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.085 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.085 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.085 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.085 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.086 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.087 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.087 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.088 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.089 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.089 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2023-10-26T06:53:45.090 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2023-10-26T06:53:45.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.091 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2023-10-26T06:53:45.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.091 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.092 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.092 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-26T06:53:45.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.093 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.093 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2023-10-26T06:53:45.093 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2023-10-26T06:53:45.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.094 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.095 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2023-10-26T06:53:45.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.095 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.095 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.095 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-26T06:53:45.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.096 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.096 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.097 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2023-10-26T06:53:45.098 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.098 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.098 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.098 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-26T06:53:45.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-26T06:53:45.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.099 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.102 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2023-10-26T06:53:45.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-26T06:53:45.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.103 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.104 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.105 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.106 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-26T06:53:45.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-26T06:53:45.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.107 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.107 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.107 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.108 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.108 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.108 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.109 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.109 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.110 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2023-10-26T06:53:45.110 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2023-10-26T06:53:45.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.111 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.111 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.111 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.112 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.112 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.112 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.113 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.113 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.113 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.114 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-26T06:53:45.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-26T06:53:45.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.114 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.115 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.115 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.117 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2023-10-26T06:53:45.118 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-26T06:53:45.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.120 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.121 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.121 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-26T06:53:45.121 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-26T06:53:45.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.122 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.122 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.123 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.123 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.123 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.123 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.124 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.125 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-26T06:53:45.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-26T06:53:45.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.126 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.126 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.126 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.127 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.127 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.127 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.128 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.129 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-26T06:53:45.129 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-26T06:53:45.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.129 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.130 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.131 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.131 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.131 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.131 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.132 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.132 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-26T06:53:45.132 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-26T06:53:45.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.133 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.134 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.134 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.134 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.135 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.135 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.135 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.136 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.136 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-26T06:53:45.137 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-26T06:53:45.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.137 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.138 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.138 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.138 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.139 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.140 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.140 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-26T06:53:45.141 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-26T06:53:45.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.142 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.142 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.142 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.143 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.144 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.144 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-26T06:53:45.145 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-26T06:53:45.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.145 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.146 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.146 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.146 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.147 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.147 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.147 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.148 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.148 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-26T06:53:45.148 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-26T06:53:45.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.149 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.150 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.150 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.150 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.151 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.151 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.151 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.152 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2023-10-26T06:53:45.152 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-26T06:53:45.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.153 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.153 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:45.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.154 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.154 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.155 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.156 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-26T06:53:45.156 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-26T06:53:45.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.157 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.157 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.158 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.160 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2023-10-26T06:53:45.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2023-10-26T06:53:45.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.163 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.164 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2023-10-26T06:53:45.164 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-26T06:53:45.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.165 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:45.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.166 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.166 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.166 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.167 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.167 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.167 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-26T06:53:45.168 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-26T06:53:45.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.168 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.169 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.169 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.169 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.170 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.170 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.171 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.171 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-26T06:53:45.172 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-26T06:53:45.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.172 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.173 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.173 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.173 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.174 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.174 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.174 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.175 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.175 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-26T06:53:45.175 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-26T06:53:45.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.176 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.176 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.177 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.178 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.178 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.178 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.178 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.179 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-26T06:53:45.179 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-26T06:53:45.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.180 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.180 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.180 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.181 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.181 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.181 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.181 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.182 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.182 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.182 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.183 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2023-10-26T06:53:45.183 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-26T06:53:45.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.184 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.184 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.184 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.184 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.185 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.185 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.185 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.186 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.186 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.187 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-26T06:53:45.187 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-26T06:53:45.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.187 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.188 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.188 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.189 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.189 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.189 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.190 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-26T06:53:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-26T06:53:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.191 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.192 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.193 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.194 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-26T06:53:45.195 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-26T06:53:45.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.195 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.196 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.196 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.196 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.197 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.197 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.197 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.198 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.198 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-26T06:53:45.199 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-26T06:53:45.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.199 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.199 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.200 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.200 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.200 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.200 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.201 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.201 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.201 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.202 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.202 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-26T06:53:45.202 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-26T06:53:45.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.203 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.203 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.203 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.204 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.204 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.204 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.205 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.205 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.205 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.206 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-26T06:53:45.206 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-26T06:53:45.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.207 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.207 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.208 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.208 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.208 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.208 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.209 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.209 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.209 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.210 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-26T06:53:45.210 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-26T06:53:45.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.211 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.211 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.211 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.212 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.212 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.213 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.213 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.214 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-26T06:53:45.214 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-26T06:53:45.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.214 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.215 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.216 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.216 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.216 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.217 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2023-10-26T06:53:45.218 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-26T06:53:45.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.218 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.219 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.219 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.219 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.220 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.220 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.221 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.221 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-26T06:53:45.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-26T06:53:45.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.222 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.222 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-26T06:53:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.224 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.224 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.224 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.224 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.225 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.225 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-26T06:53:45.225 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-26T06:53:45.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.226 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.226 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.227 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.227 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.227 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.228 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.228 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.228 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.228 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.229 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-26T06:53:45.229 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-26T06:53:45.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.230 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.230 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.230 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2023-10-26T06:53:45.231 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.231 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.231 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.232 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.232 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.233 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-26T06:53:45.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-26T06:53:45.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.234 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2023-10-26T06:53:45.235 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.236 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.236 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.236 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.237 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2023-10-26T06:53:45.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-26T06:53:45.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.238 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.239 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.239 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.239 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.240 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.241 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-26T06:53:45.241 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-26T06:53:45.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.242 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.242 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:45.243 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.243 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.244 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.244 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.244 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.245 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2023-10-26T06:53:45.245 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-26T06:53:45.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.246 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.246 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.247 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.247 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.248 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.249 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2023-10-26T06:53:45.249 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-26T06:53:45.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.250 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.250 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.251 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.251 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.251 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.253 INFO:teuthology.orchestra.run.smithi050.stdout: "UNSAFE_TLS_v1_2": { 2023-10-26T06:53:45.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-26T06:53:45.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.254 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.257 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-26T06:53:45.257 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-26T06:53:45.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.258 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.258 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.258 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:45.258 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.259 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.259 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.259 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.260 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.260 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.260 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.261 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-26T06:53:45.261 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-26T06:53:45.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.262 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.262 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.263 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.263 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.263 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.263 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.264 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.264 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.265 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-26T06:53:45.265 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-26T06:53:45.265 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.265 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.266 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:45.266 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.266 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.267 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.267 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.267 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.268 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2023-10-26T06:53:45.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2023-10-26T06:53:45.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.269 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.270 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.270 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.270 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.271 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.272 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2023-10-26T06:53:45.272 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2023-10-26T06:53:45.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.273 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.274 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.275 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.275 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.275 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.276 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2023-10-26T06:53:45.276 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2023-10-26T06:53:45.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.277 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.277 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.278 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.278 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.278 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2023-10-26T06:53:45.279 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.279 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.280 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2023-10-26T06:53:45.280 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2023-10-26T06:53:45.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.281 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.281 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2023-10-26T06:53:45.282 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.282 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.282 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.283 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.283 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2023-10-26T06:53:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2023-10-26T06:53:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.285 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.287 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.289 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.290 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.291 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.292 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.293 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.297 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.299 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.300 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.301 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.302 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.305 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.306 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.307 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.308 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2023-10-26T06:53:45.309 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2023-10-26T06:53:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2023-10-26T06:53:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2023-10-26T06:53:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2023-10-26T06:53:45.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.315 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.317 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2023-10-26T06:53:45.318 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.319 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2023-10-26T06:53:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.322 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.323 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.324 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2023-10-26T06:53:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2023-10-26T06:53:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.325 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.326 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2023-10-26T06:53:45.328 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2023-10-26T06:53:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.329 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2023-10-26T06:53:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2023-10-26T06:53:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2023-10-26T06:53:45.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2023-10-26T06:53:45.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.334 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2023-10-26T06:53:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.335 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.336 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2023-10-26T06:53:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2023-10-26T06:53:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2023-10-26T06:53:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2023-10-26T06:53:45.338 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2023-10-26T06:53:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2023-10-26T06:53:45.340 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2023-10-26T06:53:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.342 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2023-10-26T06:53:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.345 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2023-10-26T06:53:45.346 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2023-10-26T06:53:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.347 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.348 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2023-10-26T06:53:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.349 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.352 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.354 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.355 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.358 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.361 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.362 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.363 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.365 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.367 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2023-10-26T06:53:45.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2023-10-26T06:53:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2023-10-26T06:53:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-26T06:53:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2023-10-26T06:53:45.373 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2023-10-26T06:53:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2023-10-26T06:53:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-26T06:53:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2023-10-26T06:53:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2023-10-26T06:53:45.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.378 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2023-10-26T06:53:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2023-10-26T06:53:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2023-10-26T06:53:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2023-10-26T06:53:45.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2023-10-26T06:53:45.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.383 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-26T06:53:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2023-10-26T06:53:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2023-10-26T06:53:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.385 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.386 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-26T06:53:45.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:45.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2023-10-26T06:53:45.391 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.392 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2023-10-26T06:53:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2023-10-26T06:53:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2023-10-26T06:53:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-26T06:53:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.400 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2023-10-26T06:53:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.402 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.405 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.406 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.407 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.409 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.410 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.411 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.413 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.414 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.415 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.416 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.417 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.418 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.419 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.421 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2023-10-26T06:53:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2023-10-26T06:53:45.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2023-10-26T06:53:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2023-10-26T06:53:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2023-10-26T06:53:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.426 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2023-10-26T06:53:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.427 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.428 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.428 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.428 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.429 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.429 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:45.430 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:45.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.430 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.431 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.434 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2023-10-26T06:53:45.434 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2023-10-26T06:53:45.434 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2023-10-26T06:53:45.435 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.435 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2023-10-26T06:53:45.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2023-10-26T06:53:45.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.436 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.436 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2023-10-26T06:53:45.437 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.437 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.437 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.437 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-26T06:53:45.438 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.438 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.438 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.439 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2023-10-26T06:53:45.439 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2023-10-26T06:53:45.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.440 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.440 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2023-10-26T06:53:45.440 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.441 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.441 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.441 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-26T06:53:45.441 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.442 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.443 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2023-10-26T06:53:45.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2023-10-26T06:53:45.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.444 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.444 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.445 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.445 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2023-10-26T06:53:45.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.446 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.446 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.446 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:45.447 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:45.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.447 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.448 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2023-10-26T06:53:45.448 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2023-10-26T06:53:45.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.449 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.449 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-26T06:53:45.449 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.450 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.450 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.450 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.452 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.452 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.453 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.453 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.453 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.453 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.454 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.454 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.454 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.455 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.455 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.455 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.455 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.456 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.456 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.457 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.457 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.458 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.458 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.459 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.459 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.459 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.459 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.460 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.460 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.461 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.461 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.462 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.463 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.464 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.466 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.467 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.468 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.469 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2023-10-26T06:53:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2023-10-26T06:53:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.471 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2023-10-26T06:53:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.472 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2023-10-26T06:53:45.473 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2023-10-26T06:53:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2023-10-26T06:53:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.475 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2023-10-26T06:53:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2023-10-26T06:53:45.477 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2023-10-26T06:53:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.478 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2023-10-26T06:53:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-26T06:53:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.480 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2023-10-26T06:53:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2023-10-26T06:53:45.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.482 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2023-10-26T06:53:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.483 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-26T06:53:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2023-10-26T06:53:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2023-10-26T06:53:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.485 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.486 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2023-10-26T06:53:45.487 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2023-10-26T06:53:45.488 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2023-10-26T06:53:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2023-10-26T06:53:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.490 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-26T06:53:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.491 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2023-10-26T06:53:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.493 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.495 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.496 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.497 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.498 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.500 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.501 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.502 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.503 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.504 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.506 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.507 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.509 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.510 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.513 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.514 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2023-10-26T06:53:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.517 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.520 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.525 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.526 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.529 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.530 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.531 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.532 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.534 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.535 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.536 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2023-10-26T06:53:45.538 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2023-10-26T06:53:45.539 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2023-10-26T06:53:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2023-10-26T06:53:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.541 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-26T06:53:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.542 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2023-10-26T06:53:45.543 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2023-10-26T06:53:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.544 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2023-10-26T06:53:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.545 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-26T06:53:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.546 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.549 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.550 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.551 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.553 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.554 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.556 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.558 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.559 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.560 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.561 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.563 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.564 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.565 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.566 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.567 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.571 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2023-10-26T06:53:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.572 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.573 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2023-10-26T06:53:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2023-10-26T06:53:45.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.576 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2023-10-26T06:53:45.576 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.577 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.577 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2023-10-26T06:53:45.578 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-26T06:53:45.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.579 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.580 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.580 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.581 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.583 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.583 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.584 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.584 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.585 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.585 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.585 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.586 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.586 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.587 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.587 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.588 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.588 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.588 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.589 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.589 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.589 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.590 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.590 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.591 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.591 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.591 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.592 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.592 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.593 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.593 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.593 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.594 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.594 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.595 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.595 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.596 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.596 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.596 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.597 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.597 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.597 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.598 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.598 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.599 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.599 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.599 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.600 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.601 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.602 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.602 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.603 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.603 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.604 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.604 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.605 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.605 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.606 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.607 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.607 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2023-10-26T06:53:45.607 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2023-10-26T06:53:45.608 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.608 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.608 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.608 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.609 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.609 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.609 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.609 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2023-10-26T06:53:45.610 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-26T06:53:45.610 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.610 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.611 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2023-10-26T06:53:45.611 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2023-10-26T06:53:45.611 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.612 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.612 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.612 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2023-10-26T06:53:45.612 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.613 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.613 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.613 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2023-10-26T06:53:45.613 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.614 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.614 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.614 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2023-10-26T06:53:45.615 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2023-10-26T06:53:45.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.615 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.615 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.616 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2023-10-26T06:53:45.616 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.616 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.616 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.617 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2023-10-26T06:53:45.617 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.617 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.618 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.618 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2023-10-26T06:53:45.618 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2023-10-26T06:53:45.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.619 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.619 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.619 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.620 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.620 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.620 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.620 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2023-10-26T06:53:45.621 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.621 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.622 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2023-10-26T06:53:45.622 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2023-10-26T06:53:45.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.623 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.623 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.623 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2023-10-26T06:53:45.623 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.623 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.624 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.624 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-26T06:53:45.624 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-26T06:53:45.624 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.625 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.625 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.625 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.626 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2023-10-26T06:53:45.627 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.627 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.627 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.630 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.630 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.630 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.631 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.631 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.631 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.632 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.632 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.632 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.632 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.633 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.634 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.635 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.635 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.635 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.636 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.636 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.636 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.637 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.637 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.637 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.638 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.638 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.639 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.639 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.639 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.640 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.640 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.640 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.641 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.641 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.641 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.641 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.642 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.642 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.642 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.643 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.643 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.643 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.644 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.645 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.645 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.645 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.646 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.646 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.646 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.647 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.648 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.648 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.650 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2023-10-26T06:53:45.650 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.651 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.651 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.652 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.653 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.654 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.654 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.654 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.655 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.655 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.655 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.655 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.656 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.656 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.656 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.656 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.657 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.657 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.657 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.658 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.658 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.659 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.659 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.659 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.660 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.660 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.660 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.661 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.661 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.661 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.662 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.662 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.662 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.663 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.663 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.663 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.663 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.663 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.664 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.664 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.664 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.664 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.665 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.665 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.665 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.665 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.666 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.666 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.667 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.667 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.667 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.668 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.668 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.668 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.669 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.669 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.669 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.670 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.671 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.671 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.673 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2023-10-26T06:53:45.673 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.673 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.673 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.674 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.674 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.675 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.675 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.676 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.676 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.676 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.676 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.677 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.677 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.677 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.678 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.678 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.678 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.679 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.679 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.680 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.681 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.681 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.682 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.682 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.683 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.683 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.683 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.684 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.684 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.685 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.685 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.685 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.686 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.687 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.687 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.687 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.688 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.688 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.688 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.688 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.689 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.689 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.689 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.690 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.690 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.691 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.691 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.692 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.692 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.692 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.693 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.693 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.693 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.693 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.694 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.694 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.694 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.694 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.696 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2023-10-26T06:53:45.696 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.696 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.696 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.696 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2023-10-26T06:53:45.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2023-10-26T06:53:45.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.697 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.697 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.699 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.699 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-26T06:53:45.699 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.700 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.700 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.701 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.701 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.702 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.702 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.702 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.702 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.703 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.703 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.703 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.703 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.704 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.704 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.704 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.704 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.705 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.706 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.707 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.707 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.708 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.708 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.709 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.709 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.710 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.710 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.711 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.711 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.712 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.713 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.713 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.713 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.714 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.714 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.714 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.715 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.715 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.715 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.715 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.716 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.716 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.716 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.716 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.717 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.717 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.717 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.718 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.718 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.720 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.720 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.720 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.721 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.721 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.722 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2023-10-26T06:53:45.722 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2023-10-26T06:53:45.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.722 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.723 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.723 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.724 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.724 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.724 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2023-10-26T06:53:45.724 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2023-10-26T06:53:45.725 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2023-10-26T06:53:45.725 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.725 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2023-10-26T06:53:45.725 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.726 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.727 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2023-10-26T06:53:45.728 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.728 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.728 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.729 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.729 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.729 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.730 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.731 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.731 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.731 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.732 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.732 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.732 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.733 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.733 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.733 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.734 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.734 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.735 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.735 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.735 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.736 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.736 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.737 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.737 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.738 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.738 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.739 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.739 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.740 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.740 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.741 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.742 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.743 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.744 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.746 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2023-10-26T06:53:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.751 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.752 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.753 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.754 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.756 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.757 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.758 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.759 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.762 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.763 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.765 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.766 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.768 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.770 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2023-10-26T06:53:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.771 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.774 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.775 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.777 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.779 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.781 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.782 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.783 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.784 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.790 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.791 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:45.792 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.794 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.795 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2023-10-26T06:53:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2023-10-26T06:53:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.797 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2023-10-26T06:53:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2023-10-26T06:53:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2023-10-26T06:53:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-26T06:53:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.799 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2023-10-26T06:53:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.801 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2023-10-26T06:53:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2023-10-26T06:53:45.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.803 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.804 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-26T06:53:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2023-10-26T06:53:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2023-10-26T06:53:45.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.807 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.810 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.812 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.813 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.814 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.815 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.819 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.821 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.822 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.823 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.825 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.826 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2023-10-26T06:53:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2023-10-26T06:53:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2023-10-26T06:53:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2023-10-26T06:53:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:45.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.834 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2023-10-26T06:53:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2023-10-26T06:53:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.837 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2023-10-26T06:53:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2023-10-26T06:53:45.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.839 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.840 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.841 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2023-10-26T06:53:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2023-10-26T06:53:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.843 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-26T06:53:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-26T06:53:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.846 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.847 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.848 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.848 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.848 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.848 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.849 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.849 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.849 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.849 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.850 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.850 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.850 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.851 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.851 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.851 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.852 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.852 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.853 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.854 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.854 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.854 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.855 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.855 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.856 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.856 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.857 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.857 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.857 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.857 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.858 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.858 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.858 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.858 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.859 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.859 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.860 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.861 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.863 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.863 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.864 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2023-10-26T06:53:45.864 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2023-10-26T06:53:45.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.866 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.867 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.867 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-26T06:53:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-26T06:53:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.870 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2023-10-26T06:53:45.870 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.870 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.872 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.872 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2023-10-26T06:53:45.872 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2023-10-26T06:53:45.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:45.873 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.873 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.873 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2023-10-26T06:53:45.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.874 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.874 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.875 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.876 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:45.876 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:45.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.877 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.877 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2023-10-26T06:53:45.877 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.878 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.878 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.878 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-26T06:53:45.879 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.879 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.879 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.880 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:45.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:45.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.881 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.881 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2023-10-26T06:53:45.881 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.881 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.882 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-26T06:53:45.882 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.883 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.883 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2023-10-26T06:53:45.883 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2023-10-26T06:53:45.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.884 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.884 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.884 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2023-10-26T06:53:45.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.885 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.885 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.885 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.886 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.886 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.887 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2023-10-26T06:53:45.887 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2023-10-26T06:53:45.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.888 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.888 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2023-10-26T06:53:45.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.889 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.889 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2023-10-26T06:53:45.889 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2023-10-26T06:53:45.890 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.890 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.890 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.890 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.891 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2023-10-26T06:53:45.891 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2023-10-26T06:53:45.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.892 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.892 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2023-10-26T06:53:45.893 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2023-10-26T06:53:45.893 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2023-10-26T06:53:45.893 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.894 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.894 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.894 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2023-10-26T06:53:45.896 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.897 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.897 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.897 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.897 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.898 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.899 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.899 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.900 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.900 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.901 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.901 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.901 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.901 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.902 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.902 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.903 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.904 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.904 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.905 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.905 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.905 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.905 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.907 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.907 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.908 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.908 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.909 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.910 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.910 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.910 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.910 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.911 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.911 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.911 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.911 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.912 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.912 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.913 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.913 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.915 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.915 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.915 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.916 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2023-10-26T06:53:45.916 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2023-10-26T06:53:45.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:45.917 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.917 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.917 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:45.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.918 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.918 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.919 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.919 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.920 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2023-10-26T06:53:45.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2023-10-26T06:53:45.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.921 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.922 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.925 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.926 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.926 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2023-10-26T06:53:45.927 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2023-10-26T06:53:45.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.927 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.928 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.928 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.928 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.929 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.929 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.929 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.930 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2023-10-26T06:53:45.931 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.932 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.932 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.932 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2023-10-26T06:53:45.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2023-10-26T06:53:45.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.933 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:45.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.934 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.935 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.936 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2023-10-26T06:53:45.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2023-10-26T06:53:45.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.937 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.938 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.939 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.939 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.939 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.940 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.940 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.941 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.941 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.941 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.942 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.942 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.942 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.943 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.943 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.943 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.943 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.944 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.944 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.944 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.945 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.945 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.946 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.946 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.947 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.947 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.947 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.948 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.948 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.949 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.949 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.949 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.950 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.950 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.950 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.951 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.951 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.951 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.952 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.952 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.952 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.952 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.953 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.953 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.953 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.954 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.954 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.955 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.956 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.957 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.958 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.959 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:45.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:45.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.963 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:45.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:45.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.964 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.966 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.966 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.967 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.968 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2023-10-26T06:53:45.968 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.969 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.969 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.969 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.971 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.971 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.971 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.972 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.972 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.972 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.973 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.973 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.973 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.973 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.974 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.975 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:45.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:45.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.976 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.976 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.977 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.978 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.978 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.979 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:45.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:45.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.980 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.980 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:45.980 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.981 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.981 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.981 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.981 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.982 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.982 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:45.982 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:45.983 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:45.983 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:45.983 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.983 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:45.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:45.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:45.985 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.986 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.986 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:45.987 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.987 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.988 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:45.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.989 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:45.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:45.991 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2023-10-26T06:53:45.991 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:45.991 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:45.992 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:45.992 INFO:teuthology.orchestra.run.smithi050.stdout: "drive_group_interval": { 2023-10-26T06:53:45.992 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "drive_group_interval", 2023-10-26T06:53:45.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:45.993 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:45.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300.0", 2023-10-26T06:53:45.994 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.994 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:45.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-26T06:53:45.995 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:45.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:45.996 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:45.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:45.996 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:45.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:45.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:45.997 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:45.997 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:45.998 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:45.998 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:45.998 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:45.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:45.999 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:45.999 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:45.999 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:45.999 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.000 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.000 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.001 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.003 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.004 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.004 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.005 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.006 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.006 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.007 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.007 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.008 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.008 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.011 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.011 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.011 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.011 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.012 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.012 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.012 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.014 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.014 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.015 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.015 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.016 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.016 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.016 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.017 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.017 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.017 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.018 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2023-10-26T06:53:46.018 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2023-10-26T06:53:46.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.019 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2023-10-26T06:53:46.020 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.020 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.020 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-26T06:53:46.021 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.021 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.023 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2023-10-26T06:53:46.023 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.023 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.024 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.024 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.024 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.025 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.026 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.026 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.026 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.026 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.027 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.027 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.027 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.027 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.028 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.028 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.028 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.029 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.029 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.029 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.030 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.031 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.031 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.031 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.031 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.032 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.032 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.032 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.033 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.033 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.034 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.034 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.036 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.036 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.036 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.036 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.037 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.037 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.037 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.037 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.039 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.039 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.039 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.040 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.041 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.041 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.041 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.041 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.042 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.043 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.043 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2023-10-26T06:53:46.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2023-10-26T06:53:46.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.044 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.044 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.045 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.045 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.045 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.045 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.046 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.047 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2023-10-26T06:53:46.047 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2023-10-26T06:53:46.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.048 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.048 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2023-10-26T06:53:46.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.049 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.049 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.049 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.050 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.050 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.050 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.051 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2023-10-26T06:53:46.051 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2023-10-26T06:53:46.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.052 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.053 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.054 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.054 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.055 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2023-10-26T06:53:46.055 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2023-10-26T06:53:46.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.055 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.056 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.057 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.057 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.057 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.058 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.058 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2023-10-26T06:53:46.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2023-10-26T06:53:46.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:46.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.060 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.060 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.060 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.060 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.061 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.062 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2023-10-26T06:53:46.062 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2023-10-26T06:53:46.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.063 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.064 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.064 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.065 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.065 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.066 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2023-10-26T06:53:46.066 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2023-10-26T06:53:46.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.067 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.067 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.067 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.068 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.068 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.068 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.069 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.069 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.070 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2023-10-26T06:53:46.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2023-10-26T06:53:46.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.072 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.074 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.074 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.075 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.077 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2023-10-26T06:53:46.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2023-10-26T06:53:46.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.078 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.080 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:46.080 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2023-10-26T06:53:46.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.081 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.081 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.081 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.082 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2023-10-26T06:53:46.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2023-10-26T06:53:46.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.083 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.083 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.084 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.084 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.085 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.085 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.085 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2023-10-26T06:53:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2023-10-26T06:53:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2023-10-26T06:53:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2023-10-26T06:53:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2023-10-26T06:53:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2023-10-26T06:53:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2023-10-26T06:53:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2023-10-26T06:53:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2023-10-26T06:53:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2023-10-26T06:53:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2023-10-26T06:53:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2023-10-26T06:53:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2023-10-26T06:53:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2023-10-26T06:53:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2023-10-26T06:53:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2023-10-26T06:53:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-26T06:53:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.168 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.169 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2023-10-26T06:53:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.171 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.172 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.174 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.175 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.176 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.177 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.178 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.179 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.180 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.181 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.183 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.184 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.185 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.187 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.188 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.189 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.190 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2023-10-26T06:53:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.192 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2023-10-26T06:53:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2023-10-26T06:53:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.193 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.194 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-26T06:53:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.195 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2023-10-26T06:53:46.196 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2023-10-26T06:53:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.197 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.198 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-26T06:53:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2023-10-26T06:53:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2023-10-26T06:53:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.200 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.201 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-26T06:53:46.202 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.203 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2023-10-26T06:53:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2023-10-26T06:53:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.204 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.205 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-26T06:53:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.206 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2023-10-26T06:53:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2023-10-26T06:53:46.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.208 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-26T06:53:46.209 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.210 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2023-10-26T06:53:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2023-10-26T06:53:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.211 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.213 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2023-10-26T06:53:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2023-10-26T06:53:46.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.217 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2023-10-26T06:53:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2023-10-26T06:53:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.218 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-26T06:53:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.219 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2023-10-26T06:53:46.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2023-10-26T06:53:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.222 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.223 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.224 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.225 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2023-10-26T06:53:46.226 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2023-10-26T06:53:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.227 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.228 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2023-10-26T06:53:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2023-10-26T06:53:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.229 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2023-10-26T06:53:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.230 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.231 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2023-10-26T06:53:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2023-10-26T06:53:46.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.233 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.234 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.235 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2023-10-26T06:53:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2023-10-26T06:53:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.240 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.241 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.242 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.245 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.246 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.250 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.251 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.254 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2023-10-26T06:53:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2023-10-26T06:53:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.258 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.260 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2023-10-26T06:53:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2023-10-26T06:53:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2023-10-26T06:53:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2023-10-26T06:53:46.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-26T06:53:46.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.266 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.268 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2023-10-26T06:53:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.269 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.272 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.273 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.274 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.276 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.277 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.278 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.280 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.281 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.282 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.283 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.286 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2023-10-26T06:53:46.288 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.289 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.290 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.291 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.292 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.293 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.294 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.297 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.298 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.300 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.302 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.304 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.305 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.306 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.307 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2023-10-26T06:53:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2023-10-26T06:53:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.308 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2023-10-26T06:53:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-26T06:53:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2023-10-26T06:53:46.311 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2023-10-26T06:53:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.312 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.313 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2023-10-26T06:53:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.314 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2023-10-26T06:53:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2023-10-26T06:53:46.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.316 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.317 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-26T06:53:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.318 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.319 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2023-10-26T06:53:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.320 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2023-10-26T06:53:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2023-10-26T06:53:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.322 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2023-10-26T06:53:46.322 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.322 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.323 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.324 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.325 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2023-10-26T06:53:46.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2023-10-26T06:53:46.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.326 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.327 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.328 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.328 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.329 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.330 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.331 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.331 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.343 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.343 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.343 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.344 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.344 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.344 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.345 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.345 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.346 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.346 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.346 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.347 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.347 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.347 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.347 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.348 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.348 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.348 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.348 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.349 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.349 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.349 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.350 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.351 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.352 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.352 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.353 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.353 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.353 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2023-10-26T06:53:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2023-10-26T06:53:46.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.355 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.356 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2023-10-26T06:53:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2023-10-26T06:53:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.358 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2023-10-26T06:53:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.359 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.360 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2023-10-26T06:53:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2023-10-26T06:53:46.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-26T06:53:46.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:46.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24182, 2023-10-26T06:53:46.367 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "y", 2023-10-26T06:53:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540138322906710015, 2023-10-26T06:53:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2023-10-26T06:53:46.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2023-10-26T06:53:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.369 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:46.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2023-10-26T06:53:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.373 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.375 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.376 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.377 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.379 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.381 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.384 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.385 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.386 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.388 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.390 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.392 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2023-10-26T06:53:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2023-10-26T06:53:46.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.395 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.396 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2023-10-26T06:53:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.397 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2023-10-26T06:53:46.398 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2023-10-26T06:53:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.399 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2023-10-26T06:53:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.400 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2023-10-26T06:53:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.401 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2023-10-26T06:53:46.402 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2023-10-26T06:53:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.403 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2023-10-26T06:53:46.405 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.406 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2023-10-26T06:53:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2023-10-26T06:53:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.407 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2023-10-26T06:53:46.409 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.410 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2023-10-26T06:53:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2023-10-26T06:53:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2023-10-26T06:53:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.412 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2023-10-26T06:53:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.413 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2023-10-26T06:53:46.414 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2023-10-26T06:53:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.415 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2023-10-26T06:53:46.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2023-10-26T06:53:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2023-10-26T06:53:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.418 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-26T06:53:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2023-10-26T06:53:46.421 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2023-10-26T06:53:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2023-10-26T06:53:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.424 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2023-10-26T06:53:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.427 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2023-10-26T06:53:46.428 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2023-10-26T06:53:46.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.431 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.432 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2023-10-26T06:53:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2023-10-26T06:53:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2023-10-26T06:53:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2023-10-26T06:53:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.436 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2023-10-26T06:53:46.437 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-26T06:53:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.438 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2023-10-26T06:53:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2023-10-26T06:53:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2023-10-26T06:53:46.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2023-10-26T06:53:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-26T06:53:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-26T06:53:46.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.442 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2023-10-26T06:53:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2023-10-26T06:53:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2023-10-26T06:53:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2023-10-26T06:53:46.444 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-26T06:53:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.445 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2023-10-26T06:53:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2023-10-26T06:53:46.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2023-10-26T06:53:46.447 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-26T06:53:46.448 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-26T06:53:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.449 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2023-10-26T06:53:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2023-10-26T06:53:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2023-10-26T06:53:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2023-10-26T06:53:46.451 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2023-10-26T06:53:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2023-10-26T06:53:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-26T06:53:46.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2023-10-26T06:53:46.453 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2023-10-26T06:53:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.454 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2023-10-26T06:53:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.455 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2023-10-26T06:53:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-26T06:53:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2023-10-26T06:53:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2023-10-26T06:53:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:46.457 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:46.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2023-10-26T06:53:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2023-10-26T06:53:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-26T06:53:46.459 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-26T06:53:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.460 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.461 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.463 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.464 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.465 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.467 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.469 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.472 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.474 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.475 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.476 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.478 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.480 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2023-10-26T06:53:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2023-10-26T06:53:46.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-26T06:53:46.487 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2023-10-26T06:53:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2023-10-26T06:53:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.489 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2023-10-26T06:53:46.490 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2023-10-26T06:53:46.491 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2023-10-26T06:53:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap" 2023-10-26T06:53:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.492 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2023-10-26T06:53:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2023-10-26T06:53:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2023-10-26T06:53:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.494 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.495 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-26T06:53:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.496 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:46.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.498 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.499 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-26T06:53:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.500 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2023-10-26T06:53:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2023-10-26T06:53:46.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:46.503 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-26T06:53:46.504 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-26T06:53:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.505 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2023-10-26T06:53:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2023-10-26T06:53:46.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.507 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.508 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-26T06:53:46.509 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.510 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2023-10-26T06:53:46.513 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.514 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2023-10-26T06:53:46.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2023-10-26T06:53:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:46.516 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2023-10-26T06:53:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-26T06:53:46.518 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.519 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2023-10-26T06:53:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2023-10-26T06:53:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2023-10-26T06:53:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.521 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-26T06:53:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2023-10-26T06:53:46.523 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2023-10-26T06:53:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.524 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2023-10-26T06:53:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.525 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-26T06:53:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.527 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2023-10-26T06:53:46.527 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2023-10-26T06:53:46.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.527 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.528 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.528 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.528 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.529 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.529 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-26T06:53:46.529 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-26T06:53:46.529 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.530 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.530 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2023-10-26T06:53:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2023-10-26T06:53:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.531 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.532 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.533 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.533 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-26T06:53:46.533 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.534 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.534 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2023-10-26T06:53:46.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2023-10-26T06:53:46.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:46.535 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2023-10-26T06:53:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-26T06:53:46.537 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.537 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.538 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2023-10-26T06:53:46.538 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2023-10-26T06:53:46.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.539 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.539 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.539 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.540 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.540 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.540 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2023-10-26T06:53:46.540 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2023-10-26T06:53:46.541 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2023-10-26T06:53:46.541 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.541 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-26T06:53:46.541 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.542 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.542 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.543 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2023-10-26T06:53:46.543 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2023-10-26T06:53:46.543 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.543 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.544 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.544 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.544 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.544 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.545 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-26T06:53:46.545 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.545 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.546 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2023-10-26T06:53:46.546 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2023-10-26T06:53:46.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.547 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.547 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.548 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.548 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.548 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-26T06:53:46.549 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.549 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.549 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.550 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2023-10-26T06:53:46.550 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2023-10-26T06:53:46.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.550 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.551 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.551 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.551 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.552 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.552 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-26T06:53:46.552 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.553 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.553 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.553 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2023-10-26T06:53:46.553 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2023-10-26T06:53:46.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.554 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.555 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-26T06:53:46.555 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.555 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.555 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.556 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:46.556 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.556 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.556 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.557 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2023-10-26T06:53:46.557 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2023-10-26T06:53:46.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.558 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.558 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-26T06:53:46.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.559 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.559 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.559 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2023-10-26T06:53:46.560 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.560 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.560 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.561 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2023-10-26T06:53:46.561 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2023-10-26T06:53:46.561 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.561 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.562 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.562 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-26T06:53:46.562 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.563 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.563 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.563 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2023-10-26T06:53:46.563 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.564 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.564 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.564 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2023-10-26T06:53:46.565 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2023-10-26T06:53:46.565 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.565 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.565 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.566 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-26T06:53:46.566 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.566 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.566 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.567 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:46.567 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.567 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.567 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.568 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2023-10-26T06:53:46.568 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2023-10-26T06:53:46.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.569 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.569 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.569 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-26T06:53:46.569 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.570 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.570 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.570 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2023-10-26T06:53:46.570 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.571 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.571 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2023-10-26T06:53:46.572 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2023-10-26T06:53:46.572 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.572 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.572 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-26T06:53:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.573 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2023-10-26T06:53:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.574 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2023-10-26T06:53:46.575 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2023-10-26T06:53:46.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.576 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.576 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-26T06:53:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.577 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.578 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2023-10-26T06:53:46.578 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.578 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.579 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2023-10-26T06:53:46.579 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2023-10-26T06:53:46.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.580 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.580 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.580 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-26T06:53:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.581 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2023-10-26T06:53:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.582 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2023-10-26T06:53:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2023-10-26T06:53:46.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-26T06:53:46.584 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2023-10-26T06:53:46.585 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.586 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2023-10-26T06:53:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2023-10-26T06:53:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.587 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-26T06:53:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.588 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2023-10-26T06:53:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.589 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2023-10-26T06:53:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2023-10-26T06:53:46.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-26T06:53:46.591 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:46.592 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.593 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2023-10-26T06:53:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2023-10-26T06:53:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.594 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.595 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-26T06:53:46.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.596 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.596 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2023-10-26T06:53:46.596 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.596 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.597 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2023-10-26T06:53:46.597 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2023-10-26T06:53:46.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.598 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.598 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-26T06:53:46.599 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.599 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.599 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.599 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:46.600 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.600 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.600 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.601 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2023-10-26T06:53:46.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2023-10-26T06:53:46.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.601 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.602 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.602 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-26T06:53:46.602 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.603 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.603 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2023-10-26T06:53:46.604 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.604 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.604 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.605 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2023-10-26T06:53:46.605 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2023-10-26T06:53:46.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.605 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.606 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-26T06:53:46.606 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.606 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.607 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.607 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2023-10-26T06:53:46.607 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.607 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.608 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.608 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2023-10-26T06:53:46.608 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2023-10-26T06:53:46.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.609 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.609 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.609 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.610 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.610 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.610 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.610 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2023-10-26T06:53:46.611 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.611 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.611 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.612 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2023-10-26T06:53:46.612 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2023-10-26T06:53:46.612 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.612 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.613 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.613 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:46.613 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.613 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.614 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.614 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-26T06:53:46.614 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.615 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.615 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.615 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2023-10-26T06:53:46.616 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2023-10-26T06:53:46.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.616 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.616 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.617 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2023-10-26T06:53:46.617 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.617 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.617 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.618 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-26T06:53:46.618 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.618 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.619 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.619 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2023-10-26T06:53:46.619 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2023-10-26T06:53:46.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.620 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.620 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2023-10-26T06:53:46.621 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.621 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.621 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.621 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-26T06:53:46.622 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.622 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.622 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.623 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2023-10-26T06:53:46.623 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2023-10-26T06:53:46.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.624 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.624 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2023-10-26T06:53:46.624 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.625 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.625 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.625 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2023-10-26T06:53:46.625 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.626 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.626 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.627 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2023-10-26T06:53:46.627 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2023-10-26T06:53:46.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.627 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.628 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.628 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.628 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.629 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.629 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-26T06:53:46.629 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.629 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.630 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.630 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2023-10-26T06:53:46.630 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2023-10-26T06:53:46.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.631 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.631 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.632 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:46.632 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.632 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.632 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.633 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2023-10-26T06:53:46.633 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.634 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2023-10-26T06:53:46.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2023-10-26T06:53:46.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.635 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.635 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:46.635 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.636 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.636 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.636 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2023-10-26T06:53:46.636 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.637 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2023-10-26T06:53:46.638 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2023-10-26T06:53:46.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.638 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.639 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.639 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.639 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.640 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.640 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-26T06:53:46.640 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.641 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.641 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.641 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.641 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.642 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.642 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.642 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.645 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.645 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.645 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.645 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.646 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.646 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.646 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2023-10-26T06:53:46.647 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2023-10-26T06:53:46.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.647 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.648 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.648 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.648 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.648 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.649 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-26T06:53:46.649 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.649 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.649 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.650 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.650 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.650 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.651 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.651 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.651 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.652 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.652 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.652 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-26T06:53:46.652 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.653 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.653 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.653 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.654 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.654 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.654 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.655 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.655 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.655 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.655 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.656 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.656 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.656 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.656 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.657 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.657 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.657 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.657 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.658 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.658 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.658 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.659 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.659 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.660 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.660 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.660 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.661 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.661 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.661 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.662 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.662 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.662 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.663 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-26T06:53:46.663 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-26T06:53:46.663 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.664 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.664 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.664 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.665 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.665 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.665 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-26T06:53:46.665 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.666 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.666 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-26T06:53:46.667 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-26T06:53:46.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.667 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.668 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2023-10-26T06:53:46.668 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.668 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.668 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.669 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-26T06:53:46.669 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.669 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.670 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2023-10-26T06:53:46.670 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2023-10-26T06:53:46.670 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.671 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.671 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:46.671 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2023-10-26T06:53:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2023-10-26T06:53:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2023-10-26T06:53:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-26T06:53:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2023-10-26T06:53:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2023-10-26T06:53:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2023-10-26T06:53:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2023-10-26T06:53:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2023-10-26T06:53:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2023-10-26T06:53:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2023-10-26T06:53:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2023-10-26T06:53:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2023-10-26T06:53:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2023-10-26T06:53:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2023-10-26T06:53:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-26T06:53:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-26T06:53:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2023-10-26T06:53:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2023-10-26T06:53:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-26T06:53:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2023-10-26T06:53:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2023-10-26T06:53:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-26T06:53:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2023-10-26T06:53:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2023-10-26T06:53:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-26T06:53:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2023-10-26T06:53:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2023-10-26T06:53:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-26T06:53:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2023-10-26T06:53:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2023-10-26T06:53:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-26T06:53:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2023-10-26T06:53:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2023-10-26T06:53:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2023-10-26T06:53:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2023-10-26T06:53:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2023-10-26T06:53:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2023-10-26T06:53:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-26T06:53:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2023-10-26T06:53:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2023-10-26T06:53:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-26T06:53:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2023-10-26T06:53:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2023-10-26T06:53:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-26T06:53:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2023-10-26T06:53:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2023-10-26T06:53:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2023-10-26T06:53:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2023-10-26T06:53:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2023-10-26T06:53:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-26T06:53:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2023-10-26T06:53:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2023-10-26T06:53:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-26T06:53:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2023-10-26T06:53:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2023-10-26T06:53:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2023-10-26T06:53:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2023-10-26T06:53:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-26T06:53:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2023-10-26T06:53:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2023-10-26T06:53:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2023-10-26T06:53:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-26T06:53:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2023-10-26T06:53:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-26T06:53:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-26T06:53:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2023-10-26T06:53:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-26T06:53:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.783 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.784 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-26T06:53:46.784 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-26T06:53:46.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.785 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.785 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.786 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.786 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.787 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.787 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.787 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.787 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.788 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.788 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2023-10-26T06:53:46.789 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2023-10-26T06:53:46.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.789 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.790 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.790 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.791 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.791 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.792 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.792 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-26T06:53:46.793 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-26T06:53:46.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.795 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.796 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2023-10-26T06:53:46.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-26T06:53:46.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.798 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.800 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.800 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-26T06:53:46.800 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-26T06:53:46.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.803 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.803 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.804 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.806 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-26T06:53:46.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-26T06:53:46.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.809 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.809 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.811 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-26T06:53:46.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-26T06:53:46.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.812 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.813 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.813 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.813 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.813 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.814 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.814 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.814 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.816 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-26T06:53:46.816 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-26T06:53:46.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.817 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.819 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.819 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.819 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.820 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.820 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.821 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.822 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-26T06:53:46.822 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-26T06:53:46.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.823 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.824 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.828 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-26T06:53:46.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-26T06:53:46.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.829 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.830 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.830 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.831 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.832 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-26T06:53:46.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-26T06:53:46.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.833 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.834 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.834 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.834 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.835 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.836 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-26T06:53:46.836 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-26T06:53:46.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.837 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.837 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.838 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.839 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.840 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2023-10-26T06:53:46.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-26T06:53:46.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.841 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:46.842 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.842 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.843 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.843 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.844 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-26T06:53:46.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-26T06:53:46.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.845 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.847 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.848 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.848 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.849 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2023-10-26T06:53:46.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2023-10-26T06:53:46.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.850 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.850 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.853 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2023-10-26T06:53:46.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-26T06:53:46.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.854 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.854 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:46.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.856 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.856 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.857 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-26T06:53:46.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-26T06:53:46.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.858 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.859 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.861 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-26T06:53:46.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-26T06:53:46.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.862 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.863 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.863 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.864 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.866 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-26T06:53:46.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-26T06:53:46.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.868 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.869 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.869 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.869 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.870 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.870 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.870 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.871 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-26T06:53:46.871 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-26T06:53:46.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.872 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.872 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.872 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.873 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.873 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.873 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.873 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.874 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.874 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.875 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2023-10-26T06:53:46.875 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-26T06:53:46.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.875 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.876 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.876 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.876 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.876 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.877 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.877 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.877 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.878 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.878 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.878 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-26T06:53:46.879 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-26T06:53:46.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.879 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.879 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.880 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.880 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.880 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.881 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.881 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.881 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.882 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-26T06:53:46.882 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-26T06:53:46.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.883 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.883 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.883 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.884 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.884 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.884 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.885 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.885 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.886 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-26T06:53:46.886 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-26T06:53:46.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.887 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.887 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.888 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.888 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.888 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.889 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.889 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.889 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.890 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-26T06:53:46.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-26T06:53:46.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.891 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.891 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.892 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.892 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.892 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.892 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.894 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-26T06:53:46.894 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-26T06:53:46.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.896 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.896 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.898 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-26T06:53:46.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-26T06:53:46.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.898 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.900 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.901 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-26T06:53:46.901 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-26T06:53:46.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.902 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.903 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.903 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.903 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.904 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.904 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.904 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.905 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-26T06:53:46.905 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-26T06:53:46.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.906 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.907 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.907 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.908 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.909 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2023-10-26T06:53:46.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-26T06:53:46.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.909 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.910 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.910 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.911 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.911 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.911 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.912 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.912 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-26T06:53:46.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-26T06:53:46.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.913 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.913 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-26T06:53:46.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.915 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.915 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.915 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.916 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-26T06:53:46.916 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-26T06:53:46.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.917 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.917 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:46.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.919 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.919 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.919 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.921 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.922 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-26T06:53:46.922 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-26T06:53:46.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.923 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.924 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2023-10-26T06:53:46.924 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.924 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.925 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.925 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.925 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.926 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-26T06:53:46.926 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-26T06:53:46.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.927 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.927 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.927 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2023-10-26T06:53:46.928 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.928 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.928 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.928 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.929 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.929 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.929 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.930 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2023-10-26T06:53:46.930 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-26T06:53:46.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.931 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.931 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.931 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.932 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.932 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.932 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.933 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.933 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.934 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-26T06:53:46.934 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-26T06:53:46.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.934 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.935 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:46.935 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.935 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.936 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.936 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.936 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.937 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.937 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2023-10-26T06:53:46.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-26T06:53:46.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.938 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.939 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.939 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.941 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.942 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.942 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.942 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.943 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.943 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2023-10-26T06:53:46.944 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-26T06:53:46.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.944 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.945 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:46.945 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.945 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.945 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.946 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.946 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.946 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.947 INFO:teuthology.orchestra.run.smithi050.stdout: "UNSAFE_TLS_v1_2": { 2023-10-26T06:53:46.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-26T06:53:46.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.948 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.949 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.949 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.950 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.951 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-26T06:53:46.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-26T06:53:46.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.952 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:46.952 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.952 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.953 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.953 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.953 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.954 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.954 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-26T06:53:46.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-26T06:53:46.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.955 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.956 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:46.956 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.956 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.956 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.958 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-26T06:53:46.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-26T06:53:46.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.959 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.959 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:46.959 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.960 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.960 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.960 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.960 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.961 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.961 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2023-10-26T06:53:46.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2023-10-26T06:53:46.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.962 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.963 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.963 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.963 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.964 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.964 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.964 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.965 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.965 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2023-10-26T06:53:46.966 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2023-10-26T06:53:46.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.966 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.967 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.967 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.967 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.967 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.968 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.968 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.969 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2023-10-26T06:53:46.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2023-10-26T06:53:46.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.971 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.971 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.971 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2023-10-26T06:53:46.971 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.972 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.972 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2023-10-26T06:53:46.973 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2023-10-26T06:53:46.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:46.973 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.974 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2023-10-26T06:53:46.974 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.974 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.975 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.975 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.975 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.976 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2023-10-26T06:53:46.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2023-10-26T06:53:46.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.977 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:46.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.978 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.979 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.980 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:46.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:46.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.981 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:46.981 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.981 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.982 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.982 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.982 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.982 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.983 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.983 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.983 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.983 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.984 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.984 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.985 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.985 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:46.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:46.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.986 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.986 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.987 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.987 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.987 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.987 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.988 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.989 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:46.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:46.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.991 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:46.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.991 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:46.992 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:46.992 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:46.992 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:46.992 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:46.993 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:46.993 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:46.993 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:46.994 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.994 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.994 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.995 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:46.995 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:46.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:46.996 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:46.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:46.996 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:46.996 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:46.997 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:46.997 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:46.997 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:46.998 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:46.998 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:46.998 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:46.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:46.999 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2023-10-26T06:53:46.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2023-10-26T06:53:46.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:46.999 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.000 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.000 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.000 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.001 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2023-10-26T06:53:47.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.002 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2023-10-26T06:53:47.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2023-10-26T06:53:47.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.004 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.004 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.004 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.006 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:47.006 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:47.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.007 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.007 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2023-10-26T06:53:47.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.008 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.008 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.009 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.009 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:47.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:47.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.011 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2023-10-26T06:53:47.011 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.012 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.012 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.012 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2023-10-26T06:53:47.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2023-10-26T06:53:47.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.014 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.015 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.015 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.015 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.016 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.016 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2023-10-26T06:53:47.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2023-10-26T06:53:47.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.017 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.018 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2023-10-26T06:53:47.018 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.018 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.018 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2023-10-26T06:53:47.020 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2023-10-26T06:53:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.021 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2023-10-26T06:53:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.022 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2023-10-26T06:53:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2023-10-26T06:53:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2023-10-26T06:53:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2023-10-26T06:53:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2023-10-26T06:53:47.026 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2023-10-26T06:53:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2023-10-26T06:53:47.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2023-10-26T06:53:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.029 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.030 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2023-10-26T06:53:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.033 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2023-10-26T06:53:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2023-10-26T06:53:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.034 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.035 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2023-10-26T06:53:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.037 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.038 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.039 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.040 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.041 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.043 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.044 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.046 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.047 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.048 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.049 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.050 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.054 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.055 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2023-10-26T06:53:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2023-10-26T06:53:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.056 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2023-10-26T06:53:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.057 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-26T06:53:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2023-10-26T06:53:47.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2023-10-26T06:53:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.060 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2023-10-26T06:53:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.061 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-26T06:53:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.062 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2023-10-26T06:53:47.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2023-10-26T06:53:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.064 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2023-10-26T06:53:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.065 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2023-10-26T06:53:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.066 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2023-10-26T06:53:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2023-10-26T06:53:47.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2023-10-26T06:53:47.068 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-26T06:53:47.069 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2023-10-26T06:53:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2023-10-26T06:53:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.071 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.072 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-26T06:53:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.073 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:47.074 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.076 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2023-10-26T06:53:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2023-10-26T06:53:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2023-10-26T06:53:47.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2023-10-26T06:53:47.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-26T06:53:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.081 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2023-10-26T06:53:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.084 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.085 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.086 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.087 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.088 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.089 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.090 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.091 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.093 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.094 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.095 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.097 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.098 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.099 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.100 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2023-10-26T06:53:47.101 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2023-10-26T06:53:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.102 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2023-10-26T06:53:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.103 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.104 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2023-10-26T06:53:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2023-10-26T06:53:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.105 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2023-10-26T06:53:47.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.107 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:47.108 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.110 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.111 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2023-10-26T06:53:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2023-10-26T06:53:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2023-10-26T06:53:47.113 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2023-10-26T06:53:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2023-10-26T06:53:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.114 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2023-10-26T06:53:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.115 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-26T06:53:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2023-10-26T06:53:47.117 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2023-10-26T06:53:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.118 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2023-10-26T06:53:47.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.119 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-26T06:53:47.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.120 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2023-10-26T06:53:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2023-10-26T06:53:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.121 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2023-10-26T06:53:47.123 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.124 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2023-10-26T06:53:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2023-10-26T06:53:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.126 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-26T06:53:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.127 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.128 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.129 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.130 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.131 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.132 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.133 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.134 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.135 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.136 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.138 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.139 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.142 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.142 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.142 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.143 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.143 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.143 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.143 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.144 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.144 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.144 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.144 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.145 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.145 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.145 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.146 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.146 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.147 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.147 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.148 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.148 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.148 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.149 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2023-10-26T06:53:47.149 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2023-10-26T06:53:47.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.150 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.150 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.150 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.151 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.151 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.151 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2023-10-26T06:53:47.151 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.152 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.152 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.152 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2023-10-26T06:53:47.153 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2023-10-26T06:53:47.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.153 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.154 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2023-10-26T06:53:47.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.154 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.155 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2023-10-26T06:53:47.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.156 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.156 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2023-10-26T06:53:47.156 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2023-10-26T06:53:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.157 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2023-10-26T06:53:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.158 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-26T06:53:47.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.160 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2023-10-26T06:53:47.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2023-10-26T06:53:47.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:47.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:47.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2023-10-26T06:53:47.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-26T06:53:47.163 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.164 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2023-10-26T06:53:47.164 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2023-10-26T06:53:47.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.165 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.166 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.166 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2023-10-26T06:53:47.167 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.167 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.167 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.168 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2023-10-26T06:53:47.168 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2023-10-26T06:53:47.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.168 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.169 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2023-10-26T06:53:47.169 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.170 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.170 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-26T06:53:47.171 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.171 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.171 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2023-10-26T06:53:47.173 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.173 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.174 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.174 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.174 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.175 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.175 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.176 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.177 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.177 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.177 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.177 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.178 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.178 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.178 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.178 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.179 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.179 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.180 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.180 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.181 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.181 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.182 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.182 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.182 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.183 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.183 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.183 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.184 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.184 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.184 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.185 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.186 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.186 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.186 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.187 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.187 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.187 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.188 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.188 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.188 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.188 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.189 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.190 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.190 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.191 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.191 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.191 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.192 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.192 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.192 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.193 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.194 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2023-10-26T06:53:47.194 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.195 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.195 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.195 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.195 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.196 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.196 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.197 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.197 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.197 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.197 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.198 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.198 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.198 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.198 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.199 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.199 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.199 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.199 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.200 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.200 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.201 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.201 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.202 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.202 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.202 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.203 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.203 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.203 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.204 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.204 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.204 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.207 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.207 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.208 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.208 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.208 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.210 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.210 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.211 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.211 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.212 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.213 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.213 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.214 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.215 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.216 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.216 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.217 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.217 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.219 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2023-10-26T06:53:47.219 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.219 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.219 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.220 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2023-10-26T06:53:47.220 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2023-10-26T06:53:47.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.220 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.221 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2023-10-26T06:53:47.221 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.221 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.222 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.222 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-26T06:53:47.222 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.223 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.223 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2023-10-26T06:53:47.224 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2023-10-26T06:53:47.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.224 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.224 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.225 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:47.225 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2023-10-26T06:53:47.225 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.225 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.226 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-26T06:53:47.226 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.227 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.227 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.227 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.227 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.228 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.228 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.228 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.229 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.229 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.229 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.229 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.230 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.230 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.230 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.231 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.231 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.232 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.235 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.236 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.237 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.238 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.239 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.239 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.240 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.240 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.241 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.241 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.241 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.242 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.242 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.243 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.244 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.249 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2023-10-26T06:53:47.249 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.249 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.249 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.250 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2023-10-26T06:53:47.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2023-10-26T06:53:47.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2023-10-26T06:53:47.252 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.252 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.252 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.253 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2023-10-26T06:53:47.253 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-26T06:53:47.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.253 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.254 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.254 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.255 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.255 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.255 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.256 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.256 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.256 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.256 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.257 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.257 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.257 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.258 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.258 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.258 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.258 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.259 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.259 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.260 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.260 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.260 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.261 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.261 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.261 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.262 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.262 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.262 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.263 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.264 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.264 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.264 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.264 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.265 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.265 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.266 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.266 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.266 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.266 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.267 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.267 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.267 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.267 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.269 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.270 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.271 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.271 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.272 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2023-10-26T06:53:47.273 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2023-10-26T06:53:47.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.274 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.274 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.275 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2023-10-26T06:53:47.275 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-26T06:53:47.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.275 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.276 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2023-10-26T06:53:47.276 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2023-10-26T06:53:47.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.277 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2023-10-26T06:53:47.277 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.278 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.278 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.278 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2023-10-26T06:53:47.278 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.279 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.279 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2023-10-26T06:53:47.280 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2023-10-26T06:53:47.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.280 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.281 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2023-10-26T06:53:47.281 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.282 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.282 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.282 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2023-10-26T06:53:47.282 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.283 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.284 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2023-10-26T06:53:47.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2023-10-26T06:53:47.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.284 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.285 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.285 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.286 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2023-10-26T06:53:47.286 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.287 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.287 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.287 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2023-10-26T06:53:47.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2023-10-26T06:53:47.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.288 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.289 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2023-10-26T06:53:47.289 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.290 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.290 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.290 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-26T06:53:47.290 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-26T06:53:47.291 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.291 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.292 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.292 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2023-10-26T06:53:47.293 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.293 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.293 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.293 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.294 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.294 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.296 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.297 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.301 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.303 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.304 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.305 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.306 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.307 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.308 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.309 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.310 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.310 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.311 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.311 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.312 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.312 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2023-10-26T06:53:47.313 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.314 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.314 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.314 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.315 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.316 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.316 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.316 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.316 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.317 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.317 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.317 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.318 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.318 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.318 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.318 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.319 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.319 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.319 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.320 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.320 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.321 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.322 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.322 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.322 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.323 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.323 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.324 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.326 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.326 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.327 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.327 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.327 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.328 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.328 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.329 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.329 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.329 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.329 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.330 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.330 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.331 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.331 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.331 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.332 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.332 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.333 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.334 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.334 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.334 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.335 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2023-10-26T06:53:47.336 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.337 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.337 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.337 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.338 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.338 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.338 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.339 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.339 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.339 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.340 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.340 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.340 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.340 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.341 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.341 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.341 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.341 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.342 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.342 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.343 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.343 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.343 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.344 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.344 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.344 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.344 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.345 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.345 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.346 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.346 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.346 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.347 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.347 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.348 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.348 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.348 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.349 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.349 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.349 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.349 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.350 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.350 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.350 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.350 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.351 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.351 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.351 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.353 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.354 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.354 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.355 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.355 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.356 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.356 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.357 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.359 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2023-10-26T06:53:47.359 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.359 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.359 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.360 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2023-10-26T06:53:47.360 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2023-10-26T06:53:47.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.360 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.361 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.361 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.361 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.362 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.362 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-26T06:53:47.362 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.363 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.363 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.363 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.364 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.364 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.365 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.365 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.365 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.365 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.366 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.366 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.366 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.367 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.367 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.367 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.367 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.367 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.368 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.368 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.369 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.370 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.370 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.370 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.371 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.371 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.372 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.372 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.373 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.374 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.374 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.374 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.375 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.375 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.375 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.375 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.376 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.376 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.376 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.377 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.377 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.378 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.378 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.379 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.379 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.379 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.380 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.380 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.380 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.381 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.382 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2023-10-26T06:53:47.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2023-10-26T06:53:47.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.383 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.384 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.384 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.385 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.385 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.386 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2023-10-26T06:53:47.386 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2023-10-26T06:53:47.386 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2023-10-26T06:53:47.387 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2023-10-26T06:53:47.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.388 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2023-10-26T06:53:47.389 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.390 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.390 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.390 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.391 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.391 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.392 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.392 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.393 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.393 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.393 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.393 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.394 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.394 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.394 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.394 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.395 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.395 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.396 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.396 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.397 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.397 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.398 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.398 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.398 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.398 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.399 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.399 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.399 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.400 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.400 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.401 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.401 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.402 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.402 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.402 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.403 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.403 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.403 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.403 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.404 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.404 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.404 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.404 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.405 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.405 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.406 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.406 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.406 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.407 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.408 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.408 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.408 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.409 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.410 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2023-10-26T06:53:47.410 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.411 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.411 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.411 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.412 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.412 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.412 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.413 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.413 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.413 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.413 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.414 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.414 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.414 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.414 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.415 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.415 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.415 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.416 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.416 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.417 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.417 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.417 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.418 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.418 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.418 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.419 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.419 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.419 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.420 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.420 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.421 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.421 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.421 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.422 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.422 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.422 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.423 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.423 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.423 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.423 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.424 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.424 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.424 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.425 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.425 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.426 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.427 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.427 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.427 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.428 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.428 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.428 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.428 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.429 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.430 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2023-10-26T06:53:47.431 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.431 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.431 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.432 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.432 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.433 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.433 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.433 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.434 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.434 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.434 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.435 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.435 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.435 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.436 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.436 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.436 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.436 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.437 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.437 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.438 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.438 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.439 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.439 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.440 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.440 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.441 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.441 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.442 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.443 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.443 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.444 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.444 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.445 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.445 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.445 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.446 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.446 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.446 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.447 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.447 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.447 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.448 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.448 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.449 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.449 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.449 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.450 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.450 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.450 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.450 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.451 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.451 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.451 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:47.452 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:47.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.452 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.453 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:47.453 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.453 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.453 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.454 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.454 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.455 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.455 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2023-10-26T06:53:47.455 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2023-10-26T06:53:47.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:47.456 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.456 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2023-10-26T06:53:47.457 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2023-10-26T06:53:47.457 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.457 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.457 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2023-10-26T06:53:47.457 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-26T06:53:47.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.458 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.459 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2023-10-26T06:53:47.460 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.460 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.460 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.460 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2023-10-26T06:53:47.461 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2023-10-26T06:53:47.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.461 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.462 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.463 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-26T06:53:47.463 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.463 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.464 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.464 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2023-10-26T06:53:47.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2023-10-26T06:53:47.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.465 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.465 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.466 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.466 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.466 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.467 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.468 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.469 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.469 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.470 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.470 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.470 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.471 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.471 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.471 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.471 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.472 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.472 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.472 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.472 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.473 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.474 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.475 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.475 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.476 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.478 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.479 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.479 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.480 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.480 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.481 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.482 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.483 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.483 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.484 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.484 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.485 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.485 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.486 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.486 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.486 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.487 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.487 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.487 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.488 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.488 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.488 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.489 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.489 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.490 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.491 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.491 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.491 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.492 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.492 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.492 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.493 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.493 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.493 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2023-10-26T06:53:47.494 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2023-10-26T06:53:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.496 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2023-10-26T06:53:47.496 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.497 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.497 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2023-10-26T06:53:47.497 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.498 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.499 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:47.499 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:47.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.499 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.500 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:47.500 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.500 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2023-10-26T06:53:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2023-10-26T06:53:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.503 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.504 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.504 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2023-10-26T06:53:47.504 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2023-10-26T06:53:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.505 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.506 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.506 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.507 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.507 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.507 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.508 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2023-10-26T06:53:47.508 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2023-10-26T06:53:47.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.509 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.509 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.509 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.510 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.510 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.510 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-26T06:53:47.511 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-26T06:53:47.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.511 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.513 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.513 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.513 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.513 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.514 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.514 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.514 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.515 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.515 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.515 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.515 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.516 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.516 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.516 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.517 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.517 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.518 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.519 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.519 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.519 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.520 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.520 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.520 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.520 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.521 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.521 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.522 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.522 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.523 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.523 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.523 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.523 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.524 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.524 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.524 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.524 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.525 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.525 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.525 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.526 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.526 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.527 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.527 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.528 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.528 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.528 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.529 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.529 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.529 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.529 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.530 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.530 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.530 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2023-10-26T06:53:47.531 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2023-10-26T06:53:47.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.531 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.532 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.532 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.532 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.532 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.533 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.533 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.533 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.534 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.534 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-26T06:53:47.534 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-26T06:53:47.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.535 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.536 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2023-10-26T06:53:47.536 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.536 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.536 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.537 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.537 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.538 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.539 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2023-10-26T06:53:47.539 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2023-10-26T06:53:47.540 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:47.540 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.541 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2023-10-26T06:53:47.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.543 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.543 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.544 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.544 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:47.544 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:47.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.545 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.546 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2023-10-26T06:53:47.546 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.546 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.547 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.547 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-26T06:53:47.547 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.548 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.548 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:47.548 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:47.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.549 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.549 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.550 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2023-10-26T06:53:47.550 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.550 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.550 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.551 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-26T06:53:47.551 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.551 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.552 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2023-10-26T06:53:47.552 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2023-10-26T06:53:47.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.553 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.553 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.553 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2023-10-26T06:53:47.553 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.554 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.554 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.554 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.555 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.555 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.556 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2023-10-26T06:53:47.556 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2023-10-26T06:53:47.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.556 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.557 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2023-10-26T06:53:47.557 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.557 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.558 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2023-10-26T06:53:47.558 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2023-10-26T06:53:47.558 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.559 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.559 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.559 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.559 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.560 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2023-10-26T06:53:47.560 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2023-10-26T06:53:47.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.561 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.561 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2023-10-26T06:53:47.561 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2023-10-26T06:53:47.562 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2023-10-26T06:53:47.562 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.562 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.562 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.563 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.563 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.563 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.564 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2023-10-26T06:53:47.564 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.565 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.565 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.565 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.565 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.566 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.566 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.567 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.567 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.567 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.568 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.568 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.568 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.569 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.569 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.569 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.569 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.570 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.570 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.570 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.571 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.571 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.572 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.572 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.572 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.573 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.573 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.573 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.573 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.574 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.574 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.574 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.574 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.575 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.575 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.576 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.576 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.576 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.577 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.577 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.578 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.578 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.578 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.579 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.579 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.579 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.580 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.580 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.580 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.580 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.581 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.584 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.584 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.584 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.584 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.585 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.585 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.586 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2023-10-26T06:53:47.586 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2023-10-26T06:53:47.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.587 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.587 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.588 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:47.588 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.589 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.589 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.590 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.590 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.591 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.591 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2023-10-26T06:53:47.592 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2023-10-26T06:53:47.593 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.593 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.594 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.594 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.595 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.596 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.596 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.597 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.597 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2023-10-26T06:53:47.597 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2023-10-26T06:53:47.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.598 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.599 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.599 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.599 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.599 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.600 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.600 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.600 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.600 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.601 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.602 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2023-10-26T06:53:47.602 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.602 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.602 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2023-10-26T06:53:47.603 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2023-10-26T06:53:47.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.603 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.604 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.604 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.604 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.604 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.605 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.605 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.605 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.605 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.606 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.606 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2023-10-26T06:53:47.607 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2023-10-26T06:53:47.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.607 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.607 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.608 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.608 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.608 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.608 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.609 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.609 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.609 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.609 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.610 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.610 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.611 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.611 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.611 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.611 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.612 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.612 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.612 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.613 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.613 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.613 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.613 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.614 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.614 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.614 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.614 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.615 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.615 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.616 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.616 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.617 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.617 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.617 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.618 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.618 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.618 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.618 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.619 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.619 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.619 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.620 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.620 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.621 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.621 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.621 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.622 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.622 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.622 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.623 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.623 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.623 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.623 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.624 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.624 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.624 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.624 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.625 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.625 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.625 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.626 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.626 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.627 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.627 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.627 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.628 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.628 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.628 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.628 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.629 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.629 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:47.629 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:47.630 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.630 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.630 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.631 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.631 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.631 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.631 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.632 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.632 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.632 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.633 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:47.633 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:47.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.634 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.634 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.634 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.635 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.635 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.635 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.635 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.636 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.636 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.636 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.637 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2023-10-26T06:53:47.638 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.638 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.638 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.638 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.639 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.639 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.640 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.640 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.640 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.640 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.641 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.641 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.641 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.641 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.642 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.642 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.642 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.643 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.643 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.643 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.643 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.644 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.645 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.645 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.645 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.646 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.646 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.646 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.647 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.647 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.647 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.648 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.648 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.648 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.649 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.649 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.649 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.649 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.650 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.650 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.650 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.651 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.651 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.651 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.651 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.651 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.652 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.652 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.652 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.653 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.653 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.654 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.654 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.654 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.654 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.655 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.655 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.655 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.655 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.656 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.656 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.656 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.658 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2023-10-26T06:53:47.658 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.659 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.659 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.659 INFO:teuthology.orchestra.run.smithi050.stdout: "drive_group_interval": { 2023-10-26T06:53:47.660 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "drive_group_interval", 2023-10-26T06:53:47.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:47.661 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.662 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300.0", 2023-10-26T06:53:47.662 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.663 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.663 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.663 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-26T06:53:47.664 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.665 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.666 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.666 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.666 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.667 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.667 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.668 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.668 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.668 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.668 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.668 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.669 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.669 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.671 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.671 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.672 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.672 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.672 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.673 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.673 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.673 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.674 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.674 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.674 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.674 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.675 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.675 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.676 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.676 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.676 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.676 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.677 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.677 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.677 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.677 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.678 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.678 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.678 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.678 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.679 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.679 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.679 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.680 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.680 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.681 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.681 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.682 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.683 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.683 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.684 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.684 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2023-10-26T06:53:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2023-10-26T06:53:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.687 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2023-10-26T06:53:47.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.687 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.688 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.688 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-26T06:53:47.688 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.689 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.690 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2023-10-26T06:53:47.690 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.691 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.691 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.691 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.691 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.692 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.692 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.692 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.693 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.693 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.693 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.693 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.694 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.694 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.694 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.694 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.695 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.695 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.695 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.695 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.696 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.696 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.697 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.700 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.701 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.702 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.703 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.704 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.707 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.708 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.709 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2023-10-26T06:53:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2023-10-26T06:53:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.710 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.711 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2023-10-26T06:53:47.713 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2023-10-26T06:53:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2023-10-26T06:53:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.715 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.716 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.717 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2023-10-26T06:53:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2023-10-26T06:53:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.719 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2023-10-26T06:53:47.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2023-10-26T06:53:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.723 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.724 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2023-10-26T06:53:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2023-10-26T06:53:47.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.727 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2023-10-26T06:53:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2023-10-26T06:53:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.729 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.731 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.732 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2023-10-26T06:53:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2023-10-26T06:53:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.734 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.734 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.734 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.734 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.735 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.735 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.736 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2023-10-26T06:53:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2023-10-26T06:53:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.737 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.738 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2023-10-26T06:53:47.740 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2023-10-26T06:53:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.741 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2023-10-26T06:53:47.742 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.743 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2023-10-26T06:53:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2023-10-26T06:53:47.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.745 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.746 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2023-10-26T06:53:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2023-10-26T06:53:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.748 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.750 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.751 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2023-10-26T06:53:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2023-10-26T06:53:47.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.754 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.755 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2023-10-26T06:53:47.758 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2023-10-26T06:53:47.759 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2023-10-26T06:53:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.760 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.761 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2023-10-26T06:53:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.762 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2023-10-26T06:53:47.763 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2023-10-26T06:53:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.766 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2023-10-26T06:53:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.767 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.768 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.770 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.771 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.772 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.774 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.775 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.776 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.779 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.780 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.781 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.782 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.785 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.786 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.787 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.789 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.790 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2023-10-26T06:53:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.792 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.795 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.796 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.797 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.797 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.797 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.799 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.800 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.801 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.802 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.804 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.805 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.806 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.807 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2023-10-26T06:53:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.813 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.815 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.815 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.815 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.816 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.816 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.816 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.816 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.817 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.817 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.817 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.817 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.822 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.823 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.823 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.823 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.824 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.824 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.824 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.825 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.825 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.825 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.825 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.826 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.826 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.826 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.826 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.828 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.828 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.830 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.830 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.833 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2023-10-26T06:53:47.833 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.834 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.834 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.834 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2023-10-26T06:53:47.834 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2023-10-26T06:53:47.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.835 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-26T06:53:47.836 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.836 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.836 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.837 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.837 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.837 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.837 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.838 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:47.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:47.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:47.839 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.839 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2023-10-26T06:53:47.840 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.841 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.841 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.842 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.844 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.844 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.845 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.845 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.845 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.845 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.846 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.846 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.846 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.846 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.847 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.847 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.847 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.848 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.848 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.849 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.849 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.849 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.849 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.850 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.850 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.850 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.851 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.851 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.851 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.852 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.853 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.853 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.853 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.854 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.854 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.854 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.854 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.855 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.855 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.855 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.856 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.857 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.858 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.858 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.859 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2023-10-26T06:53:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.861 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2023-10-26T06:53:47.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2023-10-26T06:53:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-26T06:53:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2023-10-26T06:53:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2023-10-26T06:53:47.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-26T06:53:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2023-10-26T06:53:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2023-10-26T06:53:47.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:47.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-26T06:53:47.872 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.873 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2023-10-26T06:53:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2023-10-26T06:53:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-26T06:53:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.876 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2023-10-26T06:53:47.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2023-10-26T06:53:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.879 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-26T06:53:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.880 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2023-10-26T06:53:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2023-10-26T06:53:47.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.882 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.883 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2023-10-26T06:53:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2023-10-26T06:53:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.885 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.886 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.887 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2023-10-26T06:53:47.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2023-10-26T06:53:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-26T06:53:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2023-10-26T06:53:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2023-10-26T06:53:47.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.893 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.894 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.896 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2023-10-26T06:53:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2023-10-26T06:53:47.897 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.898 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2023-10-26T06:53:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2023-10-26T06:53:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.900 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2023-10-26T06:53:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.901 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.902 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.903 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2023-10-26T06:53:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2023-10-26T06:53:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.905 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.906 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2023-10-26T06:53:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2023-10-26T06:53:47.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.908 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.909 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.910 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.911 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.913 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.916 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.917 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.918 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.919 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.921 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.922 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.927 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2023-10-26T06:53:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2023-10-26T06:53:47.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.930 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2023-10-26T06:53:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2023-10-26T06:53:47.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.936 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2023-10-26T06:53:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2023-10-26T06:53:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-26T06:53:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.939 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2023-10-26T06:53:47.941 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.942 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.944 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.945 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.946 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.947 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.950 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.953 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.954 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.955 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.956 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.958 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.959 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2023-10-26T06:53:47.962 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.963 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.966 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.969 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.970 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.972 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.973 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.975 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:47.978 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:47.979 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:47.980 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:47.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.983 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:47.984 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.985 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2023-10-26T06:53:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2023-10-26T06:53:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.986 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2023-10-26T06:53:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.987 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-26T06:53:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2023-10-26T06:53:47.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2023-10-26T06:53:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.990 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.991 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2023-10-26T06:53:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2023-10-26T06:53:47.993 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2023-10-26T06:53:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:47.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:47.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-26T06:53:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:47.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:47.997 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2023-10-26T06:53:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:47.998 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2023-10-26T06:53:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2023-10-26T06:53:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:47.999 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2023-10-26T06:53:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.000 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.002 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2023-10-26T06:53:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2023-10-26T06:53:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.004 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:48.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.007 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.007 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:48.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.008 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.008 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.009 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.009 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.011 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.011 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.012 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.012 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.012 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.012 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.013 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.013 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.013 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.014 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.014 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.015 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.015 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.015 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.016 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.016 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.016 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.017 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.017 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.017 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.018 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.018 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.019 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.020 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.020 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.021 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.021 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.021 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.021 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.022 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.022 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.022 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.023 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.023 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.024 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.026 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.026 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.026 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.026 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.027 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.028 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2023-10-26T06:53:48.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2023-10-26T06:53:48.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.029 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.030 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.031 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.032 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2023-10-26T06:53:48.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2023-10-26T06:53:48.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.032 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.033 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2023-10-26T06:53:48.033 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.033 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.034 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.034 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.034 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.035 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.035 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2023-10-26T06:53:48.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2023-10-26T06:53:48.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.037 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-26T06:53:48.037 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.037 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.037 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.040 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:48.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.040 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.041 INFO:teuthology.orchestra.run.smithi050.stdout: "modules": [ 2023-10-26T06:53:48.041 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2023-10-26T06:53:48.041 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard", 2023-10-26T06:53:48.041 INFO:teuthology.orchestra.run.smithi050.stdout: "iostat", 2023-10-26T06:53:48.042 INFO:teuthology.orchestra.run.smithi050.stdout: "nfs", 2023-10-26T06:53:48.042 INFO:teuthology.orchestra.run.smithi050.stdout: "restful", 2023-10-26T06:53:48.042 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_schedule" 2023-10-26T06:53:48.043 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.043 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2023-10-26T06:53:48.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2023-10-26T06:53:48.044 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.044 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.044 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.044 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:48.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:48.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.045 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.046 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:48.046 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.046 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.047 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.047 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2023-10-26T06:53:48.047 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.048 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.048 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.049 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.049 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.050 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.050 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.050 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.050 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.051 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.051 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.051 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.052 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.052 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.052 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.052 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.053 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.053 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.053 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.054 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.054 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.055 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.055 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.055 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.056 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.056 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.056 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.057 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.057 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.058 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.058 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.058 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.058 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.059 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.059 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.059 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.060 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.060 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.060 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.060 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.061 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.061 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.061 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.061 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.062 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.062 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.063 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.063 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.064 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.064 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.064 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.065 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.065 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.065 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.065 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.066 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.066 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.066 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.067 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2023-10-26T06:53:48.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2023-10-26T06:53:48.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.068 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.069 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2023-10-26T06:53:48.069 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.070 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.070 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2023-10-26T06:53:48.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2023-10-26T06:53:48.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.071 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.071 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2023-10-26T06:53:48.072 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.072 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.073 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2023-10-26T06:53:48.073 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.073 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.074 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.074 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2023-10-26T06:53:48.074 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2023-10-26T06:53:48.075 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.075 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.076 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.076 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.076 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.076 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2023-10-26T06:53:48.077 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.077 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.078 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2023-10-26T06:53:48.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2023-10-26T06:53:48.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.079 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.080 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.080 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2023-10-26T06:53:48.081 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.081 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.082 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2023-10-26T06:53:48.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2023-10-26T06:53:48.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.083 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.083 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2023-10-26T06:53:48.083 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.084 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.084 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2023-10-26T06:53:48.084 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.085 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.085 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.085 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2023-10-26T06:53:48.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2023-10-26T06:53:48.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.086 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.087 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2023-10-26T06:53:48.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.089 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.089 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2023-10-26T06:53:48.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2023-10-26T06:53:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-26T06:53:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2023-10-26T06:53:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2023-10-26T06:53:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2023-10-26T06:53:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2023-10-26T06:53:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2023-10-26T06:53:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2023-10-26T06:53:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2023-10-26T06:53:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2023-10-26T06:53:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2023-10-26T06:53:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2023-10-26T06:53:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2023-10-26T06:53:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-26T06:53:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2023-10-26T06:53:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2023-10-26T06:53:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2023-10-26T06:53:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2023-10-26T06:53:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-26T06:53:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-26T06:53:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2023-10-26T06:53:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2023-10-26T06:53:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2023-10-26T06:53:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2023-10-26T06:53:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-26T06:53:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2023-10-26T06:53:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2023-10-26T06:53:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2023-10-26T06:53:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-26T06:53:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-26T06:53:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2023-10-26T06:53:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2023-10-26T06:53:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2023-10-26T06:53:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2023-10-26T06:53:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2023-10-26T06:53:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2023-10-26T06:53:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-26T06:53:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2023-10-26T06:53:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2023-10-26T06:53:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2023-10-26T06:53:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2023-10-26T06:53:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-26T06:53:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2023-10-26T06:53:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2023-10-26T06:53:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2023-10-26T06:53:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2023-10-26T06:53:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-26T06:53:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-26T06:53:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2023-10-26T06:53:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2023-10-26T06:53:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-26T06:53:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2023-10-26T06:53:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2023-10-26T06:53:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2023-10-26T06:53:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2023-10-26T06:53:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2023-10-26T06:53:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap" 2023-10-26T06:53:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2023-10-26T06:53:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2023-10-26T06:53:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2023-10-26T06:53:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-26T06:53:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-26T06:53:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2023-10-26T06:53:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2023-10-26T06:53:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-26T06:53:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-26T06:53:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2023-10-26T06:53:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2023-10-26T06:53:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-26T06:53:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2023-10-26T06:53:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2023-10-26T06:53:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2023-10-26T06:53:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2023-10-26T06:53:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-26T06:53:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2023-10-26T06:53:48.189 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2023-10-26T06:53:48.189 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.189 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.190 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2023-10-26T06:53:48.190 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.190 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.191 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.191 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-26T06:53:48.191 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.191 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.192 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.192 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2023-10-26T06:53:48.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2023-10-26T06:53:48.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.193 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.193 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2023-10-26T06:53:48.194 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.194 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.194 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.195 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-26T06:53:48.195 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.195 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.196 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.196 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2023-10-26T06:53:48.196 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2023-10-26T06:53:48.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.197 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.197 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.197 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.198 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.198 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.199 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-26T06:53:48.199 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-26T06:53:48.199 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.199 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.200 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2023-10-26T06:53:48.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2023-10-26T06:53:48.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.201 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.201 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:48.202 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.202 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.202 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.202 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-26T06:53:48.203 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.203 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.204 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2023-10-26T06:53:48.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2023-10-26T06:53:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ab40a1670 msgr2=0x7f9ab40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ab40a1670 0x7f9ab40a3b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9ac419a210 tx=0x7f9ab000b260 comp rx=0 tx=0).stop 2023-10-26T06:53:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 msgr2=0x7f9ac419e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:53:48.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac419e990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800d980 tx=0x7f9ab800dc90 comp rx=0 tx=0).stop 2023-10-26T06:53:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 shutdown_connections 2023-10-26T06:53:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f9ab40a1670 0x7f9ab40a3b30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:48.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac41066b0 0x7f9ac4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac41006a0 0x7f9ac419e990 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 --2- 172.21.15.50:0/2998044882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ac4101060 0x7f9ac419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:53:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 >> 172.21.15.50:0/2998044882 conn(0x7f9ac40fc170 msgr2=0x7f9ac410bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:53:48.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 shutdown_connections 2023-10-26T06:53:48.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:53:44.705+0000 7f9acadff700 1 -- 172.21.15.50:0/2998044882 wait complete. 2023-10-26T06:53:48.209 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:45 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/511056736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:53:48.210 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:45 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2998044882' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-26T06:53:48.210 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:46 smithi153 ceph-mon[131657]: pgmap v630: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 465 KiB/s wr, 19 op/s 2023-10-26T06:53:48.210 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:45 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/511056736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:53:48.211 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:45 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2998044882' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-26T06:53:48.211 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:46 smithi125 ceph-mon[130643]: pgmap v630: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 465 KiB/s wr, 19 op/s 2023-10-26T06:53:48.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:48.212 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.213 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.213 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2023-10-26T06:53:48.213 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.214 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.214 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-26T06:53:48.214 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.215 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.215 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2023-10-26T06:53:48.216 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2023-10-26T06:53:48.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.216 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.216 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.217 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.218 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.218 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.218 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2023-10-26T06:53:48.219 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2023-10-26T06:53:48.219 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2023-10-26T06:53:48.220 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.220 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-26T06:53:48.221 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.221 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.222 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.223 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2023-10-26T06:53:48.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2023-10-26T06:53:48.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.224 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.225 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.226 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.226 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.226 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.226 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-26T06:53:48.227 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.227 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.227 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.228 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2023-10-26T06:53:48.228 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2023-10-26T06:53:48.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.229 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.229 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.229 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.230 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.230 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.230 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-26T06:53:48.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.232 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2023-10-26T06:53:48.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2023-10-26T06:53:48.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.235 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-26T06:53:48.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.236 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2023-10-26T06:53:48.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2023-10-26T06:53:48.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.237 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-26T06:53:48.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.239 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.239 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.240 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:48.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.241 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.241 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.242 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2023-10-26T06:53:48.242 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2023-10-26T06:53:48.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-26T06:53:48.244 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.245 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.245 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.245 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2023-10-26T06:53:48.246 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.246 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.247 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2023-10-26T06:53:48.247 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2023-10-26T06:53:48.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.248 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-26T06:53:48.248 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.249 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.249 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2023-10-26T06:53:48.249 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.250 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.250 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.251 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2023-10-26T06:53:48.251 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2023-10-26T06:53:48.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.252 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-26T06:53:48.252 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.252 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.253 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.253 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:48.253 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.254 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.254 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2023-10-26T06:53:48.255 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2023-10-26T06:53:48.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.255 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.256 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-26T06:53:48.256 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.257 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.257 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.257 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2023-10-26T06:53:48.257 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.258 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.258 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.258 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2023-10-26T06:53:48.259 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2023-10-26T06:53:48.259 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.259 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.260 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-26T06:53:48.260 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.260 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.261 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.261 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2023-10-26T06:53:48.261 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.261 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.262 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.262 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2023-10-26T06:53:48.262 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2023-10-26T06:53:48.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.263 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.264 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-26T06:53:48.264 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.264 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.264 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.265 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2023-10-26T06:53:48.265 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.265 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.265 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.266 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2023-10-26T06:53:48.266 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2023-10-26T06:53:48.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.267 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.267 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.267 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-26T06:53:48.267 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.268 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.268 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2023-10-26T06:53:48.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.269 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.269 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.269 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2023-10-26T06:53:48.270 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2023-10-26T06:53:48.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.270 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.271 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.271 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-26T06:53:48.271 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.272 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.272 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2023-10-26T06:53:48.272 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.273 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.273 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2023-10-26T06:53:48.274 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2023-10-26T06:53:48.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.274 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.275 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-26T06:53:48.275 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.276 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.276 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.276 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2023-10-26T06:53:48.276 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.277 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.277 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.277 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2023-10-26T06:53:48.278 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2023-10-26T06:53:48.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.278 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.279 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-26T06:53:48.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.279 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.280 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.280 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:48.280 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.281 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.281 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.281 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2023-10-26T06:53:48.282 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2023-10-26T06:53:48.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.282 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.283 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.283 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-26T06:53:48.283 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.284 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.284 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.284 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2023-10-26T06:53:48.284 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.285 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.285 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2023-10-26T06:53:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2023-10-26T06:53:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.286 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-26T06:53:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.287 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2023-10-26T06:53:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2023-10-26T06:53:48.289 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2023-10-26T06:53:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.290 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-26T06:53:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.291 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2023-10-26T06:53:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.292 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2023-10-26T06:53:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2023-10-26T06:53:48.293 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.294 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-26T06:53:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.295 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2023-10-26T06:53:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2023-10-26T06:53:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2023-10-26T06:53:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.297 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.298 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2023-10-26T06:53:48.299 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.300 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2023-10-26T06:53:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2023-10-26T06:53:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.301 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.302 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-26T06:53:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2023-10-26T06:53:48.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2023-10-26T06:53:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.306 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2023-10-26T06:53:48.306 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.307 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.307 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.307 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-26T06:53:48.307 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.308 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.308 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.308 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2023-10-26T06:53:48.309 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2023-10-26T06:53:48.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.309 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2023-10-26T06:53:48.310 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.310 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.311 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-26T06:53:48.311 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.312 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2023-10-26T06:53:48.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2023-10-26T06:53:48.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.313 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.313 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2023-10-26T06:53:48.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.314 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.315 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2023-10-26T06:53:48.315 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.315 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.316 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2023-10-26T06:53:48.316 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2023-10-26T06:53:48.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.317 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.317 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-26T06:53:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.319 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.319 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.319 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2023-10-26T06:53:48.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2023-10-26T06:53:48.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.320 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.321 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:48.321 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.321 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.321 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.322 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2023-10-26T06:53:48.322 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.323 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.323 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2023-10-26T06:53:48.323 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2023-10-26T06:53:48.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.324 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.325 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:48.325 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.325 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.325 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.326 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2023-10-26T06:53:48.326 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.327 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.327 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2023-10-26T06:53:48.327 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2023-10-26T06:53:48.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.328 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.328 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.329 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-26T06:53:48.330 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.330 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.331 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.331 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.332 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.333 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.333 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.334 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.334 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.334 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.335 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.335 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.335 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.335 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.336 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.336 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.337 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2023-10-26T06:53:48.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2023-10-26T06:53:48.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.337 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.338 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.338 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.338 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.338 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.339 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-26T06:53:48.339 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.340 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.340 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.340 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.341 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.342 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.342 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.342 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-26T06:53:48.343 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.343 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.344 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.344 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.345 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.345 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.346 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.346 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.346 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.346 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.347 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.347 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.347 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.348 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.348 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.348 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.348 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.349 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.349 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.350 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.351 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.352 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.352 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.353 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-26T06:53:48.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-26T06:53:48.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.354 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.354 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.355 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.355 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.355 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-26T06:53:48.356 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.358 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-26T06:53:48.358 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-26T06:53:48.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.359 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2023-10-26T06:53:48.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.360 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.360 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.360 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-26T06:53:48.360 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.361 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.361 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.361 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2023-10-26T06:53:48.362 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2023-10-26T06:53:48.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.363 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.364 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.364 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2023-10-26T06:53:48.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.365 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2023-10-26T06:53:48.366 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2023-10-26T06:53:48.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.366 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.367 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.367 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.367 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.367 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-26T06:53:48.368 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.368 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.369 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2023-10-26T06:53:48.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2023-10-26T06:53:48.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.370 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.370 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.370 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.371 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.371 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2023-10-26T06:53:48.371 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.373 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2023-10-26T06:53:48.373 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2023-10-26T06:53:48.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.373 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2023-10-26T06:53:48.374 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.374 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.375 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2023-10-26T06:53:48.375 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2023-10-26T06:53:48.375 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2023-10-26T06:53:48.376 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.376 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.377 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2023-10-26T06:53:48.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2023-10-26T06:53:48.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.378 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-26T06:53:48.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-26T06:53:48.379 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.380 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.380 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2023-10-26T06:53:48.381 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2023-10-26T06:53:48.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.381 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.383 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.383 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.383 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.383 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-26T06:53:48.384 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.385 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2023-10-26T06:53:48.385 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2023-10-26T06:53:48.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.386 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.386 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.386 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.387 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.387 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-26T06:53:48.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.388 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.389 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2023-10-26T06:53:48.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2023-10-26T06:53:48.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.391 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.391 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-26T06:53:48.392 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.393 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.394 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2023-10-26T06:53:48.394 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2023-10-26T06:53:48.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.395 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.396 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.396 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.396 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.397 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.397 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-26T06:53:48.397 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.397 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.398 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.398 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2023-10-26T06:53:48.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2023-10-26T06:53:48.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.399 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.400 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.400 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.400 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.401 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.401 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-26T06:53:48.401 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.402 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.402 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2023-10-26T06:53:48.403 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2023-10-26T06:53:48.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.403 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2023-10-26T06:53:48.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.404 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.405 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2023-10-26T06:53:48.405 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.405 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.405 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.406 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2023-10-26T06:53:48.406 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2023-10-26T06:53:48.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.407 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.407 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.407 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.408 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.408 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.408 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-26T06:53:48.408 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.409 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.409 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2023-10-26T06:53:48.410 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2023-10-26T06:53:48.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.410 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.411 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.411 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.412 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.412 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-26T06:53:48.412 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.413 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.413 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2023-10-26T06:53:48.413 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2023-10-26T06:53:48.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.414 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.415 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.415 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.415 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.416 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-26T06:53:48.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.416 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.417 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2023-10-26T06:53:48.417 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2023-10-26T06:53:48.417 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.418 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.418 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.418 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.419 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.419 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2023-10-26T06:53:48.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.420 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.421 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2023-10-26T06:53:48.421 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2023-10-26T06:53:48.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.421 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.422 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.423 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.423 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-26T06:53:48.423 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.424 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.425 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2023-10-26T06:53:48.425 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2023-10-26T06:53:48.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.425 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.426 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.426 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.426 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.427 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.427 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.427 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-26T06:53:48.427 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.428 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.428 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.429 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2023-10-26T06:53:48.430 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.430 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.430 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.430 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.431 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.431 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.432 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.432 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.432 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.433 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.433 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.433 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.434 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.434 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.434 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.434 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.435 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.435 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.435 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.436 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.436 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.437 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.437 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.438 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.438 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.438 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.438 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.439 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.439 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.440 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.440 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.440 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.441 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.441 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.442 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.442 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.442 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.443 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.443 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.443 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.443 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.444 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.444 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.444 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.445 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.445 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.446 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.446 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.447 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.447 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.448 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.448 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.449 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.449 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.449 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.450 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2023-10-26T06:53:48.450 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2023-10-26T06:53:48.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.451 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2023-10-26T06:53:48.452 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.452 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-26T06:53:48.453 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.454 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2023-10-26T06:53:48.454 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2023-10-26T06:53:48.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.455 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.455 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2023-10-26T06:53:48.456 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.456 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.456 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.456 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-26T06:53:48.457 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.457 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.459 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2023-10-26T06:53:48.459 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.459 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.459 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.460 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-26T06:53:48.460 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-26T06:53:48.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.460 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.461 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.461 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.463 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.463 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.464 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2023-10-26T06:53:48.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-26T06:53:48.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.464 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.465 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.465 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.465 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.466 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.466 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.466 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.467 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-26T06:53:48.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-26T06:53:48.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.468 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.469 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.469 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.469 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.469 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.470 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.470 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.471 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2023-10-26T06:53:48.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2023-10-26T06:53:48.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.472 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.472 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.472 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.473 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.473 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.474 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.474 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.475 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.475 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-26T06:53:48.476 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-26T06:53:48.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.477 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.477 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.478 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.478 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.478 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.479 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.479 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2023-10-26T06:53:48.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-26T06:53:48.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.480 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.481 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.481 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.482 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.482 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.483 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.483 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-26T06:53:48.484 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-26T06:53:48.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.484 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.485 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.485 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.485 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.486 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.486 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.486 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.487 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.487 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-26T06:53:48.488 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-26T06:53:48.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.488 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.489 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.489 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.490 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.490 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.491 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.491 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-26T06:53:48.491 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-26T06:53:48.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.492 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.493 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.493 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.493 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.493 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.494 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.494 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.494 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.495 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-26T06:53:48.495 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-26T06:53:48.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.496 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.496 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.496 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.497 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.497 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.497 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-26T06:53:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-26T06:53:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.500 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.500 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.501 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.501 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.501 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.502 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.502 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.502 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.502 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.503 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-26T06:53:48.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-26T06:53:48.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.505 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.505 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.505 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.506 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.506 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.506 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-26T06:53:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-26T06:53:48.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.508 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.510 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.510 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.511 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-26T06:53:48.511 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-26T06:53:48.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.512 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.512 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.513 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.513 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.513 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.514 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.514 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.514 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.515 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2023-10-26T06:53:48.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-26T06:53:48.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.516 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.516 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:48.516 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.517 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.517 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.517 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.518 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.518 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.519 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-26T06:53:48.519 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-26T06:53:48.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.519 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.520 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.520 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.521 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.521 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.521 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.521 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.522 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.522 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2023-10-26T06:53:48.523 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2023-10-26T06:53:48.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.523 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.524 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.524 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.525 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.525 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.525 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.526 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.527 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.527 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2023-10-26T06:53:48.528 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-26T06:53:48.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.529 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.529 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.530 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:48.530 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.531 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.531 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.532 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.532 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.533 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.534 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-26T06:53:48.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-26T06:53:48.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.536 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.536 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.537 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.537 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.537 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.537 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.538 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.538 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.538 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.539 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.539 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-26T06:53:48.539 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-26T06:53:48.540 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.540 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.540 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.541 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.541 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.542 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.542 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.542 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.542 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.543 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-26T06:53:48.543 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-26T06:53:48.543 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.544 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.544 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.545 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.545 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.545 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.545 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.546 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.546 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.546 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.547 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-26T06:53:48.547 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-26T06:53:48.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.549 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.550 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2023-10-26T06:53:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-26T06:53:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.551 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.552 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.553 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.553 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.553 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.554 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.554 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-26T06:53:48.555 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-26T06:53:48.555 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.555 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.556 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.556 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.557 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.557 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.557 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.558 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.558 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.558 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.559 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-26T06:53:48.559 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-26T06:53:48.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.560 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.560 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.560 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.561 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.561 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.561 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.561 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.562 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.562 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.563 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-26T06:53:48.563 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-26T06:53:48.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.564 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.564 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.564 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.565 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.565 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.565 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.566 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.566 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.566 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.566 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.567 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-26T06:53:48.567 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-26T06:53:48.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.568 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.568 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.569 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.569 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.569 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.569 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.570 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.570 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.570 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.571 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-26T06:53:48.571 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-26T06:53:48.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.572 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.572 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.572 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.572 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.573 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.573 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.573 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.574 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.574 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.574 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.575 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-26T06:53:48.575 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-26T06:53:48.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.576 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.576 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.576 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.576 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.577 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.577 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.577 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.578 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.579 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-26T06:53:48.579 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-26T06:53:48.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.580 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.580 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.580 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.580 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.581 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.581 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.581 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.581 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.582 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.583 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-26T06:53:48.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-26T06:53:48.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.583 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.584 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.584 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.584 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.584 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.585 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.585 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.586 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.586 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.587 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.587 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2023-10-26T06:53:48.588 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-26T06:53:48.588 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.589 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.589 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.590 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.590 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.591 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.591 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.591 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.592 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.593 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.593 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-26T06:53:48.594 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-26T06:53:48.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.594 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.594 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.595 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-26T06:53:48.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.596 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.596 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.596 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.597 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.597 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-26T06:53:48.598 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-26T06:53:48.598 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.598 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.599 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.599 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.599 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.599 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.600 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.600 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.600 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.601 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.601 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-26T06:53:48.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-26T06:53:48.602 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.602 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.602 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.602 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2023-10-26T06:53:48.603 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.603 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.604 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.604 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.604 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.604 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.605 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-26T06:53:48.605 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-26T06:53:48.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.606 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.606 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2023-10-26T06:53:48.607 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.607 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.607 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.607 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.608 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.608 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.608 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.609 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2023-10-26T06:53:48.609 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-26T06:53:48.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.610 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.610 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.611 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.611 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.611 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.611 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.612 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.612 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.612 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.613 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-26T06:53:48.613 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-26T06:53:48.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.614 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.614 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.614 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2023-10-26T06:53:48.615 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.615 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.615 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.615 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.616 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.616 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.617 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2023-10-26T06:53:48.617 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-26T06:53:48.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.618 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.618 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.618 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.619 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.619 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.619 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.620 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.620 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.620 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.621 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2023-10-26T06:53:48.621 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-26T06:53:48.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.622 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.622 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.623 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.623 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.623 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.623 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.624 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.624 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.624 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.624 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.625 INFO:teuthology.orchestra.run.smithi050.stdout: "UNSAFE_TLS_v1_2": { 2023-10-26T06:53:48.625 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-26T06:53:48.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.626 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.626 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.626 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.627 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.627 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.627 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.628 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.628 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.628 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.628 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.629 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-26T06:53:48.629 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-26T06:53:48.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.630 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.630 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:48.631 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.631 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.631 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.631 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.632 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.632 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.634 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-26T06:53:48.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-26T06:53:48.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.635 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.636 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.637 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.638 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.639 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.640 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-26T06:53:48.640 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-26T06:53:48.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.641 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.641 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.641 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:48.641 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.642 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.642 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.642 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.644 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2023-10-26T06:53:48.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2023-10-26T06:53:48.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.645 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.645 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.645 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.646 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.646 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.646 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.646 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.647 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.648 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2023-10-26T06:53:48.648 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2023-10-26T06:53:48.648 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.649 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.649 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.649 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.650 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.650 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.650 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.651 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.651 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.652 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2023-10-26T06:53:48.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2023-10-26T06:53:48.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.653 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.653 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.653 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2023-10-26T06:53:48.654 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.655 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.655 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.656 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2023-10-26T06:53:48.656 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2023-10-26T06:53:48.656 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.657 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.657 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2023-10-26T06:53:48.658 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.658 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.659 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.659 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.659 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.660 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.660 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.660 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2023-10-26T06:53:48.661 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2023-10-26T06:53:48.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.661 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.662 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.662 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.662 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.662 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.663 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.663 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.663 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.664 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.664 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.665 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.665 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.666 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.666 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.667 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.667 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.667 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.668 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.668 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.668 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.669 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.669 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.669 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.670 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.671 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.672 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.672 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.673 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.673 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.673 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.674 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.674 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.674 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.675 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.675 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.676 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.676 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.676 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.677 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.677 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.677 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.677 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.678 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.678 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.678 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.679 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.679 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.679 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.679 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.680 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.680 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.680 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.681 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.681 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.682 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.682 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.683 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.683 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.684 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.684 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.684 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.684 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.685 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.685 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.686 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2023-10-26T06:53:48.686 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2023-10-26T06:53:48.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.687 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.687 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.688 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.688 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2023-10-26T06:53:48.688 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.689 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.689 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2023-10-26T06:53:48.690 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2023-10-26T06:53:48.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.690 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.691 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.691 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.691 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.691 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.692 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.692 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.693 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.693 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:48.693 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:48.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.694 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.695 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2023-10-26T06:53:48.696 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.696 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.696 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2023-10-26T06:53:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.702 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.702 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.703 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.703 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2023-10-26T06:53:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2023-10-26T06:53:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2023-10-26T06:53:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2023-10-26T06:53:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2023-10-26T06:53:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2023-10-26T06:53:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2023-10-26T06:53:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2023-10-26T06:53:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2023-10-26T06:53:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2023-10-26T06:53:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2023-10-26T06:53:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2023-10-26T06:53:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2023-10-26T06:53:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2023-10-26T06:53:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2023-10-26T06:53:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2023-10-26T06:53:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2023-10-26T06:53:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2023-10-26T06:53:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2023-10-26T06:53:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2023-10-26T06:53:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2023-10-26T06:53:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2023-10-26T06:53:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2023-10-26T06:53:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-26T06:53:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2023-10-26T06:53:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2023-10-26T06:53:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2023-10-26T06:53:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-26T06:53:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2023-10-26T06:53:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2023-10-26T06:53:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2023-10-26T06:53:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2023-10-26T06:53:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2023-10-26T06:53:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2023-10-26T06:53:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2023-10-26T06:53:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-26T06:53:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2023-10-26T06:53:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2023-10-26T06:53:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-26T06:53:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2023-10-26T06:53:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2023-10-26T06:53:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2023-10-26T06:53:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2023-10-26T06:53:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-26T06:53:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2023-10-26T06:53:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2023-10-26T06:53:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2023-10-26T06:53:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2023-10-26T06:53:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2023-10-26T06:53:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2023-10-26T06:53:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2023-10-26T06:53:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.808 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.809 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.809 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:48.810 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:48.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.810 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.811 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2023-10-26T06:53:48.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.812 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.812 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.812 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.812 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.813 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2023-10-26T06:53:48.814 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2023-10-26T06:53:48.815 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2023-10-26T06:53:48.815 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.815 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2023-10-26T06:53:48.816 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2023-10-26T06:53:48.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.816 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2023-10-26T06:53:48.817 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.817 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.818 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.818 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-26T06:53:48.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.819 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.819 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2023-10-26T06:53:48.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2023-10-26T06:53:48.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.821 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2023-10-26T06:53:48.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.821 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.822 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-26T06:53:48.822 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.823 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.823 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2023-10-26T06:53:48.824 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2023-10-26T06:53:48.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.824 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2023-10-26T06:53:48.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.827 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:48.827 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:48.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:48.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2023-10-26T06:53:48.830 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2023-10-26T06:53:48.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-26T06:53:48.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.833 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.834 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.834 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.836 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.836 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.836 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.837 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.837 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.837 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.837 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.838 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.838 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.839 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.840 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.841 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.841 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.842 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.842 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.843 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.843 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.844 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.844 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.845 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.845 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.845 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.846 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.846 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.846 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.847 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.847 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.847 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.847 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.848 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.848 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.848 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.849 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.850 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2023-10-26T06:53:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2023-10-26T06:53:48.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.854 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2023-10-26T06:53:48.856 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.857 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2023-10-26T06:53:48.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2023-10-26T06:53:48.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.858 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2023-10-26T06:53:48.859 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.860 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2023-10-26T06:53:48.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.861 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.862 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2023-10-26T06:53:48.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2023-10-26T06:53:48.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.863 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2023-10-26T06:53:48.863 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.864 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-26T06:53:48.865 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.866 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2023-10-26T06:53:48.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2023-10-26T06:53:48.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:48.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:48.868 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2023-10-26T06:53:48.868 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-26T06:53:48.869 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.869 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.870 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2023-10-26T06:53:48.870 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2023-10-26T06:53:48.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.870 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.872 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.872 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.872 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2023-10-26T06:53:48.872 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.873 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.874 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2023-10-26T06:53:48.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2023-10-26T06:53:48.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.875 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2023-10-26T06:53:48.875 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.876 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.876 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-26T06:53:48.876 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.877 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.878 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2023-10-26T06:53:48.879 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.879 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.879 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.879 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.881 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.881 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.881 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.882 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.882 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.882 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.883 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.883 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.883 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.883 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.884 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.884 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.885 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.886 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.888 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.888 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.889 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.890 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.891 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.891 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.891 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.892 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.892 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.892 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.893 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.893 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.893 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.894 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.894 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.895 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.895 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.896 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.896 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.897 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.897 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.897 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.898 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.898 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.899 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2023-10-26T06:53:48.899 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.900 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.900 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.900 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.901 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.901 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.902 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.902 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.902 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.903 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.903 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.903 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.903 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.904 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.904 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.904 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.905 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.905 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.906 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.906 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.907 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.908 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.909 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.910 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.911 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.911 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.912 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.912 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.912 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.912 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.913 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.913 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.913 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.913 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.914 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.914 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.915 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.915 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.916 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.916 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.916 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.917 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.917 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.917 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.917 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.918 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.919 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2023-10-26T06:53:48.919 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.920 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.920 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.920 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2023-10-26T06:53:48.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2023-10-26T06:53:48.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.921 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2023-10-26T06:53:48.922 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.922 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-26T06:53:48.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.923 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.924 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2023-10-26T06:53:48.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2023-10-26T06:53:48.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.924 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:48.925 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:48.925 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2023-10-26T06:53:48.925 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.926 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.926 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-26T06:53:48.926 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.927 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.927 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.927 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.928 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.928 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.929 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.929 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.929 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.930 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.930 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.930 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.931 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.931 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.931 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.932 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.933 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.935 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.936 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.938 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.939 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.939 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.939 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.939 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.940 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.940 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.940 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.940 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.941 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.941 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.941 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.942 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.942 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.943 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.943 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.943 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.944 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.944 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.944 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2023-10-26T06:53:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2023-10-26T06:53:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2023-10-26T06:53:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2023-10-26T06:53:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2023-10-26T06:53:48.949 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-26T06:53:48.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.950 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.950 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.951 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.952 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.952 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.952 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.952 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.953 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.953 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.953 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.953 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.954 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.954 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.954 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.956 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.958 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.959 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.959 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.961 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.962 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.962 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.962 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.963 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.963 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.963 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.963 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.964 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.964 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.964 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.965 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:48.965 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:48.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.965 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.966 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.966 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.966 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.967 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.967 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.967 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.968 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2023-10-26T06:53:48.968 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2023-10-26T06:53:48.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.969 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.969 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.969 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.970 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.970 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.970 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2023-10-26T06:53:48.971 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-26T06:53:48.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.971 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.972 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2023-10-26T06:53:48.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2023-10-26T06:53:48.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.973 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2023-10-26T06:53:48.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.974 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.974 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2023-10-26T06:53:48.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.975 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2023-10-26T06:53:48.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2023-10-26T06:53:48.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:48.976 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2023-10-26T06:53:48.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2023-10-26T06:53:48.978 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.978 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.979 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2023-10-26T06:53:48.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2023-10-26T06:53:48.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.980 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.980 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.980 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.981 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.981 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.981 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2023-10-26T06:53:48.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.982 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.983 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2023-10-26T06:53:48.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2023-10-26T06:53:48.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.984 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.984 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2023-10-26T06:53:48.984 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.984 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.985 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.985 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-26T06:53:48.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-26T06:53:48.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.986 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:48.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:48.987 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2023-10-26T06:53:48.987 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:48.988 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:48.988 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:48.988 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:48.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:48.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.989 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.989 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:48.990 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:48.990 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:48.991 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:48.991 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:48.991 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:48.992 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:48.992 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:48.992 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:48.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:48.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:48.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:48.996 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:48.997 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:48.998 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:48.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:48.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:48.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:48.999 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:48.999 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:48.999 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.000 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.000 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.000 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.000 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.000 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.001 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.001 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.001 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.002 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.003 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.004 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.004 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.005 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.006 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.006 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.006 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2023-10-26T06:53:49.007 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.008 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.008 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.008 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.008 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.009 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.011 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.011 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.011 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.011 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.012 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.012 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.012 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.012 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.013 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.014 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.015 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.015 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.015 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.016 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.016 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.016 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.016 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.017 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.017 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.018 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.019 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.019 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.019 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.019 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.020 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.020 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.020 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.020 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.021 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.021 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.021 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.022 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.022 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.023 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.023 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.023 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.024 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.024 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.024 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.025 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.025 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.025 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.026 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2023-10-26T06:53:49.027 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.028 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.028 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.028 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.030 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.031 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.031 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.031 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.031 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.032 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.032 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.032 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.033 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.033 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.033 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.034 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.034 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.035 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.036 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.036 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.036 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.037 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.037 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.037 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.038 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.038 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.039 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.039 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.040 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.040 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.040 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.040 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.041 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.041 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.041 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.042 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.042 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.042 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.043 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.043 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.044 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.044 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.045 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.045 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.045 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.046 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.046 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.046 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.047 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.048 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2023-10-26T06:53:49.048 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.049 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.049 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.049 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2023-10-26T06:53:49.050 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2023-10-26T06:53:49.050 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.050 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.051 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.051 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.051 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.051 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.052 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-26T06:53:49.052 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.052 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.053 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.053 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.054 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.054 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.055 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.055 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.055 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.055 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.056 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.056 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.056 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.056 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.057 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.057 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.057 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.057 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.058 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.058 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.060 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.060 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.060 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.060 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.061 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.062 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.062 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.063 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.063 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.064 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.064 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.065 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.065 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.065 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.065 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.066 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.066 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.066 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.067 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.067 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.068 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.069 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.070 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.071 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2023-10-26T06:53:49.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2023-10-26T06:53:49.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.072 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.072 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.073 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2023-10-26T06:53:49.073 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2023-10-26T06:53:49.074 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2023-10-26T06:53:49.074 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.074 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2023-10-26T06:53:49.075 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.075 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.075 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.076 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2023-10-26T06:53:49.077 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.077 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.077 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.077 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.079 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.080 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.080 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.080 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.081 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.081 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.081 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.081 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.082 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.082 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.082 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.082 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.083 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.084 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.084 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.085 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.085 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.085 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.086 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.086 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.087 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.087 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.087 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.088 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.088 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.088 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.089 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.089 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.089 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.089 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.090 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.090 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.090 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.090 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.091 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.091 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.091 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.092 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.093 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.093 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.093 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.094 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.094 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.094 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.095 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.095 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.096 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.096 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2023-10-26T06:53:49.097 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.097 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.097 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.097 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.098 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.098 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.099 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.099 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.099 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.099 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.100 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.100 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.100 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.100 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.101 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.101 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.101 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.102 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.103 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.104 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.105 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.105 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.106 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.106 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.107 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.107 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.107 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.108 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.108 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.108 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.109 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.109 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.109 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.109 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.110 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.110 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.110 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.111 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.111 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.112 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.112 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.112 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.113 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.113 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.114 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.114 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.114 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.114 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.115 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.115 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.116 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2023-10-26T06:53:49.117 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.117 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.117 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.117 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.118 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.120 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.120 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.120 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.120 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.121 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.121 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.121 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.121 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.122 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.122 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.122 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.123 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.123 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.123 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.124 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.124 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.124 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.125 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.125 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.125 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.125 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.126 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.126 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.127 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.128 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.128 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.128 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.128 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.129 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.129 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.129 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.129 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.130 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.130 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.130 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.130 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.131 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.131 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.131 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.133 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.133 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.133 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:49.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.138 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2023-10-26T06:53:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2023-10-26T06:53:49.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2023-10-26T06:53:49.140 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2023-10-26T06:53:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2023-10-26T06:53:49.141 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-26T06:53:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2023-10-26T06:53:49.143 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2023-10-26T06:53:49.144 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2023-10-26T06:53:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.145 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.146 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-26T06:53:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2023-10-26T06:53:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2023-10-26T06:53:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.148 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.150 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.151 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.151 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.152 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.152 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.153 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.154 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.154 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.154 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.154 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.155 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.155 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.156 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.156 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.156 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.157 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.157 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.158 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.158 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.160 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.161 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.162 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.162 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.163 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.163 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.163 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.163 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.164 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.164 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.164 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.164 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.165 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.165 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.165 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.166 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.166 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.166 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.167 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.167 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.167 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.167 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.168 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.168 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.169 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2023-10-26T06:53:49.169 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2023-10-26T06:53:49.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.169 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.170 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2023-10-26T06:53:49.170 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.170 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.171 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.171 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2023-10-26T06:53:49.171 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.171 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.172 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.172 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2023-10-26T06:53:49.172 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2023-10-26T06:53:49.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:49.173 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.173 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2023-10-26T06:53:49.173 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.174 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.174 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.174 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2023-10-26T06:53:49.174 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.175 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.175 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.176 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2023-10-26T06:53:49.176 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.177 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.177 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.177 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2023-10-26T06:53:49.177 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2023-10-26T06:53:49.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.178 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.178 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.178 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.179 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.179 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.179 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.180 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.180 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.180 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.180 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.181 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2023-10-26T06:53:49.181 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2023-10-26T06:53:49.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.182 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.182 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.182 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.183 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.183 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.183 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-26T06:53:49.183 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-26T06:53:49.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.184 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.184 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.185 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.186 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.186 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.186 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.187 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.187 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.187 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.187 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.188 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.188 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.188 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.188 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.189 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.189 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.190 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.190 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.190 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.191 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.191 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.191 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.192 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.192 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.192 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.194 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.195 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.195 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.195 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.195 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.196 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.196 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.196 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.196 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.197 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.197 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.197 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.197 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.198 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.198 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.199 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.202 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.203 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.203 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.203 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.203 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.204 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.204 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.204 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.204 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.205 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2023-10-26T06:53:49.205 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2023-10-26T06:53:49.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.206 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.206 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.206 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.207 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.207 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.207 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.207 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.208 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.208 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.208 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-26T06:53:49.209 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-26T06:53:49.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.209 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.209 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.210 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2023-10-26T06:53:49.210 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.210 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.210 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.211 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.211 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.211 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.211 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.212 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2023-10-26T06:53:49.212 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2023-10-26T06:53:49.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:49.213 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.213 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.213 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2023-10-26T06:53:49.214 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.214 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.214 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.214 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.215 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.215 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.216 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:49.216 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:49.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.216 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.217 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2023-10-26T06:53:49.217 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.217 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.217 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.218 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-26T06:53:49.218 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.218 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.218 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.219 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:49.219 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:49.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.220 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.220 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2023-10-26T06:53:49.220 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.221 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.221 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.221 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-26T06:53:49.221 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.222 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.222 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.222 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2023-10-26T06:53:49.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2023-10-26T06:53:49.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.223 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.224 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2023-10-26T06:53:49.224 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.224 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.224 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.225 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.225 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.225 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.226 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2023-10-26T06:53:49.226 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2023-10-26T06:53:49.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.227 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.227 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.227 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2023-10-26T06:53:49.227 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.228 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.228 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.228 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2023-10-26T06:53:49.228 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2023-10-26T06:53:49.229 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.229 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.229 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.229 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.230 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.230 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2023-10-26T06:53:49.230 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2023-10-26T06:53:49.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.231 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.231 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2023-10-26T06:53:49.232 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2023-10-26T06:53:49.232 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2023-10-26T06:53:49.232 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.232 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.233 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.233 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.233 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.233 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.234 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2023-10-26T06:53:49.235 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.235 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.235 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.235 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.236 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.238 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.238 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.238 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.238 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.239 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.239 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.239 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.239 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.241 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.241 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.241 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.241 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.242 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.242 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.245 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.247 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.247 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.247 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.247 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.247 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.248 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.248 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.248 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.249 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.249 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.251 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.251 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.251 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.253 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2023-10-26T06:53:49.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2023-10-26T06:53:49.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.254 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2023-10-26T06:53:49.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.255 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.256 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.256 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2023-10-26T06:53:49.257 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2023-10-26T06:53:49.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.257 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.258 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.258 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.258 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.258 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.259 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.259 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.259 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2023-10-26T06:53:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2023-10-26T06:53:49.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.261 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.261 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.261 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.262 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.262 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.262 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.263 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.263 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.264 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2023-10-26T06:53:49.264 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.265 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.265 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.265 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2023-10-26T06:53:49.265 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2023-10-26T06:53:49.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.266 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.266 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.267 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.267 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.267 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.267 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.269 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2023-10-26T06:53:49.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2023-10-26T06:53:49.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.270 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.271 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.271 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.272 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.273 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.273 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.274 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.275 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.275 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.275 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.275 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.275 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.276 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.276 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.276 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.276 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.277 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.277 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.277 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.278 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.278 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.279 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.279 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.279 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.280 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.280 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.280 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.280 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.281 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.281 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.282 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.282 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.282 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.283 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.283 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.283 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.283 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.284 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.284 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.284 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.284 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.285 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.285 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.285 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.286 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.286 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.286 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.287 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.288 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.288 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.288 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.288 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.289 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.289 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.289 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.290 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2023-10-26T06:53:49.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2023-10-26T06:53:49.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.291 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.291 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.291 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.291 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.292 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.292 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.292 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.292 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.293 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.293 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2023-10-26T06:53:49.293 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2023-10-26T06:53:49.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.294 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.295 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.296 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.297 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2023-10-26T06:53:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.298 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.299 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.300 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.301 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.301 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.301 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.301 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.302 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.302 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.302 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.303 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.303 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.304 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.304 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.305 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.305 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.305 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.305 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.306 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.306 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.306 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.307 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.307 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.307 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.308 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.308 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.308 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.309 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.309 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.309 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.310 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.310 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.310 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.310 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.311 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.311 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.311 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.312 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.313 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.313 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.313 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.315 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.315 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.315 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.315 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.317 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2023-10-26T06:53:49.317 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.317 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.317 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.318 INFO:teuthology.orchestra.run.smithi050.stdout: "drive_group_interval": { 2023-10-26T06:53:49.318 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "drive_group_interval", 2023-10-26T06:53:49.318 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:49.318 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.319 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.319 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300.0", 2023-10-26T06:53:49.319 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.320 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.320 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-26T06:53:49.320 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.320 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.321 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.321 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.321 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.322 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.323 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.323 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.323 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.324 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.324 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.324 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.324 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.325 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.325 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.325 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.325 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.326 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.326 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.327 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.327 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.328 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.328 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.328 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.328 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.329 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.329 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.329 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.330 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.330 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.331 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.331 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.331 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.331 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.332 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.332 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.332 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.332 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.333 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.333 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.333 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.333 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.334 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.334 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.334 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.334 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.335 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.335 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.338 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.338 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.338 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.339 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2023-10-26T06:53:49.339 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2023-10-26T06:53:49.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.340 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.340 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.340 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2023-10-26T06:53:49.340 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.341 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.341 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.341 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-26T06:53:49.342 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.342 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.342 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.343 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2023-10-26T06:53:49.344 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.344 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.344 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.344 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.345 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.346 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.346 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.346 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.346 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.347 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.347 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.347 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.347 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.348 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.348 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.348 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.348 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.349 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.349 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.350 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.350 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.352 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.353 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.353 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.354 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.354 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.355 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.355 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.355 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.355 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.356 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.356 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.356 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.356 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.357 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.357 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.357 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.357 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.358 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.358 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.359 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.359 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.359 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.360 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.360 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.360 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.361 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.361 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.361 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.362 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.362 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2023-10-26T06:53:49.363 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2023-10-26T06:53:49.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.364 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.364 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.364 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.365 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.365 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.365 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.366 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.366 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2023-10-26T06:53:49.366 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2023-10-26T06:53:49.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.367 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.367 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2023-10-26T06:53:49.368 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.368 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.368 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.369 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.369 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.369 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.370 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2023-10-26T06:53:49.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2023-10-26T06:53:49.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.371 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.372 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.372 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.372 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.373 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.373 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2023-10-26T06:53:49.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2023-10-26T06:53:49.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.374 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.375 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.375 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.375 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.376 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.376 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.377 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2023-10-26T06:53:49.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2023-10-26T06:53:49.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2023-10-26T06:53:49.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.378 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2023-10-26T06:53:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2023-10-26T06:53:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.381 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.382 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2023-10-26T06:53:49.384 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2023-10-26T06:53:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.386 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.387 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2023-10-26T06:53:49.388 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2023-10-26T06:53:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.389 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.390 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.391 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2023-10-26T06:53:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2023-10-26T06:53:49.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2023-10-26T06:53:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2023-10-26T06:53:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.394 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2023-10-26T06:53:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2023-10-26T06:53:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.396 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.397 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2023-10-26T06:53:49.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2023-10-26T06:53:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.400 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.401 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.402 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2023-10-26T06:53:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2023-10-26T06:53:49.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.405 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.406 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.407 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2023-10-26T06:53:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.408 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2023-10-26T06:53:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2023-10-26T06:53:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.410 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2023-10-26T06:53:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.411 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2023-10-26T06:53:49.412 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2023-10-26T06:53:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.413 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.414 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2023-10-26T06:53:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.415 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.417 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.418 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.419 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.421 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.422 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.425 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.426 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.427 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.428 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.429 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.431 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.432 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2023-10-26T06:53:49.435 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.436 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.437 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.438 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.439 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.440 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.441 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.443 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.444 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.445 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.446 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.447 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.448 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.449 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.450 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2023-10-26T06:53:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.455 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.457 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.458 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.459 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.461 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.464 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.466 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.467 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.468 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.469 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.470 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2023-10-26T06:53:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.475 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2023-10-26T06:53:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2023-10-26T06:53:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-26T06:53:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.478 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.479 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2023-10-26T06:53:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.481 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.482 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.484 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.485 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.486 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.488 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.492 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.493 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.494 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.495 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.496 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.499 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.500 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2023-10-26T06:53:49.502 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2023-10-26T06:53:49.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2023-10-26T06:53:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.505 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-26T06:53:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.506 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2023-10-26T06:53:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2023-10-26T06:53:49.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.508 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-26T06:53:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.511 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2023-10-26T06:53:49.511 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2023-10-26T06:53:49.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.512 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2023-10-26T06:53:49.512 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.513 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.513 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.513 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-26T06:53:49.513 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.514 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.514 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.515 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2023-10-26T06:53:49.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2023-10-26T06:53:49.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.515 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.516 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.516 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.516 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.516 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.517 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-26T06:53:49.517 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.518 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.518 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2023-10-26T06:53:49.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2023-10-26T06:53:49.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.519 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.519 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.520 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.520 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.520 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.520 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-26T06:53:49.521 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.521 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.522 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2023-10-26T06:53:49.522 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2023-10-26T06:53:49.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.523 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.523 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.523 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.523 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.524 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.524 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.524 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.524 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.525 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.525 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2023-10-26T06:53:49.526 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2023-10-26T06:53:49.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.526 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.527 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.527 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.527 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.527 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.528 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.528 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.528 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2023-10-26T06:53:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2023-10-26T06:53:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.530 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.530 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-26T06:53:49.531 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.531 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.531 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.531 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.532 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.532 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.532 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2023-10-26T06:53:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2023-10-26T06:53:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.535 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.535 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.535 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.535 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.536 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.536 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.536 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:49.537 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:49.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.537 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.537 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.538 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2023-10-26T06:53:49.538 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2023-10-26T06:53:49.538 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.538 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.539 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.539 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.539 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.539 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.540 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2023-10-26T06:53:49.540 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2023-10-26T06:53:49.540 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.541 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.541 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.541 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2023-10-26T06:53:49.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.542 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.542 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.542 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.543 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.543 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.544 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2023-10-26T06:53:49.544 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2023-10-26T06:53:49.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.544 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.545 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.546 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.546 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.546 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.547 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.547 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2023-10-26T06:53:49.547 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2023-10-26T06:53:49.548 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.548 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.548 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.548 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.549 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.549 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.549 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.549 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.557 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.558 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.558 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.559 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.559 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.559 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.559 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.560 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.560 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.561 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.561 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.561 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.562 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.562 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.562 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.562 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.563 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.563 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.563 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.563 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.564 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.564 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.564 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.564 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.565 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.565 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.565 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.566 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.566 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.567 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.567 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.567 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.567 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.568 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.568 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.569 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2023-10-26T06:53:49.569 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2023-10-26T06:53:49.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.569 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.570 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.571 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.571 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.571 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.571 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.572 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.572 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.572 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2023-10-26T06:53:49.573 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2023-10-26T06:53:49.573 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.573 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.573 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.574 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.574 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.574 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.574 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.575 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.575 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.575 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.575 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.576 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2023-10-26T06:53:49.576 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2023-10-26T06:53:49.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.577 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.577 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-26T06:53:49.577 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.578 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.578 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.578 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.578 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.579 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.579 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.580 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2023-10-26T06:53:49.580 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.581 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.581 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.581 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.581 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.582 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.583 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.584 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.585 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.587 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.588 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.589 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.590 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.591 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.592 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.593 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.594 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.595 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.597 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.598 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.600 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2023-10-26T06:53:49.600 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.600 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.600 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.601 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.601 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.602 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.602 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.602 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.602 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.603 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.603 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.603 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.604 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.604 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.604 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.605 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.605 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.605 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.605 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.606 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.606 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.606 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.607 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.607 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.607 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.608 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.608 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.608 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.608 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.609 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.609 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.609 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.610 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.610 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.615 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.615 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.615 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.616 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.616 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.616 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.616 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.617 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.618 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.619 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.619 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.619 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.620 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.620 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.620 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.621 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.621 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.621 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.622 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.622 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.622 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.623 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.623 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.623 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2023-10-26T06:53:49.624 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2023-10-26T06:53:49.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.624 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.625 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2023-10-26T06:53:49.625 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.625 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.625 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.626 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-26T06:53:49.626 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.626 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.626 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.627 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2023-10-26T06:53:49.627 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2023-10-26T06:53:49.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.628 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.628 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.628 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.629 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.629 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.629 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2023-10-26T06:53:49.629 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.630 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.630 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.630 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2023-10-26T06:53:49.631 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2023-10-26T06:53:49.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.631 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.631 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.632 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2023-10-26T06:53:49.632 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.632 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.632 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.633 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-26T06:53:49.633 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.635 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2023-10-26T06:53:49.635 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2023-10-26T06:53:49.635 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2023-10-26T06:53:49.635 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2023-10-26T06:53:49.636 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2023-10-26T06:53:49.636 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2023-10-26T06:53:49.636 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2023-10-26T06:53:49.636 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.637 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.637 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2023-10-26T06:53:49.637 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.637 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.638 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.638 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.638 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.638 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.639 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.639 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2023-10-26T06:53:49.639 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2023-10-26T06:53:49.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.640 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.640 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.641 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.641 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.641 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.641 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.642 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.642 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.642 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.643 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2023-10-26T06:53:49.643 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2023-10-26T06:53:49.643 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2023-10-26T06:53:49.643 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.644 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2023-10-26T06:53:49.644 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.644 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.645 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.645 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.645 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.645 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.646 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.646 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2023-10-26T06:53:49.646 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2023-10-26T06:53:49.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.647 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.647 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.648 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.648 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.648 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.648 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.649 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.649 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.649 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.649 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.650 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.650 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.650 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.650 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.651 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.651 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2023-10-26T06:53:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2023-10-26T06:53:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.653 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.653 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.653 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.653 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.654 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.654 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.654 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.655 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2023-10-26T06:53:49.655 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2023-10-26T06:53:49.655 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.656 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.656 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.656 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2023-10-26T06:53:49.656 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.657 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.657 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2023-10-26T06:53:49.657 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2023-10-26T06:53:49.657 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2023-10-26T06:53:49.658 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2023-10-26T06:53:49.658 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2023-10-26T06:53:49.658 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2023-10-26T06:53:49.658 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2023-10-26T06:53:49.659 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.659 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.659 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2023-10-26T06:53:49.660 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2023-10-26T06:53:49.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2023-10-26T06:53:49.661 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2023-10-26T06:53:49.661 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2023-10-26T06:53:49.662 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.662 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.662 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.662 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.663 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.663 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.663 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.664 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2023-10-26T06:53:49.664 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2023-10-26T06:53:49.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.664 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.665 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2023-10-26T06:53:49.665 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.665 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.666 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.666 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.666 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.667 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.667 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2023-10-26T06:53:49.667 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2023-10-26T06:53:49.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2023-10-26T06:53:49.668 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.668 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.668 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2023-10-26T06:53:49.669 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.669 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.669 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.669 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.670 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.671 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2023-10-26T06:53:49.671 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2023-10-26T06:53:49.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2023-10-26T06:53:49.672 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2023-10-26T06:53:49.672 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2023-10-26T06:53:49.672 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-26T06:53:49.672 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2023-10-26T06:53:49.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2023-10-26T06:53:49.673 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2023-10-26T06:53:49.673 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2023-10-26T06:53:49.673 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2023-10-26T06:53:49.674 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2023-10-26T06:53:49.674 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2023-10-26T06:53:49.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.675 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.675 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.675 INFO:teuthology.orchestra.run.smithi050.stdout: "services": { 2023-10-26T06:53:49.676 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard": "https://172.21.15.50:8443/" 2023-10-26T06:53:49.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.676 INFO:teuthology.orchestra.run.smithi050.stdout: "always_on_modules": { 2023-10-26T06:53:49.676 INFO:teuthology.orchestra.run.smithi050.stdout: "octopus": [ 2023-10-26T06:53:49.676 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2023-10-26T06:53:49.677 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-10-26T06:53:49.677 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2023-10-26T06:53:49.677 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2023-10-26T06:53:49.677 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2023-10-26T06:53:49.678 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2023-10-26T06:53:49.678 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2023-10-26T06:53:49.678 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2023-10-26T06:53:49.679 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2023-10-26T06:53:49.679 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2023-10-26T06:53:49.679 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.679 INFO:teuthology.orchestra.run.smithi050.stdout: "pacific": [ 2023-10-26T06:53:49.679 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2023-10-26T06:53:49.680 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-10-26T06:53:49.680 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2023-10-26T06:53:49.680 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2023-10-26T06:53:49.680 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2023-10-26T06:53:49.681 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2023-10-26T06:53:49.681 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2023-10-26T06:53:49.681 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2023-10-26T06:53:49.681 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2023-10-26T06:53:49.682 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2023-10-26T06:53:49.682 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.682 INFO:teuthology.orchestra.run.smithi050.stdout: "quincy": [ 2023-10-26T06:53:49.683 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2023-10-26T06:53:49.683 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-10-26T06:53:49.683 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2023-10-26T06:53:49.683 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2023-10-26T06:53:49.683 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2023-10-26T06:53:49.684 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2023-10-26T06:53:49.684 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2023-10-26T06:53:49.684 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2023-10-26T06:53:49.684 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2023-10-26T06:53:49.685 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2023-10-26T06:53:49.685 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-10-26T06:53:49.685 INFO:teuthology.orchestra.run.smithi050.stdout: "reef": [ 2023-10-26T06:53:49.685 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2023-10-26T06:53:49.686 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2023-10-26T06:53:49.686 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2023-10-26T06:53:49.686 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2023-10-26T06:53:49.686 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2023-10-26T06:53:49.687 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2023-10-26T06:53:49.687 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2023-10-26T06:53:49.687 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2023-10-26T06:53:49.687 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2023-10-26T06:53:49.688 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2023-10-26T06:53:49.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.688 INFO:teuthology.orchestra.run.smithi050.stdout: "last_failure_osd_epoch": 5, 2023-10-26T06:53:49.689 INFO:teuthology.orchestra.run.smithi050.stdout: "active_clients": [ 2023-10-26T06:53:49.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.689 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2023-10-26T06:53:49.689 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:49.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:49.690 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2023-10-26T06:53:49.690 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3997259714 2023-10-26T06:53:49.691 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.691 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.692 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "libcephsqlite", 2023-10-26T06:53:49.692 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:49.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2023-10-26T06:53:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2388389662 2023-10-26T06:53:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2023-10-26T06:53:49.694 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:49.695 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2023-10-26T06:53:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1960216599 2023-10-26T06:53:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2023-10-26T06:53:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:49.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:49.698 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2023-10-26T06:53:49.698 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1590000045 2023-10-26T06:53:49.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.699 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.699 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2023-10-26T06:53:49.700 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:49.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:49.700 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2023-10-26T06:53:49.701 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2641833641 2023-10-26T06:53:49.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.701 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:49.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.702 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2023-10-26T06:53:49.702 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2023-10-26T06:53:49.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-10-26T06:53:49.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2023-10-26T06:53:49.703 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2023-10-26T06:53:49.703 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 290566375 2023-10-26T06:53:49.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.704 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:49.704 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-10-26T06:53:49.705 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:53:49.711 DEBUG:tasks.check_counter:Getting stats from a 2023-10-26T06:53:49.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-26T06:53:49.713 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:45 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/511056736' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:53:49.713 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:45 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2998044882' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-26T06:53:49.713 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:46 smithi050 ceph-mon[94997]: pgmap v630: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 465 KiB/s wr, 19 op/s 2023-10-26T06:53:49.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:48 smithi050 ceph-mon[94997]: pgmap v631: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 457 KiB/s wr, 20 op/s 2023-10-26T06:53:49.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:48 smithi153 ceph-mon[131657]: pgmap v631: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 457 KiB/s wr, 20 op/s 2023-10-26T06:53:49.715 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:48 smithi125 ceph-mon[130643]: pgmap v631: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 457 KiB/s wr, 20 op/s 2023-10-26T06:53:50.468 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:53:51.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:50 smithi050 ceph-mon[94997]: pgmap v632: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 447 KiB/s wr, 17 op/s 2023-10-26T06:53:51.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:50 smithi125 ceph-mon[130643]: pgmap v632: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 447 KiB/s wr, 17 op/s 2023-10-26T06:53:51.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:50 smithi153 ceph-mon[131657]: pgmap v632: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 447 KiB/s wr, 17 op/s 2023-10-26T06:53:52.066 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:53:52.067 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:53:52.067 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 207, 2023-10-26T06:53:52.067 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 202, 2023-10-26T06:53:52.068 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 741376, 2023-10-26T06:53:52.068 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 121040, 2023-10-26T06:53:52.068 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2023-10-26T06:53:52.068 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2023-10-26T06:53:52.069 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.050239046, 2023-10-26T06:53:52.069 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.020032217, 2023-10-26T06:53:52.069 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.023542263, 2023-10-26T06:53:52.069 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005340231, 2023-10-26T06:53:52.070 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:52.070 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 201, 2023-10-26T06:53:52.070 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.023281724, 2023-10-26T06:53:52.070 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000115829 2023-10-26T06:53:52.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.071 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:52.071 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:52.071 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:52.072 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:52.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.074 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 741376, 2023-10-26T06:53:52.074 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 121040 2023-10-26T06:53:52.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.075 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:53:52.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 5, 2023-10-26T06:53:52.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 155, 2023-10-26T06:53:52.075 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3152, 2023-10-26T06:53:52.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 103904, 2023-10-26T06:53:52.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2023-10-26T06:53:52.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2023-10-26T06:53:52.076 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.018385800, 2023-10-26T06:53:52.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.014318678, 2023-10-26T06:53:52.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.002042084, 2023-10-26T06:53:52.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:53:52.077 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:52.078 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 154, 2023-10-26T06:53:52.078 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.015536179, 2023-10-26T06:53:52.078 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000100884 2023-10-26T06:53:52.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.079 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:52.079 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:52.079 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:52.079 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:52.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.080 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:53:52.080 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 103904 2023-10-26T06:53:52.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.081 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:53:52.081 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2023-10-26T06:53:52.081 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2023-10-26T06:53:52.081 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2023-10-26T06:53:52.082 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2023-10-26T06:53:52.082 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2023-10-26T06:53:52.082 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2023-10-26T06:53:52.083 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.001025431, 2023-10-26T06:53:52.083 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2023-10-26T06:53:52.083 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000898249, 2023-10-26T06:53:52.083 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:53:52.084 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:52.084 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:52.084 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:52.084 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:52.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.085 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:52.085 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:52.085 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:52.086 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:52.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.086 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:53:52.086 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:53:52.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.087 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2023-10-26T06:53:52.087 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2023-10-26T06:53:52.087 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2023-10-26T06:53:52.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.088 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2023-10-26T06:53:52.088 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:53:52.088 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2023-10-26T06:53:52.089 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:53:52.089 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:53:52.089 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:53:52.089 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:53:52.090 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:53:52.090 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:53:52.090 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:53:52.090 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:53:52.091 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:53:52.091 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:53:52.091 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:53:52.091 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:53:52.092 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:53:52.092 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2023-10-26T06:53:52.092 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:53:52.092 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2023-10-26T06:53:52.093 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:53:52.093 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:53:52.093 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:53:52.094 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:53:52.094 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:53:52.094 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:53:52.094 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:53:52.095 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2023-10-26T06:53:52.095 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:53:52.095 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:53:52.095 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:53:52.096 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2023-10-26T06:53:52.096 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2023-10-26T06:53:52.096 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2023-10-26T06:53:52.096 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:53:52.097 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:53:52.097 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:53:52.097 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:53:52.097 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148967, 2023-10-26T06:53:52.098 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2023-10-26T06:53:52.098 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:53:52.098 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2023-10-26T06:53:52.098 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2023-10-26T06:53:52.099 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2023-10-26T06:53:52.099 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:53:52.099 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2023-10-26T06:53:52.099 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:53:52.100 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2023-10-26T06:53:52.100 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2023-10-26T06:53:52.100 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2023-10-26T06:53:52.100 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:53:52.100 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:53:52.101 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2023-10-26T06:53:52.101 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2023-10-26T06:53:52.101 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2023-10-26T06:53:52.101 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2023-10-26T06:53:52.102 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2023-10-26T06:53:52.102 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2023-10-26T06:53:52.102 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2023-10-26T06:53:52.102 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2023-10-26T06:53:52.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:52.103 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:53:52.103 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2023-10-26T06:53:52.103 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2023-10-26T06:53:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2023-10-26T06:53:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 208, 2023-10-26T06:53:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 712130, 2023-10-26T06:53:52.104 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2023-10-26T06:53:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 208, 2023-10-26T06:53:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2023-10-26T06:53:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2023-10-26T06:53:52.105 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 208, 2023-10-26T06:53:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 712130, 2023-10-26T06:53:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2023-10-26T06:53:52.106 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:52.107 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:52.107 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:53:52.676 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-10-26T06:53:52.676 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-10-26T06:53:52.677 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-10-26T06:53:52.677 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-10-26T06:53:52.677 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2023-10-26T06:53:52.677 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2023-10-26T06:53:52.678 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2023-10-26T06:53:52.678 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2023-10-26T06:53:52.678 DEBUG:tasks.check_counter:Getting stats from d 2023-10-26T06:53:52.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-26T06:53:53.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:52 smithi125 ceph-mon[130643]: pgmap v633: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 456 KiB/s wr, 20 op/s 2023-10-26T06:53:53.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:52 smithi153 ceph-mon[131657]: pgmap v633: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 456 KiB/s wr, 20 op/s 2023-10-26T06:53:53.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:52 smithi050 ceph-mon[94997]: pgmap v633: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 456 KiB/s wr, 20 op/s 2023-10-26T06:53:53.428 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:53:54.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:54 smithi050 ceph-mon[94997]: pgmap v634: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 12 op/s 2023-10-26T06:53:54.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:54 smithi125 ceph-mon[130643]: pgmap v634: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 12 op/s 2023-10-26T06:53:54.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:54 smithi153 ceph-mon[131657]: pgmap v634: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 12 op/s 2023-10-26T06:53:55.007 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:53:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:53:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2023-10-26T06:53:55.008 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2023-10-26T06:53:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2023-10-26T06:53:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2023-10-26T06:53:55.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2023-10-26T06:53:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2023-10-26T06:53:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.003748738, 2023-10-26T06:53:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2023-10-26T06:53:55.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000671270, 2023-10-26T06:53:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:53:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:55.011 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:55.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:55.013 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.014 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:53:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:53:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:53:55.015 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 213, 2023-10-26T06:53:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 208, 2023-10-26T06:53:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 743072, 2023-10-26T06:53:55.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 124320, 2023-10-26T06:53:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2023-10-26T06:53:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2023-10-26T06:53:55.017 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.049410174, 2023-10-26T06:53:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.021793988, 2023-10-26T06:53:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.023443569, 2023-10-26T06:53:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005730055, 2023-10-26T06:53:55.018 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 207, 2023-10-26T06:53:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.022012791, 2023-10-26T06:53:55.019 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000106341 2023-10-26T06:53:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:55.020 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:55.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 743072, 2023-10-26T06:53:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 124320 2023-10-26T06:53:55.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:53:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 5, 2023-10-26T06:53:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 160, 2023-10-26T06:53:55.023 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3152, 2023-10-26T06:53:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 104784, 2023-10-26T06:53:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2023-10-26T06:53:55.024 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2023-10-26T06:53:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.018580309, 2023-10-26T06:53:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.014337502, 2023-10-26T06:53:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.002253222, 2023-10-26T06:53:55.025 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:53:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 159, 2023-10-26T06:53:55.026 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.020766836, 2023-10-26T06:53:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000130609 2023-10-26T06:53:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.027 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:55.028 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:53:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 104784 2023-10-26T06:53:55.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2023-10-26T06:53:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2023-10-26T06:53:55.030 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2023-10-26T06:53:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2023-10-26T06:53:55.031 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:53:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2023-10-26T06:53:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:53:55.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:53:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:53:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:53:55.033 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:53:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:53:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:53:55.034 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:53:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:53:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:53:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:53:55.035 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:53:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:53:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2023-10-26T06:53:55.036 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:53:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2023-10-26T06:53:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:53:55.037 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:53:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:53:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:53:55.038 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:53:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:53:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:53:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2023-10-26T06:53:55.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:53:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:53:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:53:55.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2023-10-26T06:53:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2023-10-26T06:53:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2023-10-26T06:53:55.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:53:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:53:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:53:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:53:55.042 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148967, 2023-10-26T06:53:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2023-10-26T06:53:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:53:55.043 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2023-10-26T06:53:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2023-10-26T06:53:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2023-10-26T06:53:55.044 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:53:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2023-10-26T06:53:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:53:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2023-10-26T06:53:55.045 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2023-10-26T06:53:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2023-10-26T06:53:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:53:55.046 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:53:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2023-10-26T06:53:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2023-10-26T06:53:55.047 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2023-10-26T06:53:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2023-10-26T06:53:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2023-10-26T06:53:55.048 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2023-10-26T06:53:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2023-10-26T06:53:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2023-10-26T06:53:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:55.049 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:53:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2023-10-26T06:53:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2023-10-26T06:53:55.050 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2023-10-26T06:53:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 214, 2023-10-26T06:53:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 712974, 2023-10-26T06:53:55.051 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2023-10-26T06:53:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 214, 2023-10-26T06:53:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2023-10-26T06:53:55.052 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2023-10-26T06:53:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 214, 2023-10-26T06:53:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 712974, 2023-10-26T06:53:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2023-10-26T06:53:55.053 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:55.054 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:55.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:55.055 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:53:55.527 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-26T06:53:55.528 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-26T06:53:55.528 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-26T06:53:55.528 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-26T06:53:55.529 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-26T06:53:55.529 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-26T06:53:55.529 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-26T06:53:55.530 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-10-26T06:53:55.530 DEBUG:tasks.check_counter:Getting stats from g 2023-10-26T06:53:55.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-26T06:53:56.277 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:53:57.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:56 smithi125 ceph-mon[130643]: pgmap v635: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 11 op/s 2023-10-26T06:53:57.208 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:56 smithi050 ceph-mon[94997]: pgmap v635: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 11 op/s 2023-10-26T06:53:57.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:56 smithi153 ceph-mon[131657]: pgmap v635: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 11 op/s 2023-10-26T06:53:58.000 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:53:58.001 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:53:58.001 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 209, 2023-10-26T06:53:58.002 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 204, 2023-10-26T06:53:58.002 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 741920, 2023-10-26T06:53:58.002 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 122288, 2023-10-26T06:53:58.002 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2023-10-26T06:53:58.003 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2023-10-26T06:53:58.003 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.052961007, 2023-10-26T06:53:58.003 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.021480299, 2023-10-26T06:53:58.004 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.026090928, 2023-10-26T06:53:58.004 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005658868, 2023-10-26T06:53:58.004 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:58.004 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 203, 2023-10-26T06:53:58.005 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.025450951, 2023-10-26T06:53:58.005 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000125374 2023-10-26T06:53:58.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.006 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:58.006 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:58.006 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:58.006 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:58.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.007 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 741920, 2023-10-26T06:53:58.007 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 122288 2023-10-26T06:53:58.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.008 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:53:58.008 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1, 2023-10-26T06:53:58.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 155, 2023-10-26T06:53:58.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 160, 2023-10-26T06:53:58.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 103808, 2023-10-26T06:53:58.009 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2023-10-26T06:53:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2023-10-26T06:53:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.018234297, 2023-10-26T06:53:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.014323801, 2023-10-26T06:53:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001799184, 2023-10-26T06:53:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:53:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 153, 2023-10-26T06:53:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.016435707, 2023-10-26T06:53:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000107422 2023-10-26T06:53:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-26T06:53:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 103808 2023-10-26T06:53:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:53:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 4, 2023-10-26T06:53:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 4, 2023-10-26T06:53:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 2992, 2023-10-26T06:53:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 448, 2023-10-26T06:53:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2023-10-26T06:53:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2023-10-26T06:53:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.001179061, 2023-10-26T06:53:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000052944, 2023-10-26T06:53:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001086842, 2023-10-26T06:53:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:53:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:53:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3, 2023-10-26T06:53:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.001405208, 2023-10-26T06:53:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000468402 2023-10-26T06:53:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:53:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-26T06:53:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 448 2023-10-26T06:53:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2023-10-26T06:53:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2023-10-26T06:53:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2023-10-26T06:53:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2023-10-26T06:53:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:53:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2023-10-26T06:53:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:53:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:53:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:53:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:53:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:53:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:53:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:53:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:53:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:53:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:53:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:53:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:53:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:53:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2023-10-26T06:53:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:53:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2023-10-26T06:53:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:53:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:53:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:53:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:53:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:53:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:53:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:53:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2023-10-26T06:53:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:53:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:53:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:53:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2023-10-26T06:53:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2023-10-26T06:53:58.034 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2023-10-26T06:53:58.034 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:53:58.034 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:53:58.035 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:53:58.035 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:53:58.035 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148967, 2023-10-26T06:53:58.035 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2023-10-26T06:53:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:53:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2023-10-26T06:53:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2023-10-26T06:53:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2023-10-26T06:53:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:53:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2023-10-26T06:53:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:53:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2023-10-26T06:53:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2023-10-26T06:53:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2023-10-26T06:53:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:53:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:53:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2023-10-26T06:53:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2023-10-26T06:53:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2023-10-26T06:53:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2023-10-26T06:53:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2023-10-26T06:53:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2023-10-26T06:53:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2023-10-26T06:53:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2023-10-26T06:53:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:53:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:53:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2023-10-26T06:53:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2023-10-26T06:53:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2023-10-26T06:53:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 210, 2023-10-26T06:53:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 712390, 2023-10-26T06:53:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2023-10-26T06:53:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 210, 2023-10-26T06:53:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2023-10-26T06:53:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2023-10-26T06:53:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 210, 2023-10-26T06:53:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 712390, 2023-10-26T06:53:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2023-10-26T06:53:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:53:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:53:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:53:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:53:58.047 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:53:58.578 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-10-26T06:53:58.579 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-10-26T06:53:58.579 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-10-26T06:53:58.580 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-10-26T06:53:58.580 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2023-10-26T06:53:58.580 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2023-10-26T06:53:58.581 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2023-10-26T06:53:58.581 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2023-10-26T06:53:58.581 DEBUG:tasks.check_counter:Getting stats from j 2023-10-26T06:53:58.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-26T06:53:59.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:58 smithi125 ceph-mon[130643]: pgmap v636: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-10-26T06:53:59.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:58 smithi153 ceph-mon[131657]: pgmap v636: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-10-26T06:53:59.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:58 smithi050 ceph-mon[94997]: pgmap v636: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-10-26T06:53:59.329 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.a/config 2023-10-26T06:54:00.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:53:59 smithi153 ceph-mon[131657]: pgmap v637: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-10-26T06:54:00.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:53:59 smithi050 ceph-mon[94997]: pgmap v637: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-10-26T06:54:00.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:53:59 smithi125 ceph-mon[130643]: pgmap v637: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-10-26T06:54:01.160 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-10-26T06:54:01.161 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:01.161 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2023-10-26T06:54:01.161 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2023-10-26T06:54:01.162 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2023-10-26T06:54:01.162 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2023-10-26T06:54:01.162 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2023-10-26T06:54:01.163 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2023-10-26T06:54:01.163 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.003624649, 2023-10-26T06:54:01.163 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2023-10-26T06:54:01.163 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000940277, 2023-10-26T06:54:01.164 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:54:01.164 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:01.164 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:54:01.165 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:54:01.165 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:54:01.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.165 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:01.166 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:54:01.166 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:54:01.166 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:54:01.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.167 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:01.167 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:01.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.168 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:01.168 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 216, 2023-10-26T06:54:01.168 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 211, 2023-10-26T06:54:01.169 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 743888, 2023-10-26T06:54:01.169 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 126192, 2023-10-26T06:54:01.169 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2023-10-26T06:54:01.169 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2023-10-26T06:54:01.170 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.048673656, 2023-10-26T06:54:01.170 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.015825234, 2023-10-26T06:54:01.170 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.024862283, 2023-10-26T06:54:01.170 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.006417565, 2023-10-26T06:54:01.171 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:01.171 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 210, 2023-10-26T06:54:01.171 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.022768063, 2023-10-26T06:54:01.172 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000108419 2023-10-26T06:54:01.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.172 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:01.172 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:54:01.173 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:54:01.173 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:54:01.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.174 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 743888, 2023-10-26T06:54:01.174 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 126192 2023-10-26T06:54:01.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.174 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:01.175 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 5, 2023-10-26T06:54:01.175 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 161, 2023-10-26T06:54:01.175 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3152, 2023-10-26T06:54:01.176 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 104960, 2023-10-26T06:54:01.176 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2023-10-26T06:54:01.176 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2023-10-26T06:54:01.176 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.017540483, 2023-10-26T06:54:01.177 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.013728161, 2023-10-26T06:54:01.177 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.002080715, 2023-10-26T06:54:01.177 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:54:01.178 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:01.178 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 160, 2023-10-26T06:54:01.178 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.016135134, 2023-10-26T06:54:01.178 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000100844 2023-10-26T06:54:01.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.179 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:01.179 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:54:01.179 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:54:01.180 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:54:01.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.180 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:54:01.181 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 104960 2023-10-26T06:54:01.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.181 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2023-10-26T06:54:01.181 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2023-10-26T06:54:01.182 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2023-10-26T06:54:01.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.183 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2023-10-26T06:54:01.183 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:01.183 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:01.183 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:01.184 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:01.184 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:01.184 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:01.184 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:01.185 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:01.185 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:01.185 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:01.185 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:01.186 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:01.186 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:01.186 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2023-10-26T06:54:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 149998, 2023-10-26T06:54:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 30, 2023-10-26T06:54:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:54:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2023-10-26T06:54:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2023-10-26T06:54:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2023-10-26T06:54:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2023-10-26T06:54:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2023-10-26T06:54:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2023-10-26T06:54:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2023-10-26T06:54:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2023-10-26T06:54:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2023-10-26T06:54:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2023-10-26T06:54:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-10-26T06:54:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2023-10-26T06:54:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2023-10-26T06:54:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2023-10-26T06:54:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 217, 2023-10-26T06:54:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 713364, 2023-10-26T06:54:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 217, 2023-10-26T06:54:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2023-10-26T06:54:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2023-10-26T06:54:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 217, 2023-10-26T06:54:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 713364, 2023-10-26T06:54:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2023-10-26T06:54:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2023-10-26T06:54:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2023-10-26T06:54:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2023-10-26T06:54:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:54:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-10-26T06:54:01.204 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-10-26T06:54:01.632 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-26T06:54:01.633 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-26T06:54:01.633 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-26T06:54:01.634 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-26T06:54:01.634 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-26T06:54:01.634 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-26T06:54:01.634 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-26T06:54:01.635 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-10-26T06:54:01.635 DEBUG:tasks.check_counter:Getting stats from b 2023-10-26T06:54:01.635 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-26T06:54:02.214 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:54:03.094 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:02 smithi125 ceph-mon[130643]: pgmap v638: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-10-26T06:54:03.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:02 smithi153 ceph-mon[131657]: pgmap v638: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-10-26T06:54:03.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:02 smithi050 ceph-mon[94997]: pgmap v638: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-10-26T06:54:03.774 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-26T06:54:03.775 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:03.775 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 68526, 2023-10-26T06:54:03.775 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 57842, 2023-10-26T06:54:03.775 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 32949249, 2023-10-26T06:54:03.776 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 243865411, 2023-10-26T06:54:03.776 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 14, 2023-10-26T06:54:03.776 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 4, 2023-10-26T06:54:03.776 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 3.576050133, 2023-10-26T06:54:03.777 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 1.437857913, 2023-10-26T06:54:03.777 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 1.151511785, 2023-10-26T06:54:03.777 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.996522327, 2023-10-26T06:54:03.778 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:03.778 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 57845, 2023-10-26T06:54:03.778 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 9.393208171, 2023-10-26T06:54:03.778 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000162385 2023-10-26T06:54:03.779 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.779 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:03.779 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 39611, 2023-10-26T06:54:03.780 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.004577781, 2023-10-26T06:54:03.780 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000115 2023-10-26T06:54:03.780 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.780 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 322336, 2023-10-26T06:54:03.781 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 97728 2023-10-26T06:54:03.781 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.781 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:03.782 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 209457, 2023-10-26T06:54:03.782 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 374322, 2023-10-26T06:54:03.782 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 72639904, 2023-10-26T06:54:03.782 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 278638307, 2023-10-26T06:54:03.783 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 86, 2023-10-26T06:54:03.783 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 9, 2023-10-26T06:54:03.783 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 9.372300546, 2023-10-26T06:54:03.783 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 4.408636904, 2023-10-26T06:54:03.784 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 7.818713688, 2023-10-26T06:54:03.784 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.980412091, 2023-10-26T06:54:03.784 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:03.785 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 374321, 2023-10-26T06:54:03.785 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 31.823704997, 2023-10-26T06:54:03.785 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000085017 2023-10-26T06:54:03.785 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.786 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:03.786 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 236688, 2023-10-26T06:54:03.786 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.049825344, 2023-10-26T06:54:03.787 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000210 2023-10-26T06:54:03.787 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.787 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 886320, 2023-10-26T06:54:03.787 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 173280 2023-10-26T06:54:03.788 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.788 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:03.788 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 57098, 2023-10-26T06:54:03.788 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 43676, 2023-10-26T06:54:03.789 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 19350714, 2023-10-26T06:54:03.789 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 83096147, 2023-10-26T06:54:03.789 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 11, 2023-10-26T06:54:03.790 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 7, 2023-10-26T06:54:03.790 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 2.621215142, 2023-10-26T06:54:03.790 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.993301665, 2023-10-26T06:54:03.790 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.968536274, 2023-10-26T06:54:03.791 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.732795756, 2023-10-26T06:54:03.791 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:03.791 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 43670, 2023-10-26T06:54:03.791 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 8.249831429, 2023-10-26T06:54:03.792 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000188913 2023-10-26T06:54:03.792 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.792 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:03.793 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 31928, 2023-10-26T06:54:03.793 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.003704360, 2023-10-26T06:54:03.793 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000116 2023-10-26T06:54:03.793 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.794 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-26T06:54:03.794 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 354144 2023-10-26T06:54:03.794 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.794 INFO:teuthology.orchestra.run.smithi125.stdout: "cct": { 2023-10-26T06:54:03.795 INFO:teuthology.orchestra.run.smithi125.stdout: "total_workers": 1, 2023-10-26T06:54:03.795 INFO:teuthology.orchestra.run.smithi125.stdout: "unhealthy_workers": 0 2023-10-26T06:54:03.795 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.796 INFO:teuthology.orchestra.run.smithi125.stdout: "finisher-MDSRank": { 2023-10-26T06:54:03.796 INFO:teuthology.orchestra.run.smithi125.stdout: "queue_len": 0, 2023-10-26T06:54:03.796 INFO:teuthology.orchestra.run.smithi125.stdout: "complete_latency": { 2023-10-26T06:54:03.796 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 72847, 2023-10-26T06:54:03.797 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 110.428266164, 2023-10-26T06:54:03.797 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.001515893 2023-10-26T06:54:03.797 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.797 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.798 INFO:teuthology.orchestra.run.smithi125.stdout: "finisher-PurgeQueue": { 2023-10-26T06:54:03.798 INFO:teuthology.orchestra.run.smithi125.stdout: "queue_len": 0, 2023-10-26T06:54:03.798 INFO:teuthology.orchestra.run.smithi125.stdout: "complete_latency": { 2023-10-26T06:54:03.799 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 2570, 2023-10-26T06:54:03.799 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.237076159, 2023-10-26T06:54:03.799 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000092247 2023-10-26T06:54:03.799 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.800 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.800 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": { 2023-10-26T06:54:03.800 INFO:teuthology.orchestra.run.smithi125.stdout: "request": 66441, 2023-10-26T06:54:03.800 INFO:teuthology.orchestra.run.smithi125.stdout: "reply": 65641, 2023-10-26T06:54:03.801 INFO:teuthology.orchestra.run.smithi125.stdout: "reply_latency": { 2023-10-26T06:54:03.801 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 65641, 2023-10-26T06:54:03.801 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 1330.627174451, 2023-10-26T06:54:03.802 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.020271281 2023-10-26T06:54:03.802 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.802 INFO:teuthology.orchestra.run.smithi125.stdout: "slow_reply": 0, 2023-10-26T06:54:03.803 INFO:teuthology.orchestra.run.smithi125.stdout: "forward": 800, 2023-10-26T06:54:03.803 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_fetch_complete": 109, 2023-10-26T06:54:03.803 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_fetch_keys": 1, 2023-10-26T06:54:03.803 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_commit": 1488, 2023-10-26T06:54:03.804 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_split": 95, 2023-10-26T06:54:03.804 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_merge": 0, 2023-10-26T06:54:03.804 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes": 6783, 2023-10-26T06:54:03.804 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_top": 0, 2023-10-26T06:54:03.805 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_bottom": 0, 2023-10-26T06:54:03.805 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_pin_tail": 6783, 2023-10-26T06:54:03.805 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_pinned": 6783, 2023-10-26T06:54:03.805 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_expired": 66311, 2023-10-26T06:54:03.806 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_with_caps": 5768, 2023-10-26T06:54:03.806 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": 5768, 2023-10-26T06:54:03.806 INFO:teuthology.orchestra.run.smithi125.stdout: "subtrees": 74, 2023-10-26T06:54:03.807 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse": 70108, 2023-10-26T06:54:03.807 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_hit": 67189, 2023-10-26T06:54:03.807 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_forward": 760, 2023-10-26T06:54:03.807 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_discover": 454, 2023-10-26T06:54:03.808 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_dir_fetch": 2, 2023-10-26T06:54:03.808 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_remote_ino": 0, 2023-10-26T06:54:03.808 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_lock": 0, 2023-10-26T06:54:03.808 INFO:teuthology.orchestra.run.smithi125.stdout: "load_cent": 435, 2023-10-26T06:54:03.809 INFO:teuthology.orchestra.run.smithi125.stdout: "q": 0, 2023-10-26T06:54:03.809 INFO:teuthology.orchestra.run.smithi125.stdout: "exported": 227, 2023-10-26T06:54:03.809 INFO:teuthology.orchestra.run.smithi125.stdout: "exported_inodes": 65352, 2023-10-26T06:54:03.809 INFO:teuthology.orchestra.run.smithi125.stdout: "imported": 12, 2023-10-26T06:54:03.810 INFO:teuthology.orchestra.run.smithi125.stdout: "imported_inodes": 9472, 2023-10-26T06:54:03.810 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_dir_fetch": 0, 2023-10-26T06:54:03.810 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_backtrace_fetch": 107964, 2023-10-26T06:54:03.810 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_peer_discover": 0, 2023-10-26T06:54:03.811 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rfiles": 74443, 2023-10-26T06:54:03.811 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rbytes": 1237542278, 2023-10-26T06:54:03.811 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rsnaps": 6, 2023-10-26T06:54:03.811 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_backtrace_fetch": 107964, 2023-10-26T06:54:03.812 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_set_tag": 0, 2023-10-26T06:54:03.812 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_backtrace_repaired": 0, 2023-10-26T06:54:03.812 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_inotable_repaired": 0, 2023-10-26T06:54:03.813 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dir_inodes": 6773, 2023-10-26T06:54:03.813 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dir_base_inodes": 10, 2023-10-26T06:54:03.813 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dirfrag_rstats": 6763, 2023-10-26T06:54:03.813 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_file_inodes": 101191, 2023-10-26T06:54:03.814 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_inode_file_caps": 23, 2023-10-26T06:54:03.814 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_revoke": 4378, 2023-10-26T06:54:03.814 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_grant": 62402, 2023-10-26T06:54:03.815 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_trunc": 88, 2023-10-26T06:54:03.815 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-26T06:54:03.815 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-26T06:54:03.815 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_caps": 92697, 2023-10-26T06:54:03.816 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_caps_dirty": 60872, 2023-10-26T06:54:03.816 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_cap_release": 1283, 2023-10-26T06:54:03.816 INFO:teuthology.orchestra.run.smithi125.stdout: "process_request_cap_release": 6109 2023-10-26T06:54:03.816 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.817 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_cache": { 2023-10-26T06:54:03.817 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_update": 941, 2023-10-26T06:54:03.817 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_update_receipt": 2024, 2023-10-26T06:54:03.817 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_try_discover": 1310, 2023-10-26T06:54:03.818 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_send_discover": 1407, 2023-10-26T06:54:03.818 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_handle_discover": 1668, 2023-10-26T06:54:03.818 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays": 0, 2023-10-26T06:54:03.819 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays_delayed": 0, 2023-10-26T06:54:03.819 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays_enqueuing": 0, 2023-10-26T06:54:03.819 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_created": 1356, 2023-10-26T06:54:03.819 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_enqueued": 1356, 2023-10-26T06:54:03.820 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_reintegrated": 0, 2023-10-26T06:54:03.820 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_migrated": 0, 2023-10-26T06:54:03.820 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_processing": 0, 2023-10-26T06:54:03.820 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_enqueued": 0, 2023-10-26T06:54:03.821 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_prioritized": 0, 2023-10-26T06:54:03.821 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_started": 0, 2023-10-26T06:54:03.821 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_completed": 0, 2023-10-26T06:54:03.822 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_enqueue_scrub": 10, 2023-10-26T06:54:03.822 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_exportdir": 229, 2023-10-26T06:54:03.822 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_flush": 0, 2023-10-26T06:54:03.822 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_fragmentdir": 96, 2023-10-26T06:54:03.823 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_fragstats": 0, 2023-10-26T06:54:03.823 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_inodestats": 0 2023-10-26T06:54:03.823 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.823 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_log": { 2023-10-26T06:54:03.824 INFO:teuthology.orchestra.run.smithi125.stdout: "evlrg": 1, 2023-10-26T06:54:03.824 INFO:teuthology.orchestra.run.smithi125.stdout: "evadd": 158942, 2023-10-26T06:54:03.824 INFO:teuthology.orchestra.run.smithi125.stdout: "evex": 51176, 2023-10-26T06:54:03.825 INFO:teuthology.orchestra.run.smithi125.stdout: "evtrm": 49161, 2023-10-26T06:54:03.825 INFO:teuthology.orchestra.run.smithi125.stdout: "ev": 109781, 2023-10-26T06:54:03.825 INFO:teuthology.orchestra.run.smithi125.stdout: "evexg": 0, 2023-10-26T06:54:03.825 INFO:teuthology.orchestra.run.smithi125.stdout: "evexd": 2015, 2023-10-26T06:54:03.826 INFO:teuthology.orchestra.run.smithi125.stdout: "segadd": 184, 2023-10-26T06:54:03.826 INFO:teuthology.orchestra.run.smithi125.stdout: "segex": 56, 2023-10-26T06:54:03.826 INFO:teuthology.orchestra.run.smithi125.stdout: "segtrm": 53, 2023-10-26T06:54:03.826 INFO:teuthology.orchestra.run.smithi125.stdout: "seg": 131, 2023-10-26T06:54:03.827 INFO:teuthology.orchestra.run.smithi125.stdout: "segmjr": 9, 2023-10-26T06:54:03.827 INFO:teuthology.orchestra.run.smithi125.stdout: "segexg": 0, 2023-10-26T06:54:03.827 INFO:teuthology.orchestra.run.smithi125.stdout: "segexd": 3, 2023-10-26T06:54:03.827 INFO:teuthology.orchestra.run.smithi125.stdout: "expos": 108971669, 2023-10-26T06:54:03.828 INFO:teuthology.orchestra.run.smithi125.stdout: "wrpos": 388056241, 2023-10-26T06:54:03.828 INFO:teuthology.orchestra.run.smithi125.stdout: "rdpos": 0, 2023-10-26T06:54:03.828 INFO:teuthology.orchestra.run.smithi125.stdout: "jlat": { 2023-10-26T06:54:03.828 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 3879, 2023-10-26T06:54:03.829 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 274.633065951, 2023-10-26T06:54:03.829 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.070799965 2023-10-26T06:54:03.829 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.830 INFO:teuthology.orchestra.run.smithi125.stdout: "replayed": 0 2023-10-26T06:54:03.830 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.830 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_mem": { 2023-10-26T06:54:03.830 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 6443, 2023-10-26T06:54:03.831 INFO:teuthology.orchestra.run.smithi125.stdout: "ino+": 72268, 2023-10-26T06:54:03.831 INFO:teuthology.orchestra.run.smithi125.stdout: "ino-": 65825, 2023-10-26T06:54:03.831 INFO:teuthology.orchestra.run.smithi125.stdout: "dir": 600, 2023-10-26T06:54:03.832 INFO:teuthology.orchestra.run.smithi125.stdout: "dir+": 5618, 2023-10-26T06:54:03.832 INFO:teuthology.orchestra.run.smithi125.stdout: "dir-": 5018, 2023-10-26T06:54:03.832 INFO:teuthology.orchestra.run.smithi125.stdout: "dn": 6783, 2023-10-26T06:54:03.832 INFO:teuthology.orchestra.run.smithi125.stdout: "dn+": 74504, 2023-10-26T06:54:03.833 INFO:teuthology.orchestra.run.smithi125.stdout: "dn-": 67721, 2023-10-26T06:54:03.833 INFO:teuthology.orchestra.run.smithi125.stdout: "cap": 5768, 2023-10-26T06:54:03.833 INFO:teuthology.orchestra.run.smithi125.stdout: "cap+": 69477, 2023-10-26T06:54:03.833 INFO:teuthology.orchestra.run.smithi125.stdout: "cap-": 63709, 2023-10-26T06:54:03.834 INFO:teuthology.orchestra.run.smithi125.stdout: "rss": 191704, 2023-10-26T06:54:03.834 INFO:teuthology.orchestra.run.smithi125.stdout: "heap": 207152 2023-10-26T06:54:03.834 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.835 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_server": { 2023-10-26T06:54:03.835 INFO:teuthology.orchestra.run.smithi125.stdout: "dispatch_client_request": 67640, 2023-10-26T06:54:03.835 INFO:teuthology.orchestra.run.smithi125.stdout: "dispatch_server_request": 181, 2023-10-26T06:54:03.835 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_request": 66441, 2023-10-26T06:54:03.836 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_session": 256, 2023-10-26T06:54:03.836 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_peer_request": 297, 2023-10-26T06:54:03.836 INFO:teuthology.orchestra.run.smithi125.stdout: "req_create_latency": { 2023-10-26T06:54:03.836 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 57693, 2023-10-26T06:54:03.837 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 1241.272976706, 2023-10-26T06:54:03.837 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.021515140 2023-10-26T06:54:03.837 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.838 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getattr_latency": { 2023-10-26T06:54:03.838 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 429, 2023-10-26T06:54:03.838 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 10.322052880, 2023-10-26T06:54:03.839 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.024060729 2023-10-26T06:54:03.839 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.839 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getfilelock_latency": { 2023-10-26T06:54:03.839 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.840 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.840 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.840 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.840 INFO:teuthology.orchestra.run.smithi125.stdout: "req_link_latency": { 2023-10-26T06:54:03.841 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.841 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.841 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.842 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.842 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookup_latency": { 2023-10-26T06:54:03.842 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 1590, 2023-10-26T06:54:03.842 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 7.987285488, 2023-10-26T06:54:03.843 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.005023449 2023-10-26T06:54:03.843 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.843 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookuphash_latency": { 2023-10-26T06:54:03.843 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.844 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.844 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.844 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.844 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupino_latency": { 2023-10-26T06:54:03.845 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.845 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.845 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.845 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.845 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupname_latency": { 2023-10-26T06:54:03.846 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.846 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.846 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.847 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.847 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupparent_latency": { 2023-10-26T06:54:03.847 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.847 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.848 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.848 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.848 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupsnap_latency": { 2023-10-26T06:54:03.848 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.849 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.849 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.849 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.850 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lssnap_latency": { 2023-10-26T06:54:03.850 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 11, 2023-10-26T06:54:03.850 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.005148224, 2023-10-26T06:54:03.851 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000468020 2023-10-26T06:54:03.851 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.851 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mkdir_latency": { 2023-10-26T06:54:03.851 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 3555, 2023-10-26T06:54:03.852 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 62.081707251, 2023-10-26T06:54:03.852 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.017463208 2023-10-26T06:54:03.852 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.853 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mknod_latency": { 2023-10-26T06:54:03.853 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.853 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.853 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.854 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.854 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mksnap_latency": { 2023-10-26T06:54:03.854 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 11, 2023-10-26T06:54:03.855 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 1.925437406, 2023-10-26T06:54:03.855 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.175039764 2023-10-26T06:54:03.855 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.855 INFO:teuthology.orchestra.run.smithi125.stdout: "req_open_latency": { 2023-10-26T06:54:03.856 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 239, 2023-10-26T06:54:03.856 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.127315475, 2023-10-26T06:54:03.856 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000532700 2023-10-26T06:54:03.857 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.857 INFO:teuthology.orchestra.run.smithi125.stdout: "req_readdir_latency": { 2023-10-26T06:54:03.857 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 565, 2023-10-26T06:54:03.857 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 1.332510640, 2023-10-26T06:54:03.858 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.002358425 2023-10-26T06:54:03.858 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.858 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rename_latency": { 2023-10-26T06:54:03.859 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 23, 2023-10-26T06:54:03.859 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.034816311, 2023-10-26T06:54:03.859 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.001513752 2023-10-26T06:54:03.860 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.860 INFO:teuthology.orchestra.run.smithi125.stdout: "req_renamesnap_latency": { 2023-10-26T06:54:03.860 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.860 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.861 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.861 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.861 INFO:teuthology.orchestra.run.smithi125.stdout: "req_snapdiff_latency": { 2023-10-26T06:54:03.861 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.862 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.862 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.862 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.863 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmdir_latency": { 2023-10-26T06:54:03.863 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.863 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.863 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.864 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.864 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmsnap_latency": { 2023-10-26T06:54:03.864 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 5, 2023-10-26T06:54:03.864 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.067440846, 2023-10-26T06:54:03.865 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.013488169 2023-10-26T06:54:03.865 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.865 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmxattr_latency": { 2023-10-26T06:54:03.865 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.866 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.866 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.866 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.867 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setattr_latency": { 2023-10-26T06:54:03.867 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 125, 2023-10-26T06:54:03.867 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 1.905089407, 2023-10-26T06:54:03.867 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.015240715 2023-10-26T06:54:03.868 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.868 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setdirlayout_latency": { 2023-10-26T06:54:03.868 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.868 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.869 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.869 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.869 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setfilelock_latency": { 2023-10-26T06:54:03.869 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.870 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.870 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.870 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.871 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setlayout_latency": { 2023-10-26T06:54:03.871 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.871 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.871 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.872 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.872 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setxattr_latency": { 2023-10-26T06:54:03.872 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 6, 2023-10-26T06:54:03.873 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.017275333, 2023-10-26T06:54:03.873 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.002879222 2023-10-26T06:54:03.873 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.873 INFO:teuthology.orchestra.run.smithi125.stdout: "req_symlink_latency": { 2023-10-26T06:54:03.874 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 33, 2023-10-26T06:54:03.874 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.336035474, 2023-10-26T06:54:03.874 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.010182893 2023-10-26T06:54:03.874 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.875 INFO:teuthology.orchestra.run.smithi125.stdout: "req_unlink_latency": { 2023-10-26T06:54:03.875 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 1356, 2023-10-26T06:54:03.875 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 3.212083010, 2023-10-26T06:54:03.875 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.002368792 2023-10-26T06:54:03.876 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.876 INFO:teuthology.orchestra.run.smithi125.stdout: "cap_revoke_eviction": 0, 2023-10-26T06:54:03.876 INFO:teuthology.orchestra.run.smithi125.stdout: "cap_acquisition_throttle": 0, 2023-10-26T06:54:03.876 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getvxattr_latency": { 2023-10-26T06:54:03.877 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.877 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.877 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.877 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.878 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.878 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_sessions": { 2023-10-26T06:54:03.878 INFO:teuthology.orchestra.run.smithi125.stdout: "session_count": 2, 2023-10-26T06:54:03.878 INFO:teuthology.orchestra.run.smithi125.stdout: "session_add": 3, 2023-10-26T06:54:03.879 INFO:teuthology.orchestra.run.smithi125.stdout: "session_remove": 1, 2023-10-26T06:54:03.879 INFO:teuthology.orchestra.run.smithi125.stdout: "sessions_open": 2, 2023-10-26T06:54:03.879 INFO:teuthology.orchestra.run.smithi125.stdout: "sessions_stale": 0, 2023-10-26T06:54:03.879 INFO:teuthology.orchestra.run.smithi125.stdout: "total_load": 1325, 2023-10-26T06:54:03.880 INFO:teuthology.orchestra.run.smithi125.stdout: "average_load": 662, 2023-10-26T06:54:03.880 INFO:teuthology.orchestra.run.smithi125.stdout: "avg_session_uptime": 613, 2023-10-26T06:54:03.880 INFO:teuthology.orchestra.run.smithi125.stdout: "mdthresh_evicted": 0 2023-10-26T06:54:03.880 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.881 INFO:teuthology.orchestra.run.smithi125.stdout: "mempool": { 2023-10-26T06:54:03.881 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_bytes": 1440, 2023-10-26T06:54:03.881 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_items": 1440, 2023-10-26T06:54:03.882 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:03.882 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:03.882 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:03.882 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:03.883 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:03.883 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:03.883 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:03.884 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:03.884 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:03.884 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:03.884 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:03.885 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:03.885 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:03.885 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:03.886 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:03.886 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:03.886 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:03.886 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:03.887 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:03.887 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:03.887 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:03.888 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:03.888 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:03.888 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:03.888 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:03.889 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:03.889 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:03.889 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:03.889 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:03.890 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_items": 0, 2023-10-26T06:54:03.890 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:03.890 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:03.891 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:03.891 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:03.891 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_bytes": 512014, 2023-10-26T06:54:03.891 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_items": 6439, 2023-10-26T06:54:03.892 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_bytes": 528, 2023-10-26T06:54:03.892 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_items": 6, 2023-10-26T06:54:03.892 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_bytes": 0, 2023-10-26T06:54:03.892 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_items": 0, 2023-10-26T06:54:03.893 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:03.893 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:03.893 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:03.894 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:03.894 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_bytes": 7680, 2023-10-26T06:54:03.894 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_items": 160, 2023-10-26T06:54:03.894 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:03.895 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:03.895 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:03.895 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_items": 0, 2023-10-26T06:54:03.896 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_bytes": 22769970, 2023-10-26T06:54:03.896 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_items": 264611, 2023-10-26T06:54:03.896 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:03.896 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_items": 0, 2023-10-26T06:54:03.897 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:03.897 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_items": 0 2023-10-26T06:54:03.897 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.897 INFO:teuthology.orchestra.run.smithi125.stdout: "objecter": { 2023-10-26T06:54:03.898 INFO:teuthology.orchestra.run.smithi125.stdout: "op_active": 0, 2023-10-26T06:54:03.898 INFO:teuthology.orchestra.run.smithi125.stdout: "op_laggy": 0, 2023-10-26T06:54:03.898 INFO:teuthology.orchestra.run.smithi125.stdout: "op_send": 124852, 2023-10-26T06:54:03.899 INFO:teuthology.orchestra.run.smithi125.stdout: "op_send_bytes": 413149511, 2023-10-26T06:54:03.899 INFO:teuthology.orchestra.run.smithi125.stdout: "op_resend": 27, 2023-10-26T06:54:03.899 INFO:teuthology.orchestra.run.smithi125.stdout: "op_reply": 124852, 2023-10-26T06:54:03.899 INFO:teuthology.orchestra.run.smithi125.stdout: "op_latency": { 2023-10-26T06:54:03.900 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 124852, 2023-10-26T06:54:03.900 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 1941.777540405, 2023-10-26T06:54:03.900 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.015552634 2023-10-26T06:54:03.901 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.901 INFO:teuthology.orchestra.run.smithi125.stdout: "op_inflight": 0, 2023-10-26T06:54:03.901 INFO:teuthology.orchestra.run.smithi125.stdout: "oplen_avg": { 2023-10-26T06:54:03.902 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 124852, 2023-10-26T06:54:03.902 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 144114 2023-10-26T06:54:03.902 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.903 INFO:teuthology.orchestra.run.smithi125.stdout: "op": 124852, 2023-10-26T06:54:03.903 INFO:teuthology.orchestra.run.smithi125.stdout: "op_r": 108299, 2023-10-26T06:54:03.903 INFO:teuthology.orchestra.run.smithi125.stdout: "op_w": 16553, 2023-10-26T06:54:03.903 INFO:teuthology.orchestra.run.smithi125.stdout: "op_rmw": 0, 2023-10-26T06:54:03.904 INFO:teuthology.orchestra.run.smithi125.stdout: "op_pg": 0, 2023-10-26T06:54:03.904 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_stat": 112, 2023-10-26T06:54:03.904 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_create": 8591, 2023-10-26T06:54:03.904 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_read": 145, 2023-10-26T06:54:03.905 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_write": 4015, 2023-10-26T06:54:03.905 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_writefull": 124, 2023-10-26T06:54:03.905 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_writesame": 0, 2023-10-26T06:54:03.905 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_append": 0, 2023-10-26T06:54:03.906 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_zero": 0, 2023-10-26T06:54:03.906 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_truncate": 79, 2023-10-26T06:54:03.906 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_delete": 2053, 2023-10-26T06:54:03.906 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_mapext": 0, 2023-10-26T06:54:03.907 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_sparse_read": 0, 2023-10-26T06:54:03.907 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_clonerange": 0, 2023-10-26T06:54:03.907 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_getxattr": 108080, 2023-10-26T06:54:03.908 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_setxattr": 17183, 2023-10-26T06:54:03.908 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_cmpxattr": 0, 2023-10-26T06:54:03.908 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_rmxattr": 0, 2023-10-26T06:54:03.908 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_resetxattrs": 0, 2023-10-26T06:54:03.909 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_call": 0, 2023-10-26T06:54:03.909 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_watch": 0, 2023-10-26T06:54:03.909 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_notify": 0, 2023-10-26T06:54:03.909 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_src_cmpxattr": 0, 2023-10-26T06:54:03.909 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_pgls": 0, 2023-10-26T06:54:03.910 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_pgls_filter": 0, 2023-10-26T06:54:03.910 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_other": 88, 2023-10-26T06:54:03.910 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_active": 0, 2023-10-26T06:54:03.911 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_send": 0, 2023-10-26T06:54:03.911 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_resend": 0, 2023-10-26T06:54:03.911 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_ping": 0, 2023-10-26T06:54:03.911 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_active": 0, 2023-10-26T06:54:03.912 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_send": 0, 2023-10-26T06:54:03.912 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_resend": 0, 2023-10-26T06:54:03.912 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_active": 0, 2023-10-26T06:54:03.912 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_send": 0, 2023-10-26T06:54:03.913 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_resend": 0, 2023-10-26T06:54:03.913 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_active": 0, 2023-10-26T06:54:03.913 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_send": 0, 2023-10-26T06:54:03.914 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_resend": 0, 2023-10-26T06:54:03.914 INFO:teuthology.orchestra.run.smithi125.stdout: "command_active": 0, 2023-10-26T06:54:03.914 INFO:teuthology.orchestra.run.smithi125.stdout: "command_send": 0, 2023-10-26T06:54:03.914 INFO:teuthology.orchestra.run.smithi125.stdout: "command_resend": 0, 2023-10-26T06:54:03.915 INFO:teuthology.orchestra.run.smithi125.stdout: "map_epoch": 94, 2023-10-26T06:54:03.915 INFO:teuthology.orchestra.run.smithi125.stdout: "map_full": 0, 2023-10-26T06:54:03.915 INFO:teuthology.orchestra.run.smithi125.stdout: "map_inc": 11, 2023-10-26T06:54:03.915 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_sessions": 12, 2023-10-26T06:54:03.916 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_session_open": 12, 2023-10-26T06:54:03.916 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_session_close": 0, 2023-10-26T06:54:03.916 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_laggy": 0, 2023-10-26T06:54:03.916 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_wr": 3156, 2023-10-26T06:54:03.917 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_rd": 290, 2023-10-26T06:54:03.917 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_del": 198 2023-10-26T06:54:03.917 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.917 INFO:teuthology.orchestra.run.smithi125.stdout: "oft": { 2023-10-26T06:54:03.918 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_objs": 1, 2023-10-26T06:54:03.918 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_kv_pairs": 0, 2023-10-26T06:54:03.918 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_updates": 0, 2023-10-26T06:54:03.919 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_removes": 0 2023-10-26T06:54:03.919 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.919 INFO:teuthology.orchestra.run.smithi125.stdout: "osd-slow-ops": { 2023-10-26T06:54:03.920 INFO:teuthology.orchestra.run.smithi125.stdout: "slow_ops_count": 0 2023-10-26T06:54:03.920 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.920 INFO:teuthology.orchestra.run.smithi125.stdout: "purge_queue": { 2023-10-26T06:54:03.920 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_ops": 0, 2023-10-26T06:54:03.921 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_ops_high_water": 20, 2023-10-26T06:54:03.921 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing": 0, 2023-10-26T06:54:03.921 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_high_water": 10, 2023-10-26T06:54:03.921 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executed": 1356, 2023-10-26T06:54:03.922 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_item_in_journal": 0 2023-10-26T06:54:03.922 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.922 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:03.923 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:03.923 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:03.923 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:03.923 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 335077, 2023-10-26T06:54:03.924 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 97305661, 2023-10-26T06:54:03.924 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:03.924 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 335077, 2023-10-26T06:54:03.924 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:03.925 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:03.925 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 335077, 2023-10-26T06:54:03.925 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 97305661, 2023-10-26T06:54:03.926 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:03.926 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.926 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.926 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.927 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.927 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.927 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-objecter_bytes": { 2023-10-26T06:54:03.928 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:03.928 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:03.928 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:03.928 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:03.929 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:03.929 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:03.929 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:03.929 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 124852, 2023-10-26T06:54:03.930 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 413282275, 2023-10-26T06:54:03.930 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 124852, 2023-10-26T06:54:03.930 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 413282275, 2023-10-26T06:54:03.931 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:03.931 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.931 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.932 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.933 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.934 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.934 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-objecter_ops": { 2023-10-26T06:54:03.934 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:03.934 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 1024, 2023-10-26T06:54:03.935 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:03.935 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:03.935 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:03.935 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:03.936 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:03.936 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 124852, 2023-10-26T06:54:03.936 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 124852, 2023-10-26T06:54:03.937 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 124852, 2023-10-26T06:54:03.937 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 124852, 2023-10-26T06:54:03.937 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:03.937 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.938 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.938 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.938 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.938 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.939 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-write_buf_throttle": { 2023-10-26T06:54:03.939 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:03.939 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 3758096384, 2023-10-26T06:54:03.939 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:03.940 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 1356, 2023-10-26T06:54:03.940 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 137020, 2023-10-26T06:54:03.940 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:03.940 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 1356, 2023-10-26T06:54:03.941 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:03.941 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:03.941 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 135, 2023-10-26T06:54:03.941 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 137020, 2023-10-26T06:54:03.942 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:03.942 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.942 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.942 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.943 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.943 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:03.943 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-write_buf_throttle-0x55c275e286e0": { 2023-10-26T06:54:03.943 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 84, 2023-10-26T06:54:03.944 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 3758096384, 2023-10-26T06:54:03.944 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:03.944 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 158942, 2023-10-26T06:54:03.944 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 383861937, 2023-10-26T06:54:03.945 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:03.945 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 158942, 2023-10-26T06:54:03.945 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:03.945 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:03.946 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 3879, 2023-10-26T06:54:03.946 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 383861853, 2023-10-26T06:54:03.946 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:03.946 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:03.947 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:03.947 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:03.947 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.947 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:03.948 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-26T06:54:04.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:03 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:54:04.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:03 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:54:04.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:03 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-26T06:54:04.275 INFO:tasks.check_counter:Daemon mds.b mds.exported=227 2023-10-26T06:54:04.275 INFO:tasks.check_counter:Daemon mds.b mds.imported=12 2023-10-26T06:54:04.276 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=941 2023-10-26T06:54:04.276 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=2024 2023-10-26T06:54:04.276 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-10-26T06:54:04.277 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2023-10-26T06:54:04.277 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2023-10-26T06:54:04.277 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=95 2023-10-26T06:54:04.278 DEBUG:tasks.check_counter:Getting stats from e 2023-10-26T06:54:04.278 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-26T06:54:04.998 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:54:05.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:04 smithi125 ceph-mon[130643]: pgmap v639: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-10-26T06:54:05.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:04 smithi153 ceph-mon[131657]: pgmap v639: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-10-26T06:54:05.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:04 smithi050 ceph-mon[94997]: pgmap v639: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-10-26T06:54:06.359 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-26T06:54:06.359 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:06.360 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 586, 2023-10-26T06:54:06.360 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 570, 2023-10-26T06:54:06.360 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 31336384, 2023-10-26T06:54:06.360 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 235445, 2023-10-26T06:54:06.361 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 6, 2023-10-26T06:54:06.361 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 2, 2023-10-26T06:54:06.361 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.089560951, 2023-10-26T06:54:06.362 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.020529153, 2023-10-26T06:54:06.362 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.050154966, 2023-10-26T06:54:06.362 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.017940603, 2023-10-26T06:54:06.362 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:06.363 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 569, 2023-10-26T06:54:06.363 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.034409712, 2023-10-26T06:54:06.363 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000060474 2023-10-26T06:54:06.364 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.364 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:06.364 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.364 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.365 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.365 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.365 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 809408, 2023-10-26T06:54:06.365 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 128144 2023-10-26T06:54:06.366 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.366 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:06.366 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 704, 2023-10-26T06:54:06.367 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 860, 2023-10-26T06:54:06.367 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 67295267, 2023-10-26T06:54:06.367 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 568946, 2023-10-26T06:54:06.367 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 6, 2023-10-26T06:54:06.368 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:06.368 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.104801145, 2023-10-26T06:54:06.368 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.020649309, 2023-10-26T06:54:06.369 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.054694170, 2023-10-26T06:54:06.369 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.022602066, 2023-10-26T06:54:06.369 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:06.369 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 859, 2023-10-26T06:54:06.370 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.035200889, 2023-10-26T06:54:06.370 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000040978 2023-10-26T06:54:06.370 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.371 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:06.371 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.371 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.371 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.372 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.372 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:54:06.372 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 351552 2023-10-26T06:54:06.372 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.373 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:06.373 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 1493, 2023-10-26T06:54:06.373 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 1495, 2023-10-26T06:54:06.374 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 50783058, 2023-10-26T06:54:06.374 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 464381, 2023-10-26T06:54:06.374 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 6, 2023-10-26T06:54:06.375 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:06.375 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.170112574, 2023-10-26T06:54:06.375 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.040587688, 2023-10-26T06:54:06.375 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.064957510, 2023-10-26T06:54:06.375 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.051580336, 2023-10-26T06:54:06.376 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:06.376 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 1493, 2023-10-26T06:54:06.376 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.060210456, 2023-10-26T06:54:06.376 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000040328 2023-10-26T06:54:06.377 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.377 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:06.377 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.377 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.378 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.378 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.378 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:06.379 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:06.379 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.379 INFO:teuthology.orchestra.run.smithi125.stdout: "cct": { 2023-10-26T06:54:06.379 INFO:teuthology.orchestra.run.smithi125.stdout: "total_workers": 1, 2023-10-26T06:54:06.380 INFO:teuthology.orchestra.run.smithi125.stdout: "unhealthy_workers": 0 2023-10-26T06:54:06.380 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.380 INFO:teuthology.orchestra.run.smithi125.stdout: "finisher-MDSRank": { 2023-10-26T06:54:06.380 INFO:teuthology.orchestra.run.smithi125.stdout: "queue_len": 0, 2023-10-26T06:54:06.381 INFO:teuthology.orchestra.run.smithi125.stdout: "complete_latency": { 2023-10-26T06:54:06.381 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 4232, 2023-10-26T06:54:06.381 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.123360567, 2023-10-26T06:54:06.381 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000029149 2023-10-26T06:54:06.382 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.382 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.382 INFO:teuthology.orchestra.run.smithi125.stdout: "finisher-PurgeQueue": { 2023-10-26T06:54:06.382 INFO:teuthology.orchestra.run.smithi125.stdout: "queue_len": 0, 2023-10-26T06:54:06.383 INFO:teuthology.orchestra.run.smithi125.stdout: "complete_latency": { 2023-10-26T06:54:06.383 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.383 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.383 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.384 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.384 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.384 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": { 2023-10-26T06:54:06.384 INFO:teuthology.orchestra.run.smithi125.stdout: "request": 0, 2023-10-26T06:54:06.385 INFO:teuthology.orchestra.run.smithi125.stdout: "reply": 0, 2023-10-26T06:54:06.385 INFO:teuthology.orchestra.run.smithi125.stdout: "reply_latency": { 2023-10-26T06:54:06.385 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.385 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.386 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.386 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.386 INFO:teuthology.orchestra.run.smithi125.stdout: "slow_reply": 0, 2023-10-26T06:54:06.387 INFO:teuthology.orchestra.run.smithi125.stdout: "forward": 0, 2023-10-26T06:54:06.387 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_fetch_complete": 0, 2023-10-26T06:54:06.387 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_fetch_keys": 0, 2023-10-26T06:54:06.387 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_commit": 0, 2023-10-26T06:54:06.387 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_split": 0, 2023-10-26T06:54:06.388 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_merge": 0, 2023-10-26T06:54:06.388 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes": 29336, 2023-10-26T06:54:06.388 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_top": 712, 2023-10-26T06:54:06.389 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_bottom": 17915, 2023-10-26T06:54:06.389 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_pin_tail": 10709, 2023-10-26T06:54:06.389 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_pinned": 28318, 2023-10-26T06:54:06.389 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_expired": 114, 2023-10-26T06:54:06.389 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_with_caps": 0, 2023-10-26T06:54:06.390 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": 0, 2023-10-26T06:54:06.390 INFO:teuthology.orchestra.run.smithi125.stdout: "subtrees": 46, 2023-10-26T06:54:06.390 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse": 0, 2023-10-26T06:54:06.391 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_hit": 0, 2023-10-26T06:54:06.391 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_forward": 0, 2023-10-26T06:54:06.391 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_discover": 0, 2023-10-26T06:54:06.391 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_dir_fetch": 0, 2023-10-26T06:54:06.392 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_remote_ino": 0, 2023-10-26T06:54:06.392 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_lock": 0, 2023-10-26T06:54:06.392 INFO:teuthology.orchestra.run.smithi125.stdout: "load_cent": 0, 2023-10-26T06:54:06.393 INFO:teuthology.orchestra.run.smithi125.stdout: "q": 0, 2023-10-26T06:54:06.393 INFO:teuthology.orchestra.run.smithi125.stdout: "exported": 0, 2023-10-26T06:54:06.393 INFO:teuthology.orchestra.run.smithi125.stdout: "exported_inodes": 0, 2023-10-26T06:54:06.393 INFO:teuthology.orchestra.run.smithi125.stdout: "imported": 0, 2023-10-26T06:54:06.394 INFO:teuthology.orchestra.run.smithi125.stdout: "imported_inodes": 0, 2023-10-26T06:54:06.394 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_dir_fetch": 0, 2023-10-26T06:54:06.394 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_backtrace_fetch": 0, 2023-10-26T06:54:06.395 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_peer_discover": 0, 2023-10-26T06:54:06.395 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rfiles": 0, 2023-10-26T06:54:06.395 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rbytes": 0, 2023-10-26T06:54:06.395 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rsnaps": 0, 2023-10-26T06:54:06.396 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_backtrace_fetch": 0, 2023-10-26T06:54:06.396 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_set_tag": 0, 2023-10-26T06:54:06.396 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_backtrace_repaired": 0, 2023-10-26T06:54:06.397 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_inotable_repaired": 0, 2023-10-26T06:54:06.397 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dir_inodes": 0, 2023-10-26T06:54:06.397 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dir_base_inodes": 0, 2023-10-26T06:54:06.397 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dirfrag_rstats": 0, 2023-10-26T06:54:06.398 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_file_inodes": 0, 2023-10-26T06:54:06.398 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_inode_file_caps": 0, 2023-10-26T06:54:06.398 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_revoke": 0, 2023-10-26T06:54:06.398 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_grant": 0, 2023-10-26T06:54:06.399 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_trunc": 0, 2023-10-26T06:54:06.399 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-26T06:54:06.399 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-26T06:54:06.400 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_caps": 0, 2023-10-26T06:54:06.400 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_caps_dirty": 0, 2023-10-26T06:54:06.400 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_cap_release": 0, 2023-10-26T06:54:06.401 INFO:teuthology.orchestra.run.smithi125.stdout: "process_request_cap_release": 0 2023-10-26T06:54:06.401 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.401 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_cache": { 2023-10-26T06:54:06.402 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_update": 0, 2023-10-26T06:54:06.402 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_update_receipt": 0, 2023-10-26T06:54:06.402 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_try_discover": 0, 2023-10-26T06:54:06.402 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_send_discover": 0, 2023-10-26T06:54:06.403 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_handle_discover": 0, 2023-10-26T06:54:06.403 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays": 0, 2023-10-26T06:54:06.403 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays_delayed": 0, 2023-10-26T06:54:06.404 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays_enqueuing": 0, 2023-10-26T06:54:06.404 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_created": 0, 2023-10-26T06:54:06.404 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_enqueued": 0, 2023-10-26T06:54:06.404 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_reintegrated": 0, 2023-10-26T06:54:06.405 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_migrated": 0, 2023-10-26T06:54:06.405 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_processing": 0, 2023-10-26T06:54:06.405 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_enqueued": 0, 2023-10-26T06:54:06.406 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_prioritized": 0, 2023-10-26T06:54:06.406 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_started": 0, 2023-10-26T06:54:06.406 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_completed": 0, 2023-10-26T06:54:06.406 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_enqueue_scrub": 0, 2023-10-26T06:54:06.407 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_exportdir": 0, 2023-10-26T06:54:06.407 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_flush": 0, 2023-10-26T06:54:06.407 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_fragmentdir": 0, 2023-10-26T06:54:06.407 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_fragstats": 0, 2023-10-26T06:54:06.408 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_inodestats": 0 2023-10-26T06:54:06.408 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.408 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_log": { 2023-10-26T06:54:06.409 INFO:teuthology.orchestra.run.smithi125.stdout: "evlrg": 0, 2023-10-26T06:54:06.409 INFO:teuthology.orchestra.run.smithi125.stdout: "evadd": 0, 2023-10-26T06:54:06.409 INFO:teuthology.orchestra.run.smithi125.stdout: "evex": 0, 2023-10-26T06:54:06.409 INFO:teuthology.orchestra.run.smithi125.stdout: "evtrm": 0, 2023-10-26T06:54:06.410 INFO:teuthology.orchestra.run.smithi125.stdout: "ev": 44967, 2023-10-26T06:54:06.410 INFO:teuthology.orchestra.run.smithi125.stdout: "evexg": 0, 2023-10-26T06:54:06.410 INFO:teuthology.orchestra.run.smithi125.stdout: "evexd": 0, 2023-10-26T06:54:06.410 INFO:teuthology.orchestra.run.smithi125.stdout: "segadd": 0, 2023-10-26T06:54:06.411 INFO:teuthology.orchestra.run.smithi125.stdout: "segex": 0, 2023-10-26T06:54:06.411 INFO:teuthology.orchestra.run.smithi125.stdout: "segtrm": 0, 2023-10-26T06:54:06.411 INFO:teuthology.orchestra.run.smithi125.stdout: "seg": 62, 2023-10-26T06:54:06.411 INFO:teuthology.orchestra.run.smithi125.stdout: "segmjr": 5, 2023-10-26T06:54:06.412 INFO:teuthology.orchestra.run.smithi125.stdout: "segexg": 0, 2023-10-26T06:54:06.412 INFO:teuthology.orchestra.run.smithi125.stdout: "segexd": 0, 2023-10-26T06:54:06.412 INFO:teuthology.orchestra.run.smithi125.stdout: "expos": 4194304, 2023-10-26T06:54:06.412 INFO:teuthology.orchestra.run.smithi125.stdout: "wrpos": 152071910, 2023-10-26T06:54:06.413 INFO:teuthology.orchestra.run.smithi125.stdout: "rdpos": 152060676, 2023-10-26T06:54:06.413 INFO:teuthology.orchestra.run.smithi125.stdout: "jlat": { 2023-10-26T06:54:06.413 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.413 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.414 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.414 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.414 INFO:teuthology.orchestra.run.smithi125.stdout: "replayed": 44967 2023-10-26T06:54:06.415 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.415 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_mem": { 2023-10-26T06:54:06.415 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 27368, 2023-10-26T06:54:06.415 INFO:teuthology.orchestra.run.smithi125.stdout: "ino+": 66392, 2023-10-26T06:54:06.417 INFO:teuthology.orchestra.run.smithi125.stdout: "ino-": 39024, 2023-10-26T06:54:06.417 INFO:teuthology.orchestra.run.smithi125.stdout: "dir": 2409, 2023-10-26T06:54:06.418 INFO:teuthology.orchestra.run.smithi125.stdout: "dir+": 5324, 2023-10-26T06:54:06.418 INFO:teuthology.orchestra.run.smithi125.stdout: "dir-": 2915, 2023-10-26T06:54:06.418 INFO:teuthology.orchestra.run.smithi125.stdout: "dn": 29340, 2023-10-26T06:54:06.419 INFO:teuthology.orchestra.run.smithi125.stdout: "dn+": 68371, 2023-10-26T06:54:06.419 INFO:teuthology.orchestra.run.smithi125.stdout: "dn-": 39031, 2023-10-26T06:54:06.419 INFO:teuthology.orchestra.run.smithi125.stdout: "cap": 0, 2023-10-26T06:54:06.419 INFO:teuthology.orchestra.run.smithi125.stdout: "cap+": 0, 2023-10-26T06:54:06.420 INFO:teuthology.orchestra.run.smithi125.stdout: "cap-": 0, 2023-10-26T06:54:06.420 INFO:teuthology.orchestra.run.smithi125.stdout: "rss": 166376, 2023-10-26T06:54:06.420 INFO:teuthology.orchestra.run.smithi125.stdout: "heap": 207152 2023-10-26T06:54:06.420 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.421 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_server": { 2023-10-26T06:54:06.421 INFO:teuthology.orchestra.run.smithi125.stdout: "dispatch_client_request": 0, 2023-10-26T06:54:06.421 INFO:teuthology.orchestra.run.smithi125.stdout: "dispatch_server_request": 0, 2023-10-26T06:54:06.422 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_request": 0, 2023-10-26T06:54:06.422 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_session": 0, 2023-10-26T06:54:06.422 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_peer_request": 0, 2023-10-26T06:54:06.423 INFO:teuthology.orchestra.run.smithi125.stdout: "req_create_latency": { 2023-10-26T06:54:06.423 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.423 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.423 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.424 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.424 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getattr_latency": { 2023-10-26T06:54:06.424 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.424 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.425 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.425 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.425 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getfilelock_latency": { 2023-10-26T06:54:06.425 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.426 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.426 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.426 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.427 INFO:teuthology.orchestra.run.smithi125.stdout: "req_link_latency": { 2023-10-26T06:54:06.427 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.427 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.427 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.428 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.428 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookup_latency": { 2023-10-26T06:54:06.428 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.428 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.429 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.429 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.429 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookuphash_latency": { 2023-10-26T06:54:06.430 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.430 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.430 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.430 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.431 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupino_latency": { 2023-10-26T06:54:06.431 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.431 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.432 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.432 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.432 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupname_latency": { 2023-10-26T06:54:06.432 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.433 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.433 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.433 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.433 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupparent_latency": { 2023-10-26T06:54:06.434 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.434 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.435 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.435 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.435 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupsnap_latency": { 2023-10-26T06:54:06.435 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.436 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.436 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.436 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.436 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lssnap_latency": { 2023-10-26T06:54:06.437 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.437 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.437 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.437 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.438 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mkdir_latency": { 2023-10-26T06:54:06.438 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.438 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.439 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.439 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.439 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mknod_latency": { 2023-10-26T06:54:06.439 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.440 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.440 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.440 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.441 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mksnap_latency": { 2023-10-26T06:54:06.441 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.441 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.441 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.442 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.442 INFO:teuthology.orchestra.run.smithi125.stdout: "req_open_latency": { 2023-10-26T06:54:06.442 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.443 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.443 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.443 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.444 INFO:teuthology.orchestra.run.smithi125.stdout: "req_readdir_latency": { 2023-10-26T06:54:06.444 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.444 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.444 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.445 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.445 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rename_latency": { 2023-10-26T06:54:06.445 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.445 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.446 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.446 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.446 INFO:teuthology.orchestra.run.smithi125.stdout: "req_renamesnap_latency": { 2023-10-26T06:54:06.447 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.447 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.447 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.447 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.448 INFO:teuthology.orchestra.run.smithi125.stdout: "req_snapdiff_latency": { 2023-10-26T06:54:06.448 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.448 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.449 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.449 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.449 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmdir_latency": { 2023-10-26T06:54:06.449 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.450 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.450 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.450 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.451 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmsnap_latency": { 2023-10-26T06:54:06.451 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.451 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.452 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.452 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.452 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmxattr_latency": { 2023-10-26T06:54:06.452 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.453 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.453 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.453 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.454 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setattr_latency": { 2023-10-26T06:54:06.454 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.454 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.455 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.455 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.455 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setdirlayout_latency": { 2023-10-26T06:54:06.455 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.456 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.456 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.456 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.456 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setfilelock_latency": { 2023-10-26T06:54:06.457 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.457 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.457 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.458 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.458 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setlayout_latency": { 2023-10-26T06:54:06.458 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.458 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.459 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.459 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.459 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setxattr_latency": { 2023-10-26T06:54:06.460 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.460 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.460 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.460 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.461 INFO:teuthology.orchestra.run.smithi125.stdout: "req_symlink_latency": { 2023-10-26T06:54:06.461 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.461 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.461 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.462 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.462 INFO:teuthology.orchestra.run.smithi125.stdout: "req_unlink_latency": { 2023-10-26T06:54:06.462 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.463 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.463 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.463 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.463 INFO:teuthology.orchestra.run.smithi125.stdout: "cap_revoke_eviction": 0, 2023-10-26T06:54:06.464 INFO:teuthology.orchestra.run.smithi125.stdout: "cap_acquisition_throttle": 0, 2023-10-26T06:54:06.464 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getvxattr_latency": { 2023-10-26T06:54:06.464 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.464 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.465 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.465 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.465 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.465 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_sessions": { 2023-10-26T06:54:06.466 INFO:teuthology.orchestra.run.smithi125.stdout: "session_count": 2, 2023-10-26T06:54:06.466 INFO:teuthology.orchestra.run.smithi125.stdout: "session_add": 3, 2023-10-26T06:54:06.466 INFO:teuthology.orchestra.run.smithi125.stdout: "session_remove": 1, 2023-10-26T06:54:06.466 INFO:teuthology.orchestra.run.smithi125.stdout: "sessions_open": 2, 2023-10-26T06:54:06.467 INFO:teuthology.orchestra.run.smithi125.stdout: "sessions_stale": 0, 2023-10-26T06:54:06.467 INFO:teuthology.orchestra.run.smithi125.stdout: "total_load": 0, 2023-10-26T06:54:06.467 INFO:teuthology.orchestra.run.smithi125.stdout: "average_load": 0, 2023-10-26T06:54:06.468 INFO:teuthology.orchestra.run.smithi125.stdout: "avg_session_uptime": 2491, 2023-10-26T06:54:06.468 INFO:teuthology.orchestra.run.smithi125.stdout: "mdthresh_evicted": 0 2023-10-26T06:54:06.468 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.468 INFO:teuthology.orchestra.run.smithi125.stdout: "mempool": { 2023-10-26T06:54:06.469 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:06.469 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:06.469 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:06.470 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:06.470 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:06.470 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:06.471 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:06.471 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:06.471 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:06.471 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:06.472 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:06.472 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:06.472 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:06.473 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:06.473 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:06.473 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:06.473 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:06.474 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:06.474 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:06.474 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:06.475 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:06.475 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:06.475 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:06.476 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:06.476 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:06.476 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:06.477 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:06.477 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:06.477 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:06.477 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:06.478 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:06.478 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_items": 0, 2023-10-26T06:54:06.478 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:06.478 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:06.479 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:06.479 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:06.479 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_bytes": 1185316, 2023-10-26T06:54:06.480 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_items": 28387, 2023-10-26T06:54:06.480 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:54:06.480 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_items": 0, 2023-10-26T06:54:06.480 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_bytes": 0, 2023-10-26T06:54:06.481 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_items": 0, 2023-10-26T06:54:06.481 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:06.481 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:06.482 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:06.482 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:06.482 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_bytes": 7680, 2023-10-26T06:54:06.483 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_items": 160, 2023-10-26T06:54:06.483 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:06.483 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:06.483 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:06.484 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_items": 0, 2023-10-26T06:54:06.484 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_bytes": 85853187, 2023-10-26T06:54:06.484 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_items": 846748, 2023-10-26T06:54:06.484 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:06.485 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_items": 0, 2023-10-26T06:54:06.485 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:06.485 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_items": 0 2023-10-26T06:54:06.486 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.486 INFO:teuthology.orchestra.run.smithi125.stdout: "objecter": { 2023-10-26T06:54:06.486 INFO:teuthology.orchestra.run.smithi125.stdout: "op_active": 0, 2023-10-26T06:54:06.487 INFO:teuthology.orchestra.run.smithi125.stdout: "op_laggy": 0, 2023-10-26T06:54:06.487 INFO:teuthology.orchestra.run.smithi125.stdout: "op_send": 2537, 2023-10-26T06:54:06.487 INFO:teuthology.orchestra.run.smithi125.stdout: "op_send_bytes": 21, 2023-10-26T06:54:06.487 INFO:teuthology.orchestra.run.smithi125.stdout: "op_resend": 3, 2023-10-26T06:54:06.488 INFO:teuthology.orchestra.run.smithi125.stdout: "op_reply": 2537, 2023-10-26T06:54:06.488 INFO:teuthology.orchestra.run.smithi125.stdout: "op_latency": { 2023-10-26T06:54:06.488 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 2537, 2023-10-26T06:54:06.488 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 4.872916337, 2023-10-26T06:54:06.489 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.001920739 2023-10-26T06:54:06.489 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.489 INFO:teuthology.orchestra.run.smithi125.stdout: "op_inflight": 0, 2023-10-26T06:54:06.489 INFO:teuthology.orchestra.run.smithi125.stdout: "oplen_avg": { 2023-10-26T06:54:06.489 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 2537, 2023-10-26T06:54:06.490 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 2538 2023-10-26T06:54:06.490 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.490 INFO:teuthology.orchestra.run.smithi125.stdout: "op": 2537, 2023-10-26T06:54:06.491 INFO:teuthology.orchestra.run.smithi125.stdout: "op_r": 2537, 2023-10-26T06:54:06.491 INFO:teuthology.orchestra.run.smithi125.stdout: "op_w": 0, 2023-10-26T06:54:06.491 INFO:teuthology.orchestra.run.smithi125.stdout: "op_rmw": 0, 2023-10-26T06:54:06.491 INFO:teuthology.orchestra.run.smithi125.stdout: "op_pg": 0, 2023-10-26T06:54:06.492 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_stat": 1469, 2023-10-26T06:54:06.492 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_create": 0, 2023-10-26T06:54:06.492 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_read": 1066, 2023-10-26T06:54:06.492 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_write": 0, 2023-10-26T06:54:06.493 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_writefull": 0, 2023-10-26T06:54:06.493 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_writesame": 0, 2023-10-26T06:54:06.493 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_append": 0, 2023-10-26T06:54:06.493 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_zero": 0, 2023-10-26T06:54:06.494 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_truncate": 0, 2023-10-26T06:54:06.494 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_delete": 0, 2023-10-26T06:54:06.494 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_mapext": 0, 2023-10-26T06:54:06.494 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_sparse_read": 0, 2023-10-26T06:54:06.495 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_clonerange": 0, 2023-10-26T06:54:06.495 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_getxattr": 1, 2023-10-26T06:54:06.495 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_setxattr": 0, 2023-10-26T06:54:06.495 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_cmpxattr": 0, 2023-10-26T06:54:06.496 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_rmxattr": 0, 2023-10-26T06:54:06.496 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_resetxattrs": 0, 2023-10-26T06:54:06.496 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_call": 0, 2023-10-26T06:54:06.497 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_watch": 0, 2023-10-26T06:54:06.497 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_notify": 0, 2023-10-26T06:54:06.497 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_src_cmpxattr": 0, 2023-10-26T06:54:06.497 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_pgls": 0, 2023-10-26T06:54:06.498 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_pgls_filter": 0, 2023-10-26T06:54:06.498 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_other": 0, 2023-10-26T06:54:06.498 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_active": 0, 2023-10-26T06:54:06.498 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_send": 0, 2023-10-26T06:54:06.499 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_resend": 0, 2023-10-26T06:54:06.499 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_ping": 0, 2023-10-26T06:54:06.499 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_active": 0, 2023-10-26T06:54:06.500 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_send": 0, 2023-10-26T06:54:06.500 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_resend": 0, 2023-10-26T06:54:06.500 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_active": 0, 2023-10-26T06:54:06.500 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_send": 0, 2023-10-26T06:54:06.501 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_resend": 0, 2023-10-26T06:54:06.501 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_active": 0, 2023-10-26T06:54:06.501 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_send": 0, 2023-10-26T06:54:06.501 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_resend": 0, 2023-10-26T06:54:06.502 INFO:teuthology.orchestra.run.smithi125.stdout: "command_active": 0, 2023-10-26T06:54:06.502 INFO:teuthology.orchestra.run.smithi125.stdout: "command_send": 0, 2023-10-26T06:54:06.502 INFO:teuthology.orchestra.run.smithi125.stdout: "command_resend": 0, 2023-10-26T06:54:06.502 INFO:teuthology.orchestra.run.smithi125.stdout: "map_epoch": 94, 2023-10-26T06:54:06.503 INFO:teuthology.orchestra.run.smithi125.stdout: "map_full": 0, 2023-10-26T06:54:06.503 INFO:teuthology.orchestra.run.smithi125.stdout: "map_inc": 10, 2023-10-26T06:54:06.503 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_sessions": 9, 2023-10-26T06:54:06.504 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_session_open": 9, 2023-10-26T06:54:06.504 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_session_close": 0, 2023-10-26T06:54:06.504 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_laggy": 0, 2023-10-26T06:54:06.504 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_wr": 0, 2023-10-26T06:54:06.505 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_rd": 2, 2023-10-26T06:54:06.505 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_del": 0 2023-10-26T06:54:06.505 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.505 INFO:teuthology.orchestra.run.smithi125.stdout: "oft": { 2023-10-26T06:54:06.506 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_objs": 0, 2023-10-26T06:54:06.506 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_kv_pairs": 0, 2023-10-26T06:54:06.506 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_updates": 0, 2023-10-26T06:54:06.507 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_removes": 0 2023-10-26T06:54:06.507 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.507 INFO:teuthology.orchestra.run.smithi125.stdout: "osd-slow-ops": { 2023-10-26T06:54:06.508 INFO:teuthology.orchestra.run.smithi125.stdout: "slow_ops_count": 0 2023-10-26T06:54:06.508 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.508 INFO:teuthology.orchestra.run.smithi125.stdout: "purge_queue": { 2023-10-26T06:54:06.508 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_ops": 0, 2023-10-26T06:54:06.509 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_ops_high_water": 0, 2023-10-26T06:54:06.509 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing": 0, 2023-10-26T06:54:06.509 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_high_water": 0, 2023-10-26T06:54:06.509 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executed": 0, 2023-10-26T06:54:06.510 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_item_in_journal": 0 2023-10-26T06:54:06.510 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.510 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:06.510 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:06.511 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:06.511 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:06.511 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 2779, 2023-10-26T06:54:06.512 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 149149325, 2023-10-26T06:54:06.512 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:06.512 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 2779, 2023-10-26T06:54:06.512 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:06.513 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:06.513 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 2779, 2023-10-26T06:54:06.513 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 149149325, 2023-10-26T06:54:06.513 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:06.514 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.514 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.514 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.515 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.515 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.515 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-objecter_bytes": { 2023-10-26T06:54:06.515 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:06.516 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:06.516 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:06.516 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:06.516 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:06.517 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:06.517 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:06.517 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 2537, 2023-10-26T06:54:06.517 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 147895415, 2023-10-26T06:54:06.518 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 2537, 2023-10-26T06:54:06.518 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 147895415, 2023-10-26T06:54:06.518 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:06.519 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.519 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.519 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.520 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.520 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.520 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-objecter_ops": { 2023-10-26T06:54:06.520 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:06.521 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 1024, 2023-10-26T06:54:06.521 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:06.521 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:06.522 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:06.522 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:06.522 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:06.522 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 2537, 2023-10-26T06:54:06.523 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 2537, 2023-10-26T06:54:06.523 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 2537, 2023-10-26T06:54:06.523 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 2537, 2023-10-26T06:54:06.524 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:06.524 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.524 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.524 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.525 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.525 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.525 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-write_buf_throttle": { 2023-10-26T06:54:06.525 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:06.526 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 3758096384, 2023-10-26T06:54:06.526 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:06.526 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:06.527 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:06.527 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:06.527 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:06.527 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:06.528 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:06.528 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 0, 2023-10-26T06:54:06.528 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 0, 2023-10-26T06:54:06.528 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:06.529 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.529 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.529 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.530 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.530 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:06.530 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-write_buf_throttle-0x5587851ce960": { 2023-10-26T06:54:06.530 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:06.531 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 3758096384, 2023-10-26T06:54:06.531 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:06.531 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:06.532 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:06.532 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:06.532 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:06.532 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:06.533 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:06.533 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 0, 2023-10-26T06:54:06.533 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 0, 2023-10-26T06:54:06.533 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:06.534 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:06.534 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:06.534 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:06.535 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.535 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:06.535 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-26T06:54:06.851 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-26T06:54:06.852 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-26T06:54:06.852 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-26T06:54:06.852 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-26T06:54:06.853 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-10-26T06:54:06.853 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-26T06:54:06.853 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-26T06:54:06.853 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-10-26T06:54:06.854 DEBUG:tasks.check_counter:Getting stats from h 2023-10-26T06:54:06.854 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-26T06:54:07.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:06 smithi125 ceph-mon[130643]: pgmap v640: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 69 KiB/s wr, 21 op/s 2023-10-26T06:54:07.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.174 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:06 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:06 smithi153 ceph-mon[131657]: pgmap v640: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 69 KiB/s wr, 21 op/s 2023-10-26T06:54:07.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:06 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:06 smithi050 ceph-mon[94997]: pgmap v640: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 69 KiB/s wr, 21 op/s 2023-10-26T06:54:07.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:06 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.421 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:54:07.922 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:07.923 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:54:07.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:54:07.924 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:07 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:54:08.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:54:08.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:07 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-26T06:54:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-26T06:54:08.268 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:07 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' 2023-10-26T06:54:08.836 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-26T06:54:08.837 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:08.837 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 1773, 2023-10-26T06:54:08.837 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 1757, 2023-10-26T06:54:08.838 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 127099139, 2023-10-26T06:54:08.838 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 604136, 2023-10-26T06:54:08.838 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 7, 2023-10-26T06:54:08.838 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 3, 2023-10-26T06:54:08.839 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.219068686, 2023-10-26T06:54:08.839 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.059310874, 2023-10-26T06:54:08.839 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.101005089, 2023-10-26T06:54:08.840 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.048096725, 2023-10-26T06:54:08.840 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:08.840 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 1756, 2023-10-26T06:54:08.840 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.066205324, 2023-10-26T06:54:08.841 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000037702 2023-10-26T06:54:08.841 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.841 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:08.841 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.842 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.842 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.842 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.843 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 809296, 2023-10-26T06:54:08.843 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 127680 2023-10-26T06:54:08.843 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.843 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:08.844 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 437, 2023-10-26T06:54:08.844 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 592, 2023-10-26T06:54:08.844 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 104988852, 2023-10-26T06:54:08.844 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 485794, 2023-10-26T06:54:08.845 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 7, 2023-10-26T06:54:08.845 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 6, 2023-10-26T06:54:08.845 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.089417593, 2023-10-26T06:54:08.845 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.013756076, 2023-10-26T06:54:08.846 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.060348712, 2023-10-26T06:54:08.846 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.011072263, 2023-10-26T06:54:08.846 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:08.847 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 591, 2023-10-26T06:54:08.847 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.025136580, 2023-10-26T06:54:08.847 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000042532 2023-10-26T06:54:08.847 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.848 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:08.848 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.848 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.848 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.849 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.849 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:54:08.849 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 351376 2023-10-26T06:54:08.849 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.850 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:08.850 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 1105, 2023-10-26T06:54:08.850 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 1107, 2023-10-26T06:54:08.850 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 154071969, 2023-10-26T06:54:08.851 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 343662, 2023-10-26T06:54:08.851 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 6, 2023-10-26T06:54:08.851 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:08.852 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.164610381, 2023-10-26T06:54:08.852 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.019502642, 2023-10-26T06:54:08.852 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.106465594, 2023-10-26T06:54:08.852 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.030957347, 2023-10-26T06:54:08.853 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:08.853 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 1105, 2023-10-26T06:54:08.853 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.033791704, 2023-10-26T06:54:08.853 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000030580 2023-10-26T06:54:08.854 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.854 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:08.854 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.855 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.855 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.855 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.855 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:08.856 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:08.856 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.856 INFO:teuthology.orchestra.run.smithi125.stdout: "cct": { 2023-10-26T06:54:08.856 INFO:teuthology.orchestra.run.smithi125.stdout: "total_workers": 1, 2023-10-26T06:54:08.857 INFO:teuthology.orchestra.run.smithi125.stdout: "unhealthy_workers": 0 2023-10-26T06:54:08.857 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.857 INFO:teuthology.orchestra.run.smithi125.stdout: "finisher-MDSRank": { 2023-10-26T06:54:08.857 INFO:teuthology.orchestra.run.smithi125.stdout: "queue_len": 0, 2023-10-26T06:54:08.858 INFO:teuthology.orchestra.run.smithi125.stdout: "complete_latency": { 2023-10-26T06:54:08.858 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 4930, 2023-10-26T06:54:08.858 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.194859027, 2023-10-26T06:54:08.859 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000039525 2023-10-26T06:54:08.859 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:08.859 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.859 INFO:teuthology.orchestra.run.smithi125.stdout: "finisher-PurgeQueue": { 2023-10-26T06:54:08.860 INFO:teuthology.orchestra.run.smithi125.stdout: "queue_len": 0, 2023-10-26T06:54:08.860 INFO:teuthology.orchestra.run.smithi125.stdout: "complete_latency": { 2023-10-26T06:54:08.860 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.860 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.861 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.861 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:08.861 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.861 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": { 2023-10-26T06:54:08.862 INFO:teuthology.orchestra.run.smithi125.stdout: "request": 0, 2023-10-26T06:54:08.862 INFO:teuthology.orchestra.run.smithi125.stdout: "reply": 0, 2023-10-26T06:54:08.862 INFO:teuthology.orchestra.run.smithi125.stdout: "reply_latency": { 2023-10-26T06:54:08.863 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.863 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.863 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.863 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.864 INFO:teuthology.orchestra.run.smithi125.stdout: "slow_reply": 0, 2023-10-26T06:54:08.864 INFO:teuthology.orchestra.run.smithi125.stdout: "forward": 0, 2023-10-26T06:54:08.864 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_fetch_complete": 0, 2023-10-26T06:54:08.864 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_fetch_keys": 0, 2023-10-26T06:54:08.865 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_commit": 0, 2023-10-26T06:54:08.865 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_split": 0, 2023-10-26T06:54:08.865 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_merge": 0, 2023-10-26T06:54:08.866 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes": 8369, 2023-10-26T06:54:08.866 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_top": 1355, 2023-10-26T06:54:08.866 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_bottom": 6826, 2023-10-26T06:54:08.866 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_pin_tail": 188, 2023-10-26T06:54:08.867 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_pinned": 6435, 2023-10-26T06:54:08.867 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_expired": 0, 2023-10-26T06:54:08.867 INFO:teuthology.orchestra.run.smithi125.stdout: "inodes_with_caps": 0, 2023-10-26T06:54:08.867 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": 0, 2023-10-26T06:54:08.868 INFO:teuthology.orchestra.run.smithi125.stdout: "subtrees": 74, 2023-10-26T06:54:08.868 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse": 0, 2023-10-26T06:54:08.868 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_hit": 0, 2023-10-26T06:54:08.868 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_forward": 0, 2023-10-26T06:54:08.869 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_discover": 0, 2023-10-26T06:54:08.869 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_dir_fetch": 0, 2023-10-26T06:54:08.869 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_remote_ino": 0, 2023-10-26T06:54:08.869 INFO:teuthology.orchestra.run.smithi125.stdout: "traverse_lock": 0, 2023-10-26T06:54:08.870 INFO:teuthology.orchestra.run.smithi125.stdout: "load_cent": 0, 2023-10-26T06:54:08.870 INFO:teuthology.orchestra.run.smithi125.stdout: "q": 0, 2023-10-26T06:54:08.870 INFO:teuthology.orchestra.run.smithi125.stdout: "exported": 0, 2023-10-26T06:54:08.871 INFO:teuthology.orchestra.run.smithi125.stdout: "exported_inodes": 0, 2023-10-26T06:54:08.871 INFO:teuthology.orchestra.run.smithi125.stdout: "imported": 0, 2023-10-26T06:54:08.871 INFO:teuthology.orchestra.run.smithi125.stdout: "imported_inodes": 0, 2023-10-26T06:54:08.871 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_dir_fetch": 0, 2023-10-26T06:54:08.872 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_backtrace_fetch": 0, 2023-10-26T06:54:08.872 INFO:teuthology.orchestra.run.smithi125.stdout: "openino_peer_discover": 0, 2023-10-26T06:54:08.872 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rfiles": 74443, 2023-10-26T06:54:08.872 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rbytes": 1237542278, 2023-10-26T06:54:08.873 INFO:teuthology.orchestra.run.smithi125.stdout: "root_rsnaps": 6, 2023-10-26T06:54:08.873 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_backtrace_fetch": 0, 2023-10-26T06:54:08.873 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_set_tag": 0, 2023-10-26T06:54:08.873 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_backtrace_repaired": 0, 2023-10-26T06:54:08.874 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_inotable_repaired": 0, 2023-10-26T06:54:08.874 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dir_inodes": 0, 2023-10-26T06:54:08.874 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dir_base_inodes": 0, 2023-10-26T06:54:08.875 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_dirfrag_rstats": 0, 2023-10-26T06:54:08.875 INFO:teuthology.orchestra.run.smithi125.stdout: "scrub_file_inodes": 0, 2023-10-26T06:54:08.875 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_inode_file_caps": 0, 2023-10-26T06:54:08.875 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_revoke": 0, 2023-10-26T06:54:08.876 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_grant": 0, 2023-10-26T06:54:08.876 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_trunc": 0, 2023-10-26T06:54:08.876 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-26T06:54:08.876 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-26T06:54:08.877 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_caps": 0, 2023-10-26T06:54:08.877 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_caps_dirty": 0, 2023-10-26T06:54:08.877 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_cap_release": 0, 2023-10-26T06:54:08.877 INFO:teuthology.orchestra.run.smithi125.stdout: "process_request_cap_release": 0 2023-10-26T06:54:08.878 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.878 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_cache": { 2023-10-26T06:54:08.878 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_update": 0, 2023-10-26T06:54:08.878 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_update_receipt": 0, 2023-10-26T06:54:08.879 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_try_discover": 0, 2023-10-26T06:54:08.879 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_send_discover": 0, 2023-10-26T06:54:08.879 INFO:teuthology.orchestra.run.smithi125.stdout: "dir_handle_discover": 0, 2023-10-26T06:54:08.880 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays": 0, 2023-10-26T06:54:08.880 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays_delayed": 0, 2023-10-26T06:54:08.880 INFO:teuthology.orchestra.run.smithi125.stdout: "num_strays_enqueuing": 0, 2023-10-26T06:54:08.880 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_created": 0, 2023-10-26T06:54:08.881 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_enqueued": 0, 2023-10-26T06:54:08.881 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_reintegrated": 0, 2023-10-26T06:54:08.881 INFO:teuthology.orchestra.run.smithi125.stdout: "strays_migrated": 0, 2023-10-26T06:54:08.881 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_processing": 0, 2023-10-26T06:54:08.882 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_enqueued": 0, 2023-10-26T06:54:08.882 INFO:teuthology.orchestra.run.smithi125.stdout: "num_recovering_prioritized": 0, 2023-10-26T06:54:08.882 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_started": 0, 2023-10-26T06:54:08.883 INFO:teuthology.orchestra.run.smithi125.stdout: "recovery_completed": 0, 2023-10-26T06:54:08.883 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_enqueue_scrub": 0, 2023-10-26T06:54:08.883 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_exportdir": 0, 2023-10-26T06:54:08.883 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_flush": 0, 2023-10-26T06:54:08.884 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_fragmentdir": 0, 2023-10-26T06:54:08.884 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_fragstats": 0, 2023-10-26T06:54:08.884 INFO:teuthology.orchestra.run.smithi125.stdout: "ireq_inodestats": 0 2023-10-26T06:54:08.884 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.884 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_log": { 2023-10-26T06:54:08.885 INFO:teuthology.orchestra.run.smithi125.stdout: "evlrg": 0, 2023-10-26T06:54:08.885 INFO:teuthology.orchestra.run.smithi125.stdout: "evadd": 0, 2023-10-26T06:54:08.885 INFO:teuthology.orchestra.run.smithi125.stdout: "evex": 0, 2023-10-26T06:54:08.886 INFO:teuthology.orchestra.run.smithi125.stdout: "evtrm": 0, 2023-10-26T06:54:08.886 INFO:teuthology.orchestra.run.smithi125.stdout: "ev": 159017, 2023-10-26T06:54:08.886 INFO:teuthology.orchestra.run.smithi125.stdout: "evexg": 0, 2023-10-26T06:54:08.886 INFO:teuthology.orchestra.run.smithi125.stdout: "evexd": 0, 2023-10-26T06:54:08.887 INFO:teuthology.orchestra.run.smithi125.stdout: "segadd": 0, 2023-10-26T06:54:08.887 INFO:teuthology.orchestra.run.smithi125.stdout: "segex": 0, 2023-10-26T06:54:08.887 INFO:teuthology.orchestra.run.smithi125.stdout: "segtrm": 0, 2023-10-26T06:54:08.887 INFO:teuthology.orchestra.run.smithi125.stdout: "seg": 131, 2023-10-26T06:54:08.888 INFO:teuthology.orchestra.run.smithi125.stdout: "segmjr": 14, 2023-10-26T06:54:08.888 INFO:teuthology.orchestra.run.smithi125.stdout: "segexg": 0, 2023-10-26T06:54:08.888 INFO:teuthology.orchestra.run.smithi125.stdout: "segexd": 0, 2023-10-26T06:54:08.888 INFO:teuthology.orchestra.run.smithi125.stdout: "expos": 108971669, 2023-10-26T06:54:08.889 INFO:teuthology.orchestra.run.smithi125.stdout: "wrpos": 388634018, 2023-10-26T06:54:08.889 INFO:teuthology.orchestra.run.smithi125.stdout: "rdpos": 388623897, 2023-10-26T06:54:08.889 INFO:teuthology.orchestra.run.smithi125.stdout: "jlat": { 2023-10-26T06:54:08.890 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.890 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.890 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.890 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.891 INFO:teuthology.orchestra.run.smithi125.stdout: "replayed": 159017 2023-10-26T06:54:08.891 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.891 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_mem": { 2023-10-26T06:54:08.892 INFO:teuthology.orchestra.run.smithi125.stdout: "ino": 6595, 2023-10-26T06:54:08.892 INFO:teuthology.orchestra.run.smithi125.stdout: "ino+": 71735, 2023-10-26T06:54:08.892 INFO:teuthology.orchestra.run.smithi125.stdout: "ino-": 65140, 2023-10-26T06:54:08.892 INFO:teuthology.orchestra.run.smithi125.stdout: "dir": 520, 2023-10-26T06:54:08.893 INFO:teuthology.orchestra.run.smithi125.stdout: "dir+": 4841, 2023-10-26T06:54:08.893 INFO:teuthology.orchestra.run.smithi125.stdout: "dir-": 4321, 2023-10-26T06:54:08.893 INFO:teuthology.orchestra.run.smithi125.stdout: "dn": 8369, 2023-10-26T06:54:08.894 INFO:teuthology.orchestra.run.smithi125.stdout: "dn+": 73517, 2023-10-26T06:54:08.894 INFO:teuthology.orchestra.run.smithi125.stdout: "dn-": 65148, 2023-10-26T06:54:08.894 INFO:teuthology.orchestra.run.smithi125.stdout: "cap": 0, 2023-10-26T06:54:08.894 INFO:teuthology.orchestra.run.smithi125.stdout: "cap+": 0, 2023-10-26T06:54:08.895 INFO:teuthology.orchestra.run.smithi125.stdout: "cap-": 0, 2023-10-26T06:54:08.895 INFO:teuthology.orchestra.run.smithi125.stdout: "rss": 111572, 2023-10-26T06:54:08.895 INFO:teuthology.orchestra.run.smithi125.stdout: "heap": 207152 2023-10-26T06:54:08.895 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.896 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_server": { 2023-10-26T06:54:08.896 INFO:teuthology.orchestra.run.smithi125.stdout: "dispatch_client_request": 0, 2023-10-26T06:54:08.896 INFO:teuthology.orchestra.run.smithi125.stdout: "dispatch_server_request": 0, 2023-10-26T06:54:08.896 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_request": 0, 2023-10-26T06:54:08.897 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_client_session": 0, 2023-10-26T06:54:08.897 INFO:teuthology.orchestra.run.smithi125.stdout: "handle_peer_request": 0, 2023-10-26T06:54:08.897 INFO:teuthology.orchestra.run.smithi125.stdout: "req_create_latency": { 2023-10-26T06:54:08.898 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.898 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.898 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.898 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.899 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getattr_latency": { 2023-10-26T06:54:08.899 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.899 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.900 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.900 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.900 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getfilelock_latency": { 2023-10-26T06:54:08.900 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.901 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.901 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.901 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.901 INFO:teuthology.orchestra.run.smithi125.stdout: "req_link_latency": { 2023-10-26T06:54:08.902 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.902 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.902 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.903 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.903 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookup_latency": { 2023-10-26T06:54:08.903 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.903 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.904 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.904 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.904 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookuphash_latency": { 2023-10-26T06:54:08.904 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.905 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.905 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.905 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.905 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupino_latency": { 2023-10-26T06:54:08.906 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.906 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.906 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.907 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.907 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupname_latency": { 2023-10-26T06:54:08.907 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.907 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.908 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.908 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.908 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupparent_latency": { 2023-10-26T06:54:08.908 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.909 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.909 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.909 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.910 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lookupsnap_latency": { 2023-10-26T06:54:08.910 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.910 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.910 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.911 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.911 INFO:teuthology.orchestra.run.smithi125.stdout: "req_lssnap_latency": { 2023-10-26T06:54:08.911 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.912 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.912 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.912 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.912 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mkdir_latency": { 2023-10-26T06:54:08.913 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.913 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.913 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.913 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.914 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mknod_latency": { 2023-10-26T06:54:08.914 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.914 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.915 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.915 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.915 INFO:teuthology.orchestra.run.smithi125.stdout: "req_mksnap_latency": { 2023-10-26T06:54:08.915 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.916 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.916 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.916 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.916 INFO:teuthology.orchestra.run.smithi125.stdout: "req_open_latency": { 2023-10-26T06:54:08.917 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.917 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.917 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.917 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.918 INFO:teuthology.orchestra.run.smithi125.stdout: "req_readdir_latency": { 2023-10-26T06:54:08.918 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.918 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.919 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.919 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.919 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rename_latency": { 2023-10-26T06:54:08.919 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.920 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.920 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.920 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.920 INFO:teuthology.orchestra.run.smithi125.stdout: "req_renamesnap_latency": { 2023-10-26T06:54:08.921 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.921 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.921 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.922 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.922 INFO:teuthology.orchestra.run.smithi125.stdout: "req_snapdiff_latency": { 2023-10-26T06:54:08.922 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.922 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.923 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.923 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.923 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmdir_latency": { 2023-10-26T06:54:08.923 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.924 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.924 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.924 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.925 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmsnap_latency": { 2023-10-26T06:54:08.925 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.925 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.925 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.926 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.926 INFO:teuthology.orchestra.run.smithi125.stdout: "req_rmxattr_latency": { 2023-10-26T06:54:08.926 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.926 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.927 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.927 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.927 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setattr_latency": { 2023-10-26T06:54:08.928 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.928 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.928 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.928 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.929 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setdirlayout_latency": { 2023-10-26T06:54:08.929 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.929 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.929 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.930 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.930 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setfilelock_latency": { 2023-10-26T06:54:08.930 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.930 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.931 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.931 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.931 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setlayout_latency": { 2023-10-26T06:54:08.932 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.932 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.932 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.932 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.933 INFO:teuthology.orchestra.run.smithi125.stdout: "req_setxattr_latency": { 2023-10-26T06:54:08.933 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.933 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.933 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.934 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.934 INFO:teuthology.orchestra.run.smithi125.stdout: "req_symlink_latency": { 2023-10-26T06:54:08.934 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.934 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.935 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.935 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.935 INFO:teuthology.orchestra.run.smithi125.stdout: "req_unlink_latency": { 2023-10-26T06:54:08.935 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.936 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.936 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.936 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.937 INFO:teuthology.orchestra.run.smithi125.stdout: "cap_revoke_eviction": 0, 2023-10-26T06:54:08.937 INFO:teuthology.orchestra.run.smithi125.stdout: "cap_acquisition_throttle": 0, 2023-10-26T06:54:08.937 INFO:teuthology.orchestra.run.smithi125.stdout: "req_getvxattr_latency": { 2023-10-26T06:54:08.937 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.938 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.938 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.938 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:08.938 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.939 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_sessions": { 2023-10-26T06:54:08.939 INFO:teuthology.orchestra.run.smithi125.stdout: "session_count": 2, 2023-10-26T06:54:08.939 INFO:teuthology.orchestra.run.smithi125.stdout: "session_add": 3, 2023-10-26T06:54:08.940 INFO:teuthology.orchestra.run.smithi125.stdout: "session_remove": 1, 2023-10-26T06:54:08.940 INFO:teuthology.orchestra.run.smithi125.stdout: "sessions_open": 2, 2023-10-26T06:54:08.940 INFO:teuthology.orchestra.run.smithi125.stdout: "sessions_stale": 0, 2023-10-26T06:54:08.941 INFO:teuthology.orchestra.run.smithi125.stdout: "total_load": 0, 2023-10-26T06:54:08.941 INFO:teuthology.orchestra.run.smithi125.stdout: "average_load": 0, 2023-10-26T06:54:08.941 INFO:teuthology.orchestra.run.smithi125.stdout: "avg_session_uptime": 2497, 2023-10-26T06:54:08.941 INFO:teuthology.orchestra.run.smithi125.stdout: "mdthresh_evicted": 0 2023-10-26T06:54:08.942 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.942 INFO:teuthology.orchestra.run.smithi125.stdout: "mempool": { 2023-10-26T06:54:08.942 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:08.943 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:08.943 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:08.943 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:08.943 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:08.944 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:08.944 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:08.944 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:08.945 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:08.945 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:08.945 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:08.945 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:08.946 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:08.946 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:08.946 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:08.946 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:08.947 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:08.947 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:08.947 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:08.948 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:08.948 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:08.948 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:08.948 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:08.949 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:08.949 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:08.949 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:08.950 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:08.950 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:08.950 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:08.950 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:08.951 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:08.951 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_items": 0, 2023-10-26T06:54:08.951 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:08.951 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:08.952 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:08.952 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:08.952 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_bytes": 474403, 2023-10-26T06:54:08.952 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_items": 7010, 2023-10-26T06:54:08.953 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:54:08.953 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_items": 0, 2023-10-26T06:54:08.953 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_bytes": 0, 2023-10-26T06:54:08.953 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_items": 0, 2023-10-26T06:54:08.954 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:08.954 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:08.954 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:08.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:08.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_bytes": 7680, 2023-10-26T06:54:08.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_items": 160, 2023-10-26T06:54:08.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:08.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:08.956 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:08.956 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_items": 0, 2023-10-26T06:54:08.956 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_bytes": 21677663, 2023-10-26T06:54:08.956 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_items": 222499, 2023-10-26T06:54:08.957 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:08.957 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_items": 0, 2023-10-26T06:54:08.957 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:08.958 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_items": 0 2023-10-26T06:54:08.958 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.958 INFO:teuthology.orchestra.run.smithi125.stdout: "objecter": { 2023-10-26T06:54:08.958 INFO:teuthology.orchestra.run.smithi125.stdout: "op_active": 0, 2023-10-26T06:54:08.959 INFO:teuthology.orchestra.run.smithi125.stdout: "op_laggy": 0, 2023-10-26T06:54:08.959 INFO:teuthology.orchestra.run.smithi125.stdout: "op_send": 3069, 2023-10-26T06:54:08.959 INFO:teuthology.orchestra.run.smithi125.stdout: "op_send_bytes": 26, 2023-10-26T06:54:08.959 INFO:teuthology.orchestra.run.smithi125.stdout: "op_resend": 4, 2023-10-26T06:54:08.960 INFO:teuthology.orchestra.run.smithi125.stdout: "op_reply": 3069, 2023-10-26T06:54:08.960 INFO:teuthology.orchestra.run.smithi125.stdout: "op_latency": { 2023-10-26T06:54:08.960 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 3069, 2023-10-26T06:54:08.960 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 6.836882490, 2023-10-26T06:54:08.961 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.002227723 2023-10-26T06:54:08.961 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.961 INFO:teuthology.orchestra.run.smithi125.stdout: "op_inflight": 0, 2023-10-26T06:54:08.962 INFO:teuthology.orchestra.run.smithi125.stdout: "oplen_avg": { 2023-10-26T06:54:08.962 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 3069, 2023-10-26T06:54:08.962 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 3070 2023-10-26T06:54:08.962 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.963 INFO:teuthology.orchestra.run.smithi125.stdout: "op": 3069, 2023-10-26T06:54:08.963 INFO:teuthology.orchestra.run.smithi125.stdout: "op_r": 3069, 2023-10-26T06:54:08.963 INFO:teuthology.orchestra.run.smithi125.stdout: "op_w": 0, 2023-10-26T06:54:08.963 INFO:teuthology.orchestra.run.smithi125.stdout: "op_rmw": 0, 2023-10-26T06:54:08.964 INFO:teuthology.orchestra.run.smithi125.stdout: "op_pg": 0, 2023-10-26T06:54:08.964 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_stat": 1815, 2023-10-26T06:54:08.964 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_create": 0, 2023-10-26T06:54:08.964 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_read": 1251, 2023-10-26T06:54:08.965 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_write": 0, 2023-10-26T06:54:08.965 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_writefull": 0, 2023-10-26T06:54:08.965 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_writesame": 0, 2023-10-26T06:54:08.965 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_append": 0, 2023-10-26T06:54:08.966 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_zero": 0, 2023-10-26T06:54:08.966 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_truncate": 0, 2023-10-26T06:54:08.966 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_delete": 0, 2023-10-26T06:54:08.966 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_mapext": 0, 2023-10-26T06:54:08.967 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_sparse_read": 0, 2023-10-26T06:54:08.967 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_clonerange": 0, 2023-10-26T06:54:08.967 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_getxattr": 2, 2023-10-26T06:54:08.967 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_setxattr": 0, 2023-10-26T06:54:08.968 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_cmpxattr": 0, 2023-10-26T06:54:08.968 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_rmxattr": 0, 2023-10-26T06:54:08.968 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_resetxattrs": 0, 2023-10-26T06:54:08.968 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_call": 0, 2023-10-26T06:54:08.969 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_watch": 0, 2023-10-26T06:54:08.969 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_notify": 0, 2023-10-26T06:54:08.969 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_src_cmpxattr": 0, 2023-10-26T06:54:08.970 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_pgls": 0, 2023-10-26T06:54:08.970 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_pgls_filter": 0, 2023-10-26T06:54:08.970 INFO:teuthology.orchestra.run.smithi125.stdout: "osdop_other": 0, 2023-10-26T06:54:08.970 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_active": 0, 2023-10-26T06:54:08.971 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_send": 0, 2023-10-26T06:54:08.971 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_resend": 0, 2023-10-26T06:54:08.971 INFO:teuthology.orchestra.run.smithi125.stdout: "linger_ping": 0, 2023-10-26T06:54:08.971 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_active": 0, 2023-10-26T06:54:08.972 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_send": 0, 2023-10-26T06:54:08.972 INFO:teuthology.orchestra.run.smithi125.stdout: "poolop_resend": 0, 2023-10-26T06:54:08.972 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_active": 0, 2023-10-26T06:54:08.972 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_send": 0, 2023-10-26T06:54:08.973 INFO:teuthology.orchestra.run.smithi125.stdout: "poolstat_resend": 0, 2023-10-26T06:54:08.973 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_active": 0, 2023-10-26T06:54:08.973 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_send": 0, 2023-10-26T06:54:08.973 INFO:teuthology.orchestra.run.smithi125.stdout: "statfs_resend": 0, 2023-10-26T06:54:08.974 INFO:teuthology.orchestra.run.smithi125.stdout: "command_active": 0, 2023-10-26T06:54:08.974 INFO:teuthology.orchestra.run.smithi125.stdout: "command_send": 0, 2023-10-26T06:54:08.974 INFO:teuthology.orchestra.run.smithi125.stdout: "command_resend": 0, 2023-10-26T06:54:08.974 INFO:teuthology.orchestra.run.smithi125.stdout: "map_epoch": 94, 2023-10-26T06:54:08.975 INFO:teuthology.orchestra.run.smithi125.stdout: "map_full": 0, 2023-10-26T06:54:08.975 INFO:teuthology.orchestra.run.smithi125.stdout: "map_inc": 10, 2023-10-26T06:54:08.975 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_sessions": 11, 2023-10-26T06:54:08.976 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_session_open": 11, 2023-10-26T06:54:08.976 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_session_close": 0, 2023-10-26T06:54:08.976 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_laggy": 0, 2023-10-26T06:54:08.976 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_wr": 0, 2023-10-26T06:54:08.976 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_rd": 2, 2023-10-26T06:54:08.977 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_del": 0 2023-10-26T06:54:08.977 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.977 INFO:teuthology.orchestra.run.smithi125.stdout: "oft": { 2023-10-26T06:54:08.977 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_objs": 0, 2023-10-26T06:54:08.978 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_kv_pairs": 0, 2023-10-26T06:54:08.978 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_updates": 0, 2023-10-26T06:54:08.978 INFO:teuthology.orchestra.run.smithi125.stdout: "omap_total_removes": 0 2023-10-26T06:54:08.979 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.979 INFO:teuthology.orchestra.run.smithi125.stdout: "osd-slow-ops": { 2023-10-26T06:54:08.979 INFO:teuthology.orchestra.run.smithi125.stdout: "slow_ops_count": 0 2023-10-26T06:54:08.979 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.980 INFO:teuthology.orchestra.run.smithi125.stdout: "purge_queue": { 2023-10-26T06:54:08.980 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_ops": 0, 2023-10-26T06:54:08.980 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_ops_high_water": 0, 2023-10-26T06:54:08.980 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing": 0, 2023-10-26T06:54:08.981 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executing_high_water": 0, 2023-10-26T06:54:08.981 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_executed": 0, 2023-10-26T06:54:08.981 INFO:teuthology.orchestra.run.smithi125.stdout: "pq_item_in_journal": 0 2023-10-26T06:54:08.981 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.981 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:08.982 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:08.982 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:08.982 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:08.983 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 3311, 2023-10-26T06:54:08.983 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 385846702, 2023-10-26T06:54:08.983 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:08.983 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 3311, 2023-10-26T06:54:08.984 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:08.984 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:08.984 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 3311, 2023-10-26T06:54:08.984 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 385846702, 2023-10-26T06:54:08.985 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:08.985 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.985 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.985 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.986 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:08.986 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.986 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-objecter_bytes": { 2023-10-26T06:54:08.986 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:08.987 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:08.987 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:08.987 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:08.987 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:08.988 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:08.988 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:08.988 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 3069, 2023-10-26T06:54:08.989 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 384503772, 2023-10-26T06:54:08.989 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 3069, 2023-10-26T06:54:08.989 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 384503772, 2023-10-26T06:54:08.989 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:08.990 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.990 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.990 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.990 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:08.991 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.991 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-objecter_ops": { 2023-10-26T06:54:08.991 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:08.991 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 1024, 2023-10-26T06:54:08.992 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:08.992 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:08.992 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:08.992 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:08.993 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:08.993 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 3069, 2023-10-26T06:54:08.993 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 3069, 2023-10-26T06:54:08.994 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 3069, 2023-10-26T06:54:08.994 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 3069, 2023-10-26T06:54:08.994 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:08.994 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.995 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.995 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:08.995 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:08.995 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:08.996 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-write_buf_throttle": { 2023-10-26T06:54:08.996 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:08.996 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 3758096384, 2023-10-26T06:54:08.996 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:08.997 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:08.997 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:08.997 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:08.997 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:08.997 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:08.998 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:08.998 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 0, 2023-10-26T06:54:08.998 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 0, 2023-10-26T06:54:08.999 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:08.999 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:08.999 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:08.999 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:09.000 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:09.000 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:09.000 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-write_buf_throttle-0x55ce61944960": { 2023-10-26T06:54:09.000 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:09.001 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 3758096384, 2023-10-26T06:54:09.001 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:09.001 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 0, 2023-10-26T06:54:09.001 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 0, 2023-10-26T06:54:09.002 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:09.002 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:09.002 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:09.002 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:09.003 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 0, 2023-10-26T06:54:09.003 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 0, 2023-10-26T06:54:09.003 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:09.003 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:09.004 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:09.004 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:09.004 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:09.004 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:09.005 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-26T06:54:09.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:08 smithi125 ceph-mon[130643]: pgmap v641: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 675 KiB/s wr, 25 op/s 2023-10-26T06:54:09.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:08 smithi153 ceph-mon[131657]: pgmap v641: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 675 KiB/s wr, 25 op/s 2023-10-26T06:54:09.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:08 smithi050 ceph-mon[94997]: pgmap v641: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 675 KiB/s wr, 25 op/s 2023-10-26T06:54:09.275 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-26T06:54:09.275 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-10-26T06:54:09.275 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-10-26T06:54:09.276 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-10-26T06:54:09.276 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-10-26T06:54:09.276 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-26T06:54:09.277 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-26T06:54:09.277 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2023-10-26T06:54:09.277 DEBUG:tasks.check_counter:Getting stats from k 2023-10-26T06:54:09.277 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-26T06:54:09.837 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.b/config 2023-10-26T06:54:11.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:10 smithi125 ceph-mon[130643]: pgmap v642: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 670 KiB/s wr, 23 op/s 2023-10-26T06:54:11.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:10 smithi125 ceph-mon[130643]: osdmap e95: 12 total, 12 up, 12 in 2023-10-26T06:54:11.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:10 smithi153 ceph-mon[131657]: pgmap v642: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 670 KiB/s wr, 23 op/s 2023-10-26T06:54:11.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:10 smithi153 ceph-mon[131657]: osdmap e95: 12 total, 12 up, 12 in 2023-10-26T06:54:11.261 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-26T06:54:11.261 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:11.262 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 223, 2023-10-26T06:54:11.262 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 216, 2023-10-26T06:54:11.262 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 747696, 2023-10-26T06:54:11.263 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 128496, 2023-10-26T06:54:11.263 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 4, 2023-10-26T06:54:11.263 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 0, 2023-10-26T06:54:11.264 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.036475988, 2023-10-26T06:54:11.264 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.012498517, 2023-10-26T06:54:11.264 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.018893837, 2023-10-26T06:54:11.264 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.005779777, 2023-10-26T06:54:11.265 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:11.265 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 216, 2023-10-26T06:54:11.265 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.012140455, 2023-10-26T06:54:11.265 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000056205 2023-10-26T06:54:11.266 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.266 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:11.266 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:11.267 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:11.267 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:11.267 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.267 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 747696, 2023-10-26T06:54:11.268 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 128496 2023-10-26T06:54:11.268 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.268 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:11.269 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 1, 2023-10-26T06:54:11.269 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 162, 2023-10-26T06:54:11.269 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 160, 2023-10-26T06:54:11.269 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 105040, 2023-10-26T06:54:11.270 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 3, 2023-10-26T06:54:11.270 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 2, 2023-10-26T06:54:11.270 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.009026842, 2023-10-26T06:54:11.270 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.006377731, 2023-10-26T06:54:11.271 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.000704096, 2023-10-26T06:54:11.271 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:54:11.271 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:11.271 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 160, 2023-10-26T06:54:11.272 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.013879323, 2023-10-26T06:54:11.272 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000086745 2023-10-26T06:54:11.272 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.272 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:11.273 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:11.273 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:11.273 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:11.274 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.274 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-26T06:54:11.274 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 105040 2023-10-26T06:54:11.274 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.275 INFO:teuthology.orchestra.run.smithi125.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:11.275 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_messages": 0, 2023-10-26T06:54:11.275 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages": 2, 2023-10-26T06:54:11.275 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_bytes": 0, 2023-10-26T06:54:11.276 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_bytes": 0, 2023-10-26T06:54:11.276 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_created_connections": 2, 2023-10-26T06:54:11.276 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_active_connections": 1, 2023-10-26T06:54:11.276 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_total_time": 0.000351361, 2023-10-26T06:54:11.277 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_send_time": 0.000000000, 2023-10-26T06:54:11.277 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_recv_time": 0.000289417, 2023-10-26T06:54:11.277 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:54:11.277 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:11.278 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:11.278 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:11.278 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:11.279 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.279 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:11.279 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:11.279 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:11.280 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:11.280 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.280 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:11.280 INFO:teuthology.orchestra.run.smithi125.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:11.281 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.281 INFO:teuthology.orchestra.run.smithi125.stdout: "cct": { 2023-10-26T06:54:11.281 INFO:teuthology.orchestra.run.smithi125.stdout: "total_workers": 0, 2023-10-26T06:54:11.281 INFO:teuthology.orchestra.run.smithi125.stdout: "unhealthy_workers": 0 2023-10-26T06:54:11.282 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.282 INFO:teuthology.orchestra.run.smithi125.stdout: "mempool": { 2023-10-26T06:54:11.282 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:11.283 INFO:teuthology.orchestra.run.smithi125.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:11.283 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:11.283 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:11.283 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:11.284 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:11.284 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:11.284 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:11.285 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:11.285 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:11.285 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:11.285 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:11.286 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:11.286 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:11.286 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:11.287 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:11.287 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:11.287 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:11.288 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:11.288 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:11.288 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:11.288 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:11.289 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:11.289 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:11.289 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:11.290 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:11.290 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:11.290 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:11.290 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:11.291 INFO:teuthology.orchestra.run.smithi125.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:11.291 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:11.291 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_items": 0, 2023-10-26T06:54:11.292 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:11.292 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:11.292 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:11.293 INFO:teuthology.orchestra.run.smithi125.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:11.293 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_bytes": 149024, 2023-10-26T06:54:11.293 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_anon_items": 31, 2023-10-26T06:54:11.293 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:54:11.294 INFO:teuthology.orchestra.run.smithi125.stdout: "buffer_meta_items": 0, 2023-10-26T06:54:11.294 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_bytes": 0, 2023-10-26T06:54:11.294 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_items": 0, 2023-10-26T06:54:11.295 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:11.295 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:11.295 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:11.295 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:11.296 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_bytes": 0, 2023-10-26T06:54:11.296 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_items": 0, 2023-10-26T06:54:11.296 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:11.296 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:11.297 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:11.297 INFO:teuthology.orchestra.run.smithi125.stdout: "pgmap_items": 0, 2023-10-26T06:54:11.297 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_bytes": 928, 2023-10-26T06:54:11.298 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_co_items": 2, 2023-10-26T06:54:11.298 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:11.298 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_1_items": 0, 2023-10-26T06:54:11.298 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:11.299 INFO:teuthology.orchestra.run.smithi125.stdout: "unittest_2_items": 0 2023-10-26T06:54:11.299 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-26T06:54:11.299 INFO:teuthology.orchestra.run.smithi125.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:11.300 INFO:teuthology.orchestra.run.smithi125.stdout: "val": 0, 2023-10-26T06:54:11.300 INFO:teuthology.orchestra.run.smithi125.stdout: "max": 104857600, 2023-10-26T06:54:11.300 INFO:teuthology.orchestra.run.smithi125.stdout: "get_started": 0, 2023-10-26T06:54:11.300 INFO:teuthology.orchestra.run.smithi125.stdout: "get": 220, 2023-10-26T06:54:11.301 INFO:teuthology.orchestra.run.smithi125.stdout: "get_sum": 713754, 2023-10-26T06:54:11.301 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:11.301 INFO:teuthology.orchestra.run.smithi125.stdout: "get_or_fail_success": 220, 2023-10-26T06:54:11.302 INFO:teuthology.orchestra.run.smithi125.stdout: "take": 0, 2023-10-26T06:54:11.302 INFO:teuthology.orchestra.run.smithi125.stdout: "take_sum": 0, 2023-10-26T06:54:11.302 INFO:teuthology.orchestra.run.smithi125.stdout: "put": 220, 2023-10-26T06:54:11.302 INFO:teuthology.orchestra.run.smithi125.stdout: "put_sum": 713754, 2023-10-26T06:54:11.303 INFO:teuthology.orchestra.run.smithi125.stdout: "wait": { 2023-10-26T06:54:11.303 INFO:teuthology.orchestra.run.smithi125.stdout: "avgcount": 0, 2023-10-26T06:54:11.303 INFO:teuthology.orchestra.run.smithi125.stdout: "sum": 0.000000000, 2023-10-26T06:54:11.304 INFO:teuthology.orchestra.run.smithi125.stdout: "avgtime": 0.000000000 2023-10-26T06:54:11.304 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:11.304 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-26T06:54:11.304 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-26T06:54:11.305 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:10 smithi050 ceph-mon[94997]: pgmap v642: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 670 KiB/s wr, 23 op/s 2023-10-26T06:54:11.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:10 smithi050 ceph-mon[94997]: osdmap e95: 12 total, 12 up, 12 in 2023-10-26T06:54:11.695 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-10-26T06:54:11.695 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-10-26T06:54:11.696 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-10-26T06:54:11.696 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-10-26T06:54:11.696 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2023-10-26T06:54:11.697 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2023-10-26T06:54:11.697 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2023-10-26T06:54:11.697 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2023-10-26T06:54:11.697 DEBUG:tasks.check_counter:Getting stats from c 2023-10-26T06:54:11.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-26T06:54:12.268 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:54:13.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:12 smithi125 ceph-mon[130643]: pgmap v644: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 37 op/s 2023-10-26T06:54:13.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:12 smithi153 ceph-mon[131657]: pgmap v644: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 37 op/s 2023-10-26T06:54:13.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:12 smithi050 ceph-mon[94997]: pgmap v644: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 37 op/s 2023-10-26T06:54:13.499 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-26T06:54:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 83130, 2023-10-26T06:54:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 171824, 2023-10-26T06:54:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 26131522, 2023-10-26T06:54:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 120493333, 2023-10-26T06:54:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 16, 2023-10-26T06:54:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 4.902686677, 2023-10-26T06:54:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 2.176579747, 2023-10-26T06:54:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 5.036160225, 2023-10-26T06:54:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.880462374, 2023-10-26T06:54:13.502 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 171823, 2023-10-26T06:54:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.851165705, 2023-10-26T06:54:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000028233 2023-10-26T06:54:13.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 60547, 2023-10-26T06:54:13.504 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.020342296, 2023-10-26T06:54:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000335 2023-10-26T06:54:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 826112, 2023-10-26T06:54:13.505 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 160624 2023-10-26T06:54:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 35959, 2023-10-26T06:54:13.506 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 36152, 2023-10-26T06:54:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 9126310, 2023-10-26T06:54:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 89150407, 2023-10-26T06:54:13.507 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 27, 2023-10-26T06:54:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 10, 2023-10-26T06:54:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 2.338170502, 2023-10-26T06:54:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.821799361, 2023-10-26T06:54:13.508 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.459916968, 2023-10-26T06:54:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.903570203, 2023-10-26T06:54:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:13.509 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 36148, 2023-10-26T06:54:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.561831515, 2023-10-26T06:54:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000043206 2023-10-26T06:54:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.510 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 73, 2023-10-26T06:54:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000022374, 2023-10-26T06:54:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000306 2023-10-26T06:54:13.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-10-26T06:54:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 367360 2023-10-26T06:54:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 72003, 2023-10-26T06:54:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 84721, 2023-10-26T06:54:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 78425020, 2023-10-26T06:54:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 78228709, 2023-10-26T06:54:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2023-10-26T06:54:13.514 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 3.978687149, 2023-10-26T06:54:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 1.431550454, 2023-10-26T06:54:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 4.016489058, 2023-10-26T06:54:13.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.947877920, 2023-10-26T06:54:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 84722, 2023-10-26T06:54:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.798102318, 2023-10-26T06:54:13.516 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000056633 2023-10-26T06:54:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:13.517 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 74001, 2023-10-26T06:54:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.011911644, 2023-10-26T06:54:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000160 2023-10-26T06:54:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.518 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-26T06:54:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2023-10-26T06:54:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.519 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-10-26T06:54:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-10-26T06:54:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-10-26T06:54:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.520 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-10-26T06:54:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-10-26T06:54:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-10-26T06:54:13.521 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 74335, 2023-10-26T06:54:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 41.247657738, 2023-10-26T06:54:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000554888 2023-10-26T06:54:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-10-26T06:54:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-10-26T06:54:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-10-26T06:54:13.523 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1435, 2023-10-26T06:54:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.104621535, 2023-10-26T06:54:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000072906 2023-10-26T06:54:13.524 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-10-26T06:54:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 14001, 2023-10-26T06:54:13.525 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 13330, 2023-10-26T06:54:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-10-26T06:54:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 13330, 2023-10-26T06:54:13.526 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 188.160097829, 2023-10-26T06:54:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014115536 2023-10-26T06:54:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-10-26T06:54:13.527 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 671, 2023-10-26T06:54:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2023-10-26T06:54:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2023-10-26T06:54:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 218, 2023-10-26T06:54:13.528 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 23, 2023-10-26T06:54:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-10-26T06:54:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 29190, 2023-10-26T06:54:13.529 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 941, 2023-10-26T06:54:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 11063, 2023-10-26T06:54:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 17186, 2023-10-26T06:54:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 27846, 2023-10-26T06:54:13.530 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 36886, 2023-10-26T06:54:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 22033, 2023-10-26T06:54:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 22034, 2023-10-26T06:54:13.531 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 68, 2023-10-26T06:54:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 17746, 2023-10-26T06:54:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 14574, 2023-10-26T06:54:13.532 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 557, 2023-10-26T06:54:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 727, 2023-10-26T06:54:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2023-10-26T06:54:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-10-26T06:54:13.533 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2023-10-26T06:54:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 268383, 2023-10-26T06:54:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-10-26T06:54:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 30, 2023-10-26T06:54:13.534 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 39075, 2023-10-26T06:54:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 102, 2023-10-26T06:54:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 56671, 2023-10-26T06:54:13.535 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-10-26T06:54:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 105062, 2023-10-26T06:54:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-10-26T06:54:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 74443, 2023-10-26T06:54:13.536 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 1237542278, 2023-10-26T06:54:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2023-10-26T06:54:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 105062, 2023-10-26T06:54:13.537 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-10-26T06:54:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-10-26T06:54:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-10-26T06:54:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 6980, 2023-10-26T06:54:13.538 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2023-10-26T06:54:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 6980, 2023-10-26T06:54:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 98082, 2023-10-26T06:54:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 19, 2023-10-26T06:54:13.539 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 1408, 2023-10-26T06:54:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 13488, 2023-10-26T06:54:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 70, 2023-10-26T06:54:13.540 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-26T06:54:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-26T06:54:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 34998, 2023-10-26T06:54:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 13221, 2023-10-26T06:54:13.541 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 725, 2023-10-26T06:54:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 2111 2023-10-26T06:54:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.542 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-10-26T06:54:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 852, 2023-10-26T06:54:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 2788, 2023-10-26T06:54:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 1709, 2023-10-26T06:54:13.543 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 1834, 2023-10-26T06:54:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 1376, 2023-10-26T06:54:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2023-10-26T06:54:13.544 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-10-26T06:54:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2023-10-26T06:54:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 711, 2023-10-26T06:54:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 711, 2023-10-26T06:54:13.545 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2023-10-26T06:54:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-10-26T06:54:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-10-26T06:54:13.546 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-10-26T06:54:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-10-26T06:54:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-10-26T06:54:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-10-26T06:54:13.547 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2023-10-26T06:54:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 30, 2023-10-26T06:54:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-10-26T06:54:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 23, 2023-10-26T06:54:13.548 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-10-26T06:54:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-10-26T06:54:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-10-26T06:54:13.549 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 15, 2023-10-26T06:54:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 47096, 2023-10-26T06:54:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2023-10-26T06:54:13.550 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2023-10-26T06:54:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 47096, 2023-10-26T06:54:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-10-26T06:54:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2023-10-26T06:54:13.551 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 65, 2023-10-26T06:54:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2023-10-26T06:54:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2023-10-26T06:54:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 65, 2023-10-26T06:54:13.552 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 5, 2023-10-26T06:54:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-10-26T06:54:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2023-10-26T06:54:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2023-10-26T06:54:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 158861834, 2023-10-26T06:54:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2023-10-26T06:54:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-10-26T06:54:13.554 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2192, 2023-10-26T06:54:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 67.166957102, 2023-10-26T06:54:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.030641859 2023-10-26T06:54:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.555 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2023-10-26T06:54:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-10-26T06:54:13.556 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 27977, 2023-10-26T06:54:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 64260, 2023-10-26T06:54:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 36283, 2023-10-26T06:54:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 2767, 2023-10-26T06:54:13.557 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 6019, 2023-10-26T06:54:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 3252, 2023-10-26T06:54:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 29190, 2023-10-26T06:54:13.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 66890, 2023-10-26T06:54:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 37700, 2023-10-26T06:54:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 22034, 2023-10-26T06:54:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 62573, 2023-10-26T06:54:13.559 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 40539, 2023-10-26T06:54:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 248020, 2023-10-26T06:54:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 198960 2023-10-26T06:54:13.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-10-26T06:54:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 15082, 2023-10-26T06:54:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 86, 2023-10-26T06:54:13.561 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 14001, 2023-10-26T06:54:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 52, 2023-10-26T06:54:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 412, 2023-10-26T06:54:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-10-26T06:54:13.562 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 9330, 2023-10-26T06:54:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 171.646806417, 2023-10-26T06:54:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.018397299 2023-10-26T06:54:13.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-10-26T06:54:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 17, 2023-10-26T06:54:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.197935756, 2023-10-26T06:54:13.564 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.011643279 2023-10-26T06:54:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-10-26T06:54:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.565 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.566 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-10-26T06:54:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-10-26T06:54:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1517, 2023-10-26T06:54:13.568 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.228525258, 2023-10-26T06:54:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.002128230 2023-10-26T06:54:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-10-26T06:54:13.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.570 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-10-26T06:54:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-10-26T06:54:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000115984, 2023-10-26T06:54:13.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000115984 2023-10-26T06:54:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-10-26T06:54:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.572 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.573 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-10-26T06:54:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-10-26T06:54:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-10-26T06:54:13.576 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.577 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-10-26T06:54:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 434, 2023-10-26T06:54:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.887022088, 2023-10-26T06:54:13.578 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.015868714 2023-10-26T06:54:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-10-26T06:54:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.579 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-10-26T06:54:13.580 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.581 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-10-26T06:54:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 759, 2023-10-26T06:54:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.619355013, 2023-10-26T06:54:13.582 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000816014 2023-10-26T06:54:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-10-26T06:54:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 488, 2023-10-26T06:54:13.583 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.965927623, 2023-10-26T06:54:13.584 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001979359 2023-10-26T06:54:13.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.584 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-10-26T06:54:13.585 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.585 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.585 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.586 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-10-26T06:54:13.586 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.586 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.586 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.587 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2023-10-26T06:54:13.587 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.588 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.588 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.588 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-10-26T06:54:13.589 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.589 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.589 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.590 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-10-26T06:54:13.590 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.590 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.591 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.591 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-10-26T06:54:13.591 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.592 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.592 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.592 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-10-26T06:54:13.593 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 72, 2023-10-26T06:54:13.593 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.247179689, 2023-10-26T06:54:13.593 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.017321940 2023-10-26T06:54:13.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.594 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-10-26T06:54:13.594 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.594 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.594 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.595 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-10-26T06:54:13.595 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.595 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.596 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.596 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-10-26T06:54:13.596 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-10-26T06:54:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.598 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-10-26T06:54:13.599 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-10-26T06:54:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.001189737, 2023-10-26T06:54:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001189737 2023-10-26T06:54:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.600 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-10-26T06:54:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 711, 2023-10-26T06:54:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.366040264, 2023-10-26T06:54:13.601 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004734233 2023-10-26T06:54:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-10-26T06:54:13.602 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-10-26T06:54:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-10-26T06:54:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.603 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.604 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-10-26T06:54:13.605 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2023-10-26T06:54:13.605 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 3, 2023-10-26T06:54:13.605 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 1, 2023-10-26T06:54:13.605 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 2, 2023-10-26T06:54:13.606 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-10-26T06:54:13.606 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 1773, 2023-10-26T06:54:13.606 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 886, 2023-10-26T06:54:13.607 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 620, 2023-10-26T06:54:13.607 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2023-10-26T06:54:13.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.607 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-10-26T06:54:13.608 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 120, 2023-10-26T06:54:13.608 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 120, 2023-10-26T06:54:13.608 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:13.608 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:13.609 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:13.609 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:13.609 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:13.610 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:13.610 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:13.610 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:13.611 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:13.611 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:13.611 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:13.611 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:13.612 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:13.612 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:13.612 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:13.613 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:13.613 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:13.613 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:13.613 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:13.614 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:13.614 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:13.614 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:13.615 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:13.615 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:13.615 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:13.615 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:13.616 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:13.616 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:13.616 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:13.616 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-10-26T06:54:13.617 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:13.617 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:13.617 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:13.618 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:13.618 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 1248263, 2023-10-26T06:54:13.618 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 28242, 2023-10-26T06:54:13.618 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 1320, 2023-10-26T06:54:13.619 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 15, 2023-10-26T06:54:13.619 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-10-26T06:54:13.619 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-10-26T06:54:13.620 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:13.620 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:13.620 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:13.620 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:13.621 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 7800, 2023-10-26T06:54:13.621 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 163, 2023-10-26T06:54:13.621 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:13.622 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:13.622 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:13.622 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-10-26T06:54:13.622 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 98057745, 2023-10-26T06:54:13.623 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 1074752, 2023-10-26T06:54:13.623 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:13.623 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-10-26T06:54:13.623 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:13.624 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-10-26T06:54:13.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.624 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-10-26T06:54:13.625 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2023-10-26T06:54:13.625 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-10-26T06:54:13.625 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 108768, 2023-10-26T06:54:13.625 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 160879579, 2023-10-26T06:54:13.626 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 33, 2023-10-26T06:54:13.626 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 108768, 2023-10-26T06:54:13.626 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2023-10-26T06:54:13.626 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 108768, 2023-10-26T06:54:13.627 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 103.107030057, 2023-10-26T06:54:13.627 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000947953 2023-10-26T06:54:13.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.628 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2023-10-26T06:54:13.628 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-10-26T06:54:13.628 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 108768, 2023-10-26T06:54:13.628 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 109179 2023-10-26T06:54:13.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.629 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 108768, 2023-10-26T06:54:13.629 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 105177, 2023-10-26T06:54:13.629 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 3591, 2023-10-26T06:54:13.630 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-10-26T06:54:13.630 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-10-26T06:54:13.630 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 0, 2023-10-26T06:54:13.631 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 10, 2023-10-26T06:54:13.631 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 115, 2023-10-26T06:54:13.631 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 2307, 2023-10-26T06:54:13.631 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 104, 2023-10-26T06:54:13.632 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-10-26T06:54:13.632 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-10-26T06:54:13.632 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2023-10-26T06:54:13.632 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 23, 2023-10-26T06:54:13.633 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 759, 2023-10-26T06:54:13.633 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-10-26T06:54:13.633 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-10-26T06:54:13.634 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-10-26T06:54:13.634 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 105062, 2023-10-26T06:54:13.634 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 20, 2023-10-26T06:54:13.634 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-10-26T06:54:13.635 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-10-26T06:54:13.635 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-10-26T06:54:13.635 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-10-26T06:54:13.635 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-10-26T06:54:13.636 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-10-26T06:54:13.636 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-10-26T06:54:13.636 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-10-26T06:54:13.636 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-10-26T06:54:13.637 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 70, 2023-10-26T06:54:13.637 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-10-26T06:54:13.637 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-10-26T06:54:13.637 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-10-26T06:54:13.638 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-10-26T06:54:13.638 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-10-26T06:54:13.638 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-10-26T06:54:13.638 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-10-26T06:54:13.639 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-10-26T06:54:13.639 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-10-26T06:54:13.639 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-10-26T06:54:13.640 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-10-26T06:54:13.640 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-10-26T06:54:13.640 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-10-26T06:54:13.640 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-10-26T06:54:13.641 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-10-26T06:54:13.641 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-10-26T06:54:13.641 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 95, 2023-10-26T06:54:13.641 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-10-26T06:54:13.642 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 11, 2023-10-26T06:54:13.642 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 12, 2023-10-26T06:54:13.642 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 12, 2023-10-26T06:54:13.643 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-10-26T06:54:13.643 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-10-26T06:54:13.643 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 606, 2023-10-26T06:54:13.644 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2023-10-26T06:54:13.644 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 103 2023-10-26T06:54:13.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.644 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-10-26T06:54:13.645 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2023-10-26T06:54:13.645 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-10-26T06:54:13.645 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-10-26T06:54:13.645 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-10-26T06:54:13.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.646 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2023-10-26T06:54:13.646 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2023-10-26T06:54:13.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.647 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-10-26T06:54:13.647 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2023-10-26T06:54:13.647 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 10, 2023-10-26T06:54:13.647 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2023-10-26T06:54:13.648 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 10, 2023-10-26T06:54:13.648 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 711, 2023-10-26T06:54:13.648 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2023-10-26T06:54:13.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.649 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:13.649 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:13.649 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:13.650 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:13.650 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 191088, 2023-10-26T06:54:13.650 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 97264829, 2023-10-26T06:54:13.650 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:13.651 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 191088, 2023-10-26T06:54:13.651 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:13.651 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:13.651 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 191088, 2023-10-26T06:54:13.652 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 97264829, 2023-10-26T06:54:13.652 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:13.652 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.652 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.653 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.654 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-10-26T06:54:13.654 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:13.654 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:13.654 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:13.655 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:13.655 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:13.655 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:13.655 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:13.656 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 108768, 2023-10-26T06:54:13.656 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 160951422, 2023-10-26T06:54:13.656 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 108768, 2023-10-26T06:54:13.656 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 160951422, 2023-10-26T06:54:13.657 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:13.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.657 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.658 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-10-26T06:54:13.658 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:13.659 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-10-26T06:54:13.659 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:13.659 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:13.660 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:13.660 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:13.660 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:13.660 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 108768, 2023-10-26T06:54:13.661 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 108768, 2023-10-26T06:54:13.661 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 108768, 2023-10-26T06:54:13.661 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 108768, 2023-10-26T06:54:13.661 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:13.662 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.662 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.662 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.663 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-10-26T06:54:13.663 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:13.663 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-10-26T06:54:13.664 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:13.664 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 711, 2023-10-26T06:54:13.664 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 71843, 2023-10-26T06:54:13.665 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:13.665 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 711, 2023-10-26T06:54:13.665 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:13.665 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:13.666 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 115, 2023-10-26T06:54:13.666 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 71843, 2023-10-26T06:54:13.666 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:13.666 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.667 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.667 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:13.668 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x5570931646e0": { 2023-10-26T06:54:13.668 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 8815, 2023-10-26T06:54:13.668 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-10-26T06:54:13.669 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:13.669 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 47096, 2023-10-26T06:54:13.669 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 154667530, 2023-10-26T06:54:13.669 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 47096, 2023-10-26T06:54:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:13.670 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2192, 2023-10-26T06:54:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 154658715, 2023-10-26T06:54:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:13.671 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:13.673 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-26T06:54:13.830 INFO:tasks.check_counter:Daemon mds.c mds.exported=30 2023-10-26T06:54:13.830 INFO:tasks.check_counter:Daemon mds.c mds.imported=102 2023-10-26T06:54:13.830 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=852 2023-10-26T06:54:13.831 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2788 2023-10-26T06:54:13.831 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2023-10-26T06:54:13.831 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-26T06:54:13.832 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-26T06:54:13.832 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=23 2023-10-26T06:54:13.832 DEBUG:tasks.check_counter:Getting stats from f 2023-10-26T06:54:13.833 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-26T06:54:14.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:14 smithi153 ceph-mon[131657]: pgmap v645: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 37 op/s 2023-10-26T06:54:14.394 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:54:14.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:14 smithi125 ceph-mon[130643]: pgmap v645: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 37 op/s 2023-10-26T06:54:14.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:14 smithi050 ceph-mon[94997]: pgmap v645: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 37 op/s 2023-10-26T06:54:15.512 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-26T06:54:15.513 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:15.513 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1553, 2023-10-26T06:54:15.513 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1555, 2023-10-26T06:54:15.514 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 59187718, 2023-10-26T06:54:15.514 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 482990, 2023-10-26T06:54:15.514 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2023-10-26T06:54:15.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-10-26T06:54:15.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.178308923, 2023-10-26T06:54:15.515 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.042281930, 2023-10-26T06:54:15.516 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.069114434, 2023-10-26T06:54:15.516 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.053142282, 2023-10-26T06:54:15.516 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:15.517 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1553, 2023-10-26T06:54:15.517 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.067020496, 2023-10-26T06:54:15.517 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000043155 2023-10-26T06:54:15.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.518 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:15.518 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.518 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.519 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.519 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:15.520 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:15.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.520 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:15.521 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 861, 2023-10-26T06:54:15.521 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 845, 2023-10-26T06:54:15.521 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 66770444, 2023-10-26T06:54:15.521 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 321517, 2023-10-26T06:54:15.522 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2023-10-26T06:54:15.522 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:15.522 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.125555344, 2023-10-26T06:54:15.523 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.025852790, 2023-10-26T06:54:15.523 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.074039759, 2023-10-26T06:54:15.523 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.023578600, 2023-10-26T06:54:15.524 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:15.524 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 844, 2023-10-26T06:54:15.524 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.095177790, 2023-10-26T06:54:15.525 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000112769 2023-10-26T06:54:15.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.525 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:15.525 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.526 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.526 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.527 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 810960, 2023-10-26T06:54:15.527 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 129568 2023-10-26T06:54:15.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.528 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:15.528 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 480, 2023-10-26T06:54:15.528 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 638, 2023-10-26T06:54:15.528 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 58855987, 2023-10-26T06:54:15.529 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 502797, 2023-10-26T06:54:15.529 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2023-10-26T06:54:15.529 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:15.530 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.082046401, 2023-10-26T06:54:15.530 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.016174539, 2023-10-26T06:54:15.530 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.048128453, 2023-10-26T06:54:15.531 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.013052599, 2023-10-26T06:54:15.531 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:15.531 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 637, 2023-10-26T06:54:15.531 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.024261866, 2023-10-26T06:54:15.532 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000038087 2023-10-26T06:54:15.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.532 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:15.533 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.533 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.533 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.534 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:54:15.534 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 355072 2023-10-26T06:54:15.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.535 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-10-26T06:54:15.535 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-10-26T06:54:15.535 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-10-26T06:54:15.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.536 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-10-26T06:54:15.536 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-10-26T06:54:15.537 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-10-26T06:54:15.537 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4403, 2023-10-26T06:54:15.537 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.132631121, 2023-10-26T06:54:15.537 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000030122 2023-10-26T06:54:15.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.538 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-10-26T06:54:15.539 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-10-26T06:54:15.539 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-10-26T06:54:15.539 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.539 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.540 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.541 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-10-26T06:54:15.541 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2023-10-26T06:54:15.541 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2023-10-26T06:54:15.541 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-10-26T06:54:15.542 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.542 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.542 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.543 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-10-26T06:54:15.543 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2023-10-26T06:54:15.544 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2023-10-26T06:54:15.544 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2023-10-26T06:54:15.544 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2023-10-26T06:54:15.544 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2023-10-26T06:54:15.545 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-10-26T06:54:15.545 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 52552, 2023-10-26T06:54:15.545 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 4161, 2023-10-26T06:54:15.545 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 36413, 2023-10-26T06:54:15.546 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 11978, 2023-10-26T06:54:15.546 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 46607, 2023-10-26T06:54:15.546 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 160, 2023-10-26T06:54:15.547 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2023-10-26T06:54:15.547 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2023-10-26T06:54:15.547 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 34, 2023-10-26T06:54:15.548 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2023-10-26T06:54:15.548 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2023-10-26T06:54:15.548 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2023-10-26T06:54:15.548 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2023-10-26T06:54:15.549 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2023-10-26T06:54:15.549 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-10-26T06:54:15.549 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2023-10-26T06:54:15.550 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2023-10-26T06:54:15.550 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-10-26T06:54:15.550 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2023-10-26T06:54:15.551 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2023-10-26T06:54:15.551 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2023-10-26T06:54:15.551 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2023-10-26T06:54:15.551 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-10-26T06:54:15.552 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2023-10-26T06:54:15.552 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-10-26T06:54:15.552 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2023-10-26T06:54:15.553 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2023-10-26T06:54:15.553 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2023-10-26T06:54:15.553 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2023-10-26T06:54:15.553 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-10-26T06:54:15.554 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-10-26T06:54:15.554 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-10-26T06:54:15.554 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2023-10-26T06:54:15.555 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2023-10-26T06:54:15.555 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2023-10-26T06:54:15.555 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2023-10-26T06:54:15.556 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2023-10-26T06:54:15.556 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2023-10-26T06:54:15.556 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2023-10-26T06:54:15.556 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2023-10-26T06:54:15.557 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-26T06:54:15.557 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-26T06:54:15.557 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2023-10-26T06:54:15.558 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2023-10-26T06:54:15.558 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2023-10-26T06:54:15.558 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2023-10-26T06:54:15.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.559 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-10-26T06:54:15.559 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2023-10-26T06:54:15.559 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2023-10-26T06:54:15.560 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2023-10-26T06:54:15.560 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2023-10-26T06:54:15.560 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2023-10-26T06:54:15.561 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2023-10-26T06:54:15.561 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-10-26T06:54:15.561 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2023-10-26T06:54:15.561 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2023-10-26T06:54:15.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2023-10-26T06:54:15.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2023-10-26T06:54:15.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-10-26T06:54:15.563 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-10-26T06:54:15.563 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-10-26T06:54:15.563 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-10-26T06:54:15.564 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-10-26T06:54:15.564 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-10-26T06:54:15.564 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2023-10-26T06:54:15.564 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2023-10-26T06:54:15.565 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-10-26T06:54:15.565 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2023-10-26T06:54:15.565 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-10-26T06:54:15.566 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-10-26T06:54:15.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.566 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-10-26T06:54:15.566 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2023-10-26T06:54:15.567 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2023-10-26T06:54:15.567 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2023-10-26T06:54:15.567 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2023-10-26T06:54:15.568 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 50654, 2023-10-26T06:54:15.568 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-10-26T06:54:15.568 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2023-10-26T06:54:15.569 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2023-10-26T06:54:15.569 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2023-10-26T06:54:15.569 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2023-10-26T06:54:15.569 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 75, 2023-10-26T06:54:15.570 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 6, 2023-10-26T06:54:15.570 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-10-26T06:54:15.570 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2023-10-26T06:54:15.571 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2023-10-26T06:54:15.571 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 187396093, 2023-10-26T06:54:15.571 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 187392265, 2023-10-26T06:54:15.572 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-10-26T06:54:15.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.572 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.573 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 50654 2023-10-26T06:54:15.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.574 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-10-26T06:54:15.574 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 49920, 2023-10-26T06:54:15.574 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 90766, 2023-10-26T06:54:15.575 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 40846, 2023-10-26T06:54:15.575 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 3536, 2023-10-26T06:54:15.575 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 7078, 2023-10-26T06:54:15.575 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 3542, 2023-10-26T06:54:15.576 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 52552, 2023-10-26T06:54:15.576 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 93316, 2023-10-26T06:54:15.576 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 40764, 2023-10-26T06:54:15.577 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2023-10-26T06:54:15.577 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2023-10-26T06:54:15.577 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2023-10-26T06:54:15.577 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 231768, 2023-10-26T06:54:15.578 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 207152 2023-10-26T06:54:15.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.578 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-10-26T06:54:15.579 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2023-10-26T06:54:15.579 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2023-10-26T06:54:15.579 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2023-10-26T06:54:15.580 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2023-10-26T06:54:15.580 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2023-10-26T06:54:15.580 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-10-26T06:54:15.580 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.581 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.581 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.582 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-10-26T06:54:15.582 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.582 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.583 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.583 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-10-26T06:54:15.583 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.584 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.584 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.585 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-10-26T06:54:15.585 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.585 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.586 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.586 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-10-26T06:54:15.586 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.587 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.587 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.588 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-10-26T06:54:15.588 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.588 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.589 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.589 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-10-26T06:54:15.590 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.590 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.590 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.591 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-10-26T06:54:15.591 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.591 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.592 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.592 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-10-26T06:54:15.593 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.593 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.593 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.594 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-10-26T06:54:15.594 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.595 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.595 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.596 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-10-26T06:54:15.596 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.596 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.596 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.597 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-10-26T06:54:15.597 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.598 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.598 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.599 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-10-26T06:54:15.599 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.599 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.600 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.600 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-10-26T06:54:15.600 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.601 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.601 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.602 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-10-26T06:54:15.602 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.602 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.603 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.603 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-10-26T06:54:15.604 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.604 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.604 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.605 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-10-26T06:54:15.605 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.605 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.606 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.606 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-10-26T06:54:15.607 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.607 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.607 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.608 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2023-10-26T06:54:15.608 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.608 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.609 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.609 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-10-26T06:54:15.610 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.610 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.610 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.611 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-10-26T06:54:15.611 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.612 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.612 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.612 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-10-26T06:54:15.613 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.613 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.613 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.614 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-10-26T06:54:15.614 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.614 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.615 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.615 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-10-26T06:54:15.616 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.616 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.616 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.617 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-10-26T06:54:15.617 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.618 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.618 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.619 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-10-26T06:54:15.619 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.619 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.619 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.620 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-10-26T06:54:15.620 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.621 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.621 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.622 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-10-26T06:54:15.622 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.622 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.623 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.623 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-10-26T06:54:15.623 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.624 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.624 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.625 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-10-26T06:54:15.625 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-10-26T06:54:15.625 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-10-26T06:54:15.625 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.626 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.626 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.626 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.627 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-10-26T06:54:15.627 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2023-10-26T06:54:15.628 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2023-10-26T06:54:15.628 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2023-10-26T06:54:15.628 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2023-10-26T06:54:15.628 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-10-26T06:54:15.629 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2023-10-26T06:54:15.629 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2023-10-26T06:54:15.629 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 2491, 2023-10-26T06:54:15.630 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2023-10-26T06:54:15.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.630 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-10-26T06:54:15.630 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:15.631 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:15.631 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:15.631 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:15.632 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:15.632 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:15.632 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:15.632 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:15.633 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:15.633 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:15.633 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:15.634 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:15.634 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:15.634 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:15.635 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:15.637 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:15.637 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:15.638 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:15.638 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:15.638 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:15.638 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:15.639 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:15.639 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:15.639 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:15.640 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:15.640 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:15.640 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:15.641 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:15.641 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:15.641 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:15.641 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:15.642 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-10-26T06:54:15.642 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:15.642 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:15.643 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:15.643 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:15.643 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 2094281, 2023-10-26T06:54:15.644 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 54612, 2023-10-26T06:54:15.644 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:54:15.644 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2023-10-26T06:54:15.644 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-10-26T06:54:15.645 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-10-26T06:54:15.645 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:15.645 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:15.646 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:15.646 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:15.646 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 7800, 2023-10-26T06:54:15.647 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 163, 2023-10-26T06:54:15.647 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:15.647 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:15.648 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:15.648 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-10-26T06:54:15.648 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 156916004, 2023-10-26T06:54:15.648 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 1700481, 2023-10-26T06:54:15.649 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:15.649 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-10-26T06:54:15.649 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:15.650 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-10-26T06:54:15.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.650 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-10-26T06:54:15.651 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2023-10-26T06:54:15.651 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-10-26T06:54:15.651 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 2645, 2023-10-26T06:54:15.651 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 21, 2023-10-26T06:54:15.652 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2023-10-26T06:54:15.652 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 2645, 2023-10-26T06:54:15.652 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2023-10-26T06:54:15.653 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2645, 2023-10-26T06:54:15.653 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.573912635, 2023-10-26T06:54:15.653 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001729267 2023-10-26T06:54:15.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.654 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2023-10-26T06:54:15.654 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-10-26T06:54:15.654 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2645, 2023-10-26T06:54:15.655 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2646 2023-10-26T06:54:15.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.655 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 2645, 2023-10-26T06:54:15.656 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 2645, 2023-10-26T06:54:15.656 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2023-10-26T06:54:15.656 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-10-26T06:54:15.656 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-10-26T06:54:15.657 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 1547, 2023-10-26T06:54:15.657 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2023-10-26T06:54:15.657 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 1096, 2023-10-26T06:54:15.658 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2023-10-26T06:54:15.658 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2023-10-26T06:54:15.658 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-10-26T06:54:15.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-10-26T06:54:15.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2023-10-26T06:54:15.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2023-10-26T06:54:15.660 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2023-10-26T06:54:15.660 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-10-26T06:54:15.660 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-10-26T06:54:15.661 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-10-26T06:54:15.661 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1, 2023-10-26T06:54:15.661 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2023-10-26T06:54:15.661 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-10-26T06:54:15.662 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-10-26T06:54:15.662 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-10-26T06:54:15.662 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-10-26T06:54:15.663 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-10-26T06:54:15.663 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-10-26T06:54:15.663 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-10-26T06:54:15.664 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-10-26T06:54:15.664 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-10-26T06:54:15.664 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2023-10-26T06:54:15.664 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-10-26T06:54:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-10-26T06:54:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-10-26T06:54:15.665 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-10-26T06:54:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-10-26T06:54:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-10-26T06:54:15.666 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-10-26T06:54:15.667 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-10-26T06:54:15.667 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-10-26T06:54:15.667 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-10-26T06:54:15.667 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-10-26T06:54:15.668 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-10-26T06:54:15.668 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-10-26T06:54:15.668 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-10-26T06:54:15.669 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-10-26T06:54:15.669 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-10-26T06:54:15.669 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 95, 2023-10-26T06:54:15.670 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-10-26T06:54:15.670 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 11, 2023-10-26T06:54:15.670 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 11, 2023-10-26T06:54:15.670 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 11, 2023-10-26T06:54:15.671 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-10-26T06:54:15.671 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-10-26T06:54:15.671 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2023-10-26T06:54:15.672 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2023-10-26T06:54:15.672 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2023-10-26T06:54:15.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.673 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-10-26T06:54:15.673 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2023-10-26T06:54:15.673 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-10-26T06:54:15.673 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-10-26T06:54:15.674 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-10-26T06:54:15.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2023-10-26T06:54:15.675 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2023-10-26T06:54:15.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.675 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-10-26T06:54:15.675 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2023-10-26T06:54:15.676 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2023-10-26T06:54:15.676 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2023-10-26T06:54:15.676 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2023-10-26T06:54:15.677 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2023-10-26T06:54:15.677 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2023-10-26T06:54:15.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.678 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:15.678 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:15.678 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:15.678 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:15.679 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 2890, 2023-10-26T06:54:15.679 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 184538621, 2023-10-26T06:54:15.679 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:15.680 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 2890, 2023-10-26T06:54:15.680 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:15.680 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:15.681 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2890, 2023-10-26T06:54:15.681 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 184538621, 2023-10-26T06:54:15.681 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:15.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.682 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.682 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.683 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-10-26T06:54:15.683 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:15.684 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:15.684 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:15.684 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:15.685 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:15.685 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:15.685 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:15.686 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2645, 2023-10-26T06:54:15.686 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 183262319, 2023-10-26T06:54:15.686 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2645, 2023-10-26T06:54:15.687 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 183262319, 2023-10-26T06:54:15.687 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:15.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.688 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.688 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.688 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.689 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-10-26T06:54:15.689 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:15.690 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-10-26T06:54:15.690 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:15.690 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:15.690 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:15.691 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:15.691 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:15.691 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2645, 2023-10-26T06:54:15.692 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 2645, 2023-10-26T06:54:15.692 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2645, 2023-10-26T06:54:15.692 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 2645, 2023-10-26T06:54:15.693 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:15.693 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.693 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.694 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.695 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-10-26T06:54:15.695 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:15.695 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-10-26T06:54:15.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:15.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:15.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:15.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:15.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:15.697 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:15.697 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:15.697 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2023-10-26T06:54:15.698 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2023-10-26T06:54:15.698 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:15.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.699 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.699 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:15.700 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x563aea08a960": { 2023-10-26T06:54:15.700 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:15.700 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-10-26T06:54:15.700 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:15.701 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:15.701 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:15.701 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:15.702 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:15.702 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:15.702 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:15.703 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2023-10-26T06:54:15.703 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2023-10-26T06:54:15.703 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:15.704 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:15.704 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:15.704 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:15.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:15.705 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-26T06:54:15.838 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-10-26T06:54:15.838 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-10-26T06:54:15.839 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-10-26T06:54:15.839 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-10-26T06:54:15.839 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2023-10-26T06:54:15.841 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-26T06:54:15.841 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-26T06:54:15.842 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-10-26T06:54:15.842 DEBUG:tasks.check_counter:Getting stats from i 2023-10-26T06:54:15.842 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-26T06:54:16.413 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:54:17.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:16 smithi125 ceph-mon[130643]: pgmap v646: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 40 op/s 2023-10-26T06:54:17.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:16 smithi153 ceph-mon[131657]: pgmap v646: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 40 op/s 2023-10-26T06:54:17.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:16 smithi050 ceph-mon[94997]: pgmap v646: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 40 op/s 2023-10-26T06:54:17.531 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-26T06:54:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 71808, 2023-10-26T06:54:17.532 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 81894, 2023-10-26T06:54:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 60280830, 2023-10-26T06:54:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 84290788, 2023-10-26T06:54:17.533 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 23, 2023-10-26T06:54:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 7, 2023-10-26T06:54:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 4.103359745, 2023-10-26T06:54:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 1.381862952, 2023-10-26T06:54:17.534 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 1.224744208, 2023-10-26T06:54:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 1.371160538, 2023-10-26T06:54:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:17.535 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 81892, 2023-10-26T06:54:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.223065056, 2023-10-26T06:54:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000027146 2023-10-26T06:54:17.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 38679, 2023-10-26T06:54:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.008028065, 2023-10-26T06:54:17.537 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000207 2023-10-26T06:54:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:17.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 74618, 2023-10-26T06:54:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 75654, 2023-10-26T06:54:17.539 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 60352065, 2023-10-26T06:54:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 99471747, 2023-10-26T06:54:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 15, 2023-10-26T06:54:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:17.540 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 4.064832664, 2023-10-26T06:54:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 1.446083560, 2023-10-26T06:54:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 1.310811513, 2023-10-26T06:54:17.541 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 1.307187677, 2023-10-26T06:54:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 75653, 2023-10-26T06:54:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.437242635, 2023-10-26T06:54:17.542 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000032216 2023-10-26T06:54:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 42858, 2023-10-26T06:54:17.543 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.006279163, 2023-10-26T06:54:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000146 2023-10-26T06:54:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:54:17.544 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 357216 2023-10-26T06:54:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 104241, 2023-10-26T06:54:17.545 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 215058, 2023-10-26T06:54:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 32079480, 2023-10-26T06:54:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 153289143, 2023-10-26T06:54:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 12, 2023-10-26T06:54:17.546 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2023-10-26T06:54:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 6.025178025, 2023-10-26T06:54:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 2.556317493, 2023-10-26T06:54:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 5.062699649, 2023-10-26T06:54:17.547 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 1.284215794, 2023-10-26T06:54:17.548 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:17.550 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 215057, 2023-10-26T06:54:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 5.592407274, 2023-10-26T06:54:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000026004 2023-10-26T06:54:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 64637, 2023-10-26T06:54:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.028008282, 2023-10-26T06:54:17.552 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000433 2023-10-26T06:54:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 827648, 2023-10-26T06:54:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 286704 2023-10-26T06:54:17.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-10-26T06:54:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-10-26T06:54:17.554 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-10-26T06:54:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-10-26T06:54:17.555 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-10-26T06:54:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-10-26T06:54:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 109704, 2023-10-26T06:54:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 54.195915312, 2023-10-26T06:54:17.556 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000494019 2023-10-26T06:54:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.557 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-10-26T06:54:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-10-26T06:54:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-10-26T06:54:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1627, 2023-10-26T06:54:17.558 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.412374387, 2023-10-26T06:54:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000253456 2023-10-26T06:54:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-10-26T06:54:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 16153, 2023-10-26T06:54:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 15506, 2023-10-26T06:54:17.560 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-10-26T06:54:17.561 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 15506, 2023-10-26T06:54:17.561 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 127.375047529, 2023-10-26T06:54:17.561 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.008214565 2023-10-26T06:54:17.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.562 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-10-26T06:54:17.562 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 647, 2023-10-26T06:54:17.563 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 3, 2023-10-26T06:54:17.563 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2023-10-26T06:54:17.563 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 251, 2023-10-26T06:54:17.564 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 27, 2023-10-26T06:54:17.564 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-10-26T06:54:17.564 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 51724, 2023-10-26T06:54:17.565 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 1614, 2023-10-26T06:54:17.565 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 43459, 2023-10-26T06:54:17.565 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 6651, 2023-10-26T06:54:17.565 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 49419, 2023-10-26T06:54:17.566 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 41590, 2023-10-26T06:54:17.566 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 40086, 2023-10-26T06:54:17.566 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 40086, 2023-10-26T06:54:17.566 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 70, 2023-10-26T06:54:17.567 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 19728, 2023-10-26T06:54:17.567 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 16845, 2023-10-26T06:54:17.567 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 570, 2023-10-26T06:54:17.568 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 741, 2023-10-26T06:54:17.568 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 2, 2023-10-26T06:54:17.568 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-10-26T06:54:17.569 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2023-10-26T06:54:17.569 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 65866, 2023-10-26T06:54:17.569 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-10-26T06:54:17.569 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 29, 2023-10-26T06:54:17.570 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 40884, 2023-10-26T06:54:17.570 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 172, 2023-10-26T06:54:17.570 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 79168, 2023-10-26T06:54:17.571 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-10-26T06:54:17.571 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 155703, 2023-10-26T06:54:17.571 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-10-26T06:54:17.571 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 74443, 2023-10-26T06:54:17.572 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 1237542278, 2023-10-26T06:54:17.572 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2023-10-26T06:54:17.572 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 155703, 2023-10-26T06:54:17.573 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-10-26T06:54:17.573 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-10-26T06:54:17.573 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-10-26T06:54:17.573 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 10540, 2023-10-26T06:54:17.574 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2023-10-26T06:54:17.574 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 10540, 2023-10-26T06:54:17.574 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 145163, 2023-10-26T06:54:17.575 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 34, 2023-10-26T06:54:17.575 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 2367, 2023-10-26T06:54:17.575 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 14450, 2023-10-26T06:54:17.575 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 55, 2023-10-26T06:54:17.576 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-26T06:54:17.576 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-26T06:54:17.576 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 37200, 2023-10-26T06:54:17.577 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 12329, 2023-10-26T06:54:17.577 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 895, 2023-10-26T06:54:17.577 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 3169 2023-10-26T06:54:17.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.578 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-10-26T06:54:17.578 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 950, 2023-10-26T06:54:17.578 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 2452, 2023-10-26T06:54:17.579 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 1502, 2023-10-26T06:54:17.579 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 1677, 2023-10-26T06:54:17.579 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 1877, 2023-10-26T06:54:17.580 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2023-10-26T06:54:17.580 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-10-26T06:54:17.580 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2023-10-26T06:54:17.580 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 855, 2023-10-26T06:54:17.581 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 855, 2023-10-26T06:54:17.581 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2023-10-26T06:54:17.581 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-10-26T06:54:17.582 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-10-26T06:54:17.582 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-10-26T06:54:17.582 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-10-26T06:54:17.582 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-10-26T06:54:17.583 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-10-26T06:54:17.583 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2023-10-26T06:54:17.583 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 29, 2023-10-26T06:54:17.584 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-10-26T06:54:17.584 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 27, 2023-10-26T06:54:17.584 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-10-26T06:54:17.584 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-10-26T06:54:17.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.585 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-10-26T06:54:17.585 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 19, 2023-10-26T06:54:17.585 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 50735, 2023-10-26T06:54:17.586 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2023-10-26T06:54:17.586 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2023-10-26T06:54:17.586 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 50735, 2023-10-26T06:54:17.586 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-10-26T06:54:17.587 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2023-10-26T06:54:17.587 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 75, 2023-10-26T06:54:17.587 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2023-10-26T06:54:17.588 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2023-10-26T06:54:17.588 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 75, 2023-10-26T06:54:17.588 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 6, 2023-10-26T06:54:17.588 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-10-26T06:54:17.589 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2023-10-26T06:54:17.589 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2023-10-26T06:54:17.589 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 187966331, 2023-10-26T06:54:17.590 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2023-10-26T06:54:17.590 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-10-26T06:54:17.590 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2095, 2023-10-26T06:54:17.591 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 78.977307952, 2023-10-26T06:54:17.591 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.037697999 2023-10-26T06:54:17.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.592 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2023-10-26T06:54:17.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.592 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-10-26T06:54:17.592 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 49982, 2023-10-26T06:54:17.593 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 91190, 2023-10-26T06:54:17.593 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 41208, 2023-10-26T06:54:17.593 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 3759, 2023-10-26T06:54:17.594 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 7916, 2023-10-26T06:54:17.594 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 4157, 2023-10-26T06:54:17.594 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 51724, 2023-10-26T06:54:17.595 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 94241, 2023-10-26T06:54:17.595 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 42517, 2023-10-26T06:54:17.595 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 40086, 2023-10-26T06:54:17.595 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 84499, 2023-10-26T06:54:17.596 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 44413, 2023-10-26T06:54:17.596 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 311664, 2023-10-26T06:54:17.596 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 198960 2023-10-26T06:54:17.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.597 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-10-26T06:54:17.597 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 17188, 2023-10-26T06:54:17.597 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 197, 2023-10-26T06:54:17.598 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 16153, 2023-10-26T06:54:17.598 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 38, 2023-10-26T06:54:17.598 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 562, 2023-10-26T06:54:17.598 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-10-26T06:54:17.599 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10307, 2023-10-26T06:54:17.599 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 88.652979042, 2023-10-26T06:54:17.599 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.008601239 2023-10-26T06:54:17.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.600 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-10-26T06:54:17.600 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 93, 2023-10-26T06:54:17.600 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.480397239, 2023-10-26T06:54:17.601 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.015918249 2023-10-26T06:54:17.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.601 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-10-26T06:54:17.601 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.602 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.602 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.603 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-10-26T06:54:17.603 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.603 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.603 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.604 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-10-26T06:54:17.604 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1436, 2023-10-26T06:54:17.605 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 9.700105714, 2023-10-26T06:54:17.605 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.006754948 2023-10-26T06:54:17.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.606 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-10-26T06:54:17.606 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.606 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.606 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.607 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-10-26T06:54:17.607 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-10-26T06:54:17.608 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000153630, 2023-10-26T06:54:17.608 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000153630 2023-10-26T06:54:17.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.608 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-10-26T06:54:17.609 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.609 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.609 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.610 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-10-26T06:54:17.610 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.610 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-10-26T06:54:17.611 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-10-26T06:54:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.613 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-10-26T06:54:17.614 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1326, 2023-10-26T06:54:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 16.278818008, 2023-10-26T06:54:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.012276634 2023-10-26T06:54:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.615 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-10-26T06:54:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.616 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-10-26T06:54:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.617 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.618 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-10-26T06:54:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 852, 2023-10-26T06:54:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.838140602, 2023-10-26T06:54:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000983733 2023-10-26T06:54:17.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-10-26T06:54:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 566, 2023-10-26T06:54:17.620 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.521469487, 2023-10-26T06:54:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.002688108 2023-10-26T06:54:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.621 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-10-26T06:54:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 11, 2023-10-26T06:54:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.875332923, 2023-10-26T06:54:17.622 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.352302993 2023-10-26T06:54:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-10-26T06:54:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.623 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.624 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2023-10-26T06:54:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-10-26T06:54:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.626 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.627 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-10-26T06:54:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-10-26T06:54:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.629 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-10-26T06:54:17.630 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 58, 2023-10-26T06:54:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.185187474, 2023-10-26T06:54:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.020434266 2023-10-26T06:54:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.631 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-10-26T06:54:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.632 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-10-26T06:54:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.633 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-10-26T06:54:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-10-26T06:54:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-10-26T06:54:17.637 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-10-26T06:54:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000883461, 2023-10-26T06:54:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000883461 2023-10-26T06:54:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.638 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-10-26T06:54:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 855, 2023-10-26T06:54:17.639 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.841579949, 2023-10-26T06:54:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004493075 2023-10-26T06:54:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.640 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-10-26T06:54:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-10-26T06:54:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-10-26T06:54:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.641 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.642 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-10-26T06:54:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2023-10-26T06:54:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2023-10-26T06:54:17.643 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2023-10-26T06:54:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2023-10-26T06:54:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-10-26T06:54:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 1676, 2023-10-26T06:54:17.644 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 1676, 2023-10-26T06:54:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 645, 2023-10-26T06:54:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2023-10-26T06:54:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.645 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-10-26T06:54:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:17.646 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:17.647 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:17.648 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:17.649 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:17.650 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:17.651 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:17.652 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:17.653 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:17.654 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-10-26T06:54:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:17.655 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 2238701, 2023-10-26T06:54:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 53291, 2023-10-26T06:54:17.656 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 1144, 2023-10-26T06:54:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 13, 2023-10-26T06:54:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-10-26T06:54:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-10-26T06:54:17.657 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:17.658 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 7800, 2023-10-26T06:54:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 163, 2023-10-26T06:54:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:17.659 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-10-26T06:54:17.660 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 173397743, 2023-10-26T06:54:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 1997839, 2023-10-26T06:54:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-10-26T06:54:17.661 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-10-26T06:54:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.662 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-10-26T06:54:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2023-10-26T06:54:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-10-26T06:54:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 159449, 2023-10-26T06:54:17.663 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 191433667, 2023-10-26T06:54:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 28, 2023-10-26T06:54:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 159449, 2023-10-26T06:54:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2023-10-26T06:54:17.664 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 159449, 2023-10-26T06:54:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 131.522485248, 2023-10-26T06:54:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000824856 2023-10-26T06:54:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.665 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2023-10-26T06:54:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-10-26T06:54:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 159449, 2023-10-26T06:54:17.666 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 159913 2023-10-26T06:54:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 159449, 2023-10-26T06:54:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 155807, 2023-10-26T06:54:17.667 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 3642, 2023-10-26T06:54:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-10-26T06:54:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-10-26T06:54:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 0, 2023-10-26T06:54:17.668 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 10, 2023-10-26T06:54:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 97, 2023-10-26T06:54:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 2193, 2023-10-26T06:54:17.669 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 92, 2023-10-26T06:54:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-10-26T06:54:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-10-26T06:54:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2023-10-26T06:54:17.670 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 26, 2023-10-26T06:54:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 911, 2023-10-26T06:54:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-10-26T06:54:17.671 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-10-26T06:54:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-10-26T06:54:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 155703, 2023-10-26T06:54:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 20, 2023-10-26T06:54:17.672 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-10-26T06:54:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-10-26T06:54:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-10-26T06:54:17.673 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-10-26T06:54:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-10-26T06:54:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-10-26T06:54:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-10-26T06:54:17.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-10-26T06:54:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-10-26T06:54:17.675 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 55, 2023-10-26T06:54:17.677 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-10-26T06:54:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-10-26T06:54:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-10-26T06:54:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-10-26T06:54:17.678 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-10-26T06:54:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-10-26T06:54:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-10-26T06:54:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-10-26T06:54:17.679 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-10-26T06:54:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-10-26T06:54:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-10-26T06:54:17.680 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-10-26T06:54:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-10-26T06:54:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-10-26T06:54:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-10-26T06:54:17.681 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-10-26T06:54:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 95, 2023-10-26T06:54:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-10-26T06:54:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 11, 2023-10-26T06:54:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 12, 2023-10-26T06:54:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 12, 2023-10-26T06:54:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-10-26T06:54:17.683 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-10-26T06:54:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 684, 2023-10-26T06:54:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 10, 2023-10-26T06:54:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 112 2023-10-26T06:54:17.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-10-26T06:54:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2023-10-26T06:54:17.685 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-10-26T06:54:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-10-26T06:54:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-10-26T06:54:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2023-10-26T06:54:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2023-10-26T06:54:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.687 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-10-26T06:54:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2023-10-26T06:54:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 10, 2023-10-26T06:54:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2023-10-26T06:54:17.688 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 10, 2023-10-26T06:54:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 855, 2023-10-26T06:54:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2023-10-26T06:54:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.689 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:17.690 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 250663, 2023-10-26T06:54:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 131006039, 2023-10-26T06:54:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 250663, 2023-10-26T06:54:17.691 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 250663, 2023-10-26T06:54:17.692 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 131006039, 2023-10-26T06:54:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.693 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.694 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-10-26T06:54:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:17.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:17.696 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 159449, 2023-10-26T06:54:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 191519852, 2023-10-26T06:54:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 159449, 2023-10-26T06:54:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 191519852, 2023-10-26T06:54:17.697 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-10-26T06:54:17.699 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-10-26T06:54:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-10-26T06:54:17.700 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-10-26T06:54:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-10-26T06:54:17.701 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 159449, 2023-10-26T06:54:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 159449, 2023-10-26T06:54:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 159449, 2023-10-26T06:54:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 159449, 2023-10-26T06:54:17.702 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-10-26T06:54:17.704 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-10-26T06:54:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:17.705 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 855, 2023-10-26T06:54:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 86363, 2023-10-26T06:54:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 855, 2023-10-26T06:54:17.706 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 97, 2023-10-26T06:54:17.707 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 86363, 2023-10-26T06:54:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.708 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x55e124c926e0": { 2023-10-26T06:54:17.709 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 1148, 2023-10-26T06:54:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-10-26T06:54:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:17.710 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 50735, 2023-10-26T06:54:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 183772027, 2023-10-26T06:54:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 50735, 2023-10-26T06:54:17.711 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2095, 2023-10-26T06:54:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 183770879, 2023-10-26T06:54:17.712 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:17.713 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:17.714 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-26T06:54:17.867 INFO:tasks.check_counter:Daemon mds.i mds.exported=29 2023-10-26T06:54:17.868 INFO:tasks.check_counter:Daemon mds.i mds.imported=172 2023-10-26T06:54:17.868 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=950 2023-10-26T06:54:17.869 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=2452 2023-10-26T06:54:17.869 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-10-26T06:54:17.869 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-10-26T06:54:17.870 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-10-26T06:54:17.870 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=27 2023-10-26T06:54:17.870 DEBUG:tasks.check_counter:Getting stats from l 2023-10-26T06:54:17.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:384993681abceb8cb8affea10538d607052db4b4 shell --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-26T06:54:18.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:17 smithi153 ceph-mon[131657]: pgmap v647: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 47 op/s 2023-10-26T06:54:18.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:17 smithi050 ceph-mon[94997]: pgmap v647: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 47 op/s 2023-10-26T06:54:18.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:17 smithi125 ceph-mon[130643]: pgmap v647: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 47 op/s 2023-10-26T06:54:18.434 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/mon.c/config 2023-10-26T06:54:19.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:19 smithi153 ceph-mon[131657]: osdmap e96: 12 total, 12 up, 12 in 2023-10-26T06:54:19.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:19 smithi125 ceph-mon[130643]: osdmap e96: 12 total, 12 up, 12 in 2023-10-26T06:54:19.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:19 smithi050 ceph-mon[94997]: osdmap e96: 12 total, 12 up, 12 in 2023-10-26T06:54:19.638 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-26T06:54:19.639 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-10-26T06:54:19.639 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 0, 2023-10-26T06:54:19.639 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2, 2023-10-26T06:54:19.639 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 0, 2023-10-26T06:54:19.640 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 0, 2023-10-26T06:54:19.640 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2023-10-26T06:54:19.640 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 0, 2023-10-26T06:54:19.641 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.001229046, 2023-10-26T06:54:19.641 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.000000000, 2023-10-26T06:54:19.641 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.000332103, 2023-10-26T06:54:19.641 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:54:19.642 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:19.642 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:19.642 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:19.643 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:19.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.643 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:19.644 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:19.644 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:19.644 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:19.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.645 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-26T06:54:19.645 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2023-10-26T06:54:19.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.646 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-10-26T06:54:19.646 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 221, 2023-10-26T06:54:19.646 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 216, 2023-10-26T06:54:19.646 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 745248, 2023-10-26T06:54:19.647 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 129296, 2023-10-26T06:54:19.647 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 2, 2023-10-26T06:54:19.647 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2023-10-26T06:54:19.648 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.036359461, 2023-10-26T06:54:19.648 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.012775216, 2023-10-26T06:54:19.648 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.019189896, 2023-10-26T06:54:19.648 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.005916691, 2023-10-26T06:54:19.649 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:19.649 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 215, 2023-10-26T06:54:19.649 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.010904068, 2023-10-26T06:54:19.650 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000050716 2023-10-26T06:54:19.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.650 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:19.650 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:19.651 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:19.651 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:19.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.652 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 745248, 2023-10-26T06:54:19.652 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 129296 2023-10-26T06:54:19.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-10-26T06:54:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 5, 2023-10-26T06:54:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 166, 2023-10-26T06:54:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 3152, 2023-10-26T06:54:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 105840, 2023-10-26T06:54:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 3, 2023-10-26T06:54:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 2, 2023-10-26T06:54:19.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.008574429, 2023-10-26T06:54:19.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.005968561, 2023-10-26T06:54:19.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.000916283, 2023-10-26T06:54:19.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-26T06:54:19.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-10-26T06:54:19.656 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 165, 2023-10-26T06:54:19.656 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.009569860, 2023-10-26T06:54:19.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000057999 2023-10-26T06:54:19.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.657 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-10-26T06:54:19.658 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:19.658 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:19.658 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:19.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-26T06:54:19.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 105840 2023-10-26T06:54:19.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.660 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-10-26T06:54:19.660 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 0, 2023-10-26T06:54:19.660 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-10-26T06:54:19.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.661 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-10-26T06:54:19.661 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2023-10-26T06:54:19.661 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2023-10-26T06:54:19.662 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-10-26T06:54:19.662 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-10-26T06:54:19.662 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-10-26T06:54:19.663 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-10-26T06:54:19.663 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-26T06:54:19.663 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-10-26T06:54:19.664 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-26T06:54:19.664 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-10-26T06:54:19.664 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-10-26T06:54:19.664 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-10-26T06:54:19.665 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-26T06:54:19.665 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2023-10-26T06:54:19.665 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2023-10-26T06:54:19.666 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2023-10-26T06:54:19.666 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2023-10-26T06:54:19.666 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2023-10-26T06:54:19.666 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-26T06:54:19.667 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2023-10-26T06:54:19.667 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-26T06:54:19.667 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-10-26T06:54:19.668 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-10-26T06:54:19.668 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-10-26T06:54:19.668 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-10-26T06:54:19.668 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-10-26T06:54:19.669 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-26T06:54:19.669 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-10-26T06:54:19.669 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-10-26T06:54:19.670 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-10-26T06:54:19.670 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-10-26T06:54:19.670 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-10-26T06:54:19.671 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-10-26T06:54:19.671 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-10-26T06:54:19.671 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-10-26T06:54:19.671 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-10-26T06:54:19.672 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 148967, 2023-10-26T06:54:19.672 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 29, 2023-10-26T06:54:19.672 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2023-10-26T06:54:19.673 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2023-10-26T06:54:19.673 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-10-26T06:54:19.673 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-10-26T06:54:19.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-10-26T06:54:19.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-10-26T06:54:19.674 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-10-26T06:54:19.675 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-10-26T06:54:19.675 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 0, 2023-10-26T06:54:19.675 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 0, 2023-10-26T06:54:19.676 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-10-26T06:54:19.676 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-10-26T06:54:19.676 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-10-26T06:54:19.676 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-10-26T06:54:19.677 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 928, 2023-10-26T06:54:19.677 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 2, 2023-10-26T06:54:19.677 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-10-26T06:54:19.677 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-10-26T06:54:19.678 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-10-26T06:54:19.678 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-10-26T06:54:19.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-26T06:54:19.679 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-26T06:54:19.679 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-10-26T06:54:19.680 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-10-26T06:54:19.680 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-10-26T06:54:19.680 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 222, 2023-10-26T06:54:19.680 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 714014, 2023-10-26T06:54:19.681 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-10-26T06:54:19.681 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 222, 2023-10-26T06:54:19.681 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-10-26T06:54:19.681 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-10-26T06:54:19.682 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 222, 2023-10-26T06:54:19.682 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 714014, 2023-10-26T06:54:19.682 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-10-26T06:54:19.683 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-10-26T06:54:19.683 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-10-26T06:54:19.683 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-10-26T06:54:19.684 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:19.684 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-26T06:54:19.684 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-26T06:54:19.989 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-10-26T06:54:19.989 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-10-26T06:54:19.990 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-10-26T06:54:19.990 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-10-26T06:54:19.991 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2023-10-26T06:54:19.991 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2023-10-26T06:54:19.991 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2023-10-26T06:54:19.992 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2023-10-26T06:54:19.992 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-26T06:54:20.005 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-26T06:54:20.006 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:54:20.006 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-26T06:54:20.058 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:54:20.058 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-26T06:54:20.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:54:20.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 -- 172.21.15.50:0/1612944473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d0073540 msgr2=0x7f71d010c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 --2- 172.21.15.50:0/1612944473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d0073540 0x7f71d010c9a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009990 tx=0x7f71c4009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 -- 172.21.15.50:0/1612944473 shutdown_connections 2023-10-26T06:54:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 --2- 172.21.15.50:0/1612944473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d010cee0 0x7f71d010f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 --2- 172.21.15.50:0/1612944473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d0072c20 0x7f71d0073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 --2- 172.21.15.50:0/1612944473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d0073540 0x7f71d010c9a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 -- 172.21.15.50:0/1612944473 >> 172.21.15.50:0/1612944473 conn(0x7f71d00fc170 msgr2=0x7f71d00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 -- 172.21.15.50:0/1612944473 shutdown_connections 2023-10-26T06:54:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.397+0000 7f71d59ff700 1 -- 172.21.15.50:0/1612944473 wait complete. 2023-10-26T06:54:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.398+0000 7f71d59ff700 1 Processor -- start 2023-10-26T06:54:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.398+0000 7f71d59ff700 1 -- start start 2023-10-26T06:54:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71d59ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d0072c20 0x7f71d0198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71d59ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 0x7f71d01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71d59ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d010cee0 0x7f71d019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71d59ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d019dcb0 con 0x7f71d0073540 2023-10-26T06:54:20.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71d59ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d019de20 con 0x7f71d0072c20 2023-10-26T06:54:20.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71d59ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d019dfe0 con 0x7f71d010cee0 2023-10-26T06:54:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 0x7f71d01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 0x7f71d01992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48598/0 (socket says 172.21.15.50:48598) 2023-10-26T06:54:20.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 -- 172.21.15.50:0/2759600960 learned_addr learned my addr 172.21.15.50:0/2759600960 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ceffd700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d0072c20 0x7f71d0198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71cf7fe700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d010cee0 0x7f71d019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 -- 172.21.15.50:0/2759600960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d010cee0 msgr2=0x7f71d019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d010cee0 0x7f71d019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 -- 172.21.15.50:0/2759600960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d0072c20 msgr2=0x7f71d0198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d0072c20 0x7f71d0198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.399+0000 7f71ce7fc700 1 -- 172.21.15.50:0/2759600960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40095f0 con 0x7f71d0073540 2023-10-26T06:54:20.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.400+0000 7f71ce7fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 0x7f71d01992d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005910 tx=0x7f71c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:20.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.400+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c401d070 con 0x7f71d0073540 2023-10-26T06:54:20.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.400+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71c4022470 con 0x7f71d0073540 2023-10-26T06:54:20.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.400+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4017650 con 0x7f71d0073540 2023-10-26T06:54:20.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.400+0000 7f71d59ff700 1 -- 172.21.15.50:0/2759600960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d019e260 con 0x7f71d0073540 2023-10-26T06:54:20.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.400+0000 7f71d59ff700 1 -- 172.21.15.50:0/2759600960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d019e4e0 con 0x7f71d0073540 2023-10-26T06:54:20.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.401+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d00742d0 con 0x7f71d0073540 2023-10-26T06:54:20.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.403+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f71c40225e0 con 0x7f71d0073540 2023-10-26T06:54:20.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.404+0000 7f71d49fd700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71b80a15f0 0x7f71b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.405+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f71c40ce060 con 0x7f71d0073540 2023-10-26T06:54:20.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.405+0000 7f71ceffd700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71b80a15f0 0x7f71b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.405+0000 7f71ceffd700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71b80a15f0 0x7f71b80a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009c60 tx=0x7f71c0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:20.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.409+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71c4097440 con 0x7f71d0073540 2023-10-26T06:54:20.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:20 smithi125 ceph-mon[130643]: pgmap v649: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 47 op/s 2023-10-26T06:54:20.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:20 smithi153 ceph-mon[131657]: pgmap v649: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 47 op/s 2023-10-26T06:54:20.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:20 smithi050 ceph-mon[94997]: pgmap v649: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 47 op/s 2023-10-26T06:54:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.624+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71d0067530 con 0x7f71d0073540 2023-10-26T06:54:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.626+0000 7f71d49fd700 1 -- 172.21.15.50:0/2759600960 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+22840 (secure 0 0 0) 0x7f71c409aa60 con 0x7f71d0073540 2023-10-26T06:54:20.628 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:54:20.628 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":96,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:54:18.139060+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:54:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.628+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71b80a15f0 msgr2=0x7f71b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.628+0000 7f71b67fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71b80a15f0 0x7f71b80a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009c60 tx=0x7f71c0009260 comp rx=0 tx=0).stop 2023-10-26T06:54:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 msgr2=0x7f71d01992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 0x7f71d01992d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005910 tx=0x7f71c4004730 comp rx=0 tx=0).stop 2023-10-26T06:54:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 shutdown_connections 2023-10-26T06:54:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71b80a15f0 0x7f71b80a3ab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71d010cee0 0x7f71d019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d0072c20 0x7f71d0198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 --2- 172.21.15.50:0/2759600960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71d0073540 0x7f71d01992d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 >> 172.21.15.50:0/2759600960 conn(0x7f71d00fc170 msgr2=0x7f71d00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:20.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 shutdown_connections 2023-10-26T06:54:20.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.629+0000 7f71b67fc700 1 -- 172.21.15.50:0/2759600960 wait complete. 2023-10-26T06:54:20.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-26T06:37:16.153823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-26T06:41:28.869523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-26T06:41:29.927975+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 95, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-26T06:54:20.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-26T06:54:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.861+0000 7f676d1ff700 1 -- 172.21.15.50:0/3332542202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 msgr2=0x7f6768073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.861+0000 7f676d1ff700 1 --2- 172.21.15.50:0/3332542202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768073000 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6758009990 tx=0x7f6758009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 -- 172.21.15.50:0/3332542202 shutdown_connections 2023-10-26T06:54:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 --2- 172.21.15.50:0/3332542202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f676810cf60 0x7f676810f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 --2- 172.21.15.50:0/3332542202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768073000 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 --2- 172.21.15.50:0/3332542202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6768073540 0x7f676810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 -- 172.21.15.50:0/3332542202 >> 172.21.15.50:0/3332542202 conn(0x7f67680fc1b0 msgr2=0x7f67680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 -- 172.21.15.50:0/3332542202 shutdown_connections 2023-10-26T06:54:20.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.862+0000 7f676d1ff700 1 -- 172.21.15.50:0/3332542202 wait complete. 2023-10-26T06:54:20.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 Processor -- start 2023-10-26T06:54:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 -- start start 2023-10-26T06:54:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6768073540 0x7f6768199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676810cf60 0x7f676819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676819dd40 con 0x7f6768072c20 2023-10-26T06:54:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676819deb0 con 0x7f6768073540 2023-10-26T06:54:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f676d1ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676819e070 con 0x7f676810cf60 2023-10-26T06:54:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f6766d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f6766d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48614/0 (socket says 172.21.15.50:48614) 2023-10-26T06:54:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.863+0000 7f6766d9d700 1 -- 172.21.15.50:0/2011495697 learned_addr learned my addr 172.21.15.50:0/2011495697 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f676659c700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6768073540 0x7f6768199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f676759e700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676810cf60 0x7f676819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f6766d9d700 1 -- 172.21.15.50:0/2011495697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676810cf60 msgr2=0x7f676819d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f6766d9d700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676810cf60 0x7f676819d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f6766d9d700 1 -- 172.21.15.50:0/2011495697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6768073540 msgr2=0x7f6768199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f6766d9d700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6768073540 0x7f6768199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:20.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f6766d9d700 1 -- 172.21.15.50:0/2011495697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580095f0 con 0x7f6768072c20 2023-10-26T06:54:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f676759e700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676810cf60 0x7f676819d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:54:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f6766d9d700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768198e20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f67580095c0 tx=0x7f675800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675801d070 con 0x7f6768072c20 2023-10-26T06:54:20.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676819e2f0 con 0x7f6768072c20 2023-10-26T06:54:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6758005050 con 0x7f6768072c20 2023-10-26T06:54:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758004b10 con 0x7f6768072c20 2023-10-26T06:54:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.864+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681a5b90 con 0x7f6768072c20 2023-10-26T06:54:20.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.865+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6768108170 con 0x7f6768072c20 2023-10-26T06:54:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.867+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f67580051c0 con 0x7f6768072c20 2023-10-26T06:54:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.869+0000 7f674ffff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67500a15f0 0x7f67500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:20.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.869+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f67580cdee0 con 0x7f6768072c20 2023-10-26T06:54:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.869+0000 7f676659c700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67500a15f0 0x7f67500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.870+0000 7f676659c700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67500a15f0 0x7f67500a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f676819a370 tx=0x7f675c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:20.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:20.873+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67580972c0 con 0x7f6768072c20 2023-10-26T06:54:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.084+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6768067600 con 0x7f6768072c20 2023-10-26T06:54:21.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.085+0000 7f674ffff700 1 -- 172.21.15.50:0/2011495697 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f675809a8e0 con 0x7f6768072c20 2023-10-26T06:54:21.087 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-10-26T06:54:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67500a15f0 msgr2=0x7f67500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67500a15f0 0x7f67500a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f676819a370 tx=0x7f675c00b410 comp rx=0 tx=0).stop 2023-10-26T06:54:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 msgr2=0x7f6768198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768198e20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f67580095c0 tx=0x7f675800f690 comp rx=0 tx=0).stop 2023-10-26T06:54:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 shutdown_connections 2023-10-26T06:54:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f67500a15f0 0x7f67500a3ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676810cf60 0x7f676819d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6768072c20 0x7f6768198e20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 --2- 172.21.15.50:0/2011495697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6768073540 0x7f6768199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 >> 172.21.15.50:0/2011495697 conn(0x7f67680fc1b0 msgr2=0x7f67680fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:21.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.087+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 shutdown_connections 2023-10-26T06:54:21.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.088+0000 7f676d1ff700 1 -- 172.21.15.50:0/2011495697 wait complete. 2023-10-26T06:54:21.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-26T06:54:21.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 -- 172.21.15.50:0/628370709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 msgr2=0x7ffa1c10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 --2- 172.21.15.50:0/628370709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 0x7ffa1c10ca20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa080098f0 tx=0x7ffa08009c00 comp rx=0 tx=0).stop 2023-10-26T06:54:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 -- 172.21.15.50:0/628370709 shutdown_connections 2023-10-26T06:54:21.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 --2- 172.21.15.50:0/628370709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 --2- 172.21.15.50:0/628370709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 0x7ffa1c073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 --2- 172.21.15.50:0/628370709 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 0x7ffa1c10ca20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 -- 172.21.15.50:0/628370709 >> 172.21.15.50:0/628370709 conn(0x7ffa1c0fc1b0 msgr2=0x7ffa1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:21.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.316+0000 7ffa231ff700 1 -- 172.21.15.50:0/628370709 shutdown_connections 2023-10-26T06:54:21.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.317+0000 7ffa231ff700 1 -- 172.21.15.50:0/628370709 wait complete. 2023-10-26T06:54:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.317+0000 7ffa231ff700 1 Processor -- start 2023-10-26T06:54:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 -- start start 2023-10-26T06:54:21.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 0x7ffa1c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 0x7ffa1c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c19dd90 con 0x7ffa1c10cf60 2023-10-26T06:54:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c19df00 con 0x7ffa1c073540 2023-10-26T06:54:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa231ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c19e0c0 con 0x7ffa1c072c20 2023-10-26T06:54:21.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa2179c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa20f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 0x7ffa1c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa2179c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c19d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48630/0 (socket says 172.21.15.50:48630) 2023-10-26T06:54:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa2179c700 1 -- 172.21.15.50:0/1118099870 learned_addr learned my addr 172.21.15.50:0/1118099870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:21.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa20f9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 0x7ffa1c198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:56142/0 (socket says 172.21.15.50:56142) 2023-10-26T06:54:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.318+0000 7ffa1bfff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 0x7ffa1c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa2179c700 1 -- 172.21.15.50:0/1118099870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 msgr2=0x7ffa1c198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa2179c700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 0x7ffa1c198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa2179c700 1 -- 172.21.15.50:0/1118099870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 msgr2=0x7ffa1c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa2179c700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 0x7ffa1c199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa2179c700 1 -- 172.21.15.50:0/1118099870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14009d00 con 0x7ffa1c10cf60 2023-10-26T06:54:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa2179c700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c19d750 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400e3c0 tx=0x7ffa1400e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa140090d0 con 0x7ffa1c10cf60 2023-10-26T06:54:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa08009520 con 0x7ffa1c10cf60 2023-10-26T06:54:21.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa1400f040 con 0x7ffa1c10cf60 2023-10-26T06:54:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14004dd0 con 0x7ffa1c10cf60 2023-10-26T06:54:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.319+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c1a5a00 con 0x7ffa1c10cf60 2023-10-26T06:54:21.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.320+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c108170 con 0x7ffa1c10cf60 2023-10-26T06:54:21.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.322+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7ffa14003a00 con 0x7ffa1c10cf60 2023-10-26T06:54:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.324+0000 7ffa19ffb700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ffa0c0a15f0 0x7ffa0c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.324+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffa140cd520 con 0x7ffa1c10cf60 2023-10-26T06:54:21.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.324+0000 7ffa20f9b700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ffa0c0a15f0 0x7ffa0c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.325+0000 7ffa20f9b700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ffa0c0a15f0 0x7ffa0c0a3ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009c60 tx=0x7ffa10009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:21.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.326+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffa14096900 con 0x7ffa1c10cf60 2023-10-26T06:54:21.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2759600960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:54:21.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:21 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2011495697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:54:21.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2759600960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:54:21.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:21 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2011495697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:54:21.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2759600960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:54:21.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:21 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2011495697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-26T06:54:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.538+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa1c19a170 con 0x7ffa1c10cf60 2023-10-26T06:54:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.538+0000 7ffa19ffb700 1 -- 172.21.15.50:0/1118099870 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa14099f20 con 0x7ffa1c10cf60 2023-10-26T06:54:21.541 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-10-26T06:54:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.540+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ffa0c0a15f0 msgr2=0x7ffa0c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.540+0000 7ffa231ff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ffa0c0a15f0 0x7ffa0c0a3ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009c60 tx=0x7ffa10009260 comp rx=0 tx=0).stop 2023-10-26T06:54:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 msgr2=0x7ffa1c19d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c19d750 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400e3c0 tx=0x7ffa1400e6d0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 shutdown_connections 2023-10-26T06:54:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7ffa0c0a15f0 0x7ffa0c0a3ab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffa1c10cf60 0x7ffa1c19d750 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa1c072c20 0x7ffa1c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 --2- 172.21.15.50:0/1118099870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffa1c073540 0x7ffa1c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 >> 172.21.15.50:0/1118099870 conn(0x7ffa1c0fc1b0 msgr2=0x7ffa1c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 shutdown_connections 2023-10-26T06:54:21.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.541+0000 7ffa231ff700 1 -- 172.21.15.50:0/1118099870 wait complete. 2023-10-26T06:54:21.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-26T06:54:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.770+0000 7f71e5dff700 1 -- 172.21.15.50:0/2866082673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 msgr2=0x7f71e0073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.770+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2866082673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0073000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009990 tx=0x7f71d0009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 -- 172.21.15.50:0/2866082673 shutdown_connections 2023-10-26T06:54:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2866082673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71e010cf60 0x7f71e010f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2866082673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0073000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2866082673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e0073540 0x7f71e010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 -- 172.21.15.50:0/2866082673 >> 172.21.15.50:0/2866082673 conn(0x7f71e00fc1b0 msgr2=0x7f71e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 -- 172.21.15.50:0/2866082673 shutdown_connections 2023-10-26T06:54:21.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.771+0000 7f71e5dff700 1 -- 172.21.15.50:0/2866082673 wait complete. 2023-10-26T06:54:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 Processor -- start 2023-10-26T06:54:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 -- start start 2023-10-26T06:54:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71e0073540 0x7f71e01993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 0x7f71e019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e019dd30 con 0x7f71e010cf60 2023-10-26T06:54:21.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e019dea0 con 0x7f71e0073540 2023-10-26T06:54:21.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.772+0000 7f71e5dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e019e060 con 0x7f71e0072c20 2023-10-26T06:54:21.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 0x7f71e019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:56168/0 (socket says 172.21.15.50:56168) 2023-10-26T06:54:21.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 -- 172.21.15.50:0/2798066178 learned_addr learned my addr 172.21.15.50:0/2798066178 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:21.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71dffff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 0x7f71e019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48648/0 (socket says 172.21.15.50:48648) 2023-10-26T06:54:21.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71deffd700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71e0073540 0x7f71e01993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 -- 172.21.15.50:0/2798066178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71e0073540 msgr2=0x7f71e01993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71e0073540 0x7f71e01993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 -- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 msgr2=0x7f71e019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 0x7f71e019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 -- 172.21.15.50:0/2798066178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009520 con 0x7f71e0072c20 2023-10-26T06:54:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71dffff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 0x7f71e019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:54:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.773+0000 7f71df7fe700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0198e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f71d0005910 tx=0x7f71d0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.774+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d001d070 con 0x7f71e0072c20 2023-10-26T06:54:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.774+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d00095f0 con 0x7f71e0072c20 2023-10-26T06:54:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.774+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d0022470 con 0x7f71e0072c20 2023-10-26T06:54:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.774+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0017650 con 0x7f71e0072c20 2023-10-26T06:54:21.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.774+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e01a59a0 con 0x7f71e0072c20 2023-10-26T06:54:21.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.775+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0108170 con 0x7f71e0072c20 2023-10-26T06:54:21.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.777+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f71d00225e0 con 0x7f71e0072c20 2023-10-26T06:54:21.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.778+0000 7f71dcff9700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71c80a15f0 0x7f71c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.778+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f71d00ce720 con 0x7f71e0072c20 2023-10-26T06:54:21.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.779+0000 7f71deffd700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71c80a15f0 0x7f71c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.779+0000 7f71deffd700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71c80a15f0 0x7f71c80a3ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f71e019a360 tx=0x7f71d4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.780+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71d0097b00 con 0x7f71e0072c20 2023-10-26T06:54:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.993+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71e019a110 con 0x7f71e0072c20 2023-10-26T06:54:21.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.994+0000 7f71dcff9700 1 -- 172.21.15.50:0/2798066178 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71d009b120 con 0x7f71e0072c20 2023-10-26T06:54:21.996 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-10-26T06:54:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71c80a15f0 msgr2=0x7f71c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71c80a15f0 0x7f71c80a3ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f71e019a360 tx=0x7f71d4009260 comp rx=0 tx=0).stop 2023-10-26T06:54:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 msgr2=0x7f71e0198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0198e60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f71d0005910 tx=0x7f71d0004730 comp rx=0 tx=0).stop 2023-10-26T06:54:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 shutdown_connections 2023-10-26T06:54:21.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f71c80a15f0 0x7f71c80a3ab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71e010cf60 0x7f71e019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0072c20 0x7f71e0198e60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 --2- 172.21.15.50:0/2798066178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71e0073540 0x7f71e01993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 >> 172.21.15.50:0/2798066178 conn(0x7f71e00fc1b0 msgr2=0x7f71e00fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 shutdown_connections 2023-10-26T06:54:22.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:21.996+0000 7f71e5dff700 1 -- 172.21.15.50:0/2798066178 wait complete. 2023-10-26T06:54:22.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-26T06:54:22.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 -- 172.21.15.50:0/1070467844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 msgr2=0x7fda4410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:22.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/1070467844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4410d570 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00b0a0 tx=0x7fda3c00b3b0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 -- 172.21.15.50:0/1070467844 shutdown_connections 2023-10-26T06:54:22.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/1070467844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4410d570 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/1070467844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441066b0 0x7fda44106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/1070467844 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda441006a0 0x7fda44100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 -- 172.21.15.50:0/1070467844 >> 172.21.15.50:0/1070467844 conn(0x7fda440fc190 msgr2=0x7fda440fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 -- 172.21.15.50:0/1070467844 shutdown_connections 2023-10-26T06:54:22.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.226+0000 7fda4b7ff700 1 -- 172.21.15.50:0/1070467844 wait complete. 2023-10-26T06:54:22.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.227+0000 7fda4b7ff700 1 Processor -- start 2023-10-26T06:54:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.227+0000 7fda4b7ff700 1 -- start start 2023-10-26T06:54:22.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4b7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441006a0 0x7fda4419ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4b7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4b7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda441066b0 0x7fda44198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4b7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44199290 con 0x7fda44101060 2023-10-26T06:54:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4b7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44199400 con 0x7fda441066b0 2023-10-26T06:54:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4b7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda441995c0 con 0x7fda441006a0 2023-10-26T06:54:22.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda48d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda48d9a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48670/0 (socket says 172.21.15.50:48670) 2023-10-26T06:54:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda48d9a700 1 -- 172.21.15.50:0/2882295382 learned_addr learned my addr 172.21.15.50:0/2882295382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda49d9c700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda441066b0 0x7fda44198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.228+0000 7fda4959b700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441006a0 0x7fda4419ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda48d9a700 1 -- 172.21.15.50:0/2882295382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441006a0 msgr2=0x7fda4419ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda48d9a700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441006a0 0x7fda4419ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda48d9a700 1 -- 172.21.15.50:0/2882295382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda441066b0 msgr2=0x7fda44198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda48d9a700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda441066b0 0x7fda44198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda48d9a700 1 -- 172.21.15.50:0/2882295382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda34009520 con 0x7fda44101060 2023-10-26T06:54:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda4959b700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441006a0 0x7fda4419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:54:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda48d9a700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4419ef60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fda3400eb30 tx=0x7fda3400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34009880 con 0x7fda44101060 2023-10-26T06:54:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda340044e0 con 0x7fda44101060 2023-10-26T06:54:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c009d00 con 0x7fda44101060 2023-10-26T06:54:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34003e90 con 0x7fda44101060 2023-10-26T06:54:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.229+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda441a59a0 con 0x7fda44101060 2023-10-26T06:54:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.230+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda44101de0 con 0x7fda44101060 2023-10-26T06:54:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.232+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fda34004000 con 0x7fda44101060 2023-10-26T06:54:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.234+0000 7fda3a7fc700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fda300a1670 0x7fda300a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.234+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fda34014070 con 0x7fda44101060 2023-10-26T06:54:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.234+0000 7fda4959b700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fda300a1670 0x7fda300a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:22.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.235+0000 7fda4959b700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fda300a1670 0x7fda300a3b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda40009c90 tx=0x7fda40009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:22.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.238+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fda34096820 con 0x7fda44101060 2023-10-26T06:54:22.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1118099870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:54:22.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:22 smithi050 ceph-mon[94997]: pgmap v650: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 187 KiB/s wr, 38 op/s 2023-10-26T06:54:22.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:22 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2798066178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:54:22.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:22 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1118099870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:54:22.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:22 smithi125 ceph-mon[130643]: pgmap v650: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 187 KiB/s wr, 38 op/s 2023-10-26T06:54:22.423 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:22 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2798066178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:54:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.465+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda44110620 con 0x7fda44101060 2023-10-26T06:54:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.465+0000 7fda3a7fc700 1 -- 172.21.15.50:0/2882295382 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v96) v1 ==== 81+0+886 (secure 0 0 0) 0x7fda34099e40 con 0x7fda44101060 2023-10-26T06:54:22.467 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1314120136 2023-10-27T06:35:29.545969+0000 2023-10-26T06:54:22.468 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2911133373 2023-10-27T06:34:16.859427+0000 2023-10-26T06:54:22.468 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1503297701 2023-10-27T06:34:16.859427+0000 2023-10-26T06:54:22.468 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1314120136 2023-10-27T06:35:29.545969+0000 2023-10-26T06:54:22.468 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2663349310 2023-10-27T06:35:29.545969+0000 2023-10-26T06:54:22.469 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1124107424 2023-10-27T06:34:16.859427+0000 2023-10-26T06:54:22.469 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2908802913 2023-10-27T06:33:49.700512+0000 2023-10-26T06:54:22.469 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3300695880 2023-10-27T06:33:49.700512+0000 2023-10-26T06:54:22.470 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/366874467 2023-10-27T06:33:49.700512+0000 2023-10-26T06:54:22.470 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1503297701 2023-10-27T06:34:16.859427+0000 2023-10-26T06:54:22.470 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2908802913 2023-10-27T06:33:49.700512+0000 2023-10-26T06:54:22.470 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/998830555 2023-10-27T06:33:49.700512+0000 2023-10-26T06:54:22.471 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/4014613334 2023-10-27T06:35:29.545969+0000 2023-10-26T06:54:22.471 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2617197618 2023-10-27T06:35:29.545969+0000 2023-10-26T06:54:22.471 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1905106945 2023-10-27T06:34:16.859427+0000 2023-10-26T06:54:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fda300a1670 msgr2=0x7fda300a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fda300a1670 0x7fda300a3b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda40009c90 tx=0x7fda40009260 comp rx=0 tx=0).stop 2023-10-26T06:54:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 msgr2=0x7fda4419ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4419ef60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fda3400eb30 tx=0x7fda3400ee40 comp rx=0 tx=0).stop 2023-10-26T06:54:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 shutdown_connections 2023-10-26T06:54:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fda300a1670 0x7fda300a3b30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda441066b0 0x7fda44198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda441006a0 0x7fda4419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 --2- 172.21.15.50:0/2882295382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda44101060 0x7fda4419ef60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.467+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 >> 172.21.15.50:0/2882295382 conn(0x7fda440fc190 msgr2=0x7fda440fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.468+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 shutdown_connections 2023-10-26T06:54:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:22.468+0000 7fda4b7ff700 1 -- 172.21.15.50:0/2882295382 wait complete. 2023-10-26T06:54:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:listed 15 entries 2023-10-26T06:54:22.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:22 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1118099870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-26T06:54:22.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:22 smithi153 ceph-mon[131657]: pgmap v650: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 187 KiB/s wr, 38 op/s 2023-10-26T06:54:22.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:22 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2798066178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-26T06:54:22.489 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-26T06:54:22.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:22.489 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-26T06:54:23.425 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:23 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2882295382' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-26T06:54:23.485 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:23 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2882295382' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-26T06:54:23.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:23 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2882295382' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-26T06:54:24.093 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:54:24.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:24.094 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-26T06:54:24.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:24.161 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-26T06:54:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-26T06:54:24.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:24.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-26T06:54:24.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:24.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-26T06:54:24.341 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:24 smithi050 ceph-mon[94997]: pgmap v651: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 187 KiB/s wr, 37 op/s 2023-10-26T06:54:24.422 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:24 smithi125 ceph-mon[130643]: pgmap v651: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 187 KiB/s wr, 37 op/s 2023-10-26T06:54:24.427 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-26T06:54:24.428 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-10-26T06:54:24.428 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-26T06:54:24.484 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:24 smithi153 ceph-mon[131657]: pgmap v651: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 187 KiB/s wr, 37 op/s 2023-10-26T06:54:24.513 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351432k,nr_inodes=4087858,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/d782063c963f43fed4589829fef4c926e9f6aa6c926dc6b33a7d42209716b3d8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/d782063c963f43fed4589829fef4c926e9f6aa6c926dc6b33a7d42209716b3d8/diff,workdir=/var/lib/containers/storage/overlay/d782063c963f43fed4589829fef4c926e9f6aa6c926dc6b33a7d42209716b3d8/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2a437d3f9bd44a780d0758a300d41c8f93c57b1b14343b04c54b30cc9ecd173e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/2a437d3f9bd44a780d0758a300d41c8f93c57b1b14343b04c54b30cc9ecd173e/diff,workdir=/var/lib/containers/storage/overlay/2a437d3f9bd44a780d0758a300d41c8f93c57b1b14343b04c54b30cc9ecd173e/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/bdbea3f3a88384f6a9f1ac36c1efd70dc339ce00817607747ade25c6b94a72f1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/bdbea3f3a88384f6a9f1ac36c1efd70dc339ce00817607747ade25c6b94a72f1/diff,workdir=/var/lib/containers/storage/overlay/bdbea3f3a88384f6a9f1ac36c1efd70dc339ce00817607747ade25c6b94a72f1/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/75cbc313acbdffb6525efa3570719b100226d7ac5b10f3b86e2445d9db2d4b3e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/75cbc313acbdffb6525efa3570719b100226d7ac5b10f3b86e2445d9db2d4b3e/diff,workdir=/var/lib/containers/storage/overlay/75cbc313acbdffb6525efa3570719b100226d7ac5b10f3b86e2445d9db2d4b3e/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/290f270c6d6d7f656d182477efe3a27c0856f4f3b50a29d69f4c340e5b0ed787/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/290f270c6d6d7f656d182477efe3a27c0856f4f3b50a29d69f4c340e5b0ed787/diff,workdir=/var/lib/containers/storage/overlay/290f270c6d6d7f656d182477efe3a27c0856f4f3b50a29d69f4c340e5b0ed787/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/815ad0d94089aa0430854c69868551c3b6db37852af1c4e610ee66b0d37c630d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/815ad0d94089aa0430854c69868551c3b6db37852af1c4e610ee66b0d37c630d/diff,workdir=/var/lib/containers/storage/overlay/815ad0d94089aa0430854c69868551c3b6db37852af1c4e610ee66b0d37c630d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3782fc0fa588adcca787427aed9f9b20c7f82769a35fe5223d8bbd6c5cd8a657/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/3782fc0fa588adcca787427aed9f9b20c7f82769a35fe5223d8bbd6c5cd8a657/diff,workdir=/var/lib/containers/storage/overlay/3782fc0fa588adcca787427aed9f9b20c7f82769a35fe5223d8bbd6c5cd8a657/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5313a84cfec0c569342fc9cbba79c2a82cc21f8df8473acfdb0539efd5554094/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/5313a84cfec0c569342fc9cbba79c2a82cc21f8df8473acfdb0539efd5554094/diff,workdir=/var/lib/containers/storage/overlay/5313a84cfec0c569342fc9cbba79c2a82cc21f8df8473acfdb0539efd5554094/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/652f3eadcbf2edbacceccd5de634de942d475205578e076c6a9ead3ba7a73f2c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/652f3eadcbf2edbacceccd5de634de942d475205578e076c6a9ead3ba7a73f2c/diff,workdir=/var/lib/containers/storage/overlay/652f3eadcbf2edbacceccd5de634de942d475205578e076c6a9ead3ba7a73f2c/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c94a9922d1d03850806fcbaf538f3552d1e79b3d6d52770b8d43848d533b83fd/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/QRE7TFDNAU45PPD4YV4OYRCKNA:/var/lib/containers/storage/overlay/l/ASIUEFMGYWSCU2EFHT67CSOSIN,upperdir=/var/lib/containers/storage/overlay/c94a9922d1d03850806fcbaf538f3552d1e79b3d6d52770b8d43848d533b83fd/diff,workdir=/var/lib/containers/storage/overlay/c94a9922d1d03850806fcbaf538f3552d1e79b3d6d52770b8d43848d533b83fd/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-26T06:54:24.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:24.514 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-10-26T06:54:24.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-26T06:54:24.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-10-26T06:54:24.713 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2023-10-26T06:54:24.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:54:24.716 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-26T06:54:24.728 INFO:tasks.cephadm:Teardown begin 2023-10-26T06:54:24.728 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-26T06:54:24.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:54:24.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 -- 172.21.15.50:0/3846892182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144106fe0 msgr2=0x7fa144067870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/3846892182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144106fe0 0x7fa144067870 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa134009990 tx=0x7fa134009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 -- 172.21.15.50:0/3846892182 shutdown_connections 2023-10-26T06:54:24.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/3846892182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144067fa0 0x7fa14410d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/3846892182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1441066c0 0x7fa144106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/3846892182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144106fe0 0x7fa144067870 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.935+0000 7fa14c7ff700 1 -- 172.21.15.50:0/3846892182 >> 172.21.15.50:0/3846892182 conn(0x7fa144076400 msgr2=0x7fa144076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:24.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.936+0000 7fa14c7ff700 1 -- 172.21.15.50:0/3846892182 shutdown_connections 2023-10-26T06:54:24.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.936+0000 7fa14c7ff700 1 -- 172.21.15.50:0/3846892182 wait complete. 2023-10-26T06:54:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.936+0000 7fa14c7ff700 1 Processor -- start 2023-10-26T06:54:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 -- start start 2023-10-26T06:54:24.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 0x7fa144198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:24.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1441066c0 0x7fa144199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:24.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144106fe0 0x7fa14419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:24.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14419dcf0 con 0x7fa144067fa0 2023-10-26T06:54:24.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14419de60 con 0x7fa1441066c0 2023-10-26T06:54:24.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14c7ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14419e020 con 0x7fa144106fe0 2023-10-26T06:54:24.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14a59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 0x7fa144198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:24.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14ad9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144106fe0 0x7fa14419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa149d9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1441066c0 0x7fa144199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14a59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 0x7fa144198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57776/0 (socket says 172.21.15.50:57776) 2023-10-26T06:54:24.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14ad9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144106fe0 0x7fa14419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.50:42156/0 (socket says 172.21.15.50:42156) 2023-10-26T06:54:24.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.937+0000 7fa14a59b700 1 -- 172.21.15.50:0/1207745961 learned_addr learned my addr 172.21.15.50:0/1207745961 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:24.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14a59b700 1 -- 172.21.15.50:0/1207745961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144106fe0 msgr2=0x7fa14419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:24.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14a59b700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144106fe0 0x7fa14419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:24.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14a59b700 1 -- 172.21.15.50:0/1207745961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1441066c0 msgr2=0x7fa144199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:24.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14a59b700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1441066c0 0x7fa144199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:24.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14a59b700 1 -- 172.21.15.50:0/1207745961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340095f0 con 0x7fa144067fa0 2023-10-26T06:54:24.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14a59b700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 0x7fa144198dd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa14000e9a0 tx=0x7fa14000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:24.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140009790 con 0x7fa144067fa0 2023-10-26T06:54:24.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa140010430 con 0x7fa144067fa0 2023-10-26T06:54:24.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14419e300 con 0x7fa144067fa0 2023-10-26T06:54:24.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140018680 con 0x7fa144067fa0 2023-10-26T06:54:24.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.938+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1441a5b40 con 0x7fa144067fa0 2023-10-26T06:54:24.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.939+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa144101de0 con 0x7fa144067fa0 2023-10-26T06:54:24.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.941+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa1400105a0 con 0x7fa144067fa0 2023-10-26T06:54:24.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.943+0000 7fa13b7fe700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa1300a15f0 0x7fa1300a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:24.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.943+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa140014070 con 0x7fa144067fa0 2023-10-26T06:54:24.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.943+0000 7fa149d9a700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa1300a15f0 0x7fa1300a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:24.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.944+0000 7fa149d9a700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa1300a15f0 0x7fa1300a3ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa14419a320 tx=0x7fa13400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:24.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:24.945+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa140096750 con 0x7fa144067fa0 2023-10-26T06:54:25.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.208+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa144067530 con 0x7fa144067fa0 2023-10-26T06:54:25.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.208+0000 7fa13b7fe700 1 -- 172.21.15.50:0/1207745961 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11332 (secure 0 0 0) 0x7fa140026090 con 0x7fa144067fa0 2023-10-26T06:54:25.210 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:54:25.211 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:52:51.263709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":116,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:54:25.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa1300a15f0 msgr2=0x7fa1300a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa1300a15f0 0x7fa1300a3ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa14419a320 tx=0x7fa13400b260 comp rx=0 tx=0).stop 2023-10-26T06:54:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 msgr2=0x7fa144198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 0x7fa144198dd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa14000e9a0 tx=0x7fa14000ecb0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 shutdown_connections 2023-10-26T06:54:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fa1300a15f0 0x7fa1300a3ab0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa144106fe0 0x7fa14419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa144067fa0 0x7fa144198dd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 --2- 172.21.15.50:0/1207745961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa1441066c0 0x7fa144199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 >> 172.21.15.50:0/1207745961 conn(0x7fa144076400 msgr2=0x7fa14410b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:25.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 shutdown_connections 2023-10-26T06:54:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.211+0000 7fa14c7ff700 1 -- 172.21.15.50:0/1207745961 wait complete. 2023-10-26T06:54:25.216 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 34 2023-10-26T06:54:25.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-26T06:54:25.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 -- 172.21.15.50:0/1206145441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07101066b0 msgr2=0x7f0710106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 --2- 172.21.15.50:0/1206145441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07101066b0 0x7f0710106a90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0704009990 tx=0x7f0704009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 -- 172.21.15.50:0/1206145441 shutdown_connections 2023-10-26T06:54:25.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 --2- 172.21.15.50:0/1206145441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0710101060 0x7f071010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 --2- 172.21.15.50:0/1206145441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07101066b0 0x7f0710106a90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 --2- 172.21.15.50:0/1206145441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101006a0 0x7f0710100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 -- 172.21.15.50:0/1206145441 >> 172.21.15.50:0/1206145441 conn(0x7f07100fc170 msgr2=0x7f07100fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 -- 172.21.15.50:0/1206145441 shutdown_connections 2023-10-26T06:54:25.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.437+0000 7f07171ff700 1 -- 172.21.15.50:0/1206145441 wait complete. 2023-10-26T06:54:25.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 Processor -- start 2023-10-26T06:54:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 -- start start 2023-10-26T06:54:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07101006a0 0x7f071019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0710101060 0x7f071019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 0x7f0710198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0710199180 con 0x7f07101066b0 2023-10-26T06:54:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07101992f0 con 0x7f0710101060 2023-10-26T06:54:25.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.438+0000 7f07171ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07101994b0 con 0x7f07101006a0 2023-10-26T06:54:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 0x7f0710198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 0x7f0710198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57792/0 (socket says 172.21.15.50:57792) 2023-10-26T06:54:25.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 -- 172.21.15.50:0/2205988638 learned_addr learned my addr 172.21.15.50:0/2205988638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f0714f9b700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07101006a0 0x7f071019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f070ffff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0710101060 0x7f071019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 -- 172.21.15.50:0/2205988638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07101006a0 msgr2=0x7f071019e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07101006a0 0x7f071019e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 -- 172.21.15.50:0/2205988638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0710101060 msgr2=0x7f071019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0710101060 0x7f071019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 -- 172.21.15.50:0/2205988638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040095f0 con 0x7f07101066b0 2023-10-26T06:54:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.439+0000 7f071579c700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 0x7f0710198b20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f070800ef30 tx=0x7f070800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.440+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708018070 con 0x7f07101066b0 2023-10-26T06:54:25.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.440+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0710199730 con 0x7f07101066b0 2023-10-26T06:54:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.440+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f070800f040 con 0x7f07101066b0 2023-10-26T06:54:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.440+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800ccc0 con 0x7f07101066b0 2023-10-26T06:54:25.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.440+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07101a59e0 con 0x7f07101066b0 2023-10-26T06:54:25.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.441+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0710101de0 con 0x7f07101066b0 2023-10-26T06:54:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.443+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0708003a00 con 0x7f07101066b0 2023-10-26T06:54:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.445+0000 7f070dffb700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07000a15f0 0x7f07000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.445+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f07080cd530 con 0x7f07101066b0 2023-10-26T06:54:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.445+0000 7f0714f9b700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07000a15f0 0x7f07000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.446+0000 7f0714f9b700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07000a15f0 0x7f07000a3ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f070400b2e0 tx=0x7f0704005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:25.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.447+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0708096910 con 0x7f07101066b0 2023-10-26T06:54:25.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:25 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1207745961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:54:25.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:25 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1207745961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:54:25.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.704+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0710199fe0 con 0x7f07101066b0 2023-10-26T06:54:25.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.705+0000 7f070dffb700 1 -- 172.21.15.50:0/2205988638 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f0708025380 con 0x7f07101066b0 2023-10-26T06:54:25.707 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:54:25.707 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/373696388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":373696388},{"type":"v1","addr":"172.21.15.50:6837","nonce":373696388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14709,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/212825483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":212825483},{"type":"v1","addr":"172.21.15.50:6839","nonce":212825483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/2366491284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":2366491284},{"type":"v1","addr":"172.21.15.50:6841","nonce":2366491284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2111783202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2111783202},{"type":"v1","addr":"172.21.15.153:6833","nonce":2111783202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24629,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6833/1915771333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":1915771333},{"type":"v1","addr":"172.21.15.125:6833","nonce":1915771333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24647,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/817994746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":817994746},{"type":"v1","addr":"172.21.15.50:6835","nonce":817994746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-26T06:41:30.489106+0000","modified":"2023-10-26T06:52:51.263709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24740,"mds_1":24709,"mds_2":24694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6835/3214904167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":3214904167},{"type":"v1","addr":"172.21.15.125:6835","nonce":3214904167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24682":{"gid":24682,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/2747210301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2747210301},{"type":"v1","addr":"172.21.15.153:6835","nonce":2747210301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24692":{"gid":24692,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.125:6837/2652114750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2652114750},{"type":"v1","addr":"172.21.15.125:6837","nonce":2652114750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24694":{"gid":24694,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6837/3558298736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":3558298736},{"type":"v1","addr":"172.21.15.153:6837","nonce":3558298736}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24709":{"gid":24709,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":116,"addr":"172.21.15.153:6839/1756575060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1756575060},{"type":"v1","addr":"172.21.15.153:6839","nonce":1756575060}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24740":{"gid":24740,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6839/1086282741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6838","nonce":1086282741},{"type":"v1","addr":"172.21.15.125:6839","nonce":1086282741}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-26T06:54:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07000a15f0 msgr2=0x7f07000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07000a15f0 0x7f07000a3ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f070400b2e0 tx=0x7f0704005fd0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 msgr2=0x7f0710198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 0x7f0710198b20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f070800ef30 tx=0x7f070800c3a0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 shutdown_connections 2023-10-26T06:54:25.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f07000a15f0 0x7f07000a3ab0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07101066b0 0x7f0710198b20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07101006a0 0x7f071019e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 --2- 172.21.15.50:0/2205988638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0710101060 0x7f071019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 >> 172.21.15.50:0/2205988638 conn(0x7f07100fc170 msgr2=0x7f07100fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:25.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 shutdown_connections 2023-10-26T06:54:25.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.707+0000 7f07171ff700 1 -- 172.21.15.50:0/2205988638 wait complete. 2023-10-26T06:54:25.713 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 34 2023-10-26T06:54:25.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-26T06:54:25.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:25 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1207745961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:54:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 -- 172.21.15.50:0/1022611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541006a0 msgr2=0x7fb754100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1022611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541006a0 0x7fb754100b20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb7440098f0 tx=0x7fb744009c00 comp rx=0 tx=0).stop 2023-10-26T06:54:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 -- 172.21.15.50:0/1022611229 shutdown_connections 2023-10-26T06:54:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1022611229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1022611229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541066b0 0x7fb754106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1022611229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541006a0 0x7fb754100b20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 -- 172.21.15.50:0/1022611229 >> 172.21.15.50:0/1022611229 conn(0x7fb7540fc170 msgr2=0x7fb7540fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:25.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 -- 172.21.15.50:0/1022611229 shutdown_connections 2023-10-26T06:54:25.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.937+0000 7fb75bbff700 1 -- 172.21.15.50:0/1022611229 wait complete. 2023-10-26T06:54:25.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.938+0000 7fb75bbff700 1 Processor -- start 2023-10-26T06:54:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.938+0000 7fb75bbff700 1 -- start start 2023-10-26T06:54:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541006a0 0x7fb75419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75bbff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541066b0 0x7fb754198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75bbff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541991e0 con 0x7fb754101060 2023-10-26T06:54:25.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75bbff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754199350 con 0x7fb7541006a0 2023-10-26T06:54:25.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75bbff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754199510 con 0x7fb7541066b0 2023-10-26T06:54:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75999b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541006a0 0x7fb75419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75a19c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541066b0 0x7fb754198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75419ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57808/0 (socket says 172.21.15.50:57808) 2023-10-26T06:54:25.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 -- 172.21.15.50:0/1792556311 learned_addr learned my addr 172.21.15.50:0/1792556311 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:25.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75999b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541006a0 0x7fb75419ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:50110/0 (socket says 172.21.15.50:50110) 2023-10-26T06:54:25.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 -- 172.21.15.50:0/1792556311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541066b0 msgr2=0x7fb754198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541066b0 0x7fb754198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 -- 172.21.15.50:0/1792556311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541006a0 msgr2=0x7fb75419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:25.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541006a0 0x7fb75419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:25.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.939+0000 7fb75919a700 1 -- 172.21.15.50:0/1792556311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009520 con 0x7fb754101060 2023-10-26T06:54:25.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.940+0000 7fb75919a700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75419ef90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb744005950 tx=0x7fb74400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:25.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.940+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74401c070 con 0x7fb754101060 2023-10-26T06:54:25.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.940+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb754199790 con 0x7fb754101060 2023-10-26T06:54:25.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.940+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb74400baa0 con 0x7fb754101060 2023-10-26T06:54:25.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.940+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440038e0 con 0x7fb754101060 2023-10-26T06:54:25.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.940+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7541a5a40 con 0x7fb754101060 2023-10-26T06:54:25.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.941+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb754101de0 con 0x7fb754101060 2023-10-26T06:54:25.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.944+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb744020030 con 0x7fb754101060 2023-10-26T06:54:25.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.946+0000 7fb74affd700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb7400a15f0 0x7fb7400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:25.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.946+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb7440cdfe0 con 0x7fb754101060 2023-10-26T06:54:25.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.946+0000 7fb75999b700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb7400a15f0 0x7fb7400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:25.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.947+0000 7fb75999b700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb7400a15f0 0x7fb7400a3ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb750009be0 tx=0x7fb750009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:25.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:25.948+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb7440973c0 con 0x7fb754101060 2023-10-26T06:54:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.168+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7540674e0 con 0x7fb754101060 2023-10-26T06:54:26.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.170+0000 7fb74affd700 1 -- 172.21.15.50:0/1792556311 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+22840 (secure 0 0 0) 0x7fb74409a9e0 con 0x7fb754101060 2023-10-26T06:54:26.172 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-10-26T06:54:26.172 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":96,"fsid":"6f658e7e-73c9-11ee-8db9-212e2dc638e7","created":"2023-10-26T06:33:16.188624+0000","modified":"2023-10-26T06:54:18.139060+0000","last_up_change":"2023-10-26T06:40:42.232163+0000","last_in_change":"2023-10-26T06:40:25.231127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-26T06:37:16.153823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-26T06:41:28.869523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-26T06:41:29.927975+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cc0af17d-e1a7-4cd3-914a-fcdaa6be75c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6803","nonce":4270342949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6805","nonce":4270342949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6809","nonce":4270342949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":4270342949},{"type":"v1","addr":"172.21.15.50:6807","nonce":4270342949}]},"public_addr":"172.21.15.50:6803/4270342949","cluster_addr":"172.21.15.50:6805/4270342949","heartbeat_back_addr":"172.21.15.50:6809/4270342949","heartbeat_front_addr":"172.21.15.50:6807/4270342949","state":["exists","up"]},{"osd":1,"uuid":"c0dee837-e527-4d2c-a2b7-6be86efb66bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6801","nonce":2294493733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6803","nonce":2294493733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6807","nonce":2294493733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":2294493733},{"type":"v1","addr":"172.21.15.125:6805","nonce":2294493733}]},"public_addr":"172.21.15.125:6801/2294493733","cluster_addr":"172.21.15.125:6803/2294493733","heartbeat_back_addr":"172.21.15.125:6807/2294493733","heartbeat_front_addr":"172.21.15.125:6805/2294493733","state":["exists","up"]},{"osd":2,"uuid":"9e6a6b09-22ef-4586-af08-5d4a22e70fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6801","nonce":3455493796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6803","nonce":3455493796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6807","nonce":3455493796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3455493796},{"type":"v1","addr":"172.21.15.153:6805","nonce":3455493796}]},"public_addr":"172.21.15.153:6801/3455493796","cluster_addr":"172.21.15.153:6803/3455493796","heartbeat_back_addr":"172.21.15.153:6807/3455493796","heartbeat_front_addr":"172.21.15.153:6805/3455493796","state":["exists","up"]},{"osd":3,"uuid":"13dce44a-ed55-4e67-9a10-1d728d5481e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6811","nonce":2387269481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6813","nonce":2387269481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6817","nonce":2387269481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2387269481},{"type":"v1","addr":"172.21.15.50:6815","nonce":2387269481}]},"public_addr":"172.21.15.50:6811/2387269481","cluster_addr":"172.21.15.50:6813/2387269481","heartbeat_back_addr":"172.21.15.50:6817/2387269481","heartbeat_front_addr":"172.21.15.50:6815/2387269481","state":["exists","up"]},{"osd":4,"uuid":"3204503f-f6de-43fa-a3cb-f4d7e5213c4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6809","nonce":1302238589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6811","nonce":1302238589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6815","nonce":1302238589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1302238589},{"type":"v1","addr":"172.21.15.125:6813","nonce":1302238589}]},"public_addr":"172.21.15.125:6809/1302238589","cluster_addr":"172.21.15.125:6811/1302238589","heartbeat_back_addr":"172.21.15.125:6815/1302238589","heartbeat_front_addr":"172.21.15.125:6813/1302238589","state":["exists","up"]},{"osd":5,"uuid":"8da6ddc7-6f23-4f38-972e-57bac47dfd40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6809","nonce":2001551915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6811","nonce":2001551915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6815","nonce":2001551915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2001551915},{"type":"v1","addr":"172.21.15.153:6813","nonce":2001551915}]},"public_addr":"172.21.15.153:6809/2001551915","cluster_addr":"172.21.15.153:6811/2001551915","heartbeat_back_addr":"172.21.15.153:6815/2001551915","heartbeat_front_addr":"172.21.15.153:6813/2001551915","state":["exists","up"]},{"osd":6,"uuid":"a6b0ab31-fd81-4000-945c-064c4d303b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6819","nonce":3555167697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6821","nonce":3555167697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6825","nonce":3555167697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3555167697},{"type":"v1","addr":"172.21.15.50:6823","nonce":3555167697}]},"public_addr":"172.21.15.50:6819/3555167697","cluster_addr":"172.21.15.50:6821/3555167697","heartbeat_back_addr":"172.21.15.50:6825/3555167697","heartbeat_front_addr":"172.21.15.50:6823/3555167697","state":["exists","up"]},{"osd":7,"uuid":"7657f951-0ca2-4e41-adfd-ff76ea7c65eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6817","nonce":3807250109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6819","nonce":3807250109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6823","nonce":3807250109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":3807250109},{"type":"v1","addr":"172.21.15.125:6821","nonce":3807250109}]},"public_addr":"172.21.15.125:6817/3807250109","cluster_addr":"172.21.15.125:6819/3807250109","heartbeat_back_addr":"172.21.15.125:6823/3807250109","heartbeat_front_addr":"172.21.15.125:6821/3807250109","state":["exists","up"]},{"osd":8,"uuid":"863809b1-9944-4b1a-8e37-a8c0ce125f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6817","nonce":3815055379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6819","nonce":3815055379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6823","nonce":3815055379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3815055379},{"type":"v1","addr":"172.21.15.153:6821","nonce":3815055379}]},"public_addr":"172.21.15.153:6817/3815055379","cluster_addr":"172.21.15.153:6819/3815055379","heartbeat_back_addr":"172.21.15.153:6823/3815055379","heartbeat_front_addr":"172.21.15.153:6821/3815055379","state":["exists","up"]},{"osd":9,"uuid":"238027b3-5f4d-49a2-be84-e1b201ef5db3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6827","nonce":2403450797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6829","nonce":2403450797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6833","nonce":2403450797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":2403450797},{"type":"v1","addr":"172.21.15.50:6831","nonce":2403450797}]},"public_addr":"172.21.15.50:6827/2403450797","cluster_addr":"172.21.15.50:6829/2403450797","heartbeat_back_addr":"172.21.15.50:6833/2403450797","heartbeat_front_addr":"172.21.15.50:6831/2403450797","state":["exists","up"]},{"osd":10,"uuid":"f1dfbdc7-aa84-41c3-a312-1e0b72311863","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6825","nonce":4125267059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6827","nonce":4125267059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6831","nonce":4125267059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4125267059},{"type":"v1","addr":"172.21.15.125:6829","nonce":4125267059}]},"public_addr":"172.21.15.125:6825/4125267059","cluster_addr":"172.21.15.125:6827/4125267059","heartbeat_back_addr":"172.21.15.125:6831/4125267059","heartbeat_front_addr":"172.21.15.125:6829/4125267059","state":["exists","up"]},{"osd":11,"uuid":"f3c32b99-ba7b-41b0-82b8-f3c139e5c21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6825","nonce":356376297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6827","nonce":356376297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6831","nonce":356376297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":356376297},{"type":"v1","addr":"172.21.15.153:6829","nonce":356376297}]},"public_addr":"172.21.15.153:6825/356376297","cluster_addr":"172.21.15.153:6827/356376297","heartbeat_back_addr":"172.21.15.153:6831/356376297","heartbeat_front_addr":"172.21.15.153:6829/356376297","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:30.285286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:36:52.277938+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:12.984673+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:37:39.283167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:01.677814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:22.894962+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:38:49.131565+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:10.810334+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:31.514134+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:39:57.753685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:20.166050+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-26T06:40:41.040509+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6800/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2911133373":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/1314120136":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2663349310":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1124107424":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6800/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/3300695880":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/366874467":"2023-10-27T06:33:49.700512+0000","172.21.15.50:6800/1503297701":"2023-10-27T06:34:16.859427+0000","172.21.15.50:6801/2908802913":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/998830555":"2023-10-27T06:33:49.700512+0000","172.21.15.50:0/4014613334":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/2617197618":"2023-10-27T06:35:29.545969+0000","172.21.15.50:0/1905106945":"2023-10-27T06:34:16.859427+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-26T06:54:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb7400a15f0 msgr2=0x7fb7400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb7400a15f0 0x7fb7400a3ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb750009be0 tx=0x7fb750009260 comp rx=0 tx=0).stop 2023-10-26T06:54:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 msgr2=0x7fb75419ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75419ef90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb744005950 tx=0x7fb74400fa00 comp rx=0 tx=0).stop 2023-10-26T06:54:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 shutdown_connections 2023-10-26T06:54:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb7400a15f0 0x7fb7400a3ab0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7541066b0 0x7fb754198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7541006a0 0x7fb75419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 --2- 172.21.15.50:0/1792556311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb754101060 0x7fb75419ef90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 >> 172.21.15.50:0/1792556311 conn(0x7fb7540fc170 msgr2=0x7fb75410be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 shutdown_connections 2023-10-26T06:54:26.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.172+0000 7fb75bbff700 1 -- 172.21.15.50:0/1792556311 wait complete. 2023-10-26T06:54:26.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-26T06:54:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 -- 172.21.15.50:0/2035455901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 msgr2=0x7fb518100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 --2- 172.21.15.50:0/2035455901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb518100b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb508009990 tx=0x7fb508009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 -- 172.21.15.50:0/2035455901 shutdown_connections 2023-10-26T06:54:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 --2- 172.21.15.50:0/2035455901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb518101060 0x7fb51810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 --2- 172.21.15.50:0/2035455901 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5181066b0 0x7fb518106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 --2- 172.21.15.50:0/2035455901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb518100b20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 -- 172.21.15.50:0/2035455901 >> 172.21.15.50:0/2035455901 conn(0x7fb5180fc170 msgr2=0x7fb5180fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 -- 172.21.15.50:0/2035455901 shutdown_connections 2023-10-26T06:54:26.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.401+0000 7fb5207ff700 1 -- 172.21.15.50:0/2035455901 wait complete. 2023-10-26T06:54:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.402+0000 7fb5207ff700 1 Processor -- start 2023-10-26T06:54:26.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 -- start start 2023-10-26T06:54:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb51819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb518101060 0x7fb51819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5181066b0 0x7fb518198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb518199330 con 0x7fb5181006a0 2023-10-26T06:54:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5181994a0 con 0x7fb518101060 2023-10-26T06:54:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb5207ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb518199660 con 0x7fb5181066b0 2023-10-26T06:54:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb51e59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb51819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb51e59b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb51819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57824/0 (socket says 172.21.15.50:57824) 2023-10-26T06:54:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb51e59b700 1 -- 172.21.15.50:0/3547140693 learned_addr learned my addr 172.21.15.50:0/3547140693 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.403+0000 7fb51dd9a700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb518101060 0x7fb51819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51ed9c700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5181066b0 0x7fb518198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51e59b700 1 -- 172.21.15.50:0/3547140693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5181066b0 msgr2=0x7fb518198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51e59b700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5181066b0 0x7fb518198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51e59b700 1 -- 172.21.15.50:0/3547140693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb518101060 msgr2=0x7fb51819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51e59b700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb518101060 0x7fb51819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51e59b700 1 -- 172.21.15.50:0/3547140693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080095f0 con 0x7fb5181006a0 2023-10-26T06:54:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51dd9a700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb518101060 0x7fb51819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:54:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb51e59b700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb51819eac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb51400e9a0 tx=0x7fb51400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514009790 con 0x7fb5181006a0 2023-10-26T06:54:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb514010430 con 0x7fb5181006a0 2023-10-26T06:54:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514018680 con 0x7fb5181006a0 2023-10-26T06:54:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.404+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518199940 con 0x7fb5181006a0 2023-10-26T06:54:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.405+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5181a5a40 con 0x7fb5181006a0 2023-10-26T06:54:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.406+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb518101de0 con 0x7fb5181006a0 2023-10-26T06:54:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.407+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fb5140105a0 con 0x7fb5181006a0 2023-10-26T06:54:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.409+0000 7fb50f7fe700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5040a15f0 0x7fb5040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.409+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb514014070 con 0x7fb5181006a0 2023-10-26T06:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.409+0000 7fb51dd9a700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5040a15f0 0x7fb5040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.410+0000 7fb51dd9a700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5040a15f0 0x7fb5040a3ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb5080098e0 tx=0x7fb508005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.413+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb514052100 con 0x7fb5181006a0 2023-10-26T06:54:26.517 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:26 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2205988638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:54:26.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:26 smithi050 ceph-mon[94997]: pgmap v652: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 184 KiB/s wr, 20 op/s 2023-10-26T06:54:26.518 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:26 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1792556311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:54:26.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.669+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb518110620 con 0x7fb5181006a0 2023-10-26T06:54:26.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2205988638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:54:26.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-mon[130643]: pgmap v652: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 184 KiB/s wr, 20 op/s 2023-10-26T06:54:26.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1792556311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:54:26.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.672+0000 7fb50f7fe700 1 -- 172.21.15.50:0/3547140693 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb514096580 con 0x7fb5181006a0 2023-10-26T06:54:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5040a15f0 msgr2=0x7fb5040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5040a15f0 0x7fb5040a3ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb5080098e0 tx=0x7fb508005960 comp rx=0 tx=0).stop 2023-10-26T06:54:26.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 msgr2=0x7fb51819eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb51819eac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb51400e9a0 tx=0x7fb51400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 shutdown_connections 2023-10-26T06:54:26.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fb5040a15f0 0x7fb5040a3ab0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5181066b0 0x7fb518198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5181006a0 0x7fb51819eac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 --2- 172.21.15.50:0/3547140693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb518101060 0x7fb51819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.675+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 >> 172.21.15.50:0/3547140693 conn(0x7fb5180fc170 msgr2=0x7fb518072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:26.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.676+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 shutdown_connections 2023-10-26T06:54:26.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.676+0000 7fb5207ff700 1 -- 172.21.15.50:0/3547140693 wait complete. 2023-10-26T06:54:26.681 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-26T06:54:26.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-26T06:54:26.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2205988638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-26T06:54:26.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-mon[131657]: pgmap v652: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 184 KiB/s wr, 20 op/s 2023-10-26T06:54:26.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1792556311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-26T06:54:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 -- 172.21.15.50:0/1586914133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd974106730 msgr2=0x7fd974106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1586914133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd974106730 0x7fd974106b10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd970009990 tx=0x7fd970009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 -- 172.21.15.50:0/1586914133 shutdown_connections 2023-10-26T06:54:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1586914133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9741010e0 0x7fd97410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1586914133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd974106730 0x7fd974106b10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1586914133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 0x7fd974100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 -- 172.21.15.50:0/1586914133 >> 172.21.15.50:0/1586914133 conn(0x7fd9740fc1b0 msgr2=0x7fd9740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:26.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 -- 172.21.15.50:0/1586914133 shutdown_connections 2023-10-26T06:54:26.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.906+0000 7fd97bfff700 1 -- 172.21.15.50:0/1586914133 wait complete. 2023-10-26T06:54:26.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.907+0000 7fd97bfff700 1 Processor -- start 2023-10-26T06:54:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.907+0000 7fd97bfff700 1 -- start start 2023-10-26T06:54:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 0x7fd97419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 0x7fd97419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd974106730 0x7fd974198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974199200 con 0x7fd9741010e0 2023-10-26T06:54:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97bfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974199370 con 0x7fd974100720 2023-10-26T06:54:26.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97bfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974199530 con 0x7fd974106730 2023-10-26T06:54:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 0x7fd97419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 0x7fd97419efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57850/0 (socket says 172.21.15.50:57850) 2023-10-26T06:54:26.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 -- 172.21.15.50:0/1792801420 learned_addr learned my addr 172.21.15.50:0/1792801420 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd979d9b700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 0x7fd97419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97a59c700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd974106730 0x7fd974198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 -- 172.21.15.50:0/1792801420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd974106730 msgr2=0x7fd974198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd974106730 0x7fd974198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 -- 172.21.15.50:0/1792801420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 msgr2=0x7fd97419ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 0x7fd97419ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:26.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd97959a700 1 -- 172.21.15.50:0/1792801420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700095f0 con 0x7fd9741010e0 2023-10-26T06:54:26.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.908+0000 7fd979d9b700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 0x7fd97419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-26T06:54:26.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.909+0000 7fd97959a700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 0x7fd97419efb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e9a0 tx=0x7fd96400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:26.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.909+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964009790 con 0x7fd9741010e0 2023-10-26T06:54:26.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.909+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd964010430 con 0x7fd9741010e0 2023-10-26T06:54:26.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.909+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964018680 con 0x7fd9741010e0 2023-10-26T06:54:26.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.909+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974199810 con 0x7fd9741010e0 2023-10-26T06:54:26.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.909+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9741a5a60 con 0x7fd9741010e0 2023-10-26T06:54:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.910+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974101e60 con 0x7fd9741010e0 2023-10-26T06:54:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.912+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd9640105a0 con 0x7fd9741010e0 2023-10-26T06:54:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.913+0000 7fd96affd700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd9600a1670 0x7fd9600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:26.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.914+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8597+0+0 (secure 0 0 0) 0x7fd964014070 con 0x7fd9741010e0 2023-10-26T06:54:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.914+0000 7fd979d9b700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd9600a1670 0x7fd9600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.914+0000 7fd979d9b700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd9600a1670 0x7fd9600a3b30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd97000b2e0 tx=0x7fd970005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:26.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:26.915+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd964096820 con 0x7fd9741010e0 2023-10-26T06:54:26.984 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c[170488]: ignoring --setuser ceph since I am not root 2023-10-26T06:54:26.985 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c[170488]: ignoring --setgroup ceph since I am not root 2023-10-26T06:54:26.985 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-mds[170512]: -- 172.21.15.153:0/298539725 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557fd592d1e0 con 0x557fd5902800 2023-10-26T06:54:26.985 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c[170488]: starting mds.c at 2023-10-26T06:54:26.986 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f[170145]: ignoring --setuser ceph since I am not root 2023-10-26T06:54:26.986 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f[170145]: ignoring --setgroup ceph since I am not root 2023-10-26T06:54:26.986 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-mds[170169]: -- 172.21.15.153:0/950499898 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5609e449f1e0 con 0x5609e4475000 2023-10-26T06:54:26.987 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f[170145]: starting mds.f at 2023-10-26T06:54:26.987 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: ignoring --setuser ceph since I am not root 2023-10-26T06:54:26.987 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: ignoring --setgroup ceph since I am not root 2023-10-26T06:54:26.988 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-mds[170852]: -- 172.21.15.153:0/1116083747 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564ff958d1e0 con 0x564ff9563000 2023-10-26T06:54:26.988 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:54:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: starting mds.i at 2023-10-26T06:54:27.017 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:54:26.670+0000 7f8f37810700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-26T06:54:27.172 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h[167832]: ignoring --setuser ceph since I am not root 2023-10-26T06:54:27.173 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h[167832]: ignoring --setgroup ceph since I am not root 2023-10-26T06:54:27.173 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-mds[167856]: -- 172.21.15.125:0/586622320 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c5f686f1e0 con 0x55c5f6844800 2023-10-26T06:54:27.173 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h[167832]: starting mds.h at 2023-10-26T06:54:27.174 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: ignoring --setuser ceph since I am not root 2023-10-26T06:54:27.174 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: ignoring --setgroup ceph since I am not root 2023-10-26T06:54:27.175 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-mds[168196]: -- 172.21.15.125:0/3740522130 <== mon.2 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d458fc91e0 con 0x55d458f9e800 2023-10-26T06:54:27.175 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: starting mds.b at 2023-10-26T06:54:27.175 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e[167492]: ignoring --setuser ceph since I am not root 2023-10-26T06:54:27.176 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e[167492]: ignoring --setgroup ceph since I am not root 2023-10-26T06:54:27.176 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-mds[167516]: -- 172.21.15.125:0/1025010952 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5610d0de11e0 con 0x5610d0db6c00 2023-10-26T06:54:27.176 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:54:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e[167492]: starting mds.e at 2023-10-26T06:54:27.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.179+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd974110690 con 0x7fd9741010e0 2023-10-26T06:54:27.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3547140693' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-26T06:54:27.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-26T06:54:27.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-26T06:54:27.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-26T06:54:27.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/3547140693' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-26T06:54:27.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: osdmap e97: 12 total, 12 up, 12 in 2023-10-26T06:54:27.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-10-26T06:54:27.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:27 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1792801420' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:54:27.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.674+0000 7fd96affd700 1 -- 172.21.15.50:0/1792801420 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd9640260a0 con 0x7fd9741010e0 2023-10-26T06:54:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd9600a1670 msgr2=0x7fd9600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd9600a1670 0x7fd9600a3b30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd97000b2e0 tx=0x7fd970005fd0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 msgr2=0x7fd97419efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:27.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 0x7fd97419efb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e9a0 tx=0x7fd96400ecb0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 shutdown_connections 2023-10-26T06:54:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fd9600a1670 0x7fd9600a3b30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd974106730 0x7fd974198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd974100720 0x7fd97419ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 --2- 172.21.15.50:0/1792801420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9741010e0 0x7fd97419efb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 >> 172.21.15.50:0/1792801420 conn(0x7fd9740fc1b0 msgr2=0x7fd97410be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:27.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 shutdown_connections 2023-10-26T06:54:27.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.677+0000 7fd97bfff700 1 -- 172.21.15.50:0/1792801420 wait complete. 2023-10-26T06:54:27.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3547140693' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-26T06:54:27.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-26T06:54:27.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-26T06:54:27.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-26T06:54:27.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/3547140693' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-26T06:54:27.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: osdmap e97: 12 total, 12 up, 12 in 2023-10-26T06:54:27.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-10-26T06:54:27.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:27 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1792801420' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:54:27.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-26T06:54:27.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3547140693' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-26T06:54:27.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-26T06:54:27.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-26T06:54:27.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-26T06:54:27.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/3547140693' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-26T06:54:27.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: osdmap e97: 12 total, 12 up, 12 in 2023-10-26T06:54:27.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-10-26T06:54:27.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:27 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1792801420' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-26T06:54:27.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 -- 172.21.15.50:0/3768416277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe90106730 msgr2=0x7fbe90106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:27.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 --2- 172.21.15.50:0/3768416277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe90106730 0x7fbe90106b10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009990 tx=0x7fbe80009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 -- 172.21.15.50:0/3768416277 shutdown_connections 2023-10-26T06:54:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 --2- 172.21.15.50:0/3768416277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe901010e0 0x7fbe9010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 --2- 172.21.15.50:0/3768416277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe90106730 0x7fbe90106b10 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 --2- 172.21.15.50:0/3768416277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90100720 0x7fbe90100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 -- 172.21.15.50:0/3768416277 >> 172.21.15.50:0/3768416277 conn(0x7fbe900fc1b0 msgr2=0x7fbe900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 -- 172.21.15.50:0/3768416277 shutdown_connections 2023-10-26T06:54:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.910+0000 7fbe95fff700 1 -- 172.21.15.50:0/3768416277 wait complete. 2023-10-26T06:54:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.911+0000 7fbe95fff700 1 Processor -- start 2023-10-26T06:54:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.911+0000 7fbe95fff700 1 -- start start 2023-10-26T06:54:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.911+0000 7fbe95fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 0x7fbe90198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe95fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe901010e0 0x7fbe90199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe95fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90106730 0x7fbe9019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe95fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9019dcd0 con 0x7fbe901010e0 2023-10-26T06:54:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe95fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9019de40 con 0x7fbe90100720 2023-10-26T06:54:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe95fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9019e000 con 0x7fbe90106730 2023-10-26T06:54:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe901010e0 0x7fbe90199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 0x7fbe90198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 0x7fbe90198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.50:50168/0 (socket says 172.21.15.50:50168) 2023-10-26T06:54:27.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 -- 172.21.15.50:0/124355257 learned_addr learned my addr 172.21.15.50:0/124355257 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe901010e0 0x7fbe90199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57870/0 (socket says 172.21.15.50:57870) 2023-10-26T06:54:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8ffff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90106730 0x7fbe9019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 -- 172.21.15.50:0/124355257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90106730 msgr2=0x7fbe9019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90106730 0x7fbe9019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 -- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe901010e0 msgr2=0x7fbe90199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe901010e0 0x7fbe90199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8f7fe700 1 -- 172.21.15.50:0/124355257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800095f0 con 0x7fbe90100720 2023-10-26T06:54:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.912+0000 7fbe8ffff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90106730 0x7fbe9019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-26T06:54:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.913+0000 7fbe8f7fe700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 0x7fbe90198e00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000c00 tx=0x7fbe80005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.913+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8001d070 con 0x7fbe90100720 2023-10-26T06:54:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.913+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9019e280 con 0x7fbe90100720 2023-10-26T06:54:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.913+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe901a5b20 con 0x7fbe90100720 2023-10-26T06:54:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.913+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe80022470 con 0x7fbe90100720 2023-10-26T06:54:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.913+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800175f0 con 0x7fbe90100720 2023-10-26T06:54:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.914+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700052e0 con 0x7fbe90100720 2023-10-26T06:54:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.916+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fbe8000fb00 con 0x7fbe90100720 2023-10-26T06:54:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.917+0000 7fbe8d7fa700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbe7c0a1670 0x7fbe7c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.918+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8597+0+0 (secure 0 0 0) 0x7fbe800ce480 con 0x7fbe90100720 2023-10-26T06:54:27.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.918+0000 7fbe87fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbe7c0a1670 0x7fbe7c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.918+0000 7fbe87fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbe7c0a1670 0x7fbe7c0a3b30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbe9019a300 tx=0x7fbe78009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:27.920+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbe80097780 con 0x7fbe90100720 2023-10-26T06:54:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.132+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe70005590 con 0x7fbe90100720 2023-10-26T06:54:28.672 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-26T06:54:28.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-26T06:54:28.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: Cluster is now healthy 2023-10-26T06:54:28.673 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/1792801420' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-26T06:54:28.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6838/1894557601,v1:172.21.15.125:6839/1894557601] up:boot 2023-10-26T06:54:28.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6834/2946296424,v1:172.21.15.125:6835/2946296424] up:boot 2023-10-26T06:54:28.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.125:6836/1753481721,v1:172.21.15.125:6837/1753481721] up:boot 2023-10-26T06:54:28.674 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6837/3356537737,v1:172.21.15.153:6839/3356537737] up:boot 2023-10-26T06:54:28.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6834/1535328441,v1:172.21.15.153:6835/1535328441] up:boot 2023-10-26T06:54:28.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: mds.? [v2:172.21.15.153:6836/4121087475,v1:172.21.15.153:6838/4121087475] up:boot 2023-10-26T06:54:28.675 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: fsmap 12 up:standby 2023-10-26T06:54:28.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-26T06:54:28.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-26T06:54:28.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-26T06:54:28.676 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-26T06:54:28.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-26T06:54:28.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-26T06:54:28.677 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: pgmap v654: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 188 KiB/s wr, 12 op/s 2023-10-26T06:54:28.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/124355257' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:28.678 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:28 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.684+0000 7fbe8d7fa700 1 -- 172.21.15.50:0/124355257 <== mon.2 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe800270d0 con 0x7fbe90100720 2023-10-26T06:54:28.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbe7c0a1670 msgr2=0x7fbe7c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:28.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbe7c0a1670 0x7fbe7c0a3b30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbe9019a300 tx=0x7fbe78009260 comp rx=0 tx=0).stop 2023-10-26T06:54:28.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 msgr2=0x7fbe90198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:28.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 0x7fbe90198e00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000c00 tx=0x7fbe80005740 comp rx=0 tx=0).stop 2023-10-26T06:54:28.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 shutdown_connections 2023-10-26T06:54:28.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7fbe7c0a1670 0x7fbe7c0a3b30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe90106730 0x7fbe9019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe90100720 0x7fbe90198e00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 --2- 172.21.15.50:0/124355257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe901010e0 0x7fbe90199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.689+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 >> 172.21.15.50:0/124355257 conn(0x7fbe900fc1b0 msgr2=0x7fbe900fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:28.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.690+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 shutdown_connections 2023-10-26T06:54:28.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.690+0000 7fbe95fff700 1 -- 172.21.15.50:0/124355257 wait complete. 2023-10-26T06:54:28.695 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-10-26T06:54:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-26T06:54:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-26T06:54:28.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: Cluster is now healthy 2023-10-26T06:54:28.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/1792801420' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-26T06:54:28.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6838/1894557601,v1:172.21.15.125:6839/1894557601] up:boot 2023-10-26T06:54:28.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6834/2946296424,v1:172.21.15.125:6835/2946296424] up:boot 2023-10-26T06:54:28.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.125:6836/1753481721,v1:172.21.15.125:6837/1753481721] up:boot 2023-10-26T06:54:28.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6837/3356537737,v1:172.21.15.153:6839/3356537737] up:boot 2023-10-26T06:54:28.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6834/1535328441,v1:172.21.15.153:6835/1535328441] up:boot 2023-10-26T06:54:28.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: mds.? [v2:172.21.15.153:6836/4121087475,v1:172.21.15.153:6838/4121087475] up:boot 2023-10-26T06:54:28.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: fsmap 12 up:standby 2023-10-26T06:54:28.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-26T06:54:28.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-26T06:54:28.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-26T06:54:28.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-26T06:54:28.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-26T06:54:28.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-26T06:54:28.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: pgmap v654: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 188 KiB/s wr, 12 op/s 2023-10-26T06:54:28.721 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/124355257' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:28.721 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:28 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:28.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-26T06:54:28.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-26T06:54:28.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-26T06:54:28.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: Cluster is now healthy 2023-10-26T06:54:28.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/1792801420' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-26T06:54:28.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6838/1894557601,v1:172.21.15.125:6839/1894557601] up:boot 2023-10-26T06:54:28.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6834/2946296424,v1:172.21.15.125:6835/2946296424] up:boot 2023-10-26T06:54:28.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.125:6836/1753481721,v1:172.21.15.125:6837/1753481721] up:boot 2023-10-26T06:54:28.736 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6837/3356537737,v1:172.21.15.153:6839/3356537737] up:boot 2023-10-26T06:54:28.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6834/1535328441,v1:172.21.15.153:6835/1535328441] up:boot 2023-10-26T06:54:28.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: mds.? [v2:172.21.15.153:6836/4121087475,v1:172.21.15.153:6838/4121087475] up:boot 2023-10-26T06:54:28.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: fsmap 12 up:standby 2023-10-26T06:54:28.737 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-26T06:54:28.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-26T06:54:28.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-26T06:54:28.738 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-26T06:54:28.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-26T06:54:28.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='mgr.14214 172.21.15.50:0/3425185626' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-26T06:54:28.739 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: pgmap v654: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 188 KiB/s wr, 12 op/s 2023-10-26T06:54:28.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/124355257' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:28.740 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:28 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 -- 172.21.15.50:0/3811487579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 msgr2=0x7f5178073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 --2- 172.21.15.50:0/3811487579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178073000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5168009990 tx=0x7f5168009ca0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 -- 172.21.15.50:0/3811487579 shutdown_connections 2023-10-26T06:54:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 --2- 172.21.15.50:0/3811487579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517810cf60 0x7f517810f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 --2- 172.21.15.50:0/3811487579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178073000 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 --2- 172.21.15.50:0/3811487579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178073540 0x7f517810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 -- 172.21.15.50:0/3811487579 >> 172.21.15.50:0/3811487579 conn(0x7f51780fc1b0 msgr2=0x7f51780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 -- 172.21.15.50:0/3811487579 shutdown_connections 2023-10-26T06:54:28.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.935+0000 7f517dbff700 1 -- 172.21.15.50:0/3811487579 wait complete. 2023-10-26T06:54:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.936+0000 7f517dbff700 1 Processor -- start 2023-10-26T06:54:28.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.936+0000 7f517dbff700 1 -- start start 2023-10-26T06:54:28.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f517dbff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f517dbff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178073540 0x7f5178199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f517dbff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517810cf60 0x7f517819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f517dbff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517819dd00 con 0x7f5178072c20 2023-10-26T06:54:28.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f517dbff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517819de70 con 0x7f517810cf60 2023-10-26T06:54:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f517dbff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517819e030 con 0x7f5178073540 2023-10-26T06:54:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f51777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:28.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f51777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57892/0 (socket says 172.21.15.50:57892) 2023-10-26T06:54:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f51777fe700 1 -- 172.21.15.50:0/2325675425 learned_addr learned my addr 172.21.15.50:0/2325675425 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-10-26T06:54:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f5176ffd700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178073540 0x7f5178199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.937+0000 7f5177fff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517810cf60 0x7f517819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:28.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f51777fe700 1 -- 172.21.15.50:0/2325675425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178073540 msgr2=0x7f5178199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f51777fe700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178073540 0x7f5178199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f51777fe700 1 -- 172.21.15.50:0/2325675425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517810cf60 msgr2=0x7f517819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:28.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f51777fe700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517810cf60 0x7f517819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f51777fe700 1 -- 172.21.15.50:0/2325675425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680095f0 con 0x7f5178072c20 2023-10-26T06:54:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f51777fe700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178198de0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5168000c00 tx=0x7f5168005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516801d070 con 0x7f5178072c20 2023-10-26T06:54:28.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5168022470 con 0x7f5178072c20 2023-10-26T06:54:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168017650 con 0x7f5178072c20 2023-10-26T06:54:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517819e2b0 con 0x7f5178072c20 2023-10-26T06:54:28.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.938+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51781a5b50 con 0x7f5178072c20 2023-10-26T06:54:28.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.939+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5178108170 con 0x7f5178072c20 2023-10-26T06:54:28.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.941+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f51680225e0 con 0x7f5178072c20 2023-10-26T06:54:28.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.943+0000 7f5174ff9700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51600a1670 0x7f51600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-26T06:54:28.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.943+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8101+0+0 (secure 0 0 0) 0x7f51680ce390 con 0x7f5178072c20 2023-10-26T06:54:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.943+0000 7f5176ffd700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51600a1670 0x7f51600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-26T06:54:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.944+0000 7f5176ffd700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51600a1670 0x7f51600a3b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f517819a330 tx=0x7f516c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-26T06:54:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:28.947+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f51680979b0 con 0x7f5178072c20 2023-10-26T06:54:29.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.169+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51780742d0 con 0x7f5178072c20 2023-10-26T06:54:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.681+0000 7f5174ff9700 1 -- 172.21.15.50:0/2325675425 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5168027020 con 0x7f5178072c20 2023-10-26T06:54:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.686+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51600a1670 msgr2=0x7f51600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.686+0000 7f517dbff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51600a1670 0x7f51600a3b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f517819a330 tx=0x7f516c009260 comp rx=0 tx=0).stop 2023-10-26T06:54:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.686+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 msgr2=0x7f5178198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-26T06:54:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.686+0000 7f517dbff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178198de0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5168000c00 tx=0x7f5168005740 comp rx=0 tx=0).stop 2023-10-26T06:54:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 shutdown_connections 2023-10-26T06:54:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:6800/3705474252,v1:172.21.15.50:6801/3705474252] conn(0x7f51600a1670 0x7f51600a3b30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f517810cf60 0x7f517819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5178072c20 0x7f5178198de0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 --2- 172.21.15.50:0/2325675425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178073540 0x7f5178199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-26T06:54:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 >> 172.21.15.50:0/2325675425 conn(0x7f51780fc1b0 msgr2=0x7f51780fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-26T06:54:29.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.688+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 shutdown_connections 2023-10-26T06:54:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-10-26T06:54:29.689+0000 7f517dbff700 1 -- 172.21.15.50:0/2325675425 wait complete. 2023-10-26T06:54:29.694 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-10-26T06:54:29.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:54:29.799 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:54:29.833 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:54:29.865 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-26T06:54:29.865 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-26T06:54:29.910 DEBUG:teuthology.orchestra.run.smithi125:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-26T06:54:29.929 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-26T06:54:29.946 INFO:tasks.cephadm:Stopping all daemons... 2023-10-26T06:54:29.946 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-26T06:54:29.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a 2023-10-26T06:54:29.984 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:29 smithi153 ceph-mon[131657]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-26T06:54:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:29 smithi153 ceph-mon[131657]: osdmap e98: 12 total, 12 up, 12 in 2023-10-26T06:54:29.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:29 smithi153 ceph-mon[131657]: from='client.? 172.21.15.50:0/2325675425' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:30.015 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:29 smithi050 ceph-mon[94997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-26T06:54:30.015 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:29 smithi050 ceph-mon[94997]: osdmap e98: 12 total, 12 up, 12 in 2023-10-26T06:54:30.016 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:29 smithi050 ceph-mon[94997]: from='client.? 172.21.15.50:0/2325675425' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:30.172 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:29 smithi125 ceph-mon[130643]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-26T06:54:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:29 smithi125 ceph-mon[130643]: osdmap e98: 12 total, 12 up, 12 in 2023-10-26T06:54:30.173 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:29 smithi125 ceph-mon[130643]: from='client.? 172.21.15.50:0/2325675425' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-26T06:54:30.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:30 smithi050 systemd[1]: Stopping Ceph mon.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:30.767 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:54:30.470+0000 7f8f3d01b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:30.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a[94973]: 2023-10-26T06:54:30.470+0000 7f8f3d01b700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-26T06:54:31.267 INFO:journalctl@ceph.mon.a.smithi050.stdout:Oct 26 06:54:30 smithi050 bash[226593]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-a 2023-10-26T06:54:31.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.a.service' 2023-10-26T06:54:31.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:31.451 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-26T06:54:31.452 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-26T06:54:31.452 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.b 2023-10-26T06:54:31.857 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:31 smithi125 systemd[1]: Stopping Ceph mon.b for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:32.147 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-b[130619]: 2023-10-26T06:54:31.855+0000 7f72ae977700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:32.148 INFO:journalctl@ceph.mon.b.smithi125.stdout:Oct 26 06:54:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-b[130619]: 2023-10-26T06:54:31.855+0000 7f72ae977700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-26T06:54:32.368 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.b.service' 2023-10-26T06:54:32.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:32.420 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-26T06:54:32.420 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-26T06:54:32.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.c 2023-10-26T06:54:32.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:32 smithi153 systemd[1]: Stopping Ceph mon.c for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:33.234 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-c[131633]: 2023-10-26T06:54:32.836+0000 7f3fb96df700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:33.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-c[131633]: 2023-10-26T06:54:32.836+0000 7f3fb96df700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-26T06:54:33.605 INFO:journalctl@ceph.mon.c.smithi153.stdout:Oct 26 06:54:33 smithi153 bash[175857]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mon-c 2023-10-26T06:54:33.612 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mon.c.service' 2023-10-26T06:54:33.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:33.666 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-26T06:54:33.667 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-26T06:54:33.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x 2023-10-26T06:54:34.017 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:54:33 smithi050 systemd[1]: Stopping Ceph mgr.x for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:34.482 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:54:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:54:34.201+0000 7fac4bec7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:34.482 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:54:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x[95245]: 2023-10-26T06:54:34.201+0000 7fac4bec7700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-26T06:54:34.767 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Oct 26 06:54:34 smithi050 bash[226732]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-x 2023-10-26T06:54:34.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.x.service' 2023-10-26T06:54:35.034 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:35.035 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-26T06:54:35.035 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-26T06:54:35.036 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.y 2023-10-26T06:54:35.422 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:54:35 smithi125 systemd[1]: Stopping Ceph mgr.y for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:35.736 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:54:35 smithi125 bash[173766]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-y 2023-10-26T06:54:35.914 INFO:journalctl@ceph.mgr.y.smithi125.stdout:Oct 26 06:54:35 smithi125 systemd[1]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-26T06:54:35.918 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.y.service' 2023-10-26T06:54:35.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:35.954 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-26T06:54:35.955 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-26T06:54:35.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.z 2023-10-26T06:54:36.234 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:54:35 smithi153 systemd[1]: Stopping Ceph mgr.z for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:36.720 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:54:36 smithi153 bash[176005]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mgr-z 2023-10-26T06:54:36.721 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Oct 26 06:54:36 smithi153 systemd[1]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-26T06:54:36.846 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mgr.z.service' 2023-10-26T06:54:36.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:36.883 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-26T06:54:36.883 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-26T06:54:36.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.0 2023-10-26T06:54:37.267 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:54:36 smithi050 systemd[1]: Stopping Ceph osd.0 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:37.767 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:54:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0[119332]: 2023-10-26T06:54:37.409+0000 7fc267cdf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:37.768 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:54:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0[119332]: 2023-10-26T06:54:37.409+0000 7fc267cdf700 -1 osd.0 99 *** Got signal Terminated *** 2023-10-26T06:54:37.768 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:54:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0[119332]: 2023-10-26T06:54:37.409+0000 7fc267cdf700 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:54:43.518 INFO:journalctl@ceph.osd.0.smithi050.stdout:Oct 26 06:54:43 smithi050 bash[226882]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-0 2023-10-26T06:54:45.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.0.service' 2023-10-26T06:54:45.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:45.432 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-26T06:54:45.433 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-26T06:54:45.433 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.1 2023-10-26T06:54:45.814 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:54:45 smithi125 systemd[1]: Stopping Ceph osd.1 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:46.172 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:54:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1[136795]: 2023-10-26T06:54:45.811+0000 7ff05cf33700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:46.173 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:54:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1[136795]: 2023-10-26T06:54:45.811+0000 7ff05cf33700 -1 osd.1 99 *** Got signal Terminated *** 2023-10-26T06:54:46.173 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:54:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1[136795]: 2023-10-26T06:54:45.811+0000 7ff05cf33700 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:54:51.672 INFO:journalctl@ceph.osd.1.smithi125.stdout:Oct 26 06:54:51 smithi125 bash[173919]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-1 2023-10-26T06:54:52.950 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.1.service' 2023-10-26T06:54:52.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:54:52.990 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-26T06:54:52.991 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-26T06:54:52.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.2 2023-10-26T06:54:53.326 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:54:53 smithi153 systemd[1]: Stopping Ceph osd.2 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:54:53.735 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:54:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2[138802]: 2023-10-26T06:54:53.324+0000 7f85e75e2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:54:53.735 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:54:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2[138802]: 2023-10-26T06:54:53.324+0000 7f85e75e2700 -1 osd.2 99 *** Got signal Terminated *** 2023-10-26T06:54:53.736 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:54:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2[138802]: 2023-10-26T06:54:53.324+0000 7f85e75e2700 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:54:59.484 INFO:journalctl@ceph.osd.2.smithi153.stdout:Oct 26 06:54:59 smithi153 bash[176155]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-2 2023-10-26T06:55:00.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.2.service' 2023-10-26T06:55:00.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:00.555 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-26T06:55:00.556 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-26T06:55:00.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.3 2023-10-26T06:55:01.017 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:55:00 smithi050 systemd[1]: Stopping Ceph osd.3 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:01.517 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:55:01 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-3[127970]: 2023-10-26T06:55:01.098+0000 7f87d425a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:01.518 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:55:01 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-3[127970]: 2023-10-26T06:55:01.098+0000 7f87d425a700 -1 osd.3 99 *** Got signal Terminated *** 2023-10-26T06:55:01.518 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:55:01 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-3[127970]: 2023-10-26T06:55:01.098+0000 7f87d425a700 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:04.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:04 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:04.386+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:05.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:05.449+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:05.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:05 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:05.351+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:06.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:05 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:05.907+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:06.671 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:06 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:06.386+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:06.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:06.428+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:07.017 INFO:journalctl@ceph.osd.3.smithi050.stdout:Oct 26 06:55:06 smithi050 bash[227164]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-3 2023-10-26T06:55:07.018 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:06 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:06.881+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:07.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:06.951+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:07.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:07.428+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:07.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:07 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:07.337+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:08.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:07 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:07.914+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:08.423 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:07.988+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:08.424 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:08.164+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:08.666 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:08.312+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:08.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:08 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:08.370+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:08.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.3.service' 2023-10-26T06:55:08.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:08.421+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:08.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:08.791 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-26T06:55:08.792 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-26T06:55:08.792 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.4 2023-10-26T06:55:09.017 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:08 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:08.891+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:09.151 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:55:08 smithi125 systemd[1]: Stopping Ceph osd.4 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:09.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:08.947+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:09.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:09 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:09.147+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:09.422 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:09 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:09.336+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:09.423 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:55:09 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:55:09.150+0000 7f1195775700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:09.424 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:55:09 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:55:09.150+0000 7f1195775700 -1 osd.4 99 *** Got signal Terminated *** 2023-10-26T06:55:09.424 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:55:09 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:55:09.150+0000 7f1195775700 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:09.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:09 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:09.406+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:09.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:09 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:09.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:10.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:09 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:09.948+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:10.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:10 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:10.125+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:10.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:09 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:09.898+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:10.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:10 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:10.354+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:10.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:10 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:10.388+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:10.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:10 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:10.323+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:11.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:10 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:10.924+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:11.349 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:10 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:10.991+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:11.349 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:11 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:11.134+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:11.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:11 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:11.351+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:11.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:11 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:11.347+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:11.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:11 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:11.302+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:12.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:11 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:11.982+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:12.235 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:11 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:11.982+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:12.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:12 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:12.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:12.236 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:12 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:12.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:12.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:11 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:11.960+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:12.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:12 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:12.335+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:12.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:12 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:12.350+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:12.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:12 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:12.350+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:12.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:12 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:12.339+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:12.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:12 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:12.339+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:13.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:12 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:12.955+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:13.235 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:12 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:12.955+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:13.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:13.060+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:13.236 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:13.060+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:13.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:12 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:12.984+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:13.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:13 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:13.328+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:13.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:13 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:13.328+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:13.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:13.391+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:13.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:13.391+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:13.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:13.376+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:13.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:13.376+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:14.106 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:55:13 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4[144771]: 2023-10-26T06:55:13.839+0000 7f119156a700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.685381+0000 front 2023-10-26T06:54:50.685428+0000 (oldest deadline 2023-10-26T06:55:12.985556+0000) 2023-10-26T06:55:14.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:13.955+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:14.235 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:13 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:13.955+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:14.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:14 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:14.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:14.236 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:14 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:14.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:14.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:13 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:13.935+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:14.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:14 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:14.105+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:14.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:14 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:14.296+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:14.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:14 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:14.296+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:14.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:14 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:14.359+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:14.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:14 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:14.359+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:14.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:14 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:14.347+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:14.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:14 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:14.347+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:15.148 INFO:journalctl@ceph.osd.4.smithi125.stdout:Oct 26 06:55:14 smithi125 bash[174186]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-4 2023-10-26T06:55:15.234 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:14 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:14.981+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:15.235 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:14 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:14.981+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:15.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:15 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:15.051+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:15.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:15 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:15.051+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:15.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:14 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:14.949+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:15.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:14 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:14.949+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:15.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:15 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:15.147+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:15.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:15 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:15.342+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:15.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:15 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:15.342+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:15.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:15 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:15.330+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:15.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:15 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:15.330+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:15.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:15.357+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:15.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:15.357+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:16.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:15.900+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:16.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:15.900+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:16.292 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.005+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:16.293 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.005+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:16.293 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:16.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:16.293 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:16.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:16.380 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:16 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:16.105+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:16.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.4.service' 2023-10-26T06:55:16.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:16.427 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-26T06:55:16.427 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-26T06:55:16.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.5 2023-10-26T06:55:16.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:16 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:16.381+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:16.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:16 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:16.381+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:16.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:16.291+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:16.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:16.291+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:16.735 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 systemd[1]: Stopping Ceph osd.5 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:16.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:16 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:16.365+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:16.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:16 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:16.365+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:17.108 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.794+0000 7f266278c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:17.108 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.794+0000 7f266278c700 -1 osd.5 99 *** Got signal Terminated *** 2023-10-26T06:55:17.108 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.794+0000 7f266278c700 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:17.109 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.962+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:17.109 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:16 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:16.962+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:17.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:16 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:16.950+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:17.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:16 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:16.950+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:17.339 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:17 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:17.069+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:17.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:17 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:17.266+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:17.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:17 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:17.266+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:17.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:17 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:17.106+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:17.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:17 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:17.106+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:17.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:17 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:17.339+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:17.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:17 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:17.339+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:17.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:17 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:17.329+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:17.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:17 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:17.329+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:18.224 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:17 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:17.938+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:18.224 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:17 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:17.938+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:18.225 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:18 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:18.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:18.225 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:18 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:18.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:18.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:17 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:17.985+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:18.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:17 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:17.985+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:18.351 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:18 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:18.025+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:18.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:18 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:18.222+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:18.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:18 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:18.222+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:18.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:18 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:18.351+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:18.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:18 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:18.351+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:18.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:18 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:18.286+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:18.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:18 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:18.286+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:19.248 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:18 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:18.984+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:19.249 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:18 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:18.984+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:19.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:19 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:19.071+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:19.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:19 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:19.319+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:19.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:19 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:19.319+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:19.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:19 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:19.319+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:19.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:19 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:19.216+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:19.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:19 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:19.216+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:19.485 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:18 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:18.985+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:19.486 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:18 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:18.985+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:19.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:19 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:19.075+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:19.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:19 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:19.075+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:19.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:19 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:19.247+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:19.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:19 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:19.247+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:20.234 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:20.223+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:20.235 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:20.223+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:20.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:20.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:20.236 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:20.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:20.236 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:19 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:19.974+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:20.236 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:19 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:19.974+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:20.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:20.001+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:20.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:20.001+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:20.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:20.001+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:20.269 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:20.237+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:20.269 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:20.237+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:20.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:20.047+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:20.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:20.047+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:20.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:20.296+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:20.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:20.296+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:20.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:20 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:20.296+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:21.250 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:21 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:21.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:21.253 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:21 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:21.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:21.253 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:20.991+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:41.471070+0000 front 2023-10-26T06:54:41.471013+0000 (oldest deadline 2023-10-26T06:55:06.771178+0000) 2023-10-26T06:55:21.254 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:20.991+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:46.771729+0000 front 2023-10-26T06:54:46.771825+0000 (oldest deadline 2023-10-26T06:55:11.471747+0000) 2023-10-26T06:55:21.254 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:20 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5[146780]: 2023-10-26T06:55:20.991+0000 7f265f583700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.872932+0000 front 2023-10-26T06:54:57.872958+0000 (oldest deadline 2023-10-26T06:55:20.773252+0000) 2023-10-26T06:55:21.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:20.965+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:21.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:20.965+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:21.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:20.965+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:21.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:21 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:21.083+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:21.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:21 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:21.083+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:21.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:21 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:21.271+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:21.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:21 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:21.271+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:21.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:21 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:21.271+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:21.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:21 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:21.249+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:21.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:21 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:21.249+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:21.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:21 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:21.249+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:21.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:21.270+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:21.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:21.270+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:22.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:21.925+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:22.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:21.925+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:22.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:21 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:21.925+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:22.291 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:22 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:22.021+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:22.292 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:22 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:22.021+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:22.292 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:22 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:22.021+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:22.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:22 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:22.131+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:22.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:22 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:22.131+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:22.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:22 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:22.283+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:22.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:22 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:22.283+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:22.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:22 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:22.283+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:22.622 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:22 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:22.290+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:22.622 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:22 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:22.290+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:22.623 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:22 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:22.290+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:22.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:22.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:22.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:22.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:22.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:22.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:22.984 INFO:journalctl@ceph.osd.5.smithi153.stdout:Oct 26 06:55:22 smithi153 bash[176434]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-5 2023-10-26T06:55:23.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:22.955+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:23.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:22.955+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:23.269 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:22 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:22.955+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:23.317 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:23.016+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:23.317 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:23.016+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:23.317 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:23.016+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:23.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:23 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:23.099+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:23.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:23 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:23.099+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:23.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:23 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:23.271+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:23.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:23 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:23.271+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:23.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:23 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:23.271+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:23.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:23.315+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:23.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:23.315+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:23.736 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:23 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:23.315+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:23.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:23.306+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:23.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:23.306+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:23.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:23.306+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:24.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:24 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:24.033+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:24.173 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:24 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:24.033+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:24.173 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:24 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:24.033+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:24.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.5.service' 2023-10-26T06:55:24.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:24.221 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-26T06:55:24.221 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-26T06:55:24.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.6 2023-10-26T06:55:24.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:23.906+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:24.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:23.906+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:24.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:23 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:23.906+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:24.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:24 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:24.057+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:24.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:24 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:24.057+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:24.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:24 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:24.261+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:24.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:24 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:24.261+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:24.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:24 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:24.261+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:24.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:24 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:24.364+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:24.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:24 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:24.364+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:24.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:24 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:24.364+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:24.747 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 systemd[1]: Stopping Ceph osd.6 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:24.748 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:24.355+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:24.748 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:24.355+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:24.748 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:24.355+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:25.017 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:24.744+0000 7f64cc330700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:25.018 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:24.746+0000 7f64cc330700 -1 osd.6 99 *** Got signal Terminated *** 2023-10-26T06:55:25.018 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:24.746+0000 7f64cc330700 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:25.018 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:24.947+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:25.019 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:24.947+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:25.019 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:24 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:24.947+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:25.403 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:25 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:25.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:25.404 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:25 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:25.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:25.404 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:25 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:25.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:25.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:25.047+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:25.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:25.047+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:25.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:25.258+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:25.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:25.258+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:25.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:25.258+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:25.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:25 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:25.402+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:25.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:25 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:25.402+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:25.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:25 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:25.402+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:25.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:25.350+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:25.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:25.351+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:25.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:25.351+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:26.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:25.997+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:26.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:25.997+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:26.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:25 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:25.997+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:26.402 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:26.072+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:26.403 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:26.072+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:26.403 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:26.072+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:26.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:26.051+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:26.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:26.051+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:26.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:26.285+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:26.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:26.285+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:26.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:26 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:26.285+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:26.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:26.401+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:26.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:26.401+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:26.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:26 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:26.401+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:26.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:26.384+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:26.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:26.384+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:26.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:26.384+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:27.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:26.995+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:27.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:26.996+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:27.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:26 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:26.996+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:27.328 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:27.009+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:27.329 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:27.009+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:27.404 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:27 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:27.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:27.405 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:27 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:27.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:27.405 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:27 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:27.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:27.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:27.326+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:27.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:27.326+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:27.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:27.326+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:27.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:27 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:27.403+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:27.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:27 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:27.403+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:27.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:27 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:27.403+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:27.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:27.421+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:27.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:27.421+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:27.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:27.421+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:27.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:27.421+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:28.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:27.961+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:28.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:27.961+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:28.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:27 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:27.961+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:28.360 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:28 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:28.015+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:28.361 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:28 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:28.015+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:28.417 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:28.072+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:28.418 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:28.072+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:28.418 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:28.072+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:28.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:28 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:28.359+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:28.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:28 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:28.359+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:28.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:28 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:28.359+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:28.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:28.416+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:28.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:28.416+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:28.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:28.416+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:28.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:28 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:28.416+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:28.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:28.415+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:28.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:28.415+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:28.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:28.415+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:28.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:28.415+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:29.267 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:28.934+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.800670+0000 front 2023-10-26T06:54:39.800868+0000 (oldest deadline 2023-10-26T06:55:05.700993+0000) 2023-10-26T06:55:29.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:28.934+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.602203+0000 front 2023-10-26T06:54:48.602169+0000 (oldest deadline 2023-10-26T06:55:14.502401+0000) 2023-10-26T06:55:29.268 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:28 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6[136477]: 2023-10-26T06:55:28.934+0000 7f64c7123700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:54.503008+0000 front 2023-10-26T06:54:54.503192+0000 (oldest deadline 2023-10-26T06:55:19.803236+0000) 2023-10-26T06:55:29.328 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:29 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:29.015+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:29.329 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:29 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:29.015+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:29.368 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:29.106+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:29.368 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:29.106+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:29.369 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:29.106+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:29.369 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:29.106+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:29.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:29 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:29.327+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:29.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:29 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:29.327+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:29.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:29 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:29.327+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:29.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:29 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:29.327+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:29.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:29.367+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:29.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:29.367+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:29.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:29.367+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:29.736 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:29 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:29.367+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:29.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:29.374+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:29.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:29.374+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:29.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:29.374+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:29.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:29 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:29.374+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:30.331 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:30 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:30.017+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:30.331 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:30 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:30.017+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:30.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:30.099+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:30.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:30.099+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:30.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:30.099+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:30.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:30.099+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:30.487 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:30.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:30.487 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:30.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:30.487 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:30.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:30.488 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:30 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:30.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:30.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:30 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:30.329+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:30.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:30 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:30.329+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:30.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:30 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:30.329+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:30.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:30 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:30.329+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:30.767 INFO:journalctl@ceph.osd.6.smithi050.stdout:Oct 26 06:55:30 smithi050 bash[227438]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-6 2023-10-26T06:55:30.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:30.395+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:30.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:30.395+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:30.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:30.395+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:30.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:30 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:30.395+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:31.323 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:31.042+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:31.324 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:31.042+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:31.324 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:31.042+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:31.375 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:31.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:31.376 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:31.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:31.376 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:31.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:31.377 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:31.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:31.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:31.322+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:31.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:31.322+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:31.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:31.322+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:31.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:31.322+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:31.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:31.375+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:31.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:31.375+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:31.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:31.375+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:31.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:31 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:31.375+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:31.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:31 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:31.419+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:31.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:31 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:31.419+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:31.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:31 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:31.419+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:31.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:31 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:31.419+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:32.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.6.service' 2023-10-26T06:55:32.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:32.325 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-26T06:55:32.325 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-26T06:55:32.325 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.7 2023-10-26T06:55:32.329 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:32.075+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:32.329 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:32.075+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:32.330 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:32.075+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:32.352 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:32.038+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:32.353 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:32.038+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:32.353 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:32.038+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:32.354 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:32.038+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:32.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:32.372+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:32.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:32.372+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:32.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:32.372+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:32.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:32 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:32.372+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:32.672 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 systemd[1]: Stopping Ceph osd.7 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:32.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:32.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:32.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:32.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:32.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:32.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:32.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:32.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:32.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:32.352+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:32.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:32.352+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:32.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:32.352+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:32.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:32 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:32.352+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:33.118 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:32.687+0000 7f5289f68700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:33.118 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:32.687+0000 7f5289f68700 -1 osd.7 99 *** Got signal Terminated *** 2023-10-26T06:55:33.119 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:32 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:32.687+0000 7f5289f68700 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:33.344 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:33.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:33.345 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:33.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:33.346 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:33.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:33.346 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:33.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:33.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:33.116+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:33.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:33.116+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:33.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:33.116+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:33.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:33.333+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:33.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:33.333+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:33.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:33.333+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:33.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:33 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:33.333+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:33.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:33.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:33.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:33.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:33.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:33.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:33.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:33 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:33.343+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:33.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:33.416+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:33.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:33.416+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:33.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:33.416+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:33.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:33 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:33.416+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:34.319 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:34.034+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:34.320 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:34.034+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:34.320 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:34.034+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:34.321 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:34.034+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:34.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:34.166+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:34.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:34.166+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:34.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:34.166+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:34.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:34.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:34.424 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:34.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:34.425 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:34.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:34.425 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:34 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:34.325+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:34.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:34.317+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:34.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:34.317+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:34.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:34.317+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:34.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:34 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:34.317+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:34.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:34.424+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:34.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:34.424+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:34.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:34.424+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:34.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:34 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:34.424+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:35.317 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:35.055+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:35.318 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:35.055+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:35.318 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:35.055+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:35.318 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:35.055+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:35.672 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:35.174+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:35.673 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:35.174+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:35.673 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:35.174+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:35.673 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:35.174+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:10.931200+0000 front 2023-10-26T06:55:10.931105+0000 (oldest deadline 2023-10-26T06:55:35.031341+0000) 2023-10-26T06:55:35.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:35.330+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:35.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:35.330+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:35.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:35.330+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:35.675 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:35.330+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:35.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:35.316+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:35.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:35.316+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:35.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:35.316+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:35.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:35 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:35.316+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:35.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:35.393+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:35.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:35.393+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:35.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:35.393+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:35.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:35 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:35.393+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:36.354 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:36.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:36.355 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:36.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:36.355 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:36.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:36.356 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:36.064+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:36.672 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:36.205+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:36.673 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:36.205+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:36.673 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:36.205+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:36.673 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:36.205+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:10.931200+0000 front 2023-10-26T06:55:10.931105+0000 (oldest deadline 2023-10-26T06:55:35.031341+0000) 2023-10-26T06:55:36.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:36.367+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:36.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:36.367+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:36.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:36.367+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:36.675 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:36 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:36.367+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:36.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:36.353+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:36.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:36.353+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:36.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:36.353+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:36.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:36 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:36.353+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:36.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:36.382+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:36.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:36.382+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:36.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:36.382+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:36.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:36 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:36.382+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:37.349 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:37.092+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:37.350 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:37.092+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:37.350 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:37.092+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:37.350 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:37.092+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:37.422 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:37.155+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:50.027081+0000 front 2023-10-26T06:54:50.027113+0000 (oldest deadline 2023-10-26T06:55:13.527288+0000) 2023-10-26T06:55:37.423 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:37.155+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:58.228342+0000 front 2023-10-26T06:54:58.228511+0000 (oldest deadline 2023-10-26T06:55:19.328321+0000) 2023-10-26T06:55:37.424 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:37.155+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.229655+0000 front 2023-10-26T06:55:05.229472+0000 (oldest deadline 2023-10-26T06:55:30.430014+0000) 2023-10-26T06:55:37.424 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7[152931]: 2023-10-26T06:55:37.155+0000 7f5283558700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:10.931200+0000 front 2023-10-26T06:55:10.931105+0000 (oldest deadline 2023-10-26T06:55:35.031341+0000) 2023-10-26T06:55:37.425 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:37.404+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:37.425 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:37.404+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:37.426 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:37.404+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:37.426 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:37 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:37.404+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:37.734 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:37.348+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:37.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:37.348+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:37.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:37.348+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:37.735 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:37 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:37.348+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:37.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:37.369+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:37.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:37.369+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:37.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:37.369+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:37.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:37 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:37.369+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:38.466 INFO:journalctl@ceph.osd.7.smithi125.stdout:Oct 26 06:55:38 smithi125 bash[174458]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-7 2023-10-26T06:55:38.467 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:38 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:38.360+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:38.467 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:38 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:38.360+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:38.467 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:38 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:38.360+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:38.467 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:38 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:38.360+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:38.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:38.304+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:38.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:38.304+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:38.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:38.304+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:38.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:38.304+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:38.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:38.095+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:38.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:38.095+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:38.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:38.095+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:38.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:38.095+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:38.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:38 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:38.095+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:38.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:38 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:38.333+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:38.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:38 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:38.333+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:38.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:38 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:38.333+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:38.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:38 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:38.333+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:39.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:39.268+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:39.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:39.268+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:39.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:39.268+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:39.486 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:39.268+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:39.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:39.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:39.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:39.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:39.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:39.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:39.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:39.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:39.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:39.059+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:39.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:39 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:39.352+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:39.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:39 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:39.352+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:39.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:39 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:39.352+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:39.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:39 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:39.352+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:39.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:39 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:39.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:39.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:39 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:39.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:39.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:39 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:39.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:39.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:39 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:39.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:39.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:39 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:39.293+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:39.829 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.7.service' 2023-10-26T06:55:39.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:39.869 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-26T06:55:39.869 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-26T06:55:39.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.8 2023-10-26T06:55:40.234 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:39 smithi153 systemd[1]: Stopping Ceph osd.8 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:40.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:40.073+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:40.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:40.073+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:40.235 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:40.073+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:40.236 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:40.073+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:40.236 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:40.073+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:40.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.233+0000 7fd562bb5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:40.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.233+0000 7fd562bb5700 -1 osd.8 99 *** Got signal Terminated *** 2023-10-26T06:55:40.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.233+0000 7fd562bb5700 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:40.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.272+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:40.486 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.272+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:40.486 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.272+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:40.486 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:40 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:40.272+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:40.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:40 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:40.385+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:40.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:40 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:40.385+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:40.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:40 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:40.385+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:40.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:40 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:40.385+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:40.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:40 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:40.385+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:40.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:40.326+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:40.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:40.326+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:40.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:40.326+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:40.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:40.326+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:40.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:40 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:40.326+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:41.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:41.271+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:41.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:41.271+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:41.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:41.271+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:41.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:41.271+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:41.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:41.071+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:41.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:41.071+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:41.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:41.071+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:41.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:41.071+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:41.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:41 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:41.071+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:41.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:41 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:41.365+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:41.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:41 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:41.365+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:41.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:41 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:41.365+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:41.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:41 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:41.365+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:41.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:41 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:41.365+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:41.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:41.278+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:41.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:41.278+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:41.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:41.278+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:41.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:41.278+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:41.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:41 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:41.278+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:42.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:42.246+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:42.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:42.246+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:42.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:42.246+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:42.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:42.246+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:42.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:42.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:42.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:42.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:42.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:42.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:42.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:42.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:42.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:42 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:42.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:42.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:42.264+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:42.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:42.264+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:42.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:42.264+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:42.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:42.264+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:42.519 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:42 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:42.264+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:42.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:42.373+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:42.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:42.373+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:42.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:42.373+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:42.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:42.373+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:42.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:42 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:42.373+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:43.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:43.227+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:43.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:43.227+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:43.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:43.227+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:43.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:43.227+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:43.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:43.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:43.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:43.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:43.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:43.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:43.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:43.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:43.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:43.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:43.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:43.262+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:43.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:43.262+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:43.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:43.262+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:43.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:43.262+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:43.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:43.262+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:43.519 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:43 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:43.262+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:43.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:43.353+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:43.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:43.353+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:43.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:43.353+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:43.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:43.353+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:43.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:43 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:43.353+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:44.484 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:44.211+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:39.075828+0000 front 2023-10-26T06:54:39.075894+0000 (oldest deadline 2023-10-26T06:55:04.975738+0000) 2023-10-26T06:55:44.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:44.211+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.977365+0000 front 2023-10-26T06:54:48.977349+0000 (oldest deadline 2023-10-26T06:55:11.877434+0000) 2023-10-26T06:55:44.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:44.211+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.078619+0000 front 2023-10-26T06:54:57.078654+0000 (oldest deadline 2023-10-26T06:55:21.178789+0000) 2023-10-26T06:55:44.485 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8[154908]: 2023-10-26T06:55:44.211+0000 7fd55b9a4700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:02.780645+0000 front 2023-10-26T06:55:02.780713+0000 (oldest deadline 2023-10-26T06:55:28.080522+0000) 2023-10-26T06:55:44.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:44.057+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:44.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:44.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:44.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:44.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:44.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:44.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:44.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:44.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:44.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:44 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:44.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:44.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:44.403+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:44.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:44.403+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:44.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:44.403+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:44.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:44.403+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:44.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:44 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:44.403+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:44.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:44.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:44.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:44.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:44.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:44.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:44.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:44.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:44.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:44.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:44.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:44 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:44.304+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:45.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:45.057+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:45.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:45.057+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:45.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:45.057+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:45.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:45.057+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:45.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:45.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:45.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:45 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:45.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:45.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:45.257+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:45.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:45.257+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:45.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:45.257+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:45.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:45.257+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:45.519 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:45.257+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:45.519 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:45 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:45.257+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:45.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:45.356+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:45.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:45.356+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:45.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:45.356+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:45.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:45.356+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:45.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:45 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:45.356+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:46.090 INFO:journalctl@ceph.osd.8.smithi153.stdout:Oct 26 06:55:46 smithi153 bash[176701]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-8 2023-10-26T06:55:46.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:46.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:46.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:46.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:46.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:46.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:46.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:46.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:46.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:46.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:46.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:46 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:46.089+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:46.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:46.241+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:46.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:46.241+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:46.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:46.241+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:46.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:46.241+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:46.519 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:46.241+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:46.519 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:46 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:46.241+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:46.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:46.363+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:46.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:46.363+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:46.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:46.363+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:46.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:46.363+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:46.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:46.363+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:46.675 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:46 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:46.363+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:47.362 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:47.102+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:47.363 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:47.102+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:47.363 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:47.102+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:47.364 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:47.102+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:47.364 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:47.102+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:47.364 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:47.102+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:47.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.8.service' 2023-10-26T06:55:47.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:47.410 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-26T06:55:47.410 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-26T06:55:47.411 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.9 2023-10-26T06:55:47.478 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.203+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:47.479 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.203+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:47.479 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.203+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:47.479 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.203+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:47.480 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.203+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:47.480 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.203+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:47.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:47.408+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:47.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:47.408+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:47.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:47.408+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:47.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:47.408+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:47.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:47.408+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:47.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:47 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:47.409+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:47.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 systemd[1]: Stopping Ceph osd.9 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:48.235 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.925+0000 7fb227cf7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:48.236 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.925+0000 7fb227cf7700 -1 osd.9 99 *** Got signal Terminated *** 2023-10-26T06:55:48.236 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:47 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:47.925+0000 7fb227cf7700 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:48.236 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:48.233+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:48.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:48.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:48.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:48.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:48.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:48.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:48.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:48.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:48.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:48.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:48.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:48 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:48.058+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:48.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:48.233+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:48.517 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:48.233+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:48.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:48.233+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:48.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:48.233+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:48.518 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:48 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:48.233+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:48.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:48.411+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:48.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:48.411+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:48.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:48.411+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:48.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:48.411+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:48.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:48.411+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:48.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:48 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:48.411+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:49.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:49.028+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:49.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:49.028+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:49.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:49.028+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:49.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:49.028+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:49.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:49.028+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:49.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:49 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:49.028+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:49.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:49.407+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:49.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:49.407+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:49.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:49.407+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:49.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:49.407+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:49.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:49.407+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:49.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:49 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:49.407+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:49.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:49.276+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:49.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:49.276+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:49.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:49.276+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:49.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:49.276+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:49.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:49.276+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:49.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:49 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:49.276+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:50.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:50 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:50.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:50.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:50 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:50.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:50.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:50 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:50.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:50.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:50 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:50.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:50.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:50 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:50.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:50.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:50 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:50.035+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:50.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:50 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:50.410+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:50.672 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:50 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:50.410+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:50.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:50 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:50.410+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:50.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:50 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:50.410+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:50.673 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:50 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:50.410+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:50.674 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:50 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:50.410+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:50.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:50.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:50.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:50.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:50.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:50.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:50.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:50 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:50.315+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:29.102781+0000 front 2023-10-26T06:55:29.102736+0000 (oldest deadline 2023-10-26T06:55:50.202694+0000) 2023-10-26T06:55:51.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:51.050+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:51.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:51.050+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:51.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:51.050+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:51.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:51.050+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:51.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:51.050+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:51.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:51.050+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:51.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:51.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:51.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:51.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:51.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:51.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:51.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:51 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:51.294+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:29.102781+0000 front 2023-10-26T06:55:29.102736+0000 (oldest deadline 2023-10-26T06:55:50.202694+0000) 2023-10-26T06:55:51.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:51.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:51.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:51.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:51.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:51.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:51.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:51 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:51.424+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:52.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:52.003+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:52.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:52.003+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:52.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:52.003+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:52.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:52.003+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:52.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:52.003+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:52.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:52 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:52.003+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:52.767 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:40.691486+0000 front 2023-10-26T06:54:40.691539+0000 (oldest deadline 2023-10-26T06:55:03.591731+0000) 2023-10-26T06:55:52.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:49.895743+0000 front 2023-10-26T06:54:49.895792+0000 (oldest deadline 2023-10-26T06:55:12.096527+0000) 2023-10-26T06:55:52.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:57.298735+0000 front 2023-10-26T06:54:57.298489+0000 (oldest deadline 2023-10-26T06:55:21.398655+0000) 2023-10-26T06:55:52.768 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:01.399176+0000 front 2023-10-26T06:55:01.399144+0000 (oldest deadline 2023-10-26T06:55:27.299274+0000) 2023-10-26T06:55:52.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:13.200853+0000 front 2023-10-26T06:55:13.200885+0000 (oldest deadline 2023-10-26T06:55:39.101112+0000) 2023-10-26T06:55:52.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:19.101708+0000 front 2023-10-26T06:55:19.101753+0000 (oldest deadline 2023-10-26T06:55:43.201826+0000) 2023-10-26T06:55:52.769 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:52 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9[145114]: 2023-10-26T06:55:52.284+0000 7fb2242ed700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:29.102781+0000 front 2023-10-26T06:55:29.102736+0000 (oldest deadline 2023-10-26T06:55:50.202694+0000) 2023-10-26T06:55:52.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:52.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:52.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:52.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:52.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:52.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:52.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:52 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:52.443+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:53.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:53.029+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:53.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:53.029+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:53.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:53.029+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:53.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:53.029+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:53.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:53.029+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:53.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:53 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:53.029+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:53.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:53.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:53.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:53.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:53.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:53.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:53.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:53 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:53.433+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:54.017 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:53 smithi050 bash[227714]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-9 2023-10-26T06:55:54.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:54 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:54.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:54.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:54 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:54.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:54.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:54 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:54.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:54.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:54 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:54.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:54.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:54 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:54.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:54.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:54 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:54.074+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:54.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:54.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:54.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:54.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:54.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:54.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:54.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:54 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:54.474+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:55.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:55.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:55.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:55.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:55.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:55.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:55.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:55.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:55.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:55.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:55.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:55 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:55.046+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:55.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.9.service' 2023-10-26T06:55:55.645 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:55 smithi050 systemd[1]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.9.service: Succeeded. 2023-10-26T06:55:55.645 INFO:journalctl@ceph.osd.9.smithi050.stdout:Oct 26 06:55:55 smithi050 systemd[1]: Stopped Ceph osd.9 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7. 2023-10-26T06:55:55.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:55:55.673 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-26T06:55:55.674 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-26T06:55:55.674 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.10 2023-10-26T06:55:55.715 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:55.715 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:55.716 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:55.716 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:55.716 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:55.717 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:55.717 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:55.462+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:56.051 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:55 smithi125 systemd[1]: Stopping Ceph osd.10 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:55:56.422 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.050+0000 7f13d9dd9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:55:56.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.050+0000 7f13d9dd9700 -1 osd.10 99 *** Got signal Terminated *** 2023-10-26T06:55:56.423 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.050+0000 7f13d9dd9700 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:55:56.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:56 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:56.047+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:56.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:56 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:56.047+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:56.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:56 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:56.047+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:56.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:56 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:56.047+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:56.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:56 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:56.047+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:56.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:56 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:56.047+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:56.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:56.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:56.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:56.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:56.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:56.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:56.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:56 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:56.498+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:57.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:57 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:57.009+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:57.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:57 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:57.009+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:57.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:57 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:57.009+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:57.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:57 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:57.009+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:57.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:57 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:57.009+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:57.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:57 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:57.009+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:57.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:57.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:57.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:57.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:57.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:57.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:57.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:57 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:57.520+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:58.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:58 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:58.027+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:58.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:58 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:58.027+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:58.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:58 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:58.027+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:58.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:58 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:58.027+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:58.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:58 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:58.027+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:58.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:58 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:58.027+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:58.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:58.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:58.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:58.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:58.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:58.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:58.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:58 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:58.487+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:55:59.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:59 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:59.067+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:55:59.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:59 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:59.067+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:55:59.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:59 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:59.067+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:55:59.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:59 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:59.067+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:55:59.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:59 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:59.067+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:55:59.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:55:59 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:55:59.067+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:55:59.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:55:59.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:55:59.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:55:59.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:55:59.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:55:59.925 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:55:59.925 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:55:59 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:55:59.503+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:56:00.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:00.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:00.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:00.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:00.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:00.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:00.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:00 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:00.048+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:00.922 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:42.178931+0000 front 2023-10-26T06:54:42.179012+0000 (oldest deadline 2023-10-26T06:55:07.478959+0000) 2023-10-26T06:56:00.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.579882+0000 front 2023-10-26T06:54:48.579910+0000 (oldest deadline 2023-10-26T06:55:13.280123+0000) 2023-10-26T06:56:00.923 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:53.280675+0000 front 2023-10-26T06:54:53.280720+0000 (oldest deadline 2023-10-26T06:55:19.180684+0000) 2023-10-26T06:56:00.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:04.982345+0000 front 2023-10-26T06:55:04.982130+0000 (oldest deadline 2023-10-26T06:55:28.482047+0000) 2023-10-26T06:56:00.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:08.482429+0000 front 2023-10-26T06:55:08.482476+0000 (oldest deadline 2023-10-26T06:55:40.283183+0000) 2023-10-26T06:56:00.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.283848+0000 front 2023-10-26T06:55:20.283940+0000 (oldest deadline 2023-10-26T06:55:46.183712+0000) 2023-10-26T06:56:00.924 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:00 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10[161767]: 2023-10-26T06:56:00.534+0000 7f13d53cd700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2023-10-26T06:55:26.184455+0000 front 2023-10-26T06:55:26.184421+0000 (oldest deadline 2023-10-26T06:55:50.884170+0000) 2023-10-26T06:56:01.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:01.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:01.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:01.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:01.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:01.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:01.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:01 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:01.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:01.718 INFO:journalctl@ceph.osd.10.smithi125.stdout:Oct 26 06:56:01 smithi125 bash[174730]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-10 2023-10-26T06:56:02.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:02.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:02.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:02.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:02.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:02.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:02.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:02 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:02.068+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:03.082 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.10.service' 2023-10-26T06:56:03.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:03.161 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-26T06:56:03.162 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-26T06:56:03.162 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.11 2023-10-26T06:56:03.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:03.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:03.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:03.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:03.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:03.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:03.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.063+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:03.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 systemd[1]: Stopping Ceph osd.11 for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:03.984 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.528+0000 7feac310a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:03.985 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.528+0000 7feac310a700 -1 osd.11 99 *** Got signal Terminated *** 2023-10-26T06:56:03.985 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:03 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:03.528+0000 7feac310a700 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-26T06:56:04.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:04.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:04.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:04.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:04.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:04.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:04.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:04 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:04.093+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:05.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:05.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:05.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:05.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:05.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:05.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:05.487 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:05 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:05.136+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:06.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:06.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:06.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:06.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:06.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:06.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:06.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:06 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:06.090+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:07.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:07.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:07.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:07.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:07.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:07.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:07.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:07 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:07.052+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:08.484 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2023-10-26T06:54:38.049716+0000 front 2023-10-26T06:54:38.049764+0000 (oldest deadline 2023-10-26T06:55:07.450301+0000) 2023-10-26T06:56:08.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6804 osd.1 since back 2023-10-26T06:54:48.551572+0000 front 2023-10-26T06:54:48.551549+0000 (oldest deadline 2023-10-26T06:55:12.051510+0000) 2023-10-26T06:56:08.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2023-10-26T06:54:55.353461+0000 front 2023-10-26T06:54:55.353358+0000 (oldest deadline 2023-10-26T06:55:21.253479+0000) 2023-10-26T06:56:08.485 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2023-10-26T06:55:05.954563+0000 front 2023-10-26T06:55:05.954524+0000 (oldest deadline 2023-10-26T06:55:28.754789+0000) 2023-10-26T06:56:08.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6812 osd.4 since back 2023-10-26T06:55:11.655764+0000 front 2023-10-26T06:55:11.655893+0000 (oldest deadline 2023-10-26T06:55:37.555861+0000) 2023-10-26T06:56:08.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2023-10-26T06:55:20.957590+0000 front 2023-10-26T06:55:20.957647+0000 (oldest deadline 2023-10-26T06:55:43.257790+0000) 2023-10-26T06:56:08.486 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:08 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11[163752]: 2023-10-26T06:56:08.069+0000 7feabdefd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.125:6820 osd.7 since back 2023-10-26T06:55:34.360067+0000 front 2023-10-26T06:55:34.360128+0000 (oldest deadline 2023-10-26T06:55:59.659885+0000) 2023-10-26T06:56:09.734 INFO:journalctl@ceph.osd.11.smithi153.stdout:Oct 26 06:56:09 smithi153 bash[176973]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-osd-11 2023-10-26T06:56:10.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@osd.11.service' 2023-10-26T06:56:10.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:10.712 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-26T06:56:10.712 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-26T06:56:10.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.a 2023-10-26T06:56:11.251 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:56:10 smithi050 systemd[1]: Stopping Ceph mds.a for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:11.517 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:56:11 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-a[152942]: 2023-10-26T06:56:11.249+0000 7f0a8a65b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:11.518 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:56:11 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-a[152942]: 2023-10-26T06:56:11.249+0000 7f0a8a65b700 -1 mds.a *** got signal Terminated *** 2023-10-26T06:56:14.757 INFO:journalctl@ceph.mds.a.smithi050.stdout:Oct 26 06:56:14 smithi050 bash[227991]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-a 2023-10-26T06:56:14.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.a.service' 2023-10-26T06:56:14.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:14.870 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-26T06:56:14.871 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-26T06:56:14.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.d 2023-10-26T06:56:15.267 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:56:14 smithi050 systemd[1]: Stopping Ceph mds.d for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:15.767 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:56:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-d[151942]: 2023-10-26T06:56:15.371+0000 7ff855f7f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:15.768 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:56:15 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-d[151942]: 2023-10-26T06:56:15.371+0000 7ff855f7f700 -1 mds.d *** got signal Terminated *** 2023-10-26T06:56:16.767 INFO:journalctl@ceph.mds.d.smithi050.stdout:Oct 26 06:56:16 smithi050 bash[228138]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-d 2023-10-26T06:56:16.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.d.service' 2023-10-26T06:56:17.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:17.079 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-26T06:56:17.080 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-26T06:56:17.080 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.g 2023-10-26T06:56:17.267 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:56:17 smithi050 systemd[1]: Stopping Ceph mds.g for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:18.017 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:56:17 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-g[152548]: 2023-10-26T06:56:17.595+0000 7febf72ca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:18.018 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:56:17 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-g[152548]: 2023-10-26T06:56:17.595+0000 7febf72ca700 -1 mds.g *** got signal Terminated *** 2023-10-26T06:56:19.517 INFO:journalctl@ceph.mds.g.smithi050.stdout:Oct 26 06:56:19 smithi050 bash[228286]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-g 2023-10-26T06:56:19.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.g.service' 2023-10-26T06:56:19.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:19.700 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-26T06:56:19.701 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-26T06:56:19.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.j 2023-10-26T06:56:20.017 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:56:19 smithi050 systemd[1]: Stopping Ceph mds.j for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:20.767 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:56:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-j[151548]: 2023-10-26T06:56:20.270+0000 7f9dc1955700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:20.768 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:56:20 smithi050 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-j[151548]: 2023-10-26T06:56:20.270+0000 7f9dc1955700 -1 mds.j *** got signal Terminated *** 2023-10-26T06:56:24.985 INFO:journalctl@ceph.mds.j.smithi050.stdout:Oct 26 06:56:24 smithi050 bash[228432]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-j 2023-10-26T06:56:25.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.j.service' 2023-10-26T06:56:25.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:25.098 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-26T06:56:25.098 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-26T06:56:25.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.b 2023-10-26T06:56:25.422 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:56:25 smithi125 systemd[1]: Stopping Ceph mds.b for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:25.922 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:56:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: 2023-10-26T06:56:25.461+0000 7f04532ae700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:25.923 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:56:25 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b[168172]: 2023-10-26T06:56:25.461+0000 7f04532ae700 -1 mds.b *** got signal Terminated *** 2023-10-26T06:56:27.172 INFO:journalctl@ceph.mds.b.smithi125.stdout:Oct 26 06:56:26 smithi125 bash[174992]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-b 2023-10-26T06:56:27.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.b.service' 2023-10-26T06:56:27.352 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:27.352 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-26T06:56:27.353 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-26T06:56:27.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.e 2023-10-26T06:56:27.672 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:56:27 smithi125 systemd[1]: Stopping Ceph mds.e for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:28.172 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:56:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e[167492]: 2023-10-26T06:56:27.732+0000 7f1389d71700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:28.172 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:56:27 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e[167492]: 2023-10-26T06:56:27.732+0000 7f1389d71700 -1 mds.e *** got signal Terminated *** 2023-10-26T06:56:31.171 INFO:journalctl@ceph.mds.e.smithi125.stdout:Oct 26 06:56:30 smithi125 bash[175141]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-e 2023-10-26T06:56:31.177 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.e.service' 2023-10-26T06:56:31.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:31.213 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-26T06:56:31.213 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-26T06:56:31.213 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.h 2023-10-26T06:56:31.586 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:56:31 smithi125 systemd[1]: Stopping Ceph mds.h for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:31.922 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:56:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h[167832]: 2023-10-26T06:56:31.584+0000 7f28302ff700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:31.923 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:56:31 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h[167832]: 2023-10-26T06:56:31.584+0000 7f28302ff700 -1 mds.h *** got signal Terminated *** 2023-10-26T06:56:35.058 INFO:journalctl@ceph.mds.h.smithi125.stdout:Oct 26 06:56:34 smithi125 bash[175285]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-h 2023-10-26T06:56:35.245 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.h.service' 2023-10-26T06:56:35.279 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:35.279 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-26T06:56:35.280 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-26T06:56:35.280 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.k 2023-10-26T06:56:35.669 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:56:35 smithi125 systemd[1]: Stopping Ceph mds.k for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:35.922 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:56:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-k[167146]: 2023-10-26T06:56:35.666+0000 7fdc6d3ea700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:35.922 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:56:35 smithi125 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-k[167146]: 2023-10-26T06:56:35.666+0000 7fdc6d3ea700 -1 mds.k *** got signal Terminated *** 2023-10-26T06:56:38.518 INFO:journalctl@ceph.mds.k.smithi125.stdout:Oct 26 06:56:38 smithi125 bash[175426]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-k 2023-10-26T06:56:38.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.k.service' 2023-10-26T06:56:38.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:38.753 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-26T06:56:38.753 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-26T06:56:38.754 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.c 2023-10-26T06:56:39.117 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:56:38 smithi153 systemd[1]: Stopping Ceph mds.c for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:39.484 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:56:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c[170488]: 2023-10-26T06:56:39.115+0000 7f8f7b601700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:39.485 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:56:39 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c[170488]: 2023-10-26T06:56:39.115+0000 7f8f7b601700 -1 mds.c *** got signal Terminated *** 2023-10-26T06:56:43.079 INFO:journalctl@ceph.mds.c.smithi153.stdout:Oct 26 06:56:43 smithi153 bash[177233]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-c 2023-10-26T06:56:43.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.c.service' 2023-10-26T06:56:43.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:43.303 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-26T06:56:43.304 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-26T06:56:43.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.f 2023-10-26T06:56:43.690 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:56:43 smithi153 systemd[1]: Stopping Ceph mds.f for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:43.984 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:56:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f[170145]: 2023-10-26T06:56:43.687+0000 7f794adce700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:43.985 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:56:43 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f[170145]: 2023-10-26T06:56:43.687+0000 7f794adce700 -1 mds.f *** got signal Terminated *** 2023-10-26T06:56:47.234 INFO:journalctl@ceph.mds.f.smithi153.stdout:Oct 26 06:56:47 smithi153 bash[177373]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-f 2023-10-26T06:56:47.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.f.service' 2023-10-26T06:56:47.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:47.277 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-26T06:56:47.277 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-26T06:56:47.278 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.i 2023-10-26T06:56:47.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:56:47 smithi153 systemd[1]: Stopping Ceph mds.i for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:47.984 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:56:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:56:47.661+0000 7fcfc80a1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:47.984 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:56:47 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i[170828]: 2023-10-26T06:56:47.661+0000 7fcfc80a1700 -1 mds.i *** got signal Terminated *** 2023-10-26T06:56:51.234 INFO:journalctl@ceph.mds.i.smithi153.stdout:Oct 26 06:56:50 smithi153 bash[177510]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-i 2023-10-26T06:56:51.347 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.i.service' 2023-10-26T06:56:51.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:51.381 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-26T06:56:51.382 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-26T06:56:51.382 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.l 2023-10-26T06:56:51.734 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:56:51 smithi153 systemd[1]: Stopping Ceph mds.l for 6f658e7e-73c9-11ee-8db9-212e2dc638e7... 2023-10-26T06:56:52.234 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:56:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-l[169809]: 2023-10-26T06:56:51.770+0000 7f78c22c2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-26T06:56:52.235 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:56:51 smithi153 ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-l[169809]: 2023-10-26T06:56:51.770+0000 7f78c22c2700 -1 mds.l *** got signal Terminated *** 2023-10-26T06:56:56.234 INFO:journalctl@ceph.mds.l.smithi153.stdout:Oct 26 06:56:55 smithi153 bash[177657]: ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7-mds-l 2023-10-26T06:56:56.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6f658e7e-73c9-11ee-8db9-212e2dc638e7@mds.l.service' 2023-10-26T06:56:56.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-26T06:56:56.356 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-26T06:56:56.357 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --force --keep-logs 2023-10-26T06:56:56.768 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:57:00.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --force --keep-logs 2023-10-26T06:57:00.470 INFO:teuthology.orchestra.run.smithi125.stdout:Deleting cluster with fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:57:02.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --force --keep-logs 2023-10-26T06:57:02.328 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:57:03.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:57:03.995 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:57:04.033 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-26T06:57:04.063 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-26T06:57:04.066 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi050/crash 2023-10-26T06:57:04.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash -- . 2023-10-26T06:57:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-26T06:57:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2023-10-26T06:57:04.141 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi125/crash 2023-10-26T06:57:04.143 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash -- . 2023-10-26T06:57:04.192 INFO:teuthology.orchestra.run.smithi125.stderr:tar: /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-26T06:57:04.193 INFO:teuthology.orchestra.run.smithi125.stderr:tar: Error is not recoverable: exiting now 2023-10-26T06:57:04.195 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi153/crash 2023-10-26T06:57:04.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash -- . 2023-10-26T06:57:04.236 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-26T06:57:04.236 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2023-10-26T06:57:04.237 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-26T06:57:04.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-26T06:57:04.319 INFO:teuthology.orchestra.run.smithi050.stderr:grep: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph.log: No such file or directory 2023-10-26T06:57:04.324 INFO:tasks.cephadm:Compressing logs... 2023-10-26T06:57:04.325 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-26T06:57:04.330 DEBUG:teuthology.orchestra.run.smithi125:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-26T06:57:04.332 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-26T06:57:04.360 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2023-10-26T06:57:04.360 INFO:teuthology.orchestra.run.smithi153.stderr:-5 --verbose -- /var/log/ceph/cephadm.log 2023-10-26T06:57:04.360 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.5.log 2023-10-26T06:57:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.2.log 2023-10-26T06:57:04.361 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.11.log 2023-10-26T06:57:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.z.log 2023-10-26T06:57:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.8.log 2023-10-26T06:57:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.11.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-26T06:57:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.f.log 2023-10-26T06:57:04.364 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.c.log 2023-10-26T06:57:04.366 INFO:teuthology.orchestra.run.smithi125.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-26T06:57:04.366 INFO:teuthology.orchestra.run.smithi125.stderr:: No such file or directory 2023-10-26T06:57:04.366 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.10.log 2023-10-26T06:57:04.367 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.h.log 2023-10-26T06:57:04.367 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.e.log 2023-10-26T06:57:04.367 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.10.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.4.log 2023-10-26T06:57:04.368 INFO:teuthology.orchestra.run.smithi125.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-26T06:57:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.1.log 2023-10-26T06:57:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.k.log 2023-10-26T06:57:04.370 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log 2023-10-26T06:57:04.371 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.8.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.f.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.i.log 2023-10-26T06:57:04.371 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.k.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log: 94.6% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.k.log.gz 2023-10-26T06:57:04.371 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.7.log 2023-10-26T06:57:04.372 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.b.log 2023-10-26T06:57:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.i.log: 92.7% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-26T06:57:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.c.log 2023-10-26T06:57:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log 2023-10-26T06:57:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.7.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log.gz 2023-10-26T06:57:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.b.log 2023-10-26T06:57:04.389 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.l.log 2023-10-26T06:57:04.389 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.y.log 2023-10-26T06:57:04.395 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-26T06:57:04.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-26T06:57:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.0.log 2023-10-26T06:57:04.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.g.log 2023-10-26T06:57:04.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.a.log 2023-10-26T06:57:04.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.g.log: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-26T06:57:04.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.6.log 2023-10-26T06:57:04.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.3.log 2023-10-26T06:57:04.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.d.log 2023-10-26T06:57:04.402 INFO:teuthology.orchestra.run.smithi050.stderr: 94.6%/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.3.log: -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.g.log.gz 2023-10-26T06:57:04.403 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.x.log 2023-10-26T06:57:04.404 INFO:teuthology.orchestra.run.smithi050.stderr: 94.6% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.a.log.gz 2023-10-26T06:57:04.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.9.log 2023-10-26T06:57:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log 2023-10-26T06:57:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.9.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log: 94.5% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.d.log.gz 2023-10-26T06:57:04.409 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.j.log 2023-10-26T06:57:04.410 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.l.log: 94.5% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.l.log.gz 2023-10-26T06:57:04.411 INFO:teuthology.orchestra.run.smithi153.stderr: 91.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log.gz 2023-10-26T06:57:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.a.log 2023-10-26T06:57:04.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.j.log: /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.a.log: 94.4% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.j.log.gz 2023-10-26T06:57:04.419 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.y.log: 92.7% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-26T06:57:04.423 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-volume.log.gz 2023-10-26T06:57:04.741 INFO:teuthology.orchestra.run.smithi050.stderr: 90.0% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-26T06:57:04.861 INFO:teuthology.orchestra.run.smithi153.stderr: 92.0% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.c.log.gz 2023-10-26T06:57:04.866 INFO:teuthology.orchestra.run.smithi125.stderr: 91.9% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.b.log.gz 2023-10-26T06:57:05.389 INFO:teuthology.orchestra.run.smithi050.stderr: 90.5% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mon.a.log.gz 2023-10-26T06:57:07.958 INFO:teuthology.orchestra.run.smithi125.stderr: 94.9% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.e.log.gz 2023-10-26T06:57:08.633 INFO:teuthology.orchestra.run.smithi050.stderr: 94.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.9.log.gz 2023-10-26T06:57:09.217 INFO:teuthology.orchestra.run.smithi153.stderr: 94.4% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.8.log.gz 2023-10-26T06:57:09.813 INFO:teuthology.orchestra.run.smithi125.stderr: 94.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.4.log.gz 2023-10-26T06:57:10.632 INFO:teuthology.orchestra.run.smithi153.stderr: 94.9% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.f.log.gz 2023-10-26T06:57:11.171 INFO:teuthology.orchestra.run.smithi050.stderr: 94.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.6.log.gz 2023-10-26T06:57:11.651 INFO:teuthology.orchestra.run.smithi153.stderr: 94.4% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.2.log.gz 2023-10-26T06:57:11.732 INFO:teuthology.orchestra.run.smithi125.stderr: 94.4% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.10.log.gz 2023-10-26T06:57:11.792 INFO:teuthology.orchestra.run.smithi050.stderr: 94.5% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.0.log.gz 2023-10-26T06:57:12.085 INFO:teuthology.orchestra.run.smithi153.stderr: 94.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.5.log.gz 2023-10-26T06:57:12.089 INFO:teuthology.orchestra.run.smithi125.stderr: 94.4% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.1.log.gz 2023-10-26T06:57:12.171 INFO:teuthology.orchestra.run.smithi050.stderr: 94.3% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.3.log.gz 2023-10-26T06:57:12.174 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-10-26T06:57:12.175 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m7.808s 2023-10-26T06:57:12.175 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m25.432s 2023-10-26T06:57:12.175 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m2.157s 2023-10-26T06:57:12.457 INFO:teuthology.orchestra.run.smithi153.stderr: 94.6% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.11.log.gz 2023-10-26T06:57:12.695 INFO:teuthology.orchestra.run.smithi125.stderr: 94.5% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-osd.7.log.gz 2023-10-26T06:57:13.782 INFO:teuthology.orchestra.run.smithi125.stderr: 95.4% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.h.log.gz 2023-10-26T06:57:40.298 INFO:teuthology.orchestra.run.smithi153.stderr: 94.1% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.c.log.gz 2023-10-26T06:57:48.253 INFO:teuthology.orchestra.run.smithi153.stderr: 94.2% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.i.log.gz 2023-10-26T06:57:48.254 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-26T06:57:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m43.906s 2023-10-26T06:57:48.255 INFO:teuthology.orchestra.run.smithi153.stderr:user 1m50.465s 2023-10-26T06:57:48.255 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m3.817s 2023-10-26T06:58:33.848 INFO:teuthology.orchestra.run.smithi125.stderr: 93.1% -- replaced with /var/log/ceph/6f658e7e-73c9-11ee-8db9-212e2dc638e7/ceph-mds.b.log.gz 2023-10-26T06:58:33.850 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-26T06:58:33.850 INFO:teuthology.orchestra.run.smithi125.stderr:real 1m29.500s 2023-10-26T06:58:33.851 INFO:teuthology.orchestra.run.smithi125.stderr:user 2m7.525s 2023-10-26T06:58:33.851 INFO:teuthology.orchestra.run.smithi125.stderr:sys 0m4.132s 2023-10-26T06:58:33.851 INFO:tasks.cephadm:Archiving logs... 2023-10-26T06:58:33.852 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi050/log 2023-10-26T06:58:33.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-26T06:58:37.256 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi125/log 2023-10-26T06:58:37.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-26T06:58:54.771 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi153/log 2023-10-26T06:58:54.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-26T06:59:09.660 INFO:tasks.cephadm:Removing cluster... 2023-10-26T06:59:09.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --force 2023-10-26T06:59:10.089 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:59:10.891 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --force 2023-10-26T06:59:11.208 INFO:teuthology.orchestra.run.smithi125.stdout:Deleting cluster with fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:59:11.807 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6f658e7e-73c9-11ee-8db9-212e2dc638e7 --force 2023-10-26T06:59:12.122 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 6f658e7e-73c9-11ee-8db9-212e2dc638e7 2023-10-26T06:59:12.706 INFO:tasks.cephadm:Removing cephadm ... 2023-10-26T06:59:12.707 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-26T06:59:12.756 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-26T06:59:12.779 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-26T06:59:12.797 INFO:tasks.cephadm:Teardown complete 2023-10-26T06:59:12.798 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-26T06:59:12.809 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-26T06:59:12.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-26T06:59:12.815 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-26T06:59:12.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-26T06:59:12.960 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-26T06:59:12.980 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-26T06:59:12.981 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-26T06:59:12.986 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-26T06:59:12.989 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-26T06:59:13.005 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-10-26T06:59:13.006 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-10-26T06:59:13.010 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-26T06:59:13.010 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-10-26T06:59:13.010 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +675us[ +675us] +/- 80ms 2023-10-26T06:59:13.011 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -524us[ -506us] +/- 53ms 2023-10-26T06:59:13.011 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +138us[ +138us] +/- 75ms 2023-10-26T06:59:13.011 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:59:13.013 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-26T06:59:13.013 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-10-26T06:59:13.013 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +669us[ +675us] +/- 80ms 2023-10-26T06:59:13.014 INFO:teuthology.orchestra.run.smithi125.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -540us[ -534us] +/- 53ms 2023-10-26T06:59:13.014 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +129us[ +129us] +/- 75ms 2023-10-26T06:59:13.014 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:59:13.024 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2023-10-26T06:59:13.032 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-26T06:59:13.033 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-10-26T06:59:13.033 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 38 +710us[ +710us] +/- 80ms 2023-10-26T06:59:13.033 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 6 377 39 -529us[ -511us] +/- 53ms 2023-10-26T06:59:13.034 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +150us[ +167us] +/- 75ms 2023-10-26T06:59:13.034 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-26T06:59:13.035 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-26T06:59:13.049 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-26T06:59:13.049 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-26T06:59:13.099 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-26T06:59:13.280 DEBUG:teuthology.orchestra.run.smithi125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-26T06:59:13.380 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-26T06:59:13.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-26T06:59:13.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:59:13.553 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-26T06:59:13.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:59:13.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-26T06:59:13.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:59:13.621 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-26T06:59:13.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-26T06:59:13.650 INFO:teuthology.task.internal:Duration was 2536.183674 seconds 2023-10-26T06:59:13.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-26T06:59:13.661 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-26T06:59:13.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-26T06:59:13.667 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-26T06:59:13.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-26T06:59:13.717 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-26T06:59:13.718 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-26T06:59:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-26T06:59:13.996 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-26T06:59:13.997 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-10-26T06:59:13.997 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-26T06:59:14.058 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2023-10-26T06:59:14.058 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-26T06:59:14.080 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-10-26T06:59:14.080 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-26T06:59:14.102 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-26T06:59:14.103 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-26T06:59:14.108 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-26T06:59:14.124 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-26T06:59:14.209 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-26T06:59:14.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-26T06:59:14.215 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-26T06:59:14.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-26T06:59:14.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-26T06:59:14.406 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-26T06:59:14.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-26T06:59:14.477 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-26T06:59:14.504 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-26T06:59:14.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-26T06:59:14.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-26T06:59:14.550 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-26T06:59:14.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-26T06:59:14.576 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2023-10-26T06:59:14.599 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-10-26T06:59:14.614 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-10-26T06:59:14.652 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-26T06:59:14.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:59:14.695 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-26T06:59:14.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:59:14.711 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-26T06:59:14.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-26T06:59:14.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-26T06:59:14.741 INFO:teuthology.task.internal:Transferring archived files... 2023-10-26T06:59:14.742 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi050 2023-10-26T06:59:14.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-26T06:59:14.827 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi125 2023-10-26T06:59:14.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-26T06:59:14.868 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469/remote/smithi153 2023-10-26T06:59:14.868 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-26T06:59:14.909 INFO:teuthology.task.internal:Removing archive directory... 2023-10-26T06:59:14.910 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-26T06:59:14.915 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-26T06:59:14.917 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-26T06:59:14.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-26T06:59:14.972 INFO:teuthology.task.internal:Not uploading archives. 2023-10-26T06:59:14.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-26T06:59:14.985 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-26T06:59:14.985 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-26T06:59:15.000 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-26T06:59:15.002 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-26T06:59:15.017 INFO:teuthology.orchestra.run.smithi125.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 26 06:59 /home/ubuntu/cephtest 2023-10-26T06:59:15.019 INFO:teuthology.orchestra.run.smithi153.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 26 06:59 /home/ubuntu/cephtest 2023-10-26T06:59:15.039 INFO:teuthology.orchestra.run.smithi050.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 26 06:59 /home/ubuntu/cephtest 2023-10-26T06:59:15.043 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-26T06:59:15.055 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-26T06:59:15.080 INFO:teuthology.nuke:Checking targets against current locks 2023-10-26T06:59:15.109 DEBUG:teuthology.nuke:shortname: smithi050 2023-10-26T06:59:15.109 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T06:59:15.133 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-26T06:59:15.134 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T06:59:15.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 06:08:23.310841', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-26T06:59:15.158 DEBUG:teuthology.nuke:shortname: smithi153 2023-10-26T06:59:15.158 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-26T06:59:15.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 06:08:23.309296', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-26T06:59:15.181 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-26_05:21:22-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7438469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-26 06:08:23.312087', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-26T06:59:15.193 INFO:teuthology.orchestra.console.smithi050:Power off 2023-10-26T06:59:15.194 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T06:59:15.222 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-10-26T06:59:15.223 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:15.242 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-26T06:59:15.242 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T06:59:15.254 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-26T06:59:15.265 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-26T06:59:15.266 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:15.283 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-26T06:59:15.284 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-26T06:59:15.307 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-26T06:59:15.308 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:15.318 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-26T06:59:15.332 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-26T06:59:19.257 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:19.320 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:19.333 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:19.367 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-10-26T06:59:19.430 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-26T06:59:19.446 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-26T06:59:23.373 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:23.431 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:23.448 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:23.483 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-10-26T06:59:23.541 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-26T06:59:23.559 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-26T06:59:23.585 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-10-26T06:59:23.642 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-26T06:59:27.562 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-26T06:59:27.674 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-26T06:59:27.775 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-26T06:59:27.882 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} duration: 2536.183674097061 failure_reason: 'Command failed (workunit test kernel_untar_build.sh) on smithi050 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4c9e8c1b74f8497791d203256b4e25df status: fail success: false 2023-10-26T06:59:27.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-26T06:59:27.967 INFO:teuthology.run:FAIL